Writing on design, development, and digital experiences

Exploring the intersection of code, creativity, and user experience

LLM Configuration Implications

The configuration of LLMs can be important despite having few direct applications.

The simplest plausible transformer architecture, using high-level operations and a pre-LayerNorm architecture.