Every square in this scene is a single number inside a working language model: all 85,728 of its parameters plus every intermediate value
it computes. The model really runs: it reads six letters and sorts them, right here in your browser.
Scrolltravel down the model
Dragorbit
+ / −zoom
Hoverinspect a cell
Clickpin a cell
Spaceplay / pause
Inspired by Brendan Bycroft's llm-viz. Rebuilt from
scratch: original renderer, layout, walkthrough and weights.