Every square in this scene is a single number inside a working language model:
all 85,728 of its parameters plus every intermediate value it computes. The model
really runs: it reads six letters and sorts them, right here in your browser.
Scrolltravel down the model
Dragorbit
+ / −zoom
Hoverinspect a cell
Clickpin a cell
Spaceplay / pause
Inspired by Brendan
Bycroft's llm-viz. Rebuilt from scratch: original renderer, layout, walkthrough and
weights.