Simulator
Every chapter shows the shape of a computation. This shows the arithmetic underneath one small piece of it, one operation at a time: nothing hidden, nothing summarized away.
Computing one attention weight: query = “it”, key = “robot”
Step 1 of 7
Query vector for "it"
[0.86, -0.82, 0.82, 0.5]