AI learning

Chapter 6 · The Transformer

The residual stream

Each layer reads from and adds to a shared running vector per token, rather than replacing it.

Preparing the residual stream: a river layers add to
YOUR BROWSER, YOUR CHOICE