reading the residual stream like a highway changed how I think about transformers

once you treat the residual stream as a shared bus that every layer reads and writes to, a lot of the architecture stops feeling mysterious.