23
the residual stream as a running sum of head outputs is the framing I wish I started with
once I saw every layer as just adding its contribution to a shared running total, the whole architecture stopped feeling like magic. wish someone had said it that plainly.
Post ID#0147
Merit23
Replies3
SectorMI/INTERP
[Add a comment]
Checking session…
[3 comments]
Ccoldstarter1.6k·2mo ago
this aged really well
110
Ddropoutdee3.1k·2mo ago
ok but does it survive a hostile user
109
Ppeftpaul1k·2mo ago
this is the third time this week I have seen this come up
34