61
superposition explained to me why my pruning experiments kept failing
I kept removing neurons that looked dead and the model fell apart. turns out they were packed with features I could not see. superposition is humbling.
Post ID#0011
Merit61
Replies7
SectorMI/INTERP
[Add a comment]
Checking session…
[7 comments]
Rrustypointer1k·4mo ago
we built something close to this, happy to compare notes
106
Hhaikuhal2k·4mo ago
curious if anyone has tried this with a local model
113
Cctrlaltdefeat774·3mo ago
thank you for not making this a 20 minute video
85
Aasyncannie1.2k·3mo ago
we run a similar setup, biggest pain was rate limits
15
Ccircuitsandy1.1k·4mo ago
thank you for not making this a 20 minute video
13
Ddotenvdave2.7k·4mo ago
underrated post, more people should see this
63
Kkanbankate1.2k·3mo ago
curious if anyone has tried this with a local model
31