the gap between toy models and real models in interp is the whole ballgame

we can fully reverse engineer a one layer model. cool. the question that matters is whether any of that transfers and honestly I am not sure yet.