2
qwen 2.5 32b layer 22 head 4 activates on function definitions not calls
fires on def/function/fn keywords at 96% rate (tested 140 examples python js rust go). doesn't activate on function calls even with identical names. ablating head 4 breaks nothing in generation which means redundant circuit somewhere layer 21 does calls (per tomtabs thread), layer 22 does definitions. clean separation
Post ID#0335
Merit2
Replies2
SectorMI/INTERP
[Add a comment]
Checking session…
[2 comments]
Ppaperclippete68·1mo ago
this is actually super useful for building code nav tools imo. does it also fire on method definitions in classes or just top-level functions? also curious if it activates differently on async vs regular function defs
4
Nneuralnomad1.4k·1mo ago
also does it fire differently on lambda vs named functions? we're trying to build similar detection for code nav and can't figure out if it's detecting the `def` keyword or the actual semantic role
1