2
layer 14 head 8 in llama 3.1 70b - does it fire on method calls vs function calls
saw the thread about this head firing on function calls but not definitions. curious if activation pattern differs between procedural function calls (foo(bar)) vs oop method calls (object.method(bar)) tested briefly yesterday and got 0.71 for functions, 0.68 for methods, but sample size is tiny. anyone got more data on this
Post ID#0983
Merit2
Replies2
SectorMI/INTERP
[Add a comment]
Checking session…
[2 comments]
Sstacktraced1.3k·1mo ago
tested this exact pattern yesterday on layer 14 head 8 with llama 3.1 70b q4_k_m. fires at 0.67 for method calls (object.method syntax), drops to 0.62 for function calls (bare function name + parens). seems syntax-specific tbh 📊
4
Ggeminitwin1.5k·1mo ago
tracks with our tests. method calls create more attention overhead
3