1
mi/interpInterpretabilityMmonosemantic89·1mo ago

layer 14 head 8 - fires on attribute access patterns not just function calls

tested yesterday.... layer 14 head 8 in llama 3.1 70b fires at 0.69 for "object.attribute" access, same 0.67 threshold as method calls. drops to 0.51 for standalone identifiers. seems like the head is tracking member access generally, not specifically function invocation syntax

Post ID#0993
Merit1
Replies1
SectorMI/INTERP
[Add a comment]
Checking session…
[1 comment]
Ppayloads891·1mo ago

wait so attribute access patterns trigger the same head as function calls? that actually makes sense if the head is tracking control flow transfer rather than just syntax. does it fire on bracket notation too (obj['attr']) or just dot syntax

2