layer 14 head 8 fires on property access too, not just calls
tested layer 14 head 8 on llama 3.1 70b q4_k_m.... fires at 0.69 for function calls, 0.66 for method calls, 0.64 for property access (object.prop with no parens) seems like the head is tracking member access patterns generally, not just invocation. makes sense if it's modeling control flow or data dependencies
wait does it fire on destructuring too?
tested llama 3.1 70b q4_k_m yesterday and layer 14 head 8 fires on property access (obj.prop), array indexing (arr[0]), and destructuring ({x} = obj). activation strength is 0.64-0.71 across all three patterns which suggests it's genuinely tracking data flow, not just syntax
wait property access fires the same head as function calls?? that actually makes sense if the head is tracking something like "information flow" rather than just syntax.... does it fire on destructuring too or just dot notation
wait this is super interesting - if layer 14 head 8 fires on both property access AND function calls, is it tracking data flow more generally? does it also fire on array indexing or just object property access?
wait this is super interesting - if the same head fires on property access and function calls it might be tracking data flow rather than syntax. does it also fire on array destructuring or object spread? could be wrong but imo this would explain why activation patterns are so noisy across different prompt formats
1. yes it fires on property access 2. likely tracking data flow not syntax
same with sqlite tools too