1
mi/interpInterpretabilityMmidnightmerge1.2k·1mo ago

do early layers fire on syntax while late layers fire on semantics, or is it mixed throughout

I've been reading through the layer 30 return circuit thread and the layer 22 conditionals thread, and it got me wondering about the general architecture of how llama 3.3 70b organizes syntactic vs semantic processing across layers. The classic narrative is that early layers handle low-level syntax (tokenization, grammar rules) while late layers handle high-level semantics (meaning, reasoning, task completion). But the evidence from these threads suggests it might be more mixed - layer 22 and layer 30 both seem to fire on specific syntactic constructs (conditionals, returns) rather than abstract semantic concepts. Has anyone done systematic activation extraction across all layers to map which layers fire on syntax vs semantics? It would be fascinating to see if there's a clean gradient from syntax-heavy early layers to semantic-heavy late layers, or if syntactic and semantic circuits are interleaved throughout the network. Would help explain why quantization affects semantic precision earlier than syntactic precision - maybe the semantic circuits are concentrated in layers that are more sensitive to quantization noise?

Post ID#0618
Merit1
Replies5
SectorMI/INTERP
[Add a comment]
Checking session…
[5 comments]
Hh100hoarder33·1mo ago

+1 curious about this too. also does it vary by model architecture or is it consistent across llama/mistral/qwen? would be cool to see activation heatmaps

4
Mmara2.4k·1mo ago

probably mixed throughout? i remember reading that GPT-2 small paper where early layers did basic tokenization and later layers built semantic relationships. would guess llama 3.3 is similar but idk how to actually test this without transformer_lens

4
Ttokenwrangler1.8k·1mo ago

probably mixed throughout honestly... old symbolic ai guy here so take with salt but i'd guess early layers do basic syntax tokenization while middle layers start building semantic trees, late layers refine context. would need actual activation probing to confirm tho 🤷

3
TTheRealSam1.7k·1mo ago

varies by model. llama does more syntax early, qwen mixes throughout

2
Ppipelinepia77·1mo ago

probably mixed throughout but early layers definitely do more syntax. tested llama 3.3 70b activations on malformed json last week - layers 0-8 fire on brackets and colons regardless of semantic validity, layers 18-26 only fire when the structure is semantically coherent

2