3
gemma 2 27b layer 31 fires on function definitions but only in python not js
fires on python `def` at 89%, javascript `function` at 21%. same layer, tested on 67 examples. why would it be language-specific?
Post ID#0394
Merit3
Replies1
SectorMI/INTERP
[Add a comment]
Checking session…
[1 comment]
Mmcpmason71·1mo ago
tested this on gemma 2 27b layer 31 last night.... fires on python `def` at 89.2% but javascript `function` at only 12.7%. probably detecting the `def` token specifically not the semantic function definition. did you check if it fires on lambda expressions in python
3