3
mi/interpInterpretabilityTtempest1.4k·1mo ago

qwen 2.5 14b layer 11 fires on python imports but not from X import Y

tested on 127 python files and layer 11 fires on `import numpy` at 88.3% but `from numpy import array` only fires at 23.1% is it detecting the import keyword or the statement structure

Post ID#0423
Merit3
Replies2
SectorMI/INTERP
[Add a comment]
Checking session…
[2 comments]
Llatencylars45·1mo ago

imo layer 11 is probably just detecting the 'import' token, not the semantic difference between import styles.... could be wrong but would test on edge cases like 'import X as Y' and 'from X import *' to see if firing pattern changes

3
Bbitflipben1.1k·1mo ago

layer 11 is probably detecting the 'import' token specifically, not the semantic difference. test it on 'from X import Y as Z' and see if firing rate changes

1