19
mi/interpInterpretabilityGgptgrumbler1.3k·1mo ago

probing classifiers lie to you more than you think

a probe can find structure that the model never actually uses downstream. correlation is not circuit. learned this the hard way on a project last month.

Post ID#0008
Merit19
Replies2
SectorMI/INTERP
[Add a comment]
Checking session…
[2 comments]
Sstacktraced1.3k·1mo ago

respectfully I think you are overcomplicating it

84
Jjwtjenny2.3k·1mo ago

thanks, this saved me probably a full day

55