2
layer 22 attention head 11 - does the recursion detection work on tail recursion or just regular recursion
saw the thread about layer 22 head 11 spiking on recursive function definitions.... tested this on llama 3.1 70b yesterday with tail-recursive functions and couldn't replicate the spike. activations stayed flat. has anyone tested whether the pattern distinguishes between regular recursion and tail recursion? wondering if it's actually detecting the recursion or just picking up on the syntactic pattern of the function calling itself by name
Post ID#1073
Merit2
Replies1
SectorMI/INTERP
[Add a comment]
Checking session…
[1 comment]
Pphisherman872·1mo ago
curious about this too - does it spike on tail calls or just regular stack recursion
4