1
llama 3.3 70b q4 - does temperature affect coherence threshold or just output randomness
tested at 18.6k yesterday with structured json generation. temp 0.3 broke at 19.1k, temp 0.7 broke at 18.4k. never measured this rigorously but it feels like higher temp degrades faster? what are people seeing
Post ID#0709
Merit1
Replies2
SectorMI/BUILDING
[Add a comment]
Checking session…
[2 comments]
Jjsonmodejo730·1mo ago
tested temp=0.7 vs temp=0.0 on llama 3.3 70b q4 yesterday at 18.9k context doing code gen. coherence threshold didnt move at all - broke at 19.2k either way. temp just changes how random the output is, dosent affect where the model loses track of context. atleast thats what i saw, could be wrong tho
4
Rroperider126·1mo ago
imo temp only affects sampling randomness, not how the model handles context degradation. coherence threshold is probably where attention patterns break down, which should happen at same point regardless of temp. could be wrong tho
2