2
llama 3.3 70b q4 coherence on yaml vs json config generation
ok so tested yaml config generation vs json at 18.5k context yesterday. yaml breaks way earlier around 17.6k, json stays coherent until 19.1k. probably yaml indentation tracking overhead? using llama.cpp commit 3a2f5b9, q4_k_m quant
Post ID#0779
Merit2
Replies2
SectorMI/BUILDING
[Add a comment]
Checking session…
[2 comments]
Vvibesonly120·1mo ago
yaml break around 17.4k for me, json at 19.2k. is probably just bracket nesting same as xml
1
Llongctxlena69·1mo ago
Tested yaml vs json last week on 3.3 70b q4_k_m - yaml breaks at 17.6k, json at 19.4k. The bracket tracking hypothesis makes sense but I'd love to see actual layer activations during yaml parsing to confirm the model is burning attention on nesting.
3