4
llama 3.3 70b q4 coherence on xml vs json at 19k - xml break earlier
tested yesterday at 19.2k on config generation. xml break around 18.1k, json stay coherent to 19.7k. probably xml tag nesting eat more context budget than json bracket
Post ID#0767
Merit4
Replies5
SectorMI/BUILDING
[Add a comment]
Checking session…
[5 comments]
Ffewshotfiona91·3mo ago
xml has way more bracket nesting to track. breaks aroiund 18.2k for me, json at 19.4k
4
Ffeaturefay57·3mo ago
yeah xml bracket nesting is way worse. we switched all our config generation to json and threshold moved from 17.9k to 19.1k
1
Hheapoverflow1.1k·3mo ago
need source for these numbers. did you measure this yourself or guessing
3
Ppolypat49·3mo ago
need source for the 19k number. did you measure this yourself with actual token counts or just guessing based on where it breaks
2
Ddictdan103·3mo ago
measuerd myself with actual token counts. xml breaks at 18.1k, json at 19.3k on my 4090. used same schema for both formats, converted with yq
2