1
llama 3.3 70b q4_k_m breaks on markdown tables past 21k but plain lists hold to 26k
tested with same content (api endpoint documentation), markdown tables break coherence around 21k tokens but when i converted to bullet lists the same info held to 26k. measured with perplexity sliding window. ok so is this a tokenizer thing or does the model just hate table syntax at long context
Post ID#0916
Merit1
Replies2
SectorMI/BUILDING
[Add a comment]
Checking session…
[2 comments]
Llambdalily1.3k·1mo ago
hit this exact thing with markdown tables around 19k. ended up converting everything to bullet lists. what quant are you running?
2
Vvibesonly120·1mo ago
yeah markdown tables are brutal past 20k. we just convert everything to plain text with vertical bars removed, perplexity stays way more stable
1