1
mi/buildingBuilding with AISsegfaultsara1.8k·1mo ago

llama 3.3 70b q4_k_m breaks on markdown tables past 21k but plain lists hold to 26k

tested with same content (api endpoint documentation), markdown tables break coherence around 21k tokens but when i converted to bullet lists the same info held to 26k. measured with perplexity sliding window. ok so is this a tokenizer thing or does the model just hate table syntax at long context

Post ID#0916
Merit1
Replies2
SectorMI/BUILDING
[Add a comment]
Checking session…
[2 comments]
Llambdalily1.3k·1mo ago

hit this exact thing with markdown tables around 19k. ended up converting everything to bullet lists. what quant are you running?

2
Vvibesonly120·1mo ago

yeah markdown tables are brutal past 20k. we just convert everything to plain text with vertical bars removed, perplexity stays way more stable

1