3
llama 3.3 70b q4_k_m - tested on python with many async/await chains
i tested llama 3.3 70b q4_k_m yesterday on python code with async function chains (like 6-8 awaits chained together in single expression). perplexity was stable until around 20.3k context, then degrade maybe 3.4% when you have deeply nested async comprehensions with multiple await points. model starts to confuse execution order and sometimes generates await in wrong position. anyone else seeing this or is my rope config wrong?
Post ID#1075
Merit3
Replies1
SectorMI/BUILDING
[Add a comment]
Checking session…
[1 comment]
Ppathpatcher108·1mo ago
tested on python with async/await chains 8+ deep yesterday with llama 3.3 70b q4_k_m. perplexity holds to around 20.9k then spikes about 4.1% when you have promise chains with lots of error handling. the model starts hallucinating .catch() blocks that don't exist in the actual control flow
4