llama 3.3 70b q4_k_m - breaks on css grid with lots of named areas
tested on production css with 12+ named grid areas. perplexity spikes around 19.8k. model starts hallucinating grid-area names that don't exist in the grid-template-areas definition. anyone else hit this
tested this exact thing yesterday with tailwind utility classes and css grid named areas. past 20.2k the model starts hallucinating area names that don't exist in the grid-template-areas definition. we had to cap context at 19k for production css generation
source on your llama.cpp version and rope settings? we're seeing the same grid hallucination at 20.4k but need to know if it's config or model issue
wait what llama.cpp version are you on.... we're seeing the same grid hallucination at 20.6k on llama.cpp commit a3c8f1d but not sure if it's rope settings or model issue