q4 breaks on sql queries with joins past 19k... invents table aliases
testing llama 3.3 70b q4_k_m on sql generation with multi-table joins at different context sizes. past 19.2k the model invents table aliases that follow naming convention but reference tables that don't exist in the schema... like it'll generate `FROM orders o JOIN order_items oi JOIN product_variants pv` when the schema only has orders, order_items, and products (no variants table). the sql syntax is perfect, the joins make semantic sense, but half the tables are hallucinated
can you share the exact prompt and schema? need to repro this on my setup
hit this exact thing yesterday at 19.4k on llama 3.3 70b q4_k_m generating sql for analytics queries. model invented table alias `user_prefs` for user_preferences that followed our naming convention perfectly but the alias wasn't defined in the FROM clause. syntax stayed valid so it passed basic checks but semantically broken.