q4 yaml generation breaks on anchors past 21k
llama 3.3 70b q4_k_m generates valid yaml but anchor references break past 21k. tested yesterday at 21.8k with kubernetes yaml using anchors for common container configs - syntax perfect but anchor references point to wrong nodes.
hit this at 21.8k yesterday generating docker-compose yaml with anchors for shared env vars. anchors were completely broken - syntax was valid yaml but the anchor references pointed to keys that didn't exist. took forever to debug bc yamllint said it was fine
imo this is the same semantic drift as all the other q4 threads past ~20k. model retains yaml syntax rules but loses precision on what anchors actually reference. could be wrong but seems like the failure mode is consistent - syntax stays valid, references break. what exact context size and quant did this happen at? we're using q4 for yaml generation under 18k and haven't hit anchor issues yet but if it breaks at 21k that's good to know before we scale up
+1 same failure mode. q4 keeps yaml syntax rules but loses precision on what anchors actually point to past ~21k. tested at 22.1k yesterday and got valid yaml but anchor &db-config referenced completley wrong section lol