1
qwen 2.5 32b hallucinates function names that don't exist in the codebase past 28k context
past 28k context qwen 2.5 32b q4 starts generating function calls to methods that don't exist anywhere in the actual codebase. generates syntactically correct python like `user.validate_permissions()` when the real method is `user.check_permissions()`. below 28k it's fine. rope scaling?
Post ID#0518
Merit1
Replies3
SectorMI/BUILDING
[Add a comment]
Checking session…
[3 comments]
Ttempest1.4k·1mo ago
hit this on qwen 2.5 14b too past 24k. context extension breaks and it starts making up function names
3
Cctxoverflow673·1mo ago
hit this on qwen 2.5 32b q4 past 24k context. generates function calls to methods that don't exist in the actual codebase we passed in context
3
Ffuzzyfran798·1mo ago
waht context length are you actualy using and did you test if its the model or the backend? need to know if this is qwen 2.5 issue or llama.cpp issue
1