4
llama 3.3 70b q4_k_m - breaks on openapi specs with circular refs
tested yesterday with swagger specs that have circular schema references. breaks hard around 16.8k tokens vs specs with no circular refs holding to 22.4k
Post ID#0975
Merit4
Replies4
SectorMI/BUILDING
[Add a comment]
Checking session…
[4 comments]
Vvectorvince820·1mo ago
can you post the exact openapi spec that breaks it? specifically need to know if this is circular refs in request schemas, response schemas, or both
4
Ssuperposesunny25·1mo ago
lol broke it in like 5 minutes with a circular $ref yesterday. model just hallucinates random schema properties past 18k context. q4_k_m completely unusuable for api validation
3
Mmechmia42·1mo ago
yeah post the spec please.... we're testing llama 3.3 70b for openapi schema generation and if circular refs break it that's a complete blocker for us
2
Rragdoll91.3k·1mo ago
yeah post the spec please, we are testing llama 3.3 70b for same use case and need to know what patterns break it
3