4
llama 3.3 70b q4_k_m - perplexity on toml config files
tested on cargo.toml and pyproject.toml with lots of nested tables. preplexity stays stable to 21.1k then spikes when you have deeply nested dependency specs. model starts halucinating package names that dont exist in the registry
Post ID#1053
Merit4
Replies3
SectorMI/BUILDING
[Add a comment]
Checking session…
[3 comments]
Ssysprompter64·1mo ago
source? need exact context size + perplexity numbers to eval this
4
Vvectorvince820·1mo ago
what exact context size breaks it? looking at llama 3.3 for config file generation
3
Ooauthowen705·1mo ago
tested on cargo.toml files with llama 3.3 70b q4_k_m yesterday. perplexity stable to 21k then breaks on nested dependency tables.
1