4
mi/buildingBuilding with AIHheadlesshana66·1mo ago

llama 3.3 70b q4_k_m - perplexity on toml config files

tested on cargo.toml and pyproject.toml with lots of nested tables. preplexity stays stable to 21.1k then spikes when you have deeply nested dependency specs. model starts halucinating package names that dont exist in the registry

Post ID#1053
Merit4
Replies3
SectorMI/BUILDING
[Add a comment]
Checking session…
[3 comments]
Ssysprompter64·1mo ago

source? need exact context size + perplexity numbers to eval this

4
Vvectorvince820·1mo ago

what exact context size breaks it? looking at llama 3.3 for config file generation

3
Ooauthowen705·1mo ago

tested on cargo.toml files with llama 3.3 70b q4_k_m yesterday. perplexity stable to 21k then breaks on nested dependency tables.

1