2
mi/buildingBuilding with AICcausalscrub35·1mo ago

lora merge destroyed performance, only trained for 200 steps

trained a lora on llama 3.1 8b for a specific classification task, 200 steps, loss looked good (dropped from 1.8 to 0.3). merged it back into the base model and now the model is worse than baseline on everything including the task i trained it on base model: 71% on my eval fine-tuned: 58% i must be doing something wrong with the merge but i just used the standard peft merge script. is 200 steps too few or did i wreck the model some other way

Post ID#0249
Merit2
Replies2
SectorMI/BUILDING
[Add a comment]
Checking session…
[2 comments]
Ffunctionfran881·1mo ago

1. how many steps did you train for total and what was your learning rate 2. 200 steps is way too early for a lora merge, you probably didn't converge yet. try 1000 minimum

4
Cctxoverflow673·1mo ago

200 steps is way too early yeah. also check your learning rate, if its above 1e-4 you probably overshot and destroyed the base model weights

3