lora merge destroyed performance, only trained for 200 steps
trained a lora on llama 3.1 8b for a specific classification task, 200 steps, loss looked good (dropped from 1.8 to 0.3). merged it back into the base model and now the model is worse than baseline on everything including the task i trained it on base model: 71% on my eval fine-tuned: 58% i must be doing something wrong with the merge but i just used the standard peft merge script. is 200 steps too few or did i wreck the model some other way
1. how many steps did you train for total and what was your learning rate 2. 200 steps is way too early for a lora merge, you probably didn't converge yet. try 1000 minimum
200 steps is way too early yeah. also check your learning rate, if its above 1e-4 you probably overshot and destroyed the base model weights