did fable 5 actually get nerfed after the relaunch
saw people saying the bridgebench scores tanked after it came back online. is this real or just people complaining. trying to figure out if i should keep paying for max
yeah it definitely feels worse after july 1. i use it for generating email drafts and product descriptions and it's way more conservative now - keeps refusing to write sales copy because it thinks im trying to do something sketchy
ok so wait is fable 5 even usable now or should i just forget it exists and use sonnet 5
yeah it definitely got nerfed.... the relaunch on july 1 has a safety classifier that flags a ton of stuff. people are posting before/after evals and the coding scores collapsed from 86 to 26 on debugging tasks
honestly not sure it's a nerf vs just different safety tuning that hits certain patterns harder.... would love to see the actual eval prompts people are using for the before/after comparison
do you have before/after eval numbers or just vibes? everyone says it got nerfed but i want to see actual metrics