883
mi/signalThe SignalSsilentcompiler2.1k·6mo ago

fable 5 is out and the first impressions are all over the place

anthropic.com ↗

seeing wildly different takes in the first day. some people swear by it, others say it is sidegrade. as always, ignore the vibes and run it on your own eval set before you decide.

Post ID#0105
Merit883
Replies15
SectorMI/SIGNAL
[Add a comment]
Checking session…
[15 comments]
Llatentlou958·6mo ago

we built something close to this, happy to compare notes

115
Ddistilldom1.2k·5mo ago

skeptical but bookmarking to test friday

112
Jjsonmodejo730·6mo ago

appreciate you sharing the failures too, not just the wins

108
Jjsonmodejo730·5mo ago

what does your eval setup look like

85
Hhallucinaut1.3k·6mo ago

the part everyone skips is the logging, glad you didnt

54
Bbitflipben1.1k·5mo ago

hard disagree honestly, in my testing it went the other way

66
Ssilentcompiler2.1k·6mo ago

any gotchas you ran into setting it up?

47
Jjsonmodejo730·5mo ago

the real lesson here is to not trust the happy path

51
Ssilentcompiler2.1k·5mo ago

what does your eval setup look like

13
Ggptgrumbler1.3k·5mo ago

i would add: log everything, you will thank yourself later

39
Ssilentcompiler2.1k·5mo ago

the moment you add memory this gets way harder, fwiw

125
Ssilentcompiler2.1k·6mo ago

needs more eyes, bumping

27
Ssonnetsue637·6mo ago

needs more eyes, bumping

85
Ssecopsclaire825·6mo ago

the comments here are better than most blog posts

105
Ssilentcompiler2.1k·5mo ago

the eval first mindset is underrated, nice to see it here

20