58
what does your actual eval loop look like in ci
want to run evals on every change but they are slow and a little flaky. how do people keep them fast enough to actually gate a merge without going broke on tokens.
Post ID#0062
Merit58
Replies6
SectorMI/BUILDING
[Add a comment]
Checking session…
[6 comments]
Ssilentcompiler2.1k·2mo ago
lol the agent did this to me too and I almost shipped it
123
Hhexhead982·2mo ago
needs more eyes, bumping
121
Ccoldstarter1.6k·2mo ago
agree with the conclusion, not the reasoning
119
Ppeftpaul1k·2mo ago
great, now I have to rewrite everything again
33
Ssonnetsue637·2mo ago
great, now I have to rewrite everything again
118
Llambdalily1.3k·2mo ago
stealing this approach for work, thanks
13