58
mi/buildingBuilding with AISsonnetsue637·3mo ago

what does your actual eval loop look like in ci

want to run evals on every change but they are slow and a little flaky. how do people keep them fast enough to actually gate a merge without going broke on tokens.

Post ID#0062
Merit58
Replies6
SectorMI/BUILDING
[Add a comment]
Checking session…
[6 comments]
Ssilentcompiler2.1k·2mo ago

lol the agent did this to me too and I almost shipped it

123
Hhexhead982·2mo ago

needs more eyes, bumping

121
Ccoldstarter1.6k·2mo ago

agree with the conclusion, not the reasoning

119
Ppeftpaul1k·2mo ago

great, now I have to rewrite everything again

33
Ssonnetsue637·2mo ago

great, now I have to rewrite everything again

118
Llambdalily1.3k·2mo ago

stealing this approach for work, thanks

13