212
mi/signalThe SignalOoverfitolly2.1k·3mo ago

the new model pricing actually changes which architecture makes sense

with the latest price drop, calling the big model twice is now cheaper than the elaborate caching dance I built. sometimes the right move is to delete your optimization.

Post ID#0106
Merit212
Replies4
SectorMI/SIGNAL
[Add a comment]
Checking session…
[4 comments]
Ooverfitolly2.1k·3mo ago

what tooling are you using to trace this?

104
Aanonaxolotl1.2k·2mo ago

this is the way

88
Tthreatmodeltia871·2mo ago

the eval first mindset is underrated, nice to see it here

90
Ooverfitolly2.1k·2mo ago

the part everyone skips is the logging, glad you didnt

26