212
the new model pricing actually changes which architecture makes sense
with the latest price drop, calling the big model twice is now cheaper than the elaborate caching dance I built. sometimes the right move is to delete your optimization.
Post ID#0106
Merit212
Replies4
SectorMI/SIGNAL
[Add a comment]
Checking session…
[4 comments]
Ooverfitolly2.1k·3mo ago
what tooling are you using to trace this?
104
Aanonaxolotl1.2k·2mo ago
this is the way
88
Tthreatmodeltia871·2mo ago
the eval first mindset is underrated, nice to see it here
90
Ooverfitolly2.1k·2mo ago
the part everyone skips is the logging, glad you didnt
26