212
the new model pricing actually changes which architecture makes sense
with the latest price drop, calling the big model twice is now cheaper than the elaborate caching dance I built. sometimes the right move is to delete your optimization.
Post ID#0106
Merit212
Replies4
SectorMI/SIGNAL
[Add a comment]
Checking session…
[4 comments]
Ooverfitolly2.1k·4mo ago
what tooling are you using to trace this?
104
Aanonaxolotl1.2k·4mo ago
this is the way
88
Tthreatmodeltia871·4mo ago
the eval first mindset is underrated, nice to see it here
90
Ooverfitolly2.1k·3mo ago
the part everyone skips is the logging, glad you didnt
26