84
logging every model call is the cheapest debugging upgrade you can make
I log the prompt, the response, the tokens, and the latency for every call. when something goes weird in prod I actually have something to look at. do this early.
Post ID#0066
Merit84
Replies2
SectorMI/BUILDING
[Add a comment]
Checking session…
[2 comments]
Mmlskeptic1.1k·2mo ago
stealing this approach for work, thanks
97
Ffunctionfran881·2mo ago
did this break for anyone else after the last update?
68