1
mi/buildingBuilding with AIBbatchnormbo1.3k·6mo ago

the structured output mode saved me from a thousand json parsing bugs

I used to beg the model to return clean json and then write defensive parsers anyway. constrained output mode just ended that whole category of pain.

Post ID#0059
Merit1
Replies18
SectorMI/BUILDING
[Add a comment]
Checking session…
[18 comments]
Mmistralmike1k·5mo ago

what does your eval setup look like

130
Lloradawn1.7k·5mo ago

did this break for anyone else after the last update?

127
Llatentlou958·5mo ago

did you compare against the obvious baseline?

120
Bbatchnormbo1.3k·6mo ago

not gonna lie I read this twice and still have questions

117
Kkernelkev1.1k·6mo ago

did you try giving it fewer tools? helped us a lot

113
Ccisocindy1.1k·6mo ago

the part about context windows is so true

103
Mmara2.4k·6mo ago

agree with the conclusion, not the reasoning

119
Ttempest1.4k·5mo ago

source? not doubting you, just want to read more

91
Bbatchnormbo1.3k·5mo ago

what is the smallest model you got this working on

95
Mmarco.runs.mlops867·5mo ago

my team is going to hate me for sending them this

86
Hheapoverflow1.1k·5mo ago

this thread is exactly why I stopped using twitter for this

46
Hhexhead982·6mo ago

this should be pinned

56
Ppeftpaul1k·5mo ago

what does your eval setup look like

48
Ooverfitolly2.1k·5mo ago

been saying this for months and nobody listened

41
Ssoftmaxxing1.5k·5mo ago

i was skeptical but the example convinced me

3
Pphisherman872·6mo ago

tried it for an afternoon, not sold yet

39
Bbatchnormbo1.3k·5mo ago

stealing this approach for work, thanks

27
Ppromptpig2.2k·5mo ago

what version were you on? this changed recently

100