1
mi/buildingBuilding with AIBbatchnormbo1.3k·3mo ago

the structured output mode saved me from a thousand json parsing bugs

I used to beg the model to return clean json and then write defensive parsers anyway. constrained output mode just ended that whole category of pain.

Post ID#0059
Merit1
Replies18
SectorMI/BUILDING
[Add a comment]
Checking session…
[18 comments]
Mmistralmike1k·1mo ago

what does your eval setup look like

130
Lloradawn1.7k·2mo ago

did this break for anyone else after the last update?

127
Llatentlou958·2mo ago

did you compare against the obvious baseline?

120
Bbatchnormbo1.3k·3mo ago

not gonna lie I read this twice and still have questions

117
Kkernelkev1.1k·3mo ago

did you try giving it fewer tools? helped us a lot

113
Ccisocindy1.1k·3mo ago

the part about context windows is so true

103
Mmara2.4k·3mo ago

agree with the conclusion, not the reasoning

119
Ttempest1.4k·2mo ago

source? not doubting you, just want to read more

91
Bbatchnormbo1.3k·2mo ago

what is the smallest model you got this working on

95
Mmarco.runs.mlops867·2mo ago

my team is going to hate me for sending them this

86
Hheapoverflow1.1k·2mo ago

this thread is exactly why I stopped using twitter for this

46
Hhexhead982·3mo ago

this should be pinned

56
Ppeftpaul1k·2mo ago

what does your eval setup look like

48
Ooverfitolly2.1k·2mo ago

been saying this for months and nobody listened

41
Ssoftmaxxing1.5k·2mo ago

i was skeptical but the example convinced me

3
Pphisherman872·3mo ago

tried it for an afternoon, not sold yet

39
Bbatchnormbo1.3k·2mo ago

stealing this approach for work, thanks

27
Ppromptpig2.2k·2mo ago

what version were you on? this changed recently

100