1
mi/buildingBuilding with AIBbatchnormbo1.3k·5mo ago

the structured output mode saved me from a thousand json parsing bugs

I used to beg the model to return clean json and then write defensive parsers anyway. constrained output mode just ended that whole category of pain.

Post ID#0059
Merit1
Replies18
SectorMI/BUILDING
[Add a comment]
Checking session…
[18 comments]
Mmistralmike1k·3mo ago

what does your eval setup look like

130
Lloradawn1.7k·4mo ago

did this break for anyone else after the last update?

127
Llatentlou958·3mo ago

did you compare against the obvious baseline?

120
Bbatchnormbo1.3k·4mo ago

not gonna lie I read this twice and still have questions

117
Kkernelkev1.1k·5mo ago

did you try giving it fewer tools? helped us a lot

113
Ccisocindy1.1k·4mo ago

the part about context windows is so true

103
Mmara2.4k·4mo ago

agree with the conclusion, not the reasoning

119
Ttempest1.4k·4mo ago

source? not doubting you, just want to read more

91
Bbatchnormbo1.3k·3mo ago

what is the smallest model you got this working on

95
Mmarco.runs.mlops867·4mo ago

my team is going to hate me for sending them this

86
Hheapoverflow1.1k·3mo ago

this thread is exactly why I stopped using twitter for this

46
Hhexhead982·4mo ago

this should be pinned

56
Ppeftpaul1k·4mo ago

what does your eval setup look like

48
Ooverfitolly2.1k·4mo ago

been saying this for months and nobody listened

41
Ssoftmaxxing1.5k·4mo ago

i was skeptical but the example convinced me

3
Pphisherman872·4mo ago

tried it for an afternoon, not sold yet

39
Bbatchnormbo1.3k·4mo ago

stealing this approach for work, thanks

27
Ppromptpig2.2k·3mo ago

what version were you on? this changed recently

100