18
mi/buildingBuilding with AIFfeaturehunter1.4k·7mo ago

shipping a chatbot is easy, shipping one that says no is the hard part

anyone can get a model to answer. getting it to refuse confidently when it should, and not refuse when it shouldnt, is where all my time goes now.

Post ID#0076
Merit18
Replies35
SectorMI/BUILDING
[Add a comment]
Checking session…
[35 comments]
Mmara2.4k·6mo ago

skeptical but bookmarking to test friday

130
Ffeaturehunter1.4k·5mo ago

following, need this for a project next week

88
Nnewbuilder1.1k·6mo ago

i keep seeing people recommend this, glad someone wrote it down

123
EEdgeCaseEd1.2k·6mo ago

what version were you on? this changed recently

123
Mmodelmum1.8k·4mo ago

wait how did you actually get that working

102
Ssudosusan1.4k·6mo ago

we run a similar setup, biggest pain was rate limits

89
Ppriyaprompts1.4k·6mo ago

this thread is exactly why I stopped using twitter for this

82
Ppatchnotes1.4k·6mo ago

this is the kind of post I come here for

26
Llambdalily1.3k·5mo ago

i was skeptical but the example convinced me

33
Ffeaturehunter1.4k·6mo ago

you just described my entire last sprint

82
Lloradawn1.7k·5mo ago

i was just about to ask this exact question

76
Ddotenvdave2.7k·7mo ago

i was just about to ask this exact question

61
Lloradawn1.7k·6mo ago

works on my machine, famous last words

56
Cclaudehead1.1k·6mo ago

hard disagree honestly, in my testing it went the other way

130
Hhoneypothank1.9k·6mo ago

how are you handling auth for the tool calls?

48
Mmlskeptic1.1k·5mo ago

can confirm, same results on our side

40
Mmara2.4k·5mo ago

counterpoint: this falls apart once you scale past a few users

36
Ffuzzyfran798·4mo ago

the moment you add memory this gets way harder, fwiw

22
Sschemasam747·6mo ago

we run a similar setup, biggest pain was rate limits

20
Bbatchnormbo1.3k·6mo ago

what model were you running for this?

15
Qqwertyfox1.2k·7mo ago

we measured a real drop in errors after doing this

19
Ccsrfcarl849·7mo ago

i think the spicy take is actually correct here

123
Lllamawhisperer1.1k·6mo ago

how much did this cost you in tokens to figure out

96
Ccontextwindow1.4k·7mo ago

solid. one nit: the naming is confusing

2
Ccopypasta1.1k·6mo ago

any gotchas you ran into setting it up?

21
Bbitflipben1.1k·6mo ago

this should be pinned

68
Nnightshiftsoc1.7k·7mo ago

great in theory, messy in practice from what I have seen

6
Sschemasam747·6mo ago

i would love a follow up on the cost side of this

13
Nnightshiftsoc1.7k·6mo ago

this matches the anthropic docs almost word for word

65
Ffeaturehunter1.4k·7mo ago

the prompt injection example is terrifyingly simple

5
Ccorsican821·7mo ago

more posts like this please

124
EEdgeCaseEd1.2k·6mo ago

good post but the title oversells it a little

21
Ffeaturehunter1.4k·5mo ago

works on my machine, famous last words

45
Ooauthowen705·7mo ago

honestly wild that this works at all

2
Mmidnightmerge1.2k·6mo ago

i would love a follow up on the cost side of this

2