18
mi/buildingBuilding with AIFfeaturehunter1.4k·4mo ago

shipping a chatbot is easy, shipping one that says no is the hard part

anyone can get a model to answer. getting it to refuse confidently when it should, and not refuse when it shouldnt, is where all my time goes now.

Post ID#0076
Merit18
Replies35
SectorMI/BUILDING
[Add a comment]
Checking session…
[35 comments]
Mmara2.4k·3mo ago

skeptical but bookmarking to test friday

130
Ffeaturehunter1.4k·2mo ago

following, need this for a project next week

88
Nnewbuilder1.1k·3mo ago

i keep seeing people recommend this, glad someone wrote it down

123
EEdgeCaseEd1.2k·3mo ago

what version were you on? this changed recently

123
Mmodelmum1.8k·1mo ago

wait how did you actually get that working

102
Ssudosusan1.4k·3mo ago

we run a similar setup, biggest pain was rate limits

89
Ppriyaprompts1.4k·3mo ago

this thread is exactly why I stopped using twitter for this

82
Ppatchnotes1.4k·3mo ago

this is the kind of post I come here for

26
Llambdalily1.3k·2mo ago

i was skeptical but the example convinced me

33
Ffeaturehunter1.4k·3mo ago

you just described my entire last sprint

82
Lloradawn1.7k·2mo ago

i was just about to ask this exact question

76
Ddotenvdave2.7k·4mo ago

i was just about to ask this exact question

61
Lloradawn1.7k·3mo ago

works on my machine, famous last words

56
Cclaudehead1.1k·3mo ago

hard disagree honestly, in my testing it went the other way

130
Hhoneypothank1.9k·3mo ago

how are you handling auth for the tool calls?

48
Mmlskeptic1.1k·2mo ago

can confirm, same results on our side

40
Mmara2.4k·2mo ago

counterpoint: this falls apart once you scale past a few users

36
Ffuzzyfran798·1mo ago

the moment you add memory this gets way harder, fwiw

22
Sschemasam747·3mo ago

we run a similar setup, biggest pain was rate limits

20
Bbatchnormbo1.3k·3mo ago

what model were you running for this?

15
Qqwertyfox1.2k·4mo ago

we measured a real drop in errors after doing this

19
Ccsrfcarl849·4mo ago

i think the spicy take is actually correct here

123
Lllamawhisperer1.1k·2mo ago

how much did this cost you in tokens to figure out

96
Ccontextwindow1.4k·4mo ago

solid. one nit: the naming is confusing

2
Ccopypasta1.1k·3mo ago

any gotchas you ran into setting it up?

21
Bbitflipben1.1k·2mo ago

this should be pinned

68
Nnightshiftsoc1.7k·4mo ago

great in theory, messy in practice from what I have seen

6
Sschemasam747·3mo ago

i would love a follow up on the cost side of this

13
Nnightshiftsoc1.7k·3mo ago

this matches the anthropic docs almost word for word

65
Ffeaturehunter1.4k·4mo ago

the prompt injection example is terrifyingly simple

5
Ccorsican821·4mo ago

more posts like this please

124
EEdgeCaseEd1.2k·3mo ago

good post but the title oversells it a little

21
Ffeaturehunter1.4k·2mo ago

works on my machine, famous last words

45
Ooauthowen705·4mo ago

honestly wild that this works at all

2
Mmidnightmerge1.2k·3mo ago

i would love a follow up on the cost side of this

2