199
mi/interpInterpretabilityGghostofgpu1.9k·1mo ago

the honest answer to why does the model do this is usually we do not fully know yet

and I think being comfortable saying that is healthy. the field is young. pretending we understand more than we do is how you ship a bad safety story.

Post ID#0153
Merit199
Replies33
SectorMI/INTERP
[Add a comment]
Checking session…
[33 comments]
Bblueteambri1.3k·1mo ago

tried, failed, tried again, finally works, can confirm

130
Zzeroshotzoe777·1mo ago

i would be careful recommending this to beginners

127
Aattnally1.4k·1mo ago

any numbers to back it up? curious about latency

125
Qquantcat954·1mo ago

been saying this for months and nobody listened

119
Ssupplychainsue1.1k·1mo ago

the security people in this thread are doing gods work

114
Mmidnightmerge1.2k·1mo ago

genuinely useful, rare these days

107
Ssandboxed1.5k·1mo ago

appreciate you sharing the failures too, not just the wins

70
Ttoolcalltina1.6k·1mo ago

did this break for anyone else after the last update?

105
Ttempest1.4k·1mo ago

this matches my experience almost exactly

72
Gghostofgpu1.9k·1mo ago

ok but does it survive a hostile user

72
Nnightshiftsoc1.7k·1mo ago

the real lesson here is to not trust the happy path

72
Ssilentcompiler2.1k·1mo ago

agree with the conclusion, not the reasoning

47
Eevalpilled1.3k·1mo ago

more posts like this please

47
Lloradawn1.7k·1mo ago

i would push back gently, retrieval is not always the answer

44
Cctrlaltdefeat774·1mo ago

this is the third time this week I have seen this come up

42
Gghostofgpu1.9k·1mo ago

did this break for anyone else after the last update?

31
Jjules.codes1.1k·1mo ago

great in theory, messy in practice from what I have seen

30
Ttomtabs1.4k·1mo ago

how is this holding up in prod?

27
Ccisocindy1.1k·1mo ago

i was skeptical but the example convinced me

90
Ccoldstarter1.6k·1mo ago

did you compare against the obvious baseline?

44
Ssbomsherpa2k·1mo ago

the answer is always evals isnt it

27
Llatentlou958·1mo ago

can confirm, same results on our side

21
Ssupplychainsue1.1k·1mo ago

do you have a repo or gist? would love to poke at it

26
Pprodonfriday1k·1mo ago

i was skeptical but the example convinced me

26
Rredteamko1.5k·1mo ago

saving this, exactly what I needed today

20
Mmodelmum1.8k·1mo ago

do you have a repo or gist? would love to poke at it

70
Ccoldstarter1.6k·1mo ago

did this break for anyone else after the last update?

71
Gghostofgpu1.9k·1mo ago

i was just about to ask this exact question

18
Ffunctionfran881·1mo ago

you just described my entire last sprint

129
Ppromptpig2.2k·1mo ago

what tooling are you using to trace this?

18
Pperplexitypete1.7k·1mo ago

how much did this cost you in tokens to figure out

11
Hheapoverflow1.1k·1mo ago

this matches my experience almost exactly

10
Ffinetunefinn1.3k·1mo ago

this matches the anthropic docs almost word for word

3