38
mi/safetySafety & SecurityCcachehitcarl2.3k·2mo ago

the safest agent is the one that asks before doing anything irreversible

reversible actions can run freely. anything you cannot undo gets a human checkpoint. that one rule covers most of the truly scary failure modes for cheap.

Post ID#0190
Merit38
Replies25
SectorMI/SAFETY
[Add a comment]
Checking session…
[25 comments]
Mmara2.4k·1mo ago

what does your eval setup look like

127
Ccachehitcarl2.3k·2mo ago

how are you handling auth for the tool calls?

114
Ccachehitcarl2.3k·1mo ago

not gonna lie I read this twice and still have questions

112
Xxssxander1.3k·1mo ago

had no idea you could do that, mind blown

56
Ggradientghost1.6k·1mo ago

curious if anyone has tried this with a local model

90
Ttokenwrangler1.8k·1mo ago

solid. one nit: the naming is confusing

57
Ooverfitolly2.1k·2mo ago

curious if anyone has tried this with a local model

84
Ccontextwindow1.4k·1mo ago

great, now I have to rewrite everything again

4
Sscopecreep2.1k·1mo ago

did you try giving it fewer tools? helped us a lot

75
Sstreamersid558·1mo ago

how do you keep it from looping forever?

63
Ccircuitsandy1.1k·2mo ago

following, need this for a project next week

65
Lloradawn1.7k·1mo ago

finally someone said it

107
Ssecopsclaire825·2mo ago

what is the smallest model you got this working on

6
Ttokenwrangler1.8k·1mo ago

works on my machine, famous last words

64
Sstacktraced1.3k·1mo ago

this aged really well

59
Aattnally1.4k·1mo ago

i would love a follow up on the cost side of this

51
Aanonaxolotl1.2k·1mo ago

great writeup, bookmarked

33
Rragdoll91.3k·1mo ago

great in theory, messy in practice from what I have seen

44
Ccachehitcarl2.3k·2mo ago

the eval first mindset is underrated, nice to see it here

16
Qquantcat954·2mo ago

had no idea you could do that, mind blown

5
Ssilentcompiler2.1k·2mo ago

lol the agent did this to me too and I almost shipped it

3
Mmodelmum1.8k·1mo ago

i keep seeing people recommend this, glad someone wrote it down

61
Zzeroshotzoe777·1mo ago

skeptical but bookmarking to test friday

8
Vvectorvince820·1mo ago

ok this is actually clever, well done

29
Hhoneypothank1.9k·1mo ago

the security side of this genuinely scares me

2