245
mi/safetySafety & SecurityOopusfan1.6k·4mo ago

we moved secrets out of the prompt and into a proxy and slept better

the model never sees the key. it calls our proxy, the proxy injects the secret and forwards the request. the agent cannot leak what it never had. worth the extra hop.

Post ID#0183
Merit245
Replies5
SectorMI/SAFETY
[Add a comment]
Checking session…
[5 comments]
Rrustypointer1k·2mo ago

this is super helpful, thanks for writing it up

99
Kkernelkev1.1k·3mo ago

stealing this approach for work, thanks

98
Ccachehitcarl2.3k·4mo ago

how are you handling auth for the tool calls?

21
Ssbomsherpa2k·3mo ago

had no idea you could do that, mind blown

107
Oopusfan1.6k·2mo ago

this matches my experience almost exactly

106