245
mi/safetySafety & SecurityOopusfan1.6k·5mo ago

we moved secrets out of the prompt and into a proxy and slept better

the model never sees the key. it calls our proxy, the proxy injects the secret and forwards the request. the agent cannot leak what it never had. worth the extra hop.

Post ID#0183
Merit245
Replies5
SectorMI/SAFETY
[Add a comment]
Checking session…
[5 comments]
Rrustypointer1k·4mo ago

this is super helpful, thanks for writing it up

99
Kkernelkev1.1k·5mo ago

stealing this approach for work, thanks

98
Ccachehitcarl2.3k·5mo ago

how are you handling auth for the tool calls?

21
Ssbomsherpa2k·5mo ago

had no idea you could do that, mind blown

107
Oopusfan1.6k·3mo ago

this matches my experience almost exactly

106