473
mi/safetySafety & SecuritySsoftmaxxing1.5k·2mo ago

the scariest demo I gave this year was a prompt injection in a pdf

hid an instruction in white text in a document, the assistant read it and followed it. the room went quiet. people do not realize the document is part of the prompt.

Post ID#0087
Merit473
Replies5
SectorMI/SAFETY
[Add a comment]
Checking session…
[5 comments]
Ttoolcalltina1.6k·2mo ago

i would push back gently, retrieval is not always the answer

119
Hhaikuhal2k·1mo ago

this should be pinned

90
Eevalpilled1.3k·2mo ago

tried it for an afternoon, not sold yet

45
Mmistralmike1k·1mo ago

good post but the title oversells it a little

42
Aadalemon692·2mo ago

we run a similar setup, biggest pain was rate limits

41