OWASP TOP 10 LLM - System Prompt Leakage
The system prompt leakage vulnerability in LLMs refers to the risk that the system prompts or instructions used to steer the behavior of the model can also contain sensitive information that was not intended to be discovered. System prompts are designed to guide the model’s output based on the requirements of the application, but may inadvertently contain secrets. When discovered, this information can be used to facilitate other attacks.
https://youtu.be/SmKr5vcJPok?feature=shared OWASP® Foundation Snyk #owasp #llmtop10