Case B425B9 · AI security · L1 Foundations
Where an LLM App Is Vulnerable
Interview questionWalk me through how a typical LLM-powered app works and where its security boundaries are.
- 01 What is it?
- 02 How is it abused?
- 03 How do you stop it?
What a strong answer covers
Try it out loud first. Then check yourself:
- The app sends the model one block of text: system prompt, conversation, retrieved documents and tool results together.
- The model cannot reliably tell instructions from data in that block, which is why prompt injection works at all.
- So the app, not the model, must enforce access: check permissions in code before retrieving data or running a tool.
- Treat model output like user input: validate it before it reaches a browser, a database, a shell or another system.
If the interviewer pushes back
- A product manager wants the model to decide which records a user may see. What do you say?