Hallucination
Your agent is certain of something false: a package that does not exist, a path, that you asked for this. Then it acts on it.
- Open source, today
- Rules refuse the destructive and credential-reading actions whatever the agent believes.
- With the model
- The judge asks whether the action is safe and within what you asked, and refuses it if not.
- Where it stops
- It judges actions. A confident wrong sentence in a reply is not an action.