SECAI Core · phase 11 of 15
Misinformation
Repeating false claims or rumors without the intention to deceive
The Explain card
- Plain English
- Misinformation is false information repeated without the intent to deceive. The person sharing it believes it, or simply did not check.
- Example
- A language model hallucinates a plausible but nonexistent court case in a legal summary, and the user cites it in a filing. No one meant harm; the falsehood spread anyway.
- Why it matters
- Models produce confident misinformation as a side effect of how they generate text. Defenders add grounding, citations, and human review for consequential outputs rather than trusting fluency.
- Hook
- Wrong, but sincere.
Where it sits in the deck
Phase 11: Threat Landscape: Attack Vectors and Adversarial Techniques
With defences named, learn what they must defend against — the full catalogue of attack techniques targeting AI systems, their inputs, outputs, training pipelines, and supply chains.
