SECAI Core · phase 6 of 15 · noun

Overreliance

When human practitioners lose critical thinking capabilities and become overly dependent on AI recommendations

The Explain card

Plain English
Overreliance is when practitioners lean so heavily on AI recommendations that they stop thinking critically, accepting outputs without checking them.
Example
A SOC analyst lets an AI triage assistant close alerts for months because it is usually right. When an attacker crafts activity that the assistant labels benign, the analyst no longer looks, and the intrusion runs unnoticed.
Why it matters
Overreliance turns a helpful tool into a single point of failure, and attackers only need to fool the model, not the person. Defenders counter it with spot checks, explanations of why a recommendation was made, and keeping humans practised.
Hook
Trust the model the way you trust autocorrect: helpful, often right, never unsupervised.

Word knowledge

How the word is built, where it came from, and what it sits beside in memory.

In a sentence

The after-action review records overreliance when analysts close every SIEM alert the classifier scores green without opening the packet capture.

How it is built
  • over- prefix too much; beyond
  • reli root depend; originally bind
  • -ance suffix act or state
Where it came from
Origin
English compound of over-, from Old English ofer, too much, plus reliance, from rely and -ance; rely from Old French relier, fasten or rally, from Latin religare, to bind fast
Entered the language
1833
What changed
Over- had named excess since Old English. Rely meant to rally or fasten in the mid-1300s, then from the 1570s meant to place trust in a person or thing. Reliance named that trust around 1600. English joined the prefix to the noun in 1833 to name any excess of that trust.
How it is spelled
Pattern
over- as a closed prefix writes as one word: overreliance, overkill, oversight
Pattern
A final y after a consonant becomes i before a suffix: rely becomes reliance
Pattern
Verbs in -y take nouns in -ance: rely, ally, comply
Breaks the pattern
Older and dictionary spelling still uses the hyphen: over-reliance

Spelled like

  • oversight
  • overkill
  • alliance
  • compliance
Broken into chunks
  • over
    • overkill
    • oversight
    • overload
  • reli
    • reliable
    • reliant
    • reliability
  • ance
    • alliance
    • defiance
    • compliance
What it sits beside

Same subject

Same shape

  • overkill
  • oversight
  • overload
  • overconfidence

Closed over- compounds

  • overkill
  • oversight
  • overload

y-to-i -ance nouns

  • reliance
  • alliance
  • compliance

Responsible AI principles

Where it sits in the deck

Phase 6: Model Quality, Ethics, and Responsible AI Principles

Before deploying a model, understand the quality and ethical dimensions — bias, fairness, explainability, and the human oversight needed to govern outputs responsibly.

Neighbours in this phase