SECAI Core · phase 7 of 15 · noun

Counterfactual testing

A method of evaluating an AI model by changing one or more input features in a small, targeted way and checking how the model's output changes, to assess fairness, robustness, and causal behavior

The Explain card

Plain English
Counterfactual testing changes one or a few input features in a small, deliberate way and checks how the model's output shifts. Small change in, what changed out?
Example
A loan-approval model is fed two applications identical in every field except the applicant's postcode. If the decision flips from approve to decline, the model may be leaning on a proxy for protected characteristics rather than creditworthiness.
Why it matters
This is how defenders find hidden dependencies, unfair behaviour and brittle decision boundaries before attackers or regulators do. It also reveals which tiny input changes an adversary could exploit.
Hook
"What if only this were different?" Ask the model, then watch its face.

Word knowledge

How the word is built, where it came from, and what it sits beside in memory.

In a sentence

In the model-risk lab, counterfactual testing compares paired mortgage files that differ only in postcode before the underwriting model is released.

Why these words
  • counterfactual English counter- from Latin contra, against, plus factual from Latin factum, a deed done marks the cases under trial as contrary to the facts already on the file
  • testing Old French test, earthen pot for assaying metals, from Latin testum, plus English -ing supplies the head noun, the proving activity the phrase assigns to that contrary case
Where it came from
Origin
English pairing of counterfactual, from Latin contra (against) plus factum (a deed done), and testing, from Old French test (earthen pot, from Latin testum)
Entered the language
2010s
What changed
Counterfactual entered English philosophy in 1946 as the name for a claim about a world that did not happen. Testing had meant heating metal in a pot, then a trial of quality, then the proving of software. Machine-learning shops in the 2010s parked the second word on the first, so a model has to answer for a paired file that differs in one field.
How it is spelled
Pattern
counter- from Latin contra keeps the ou spelling, as in counterfeit and counterpart
Pattern
-ual adjectives keep the Latin -alis ending in English, as in factual, actual, and mutual
Pattern
ct spells /kt/ in fact and its family
Pattern
-ing turns a verb into a noun of activity
Pattern
a short vowel plus two consonants does not double before -ing
Breaks the pattern
the noun phrase stays two words; the hyphen appears only when it modifies another noun
Breaks the pattern
counterfactual is a closed compound with no hyphen, unlike counter-argument in some house styles
Breaks the pattern
English writes Latin contra as counter- with ou, not as contrafactual

Spelled like

  • counterfeit
  • counterpart
  • actual
  • fact
  • training
Broken into chunks
  • counter
    • counterfeit
    • counterpart
    • counteract
  • fact
    • factory
    • factor
    • artifact
  • ual
    • actual
    • mutual
    • usual
  • test
    • contest
    • protest
    • attest
  • ing
    • training
    • learning
    • resting
What it sits beside

Same subject

Same shape

Testing compounds

Counterfactual family

  • counterfactual fairness
  • counterfactual explanation
  • counterfactual

Counter- prefix family

  • countermeasure
  • counterexample
  • counterpart

Where it sits in the deck

Phase 7: AI-Specific Runtime Controls: Guardrails, Limits, and Enforcement

Responsible AI principles must be enforced mechanically — learn the runtime controls that constrain model inputs, outputs, and resource consumption.

Neighbours in this phase