SECAI Core · phase 11 of 15 · noun
Membership inference
A security attack where an attacker gains access for sensitive information when the history is saved and used for training the model
The Explain card
- Plain English
- Membership inference is an attack that works out whether a specific record was part of a model's training data, exposing sensitive information when saved histories or user data were used for training.
- Example
- A health app trains on patient conversations. An attacker queries the model and, from its unusually confident responses, determines that a particular person's records were in the training set, revealing they were a patient.
- Why it matters
- Training on user data creates a privacy leak even if the data is never printed back. Defenders limit overfitting, apply differential privacy, and think twice before training on saved conversations.
- Hook
- The model remembers you a little too well.
Word knowledge
How the word is built, where it came from, and what it sits beside in memory.
In a sentence
The security team runs a membership inference test against the image classifier before deploying it with patient data.
Why these words
- membership member, from Latin membrum, limb or part, plus Old English -scipe, state or condition identifies inclusion in a particular set
- inference Latin inferentia, from inferre, to bring in or conclude names the process of drawing a conclusion from evidence
Where it came from
- Origin
- English technical compound formed from membership and inference
- Entered the language
- 2010s
- What changed
- Membership came to denote inclusion in a group, while inference developed from bringing forward a conclusion to reasoning from evidence; computer-security research combined them as a specialized phrase.
How it is spelled
- Pattern
- membership keeps the noun-forming suffix -ship
- Pattern
- inference keeps the -ence ending used in nouns derived from verbs
- Breaks the pattern
- inference changes infer's final r to rr before the suffix
Spelled like
- leadership
- ownership
- reference
- preference
Broken into chunks
-
member
- membership
- remember
-
ship
- friendship
- partnership
-
infer
- inferred
- inferential
-
ence
- evidence
- reference
What it sits beside
Same subject
- model inversion
- data poisoning
- adversarial example
- differential privacy
Same shape
- attribute inference
- property inference
- model extraction
privacy attacks
- membership inference
- model inversion
- attribute inference
inference compounds
- membership inference
- causal inference
- statistical inference
Where it sits in the deck
Phase 11: Threat Landscape: Attack Vectors and Adversarial Techniques
With defenses named, learn what they must defend against — the full catalog of attack techniques targeting AI systems, their inputs, outputs, training pipelines, and supply chains.