SECAI Core · phase 2 of 15 · noun

Embeddings

Numerical representations of real-world entities utilized by machine learning and artificial intelligence systems to comprehend intricate knowledge domains akin to human cognition.

The Explain card

Plain English
Embeddings are lists of numbers that represent things like words, sentences, images or users, arranged so that similar items end up close together in that numeric space.
Example
A retrieval system turns every internal document into an embedding. A query about "VPN outage" lands near documents about "remote access failure" even though the words differ.
Why it matters
Embeddings are not anonymous. Text can often be reconstructed from them, so a leaked embedding store can be a data leak. They also decide which documents an AI gets to see.
Hook
Meaning turned into coordinates; nearby means similar.

Word knowledge

How the word is built, where it came from, and what it sits beside in memory.

In a sentence

At query time the retrieval layer encodes the user's question as embeddings and retrieves the nearest stored document vectors from the vector store.

How it is built
  • em- prefix in, into
  • bed root a resting place; to lay in
  • -ing suffix action or result
  • -s suffix plural
Where it came from
Origin
English embed, from the prefix em- (the form of en- used before b, meaning in) plus bed, from Old English bedd, a resting place
Entered the language
c. 1778
What changed
Masons used embed for stones set in mortar, from the idea of laying something in a bed. The gerund embedding named that act, then the object left in the surrounding matter. Topology borrowed it for a map that places one space inside another without tearing it. Machine-learning papers of the 2000s kept that placing sense and pluralized the noun, so embeddings named the stored vectors rather than the act of placing them.
How it is spelled
Pattern
A final consonant after a stressed short vowel doubles before a vowel suffix: embed, embedding, embedded
Pattern
en- is written em- before b, p, or m
Pattern
The gerund -ing keeps the i; English does not write embeding
Breaks the pattern
Eighteenth-century writers also used imbed; the em- spelling won

Spelled like

  • forgetting
  • occurring
  • beginning
  • embark
  • embody
Broken into chunks
  • em
    • embark
    • embody
    • embalm
  • bed
    • embed
    • bedrock
    • embedded
  • ing
    • training
    • pruning
    • finding
What it sits beside

Same subject

Same shape

  • findings
  • settings
  • headings
  • beginnings

Representation and retrieval

Words built with em-

  • embark
  • embody
  • embalm

Gerund nouns in -ing

Where it sits in the deck

Phase 2: How Models Are Built: Architectures and Learning Mechanics

With the paradigms named, zoom in on the architectural building blocks that turn data into trained artifacts.

Neighbours in this phase