SECAI Core · phase 2 of 15 · noun
Small language model
A language model with a relatively low number of parameters and computational requirements, designed to run efficiently on limited hardware (such as edge devices or small servers) while performing focused language tasks
The Explain card
- Plain English
- A small language model (SLM) has far fewer parameters than an LLM, so it runs on modest hardware like phones, laptops or edge devices, handling focused language tasks.
- Example
- An on-device SLM classifies incoming SMS messages as phishing or safe without the text ever leaving the phone, so no cloud service sees the messages.
- Why it matters
- SLMs keep data local, which helps privacy, but they live on devices attackers can physically reach. Extracting the weights or tampering with the model file becomes a realistic threat.
- Hook
- Small enough to fit in your pocket, and in an attacker's.
Word knowledge
How the word is built, where it came from, and what it sits beside in memory.
In a sentence
On each managed phone, the NPU runs a small language model that scores inbound SMS for phishing before the message is displayed.
Why these words
- small Old English smæl, narrow, slender marks the scale of this model against a larger counterpart of the same family
- language Old French langage, from Latin lingua, tongue names the medium the model is built to handle, so the phrase claims a system that works in words
- model French modele, from Latin modulus, a small measure, diminutive of modus, measure is the head noun, the mathematical stand-in that small and language qualify
Where it came from
- Origin
- English computing compound, from Old English smæl (narrow, slender), Old French langage (from Latin lingua, tongue), and French modele (from Latin modulus, a small measure)
- Entered the language
- early 2020s
- What changed
- Small had meant narrow, then little, then modest in rank. Language had meant the tongue, then a people's speech, then any system of words. Model had meant a small measure, then a miniature to copy, then a mathematical stand-in. Speech labs joined language and model in the 1980s for the statistical predictor of the next word. When those predictors grew huge in the late 2010s, small was added as a contrast label for the compact members of the same family.
How it is spelled
- Pattern
- all after a short vowel keeps ll
- Pattern
- ge after a vowel is /dʒ/, never /g/
- Pattern
- -age from Old French is said /ɪdʒ/
- Pattern
- Latin modulus drops the u in English model
- Breaks the pattern
- the noun phrase stays three words; a hyphen appears only when the stack modifies another noun
- Breaks the pattern
- language keeps ua after g from French, while linguistic, from the same Latin lingua, restored the Latin spelling
- Breaks the pattern
- small is native English; German cousin schmal keeps sch, which English dropped
Spelled like
- tall
- stall
- village
- module
Broken into chunks
-
small
- smallness
- smallest
- smallish
-
age
- courage
- village
- message
-
mod
- modest
- modify
- module
What it sits beside
Same subject
Same shape
- large language model
- masked language model
- vision language model
- foundation model
Language-model family
- large language model
- masked language model
- vision language model
Size-marked models
- large language model
- foundation model
- pre-trained model
Open model compounds
- language model
- foundation model
- world model
Where it sits in the deck
Phase 2: How Models Are Built: Architectures and Learning Mechanics
With the paradigms named, zoom in on the architectural building blocks that turn data into trained artifacts.
