Foundations of mathematics
Model theory
Model theory studies mathematical structures through the first-order sentences they satisfy, . Its two founding theorems — Compactness and Löwenheim–Skolem — govern which collections of structures can share a common theory, with applications from Tarski's decision procedure for real closed fields to nonstandard analysis and o-minimality.
IntuitionWhat counts as a "model" of a theory?
The axioms of group theory ("there is an identity", "every element has an inverse", ...) don't describe one specific group — they describe a class of structures: satisfies them, and so does , and so does any symmetry group. A structure is a set (the domain) together with interpretations of the constants, functions, and relations of a language; it is a model of a theory if it makes every axiom true. Model theory studies structures from the outside, asking: which sentences distinguish them, and which structures are secretly indistinguishable by first-order sentences alone?
UndergraduateStructures and Tarski's satisfaction relation
Definition: First-order structure and satisfaction
A structure for a language is : a nonempty domain together with an interpretation of every constant, function, and relation symbol of (e.g. a symbol interpreted as an actual order on ). For an -sentence , Tarski's satisfaction relation (" satisfies ", or " is true in ") is defined by recursion on the structure of : atomic formulas are checked directly against the interpreted relations, follow the truth tables, and , quantify over the elements of . Two structures are elementarily equivalent, written , if they satisfy exactly the same -sentences.
A related but stronger notion is the elementary substructure: means as an -structure, and moreover every -formula with parameters in is satisfied in exactly when it is satisfied in — not just for sentences, but for formulas with free variables plugged in by elements of . This is the key relation used in the Löwenheim–Skolem construction below.
| Relation | Definition | Example |
|---|---|---|
| Isomorphism | A bijection preserving all functions/relations | |
| Elementary equivalence | Same truth first-order sentences, domains may differ in size | and a nonstandard |
| Elementary substructure | Substructure that agrees with the ambient one on every formula with parameters | A countable -copy of an uncountable model |
AdvancedTwo pillars: Compactness and Löwenheim–Skolem
Let be a set of -sentences. If every finite has a model, then itself has a model.
Why is it true?
This is startling: can be infinite, even encoding infinitely many constraints, yet consistency need only be checked finitely many constraints at a time. It is the bridge from finitary proof (a formal derivation is always a finite object) to infinitary semantics (a model can be infinite), and it is the single theorem responsible for the existence of infinite and nonstandard models throughout model theory.
Proof
We prove the contrapositive: if has no model, then some finite has no model.
Suppose is unsatisfiable. By Gödel's Completeness Theorem for first-order logic (semantic entailment coincides with syntactic derivability: iff ), being unsatisfiable is equivalent to being syntactically inconsistent, i.e. — a contradiction is formally derivable from .
A formal derivation is by definition a finite sequence of formulas, each justified by an axiom, a premise from , or an inference rule applied to earlier lines. Since the derivation of is finite, it cites only finitely many premises from ; collect them into a finite set .
The very same finite derivation, using only premises from , witnesses . By soundness of first-order logic (derivability implies entailment), , i.e. is unsatisfiable — it has no model.
So we have produced a finite with no model, proving the contrapositive. Equivalently: if every finite subset of has a model, no such inconsistent finite derivation can exist, so cannot be unsatisfiable, hence has a model.
Let be a countable language and an infinite -structure. Then has a countable elementary substructure , i.e. there is with and countably infinite.
Why is it true?
This shows first-order logic cannot pin down cardinality: any theory with an infinite model (e.g. the axioms of a field, of set theory, ...) already has a countable model, no matter how "big" the original model was built to be. Combined with the upward version (any infinite model has elementary extensions of every larger cardinality), this is the source of Skolem's Paradox — a countable structure can satisfy the same first-order sentences as an uncountable one, including sentences that "assert" uncountability from the inside.
Proof
We build as the union of a countable increasing chain of countable subsets of , using the Tarski–Vaught test: a subset (as a substructure) is elementary iff for every -formula and every tuple from , if there is some with , then there is already such a witness .
Since is countable, there are only countably many formulas . Start with any countably infinite (possible since is infinite). Given a countable , for each formula and each tuple from (still only countably many pairs, since is countable and is countable), if , choose one such witness (using the Axiom of Choice) and add it to form ; this adds only countably many new elements, so stays countable.
Let ; a countable union of countable sets, so is countable (and infinite, since ). We check the Tarski–Vaught test for : given and from , since is a finite tuple it lies entirely in some single (the chain is increasing); if a witness exists for , then by construction of , a witness was already chosen and placed into .
By the Tarski–Vaught test, (with the induced -structure ) satisfies . Elementary substructures satisfy exactly the same sentences as the ambient structure, so is a countably infinite model witnessing the theorem.
AdvancedReal-World Applications and Worked Examples
Tarski proved that the theory of real closed fields (ordered fields where every positive element has a square root and every odd-degree polynomial has a root — is the canonical example) admits quantifier elimination: every formula is equivalent, provably in , to a quantifier-free formula in polynomial inequalities. Consequence: is decidable, giving an algorithm (however expensive) for elementary Euclidean geometry and polynomial optimization, used today in robotics motion planning and formal verification of hybrid control systems. Applying compactness to with a new constant satisfying for every produces a nonstandard elementarily equivalent extension containing genuine infinitesimals, the starting point of Abraham Robinson's nonstandard analysis. The tame quantifier-elimination behavior of was later abstracted into o-minimality, a framework now central to unlikely-intersections results in arithmetic geometry (the Pila–Zannier method).
Example: Tarski's quantifier elimination in action
Eliminate the quantifier from over the reals (with ), producing an equivalent quantifier-free condition on alone — exactly the kind of step Tarski's algorithm performs.
Solution
By the quadratic formula, has a real solution iff the discriminant is nonnegative: .
So is equivalent, provably in the theory of real closed fields, to the quantifier-free formula (given ) — the existential quantifier over has been completely eliminated, replaced by a polynomial inequality in the remaining variables .
This is a single instance of Tarski's general theorem: every formula in the language of ordered fields is equivalent to a Boolean combination of polynomial equalities/inequalities in the free variables, with no quantifiers, and the elimination is uniform and effective — an actual algorithm computes it for formulas of arbitrary complexity, which is why RCF is a decidable theory.
Example: Building an infinitesimal via Compactness
Let be the elementary diagram of (all first-order sentences with parameters from true in ) together with a new constant symbol and the infinite set of sentences . Use the Compactness Theorem to show has a model, and explain why this model contains a genuine infinitesimal.
Solution
Take any finite . It mentions only finitely many of the sentences , say for . Interpret in the ordinary structure as the specific real number : this satisfies for every (since whenever ), and all the elementary-diagram sentences are true in by construction. So has a model.
Since every finite has a model, the Compactness Theorem proved above gives a model of the full infinite set .
In this model, the interpretation of satisfies for every positive integer simultaneously — no single real number has this property (any real fails the sentence for ), so must be a new element of : a positive infinitesimal, smaller than every positive rational yet still greater than . Because satisfies the elementary diagram of , it is elementarily equivalent to and obeys every first-order property does — this is exactly Abraham Robinson's construction underlying nonstandard analysis.
If every finite subset of a set of sentences has a model, what does the Compactness Theorem conclude?
The downward Löwenheim–Skolem theorem is proved using which key tool?
Tarski's quantifier elimination for turns (with ) into which quantifier-free condition?
Why is Skolem's Paradox not a genuine contradiction?
References
- Katrin Tent, Martin Ziegler (2012). A Course in Model Theory
- Lou van den Dries (1998). Tame Topology and O-minimal Structures
- Jonathan Pila, Alex J. Wilkie (2006). The rational points of a definable set