MathLabs

Foundations of mathematics

Model theory

Model theory studies mathematical structures M=(M,… )\mathcal{M} = (M, \dots) through the first-order sentences they satisfy, M⊨φ\mathcal{M} \models \varphi. Its two founding theorems — Compactness and Löwenheim–Skolem — govern which collections of structures can share a common theory, with applications from Tarski's decision procedure for real closed fields to nonstandard analysis and o-minimality.

IntuitionWhat counts as a "model" of a theory?

The axioms of group theory ("there is an identity", "every element has an inverse", ...) don't describe one specific group — they describe a class of structures: (Z,+,0)(\mathbb{Z}, +, 0) satisfies them, and so does (R×,×,1)(\mathbb{R}^{\times}, \times, 1), and so does any symmetry group. A structure is a set MM (the domain) together with interpretations of the constants, functions, and relations of a language; it is a model of a theory if it makes every axiom true. Model theory studies structures from the outside, asking: which sentences distinguish them, and which structures are secretly indistinguishable by first-order sentences alone?

Interactive chain graph of nested structures linked by elementary substructure edges.
A chain of structures M0⊆M1⊆⋯\mathcal{M}_0 \subseteq \mathcal{M}_1 \subseteq \cdots linked by elementary-substructure edges N⪯M\mathcal{N} \preceq \mathcal{M}: drag the highlight along the chain to see how the Löwenheim–Skolem construction builds a small elementary substructure inside a large one.

UndergraduateStructures and Tarski's satisfaction relation

Definition: First-order structure and satisfaction

A structure for a language L\mathcal{L} is M=(M,… )\mathcal{M} = (M, \dots): a nonempty domain MM together with an interpretation of every constant, function, and relation symbol of L\mathcal{L} (e.g. a symbol << interpreted as an actual order on MM). For an L\mathcal{L}-sentence φ\varphi, Tarski's satisfaction relation M⊨φ\mathcal{M} \models \varphi ("M\mathcal{M} satisfies φ\varphi", or "φ\varphi is true in M\mathcal{M}") is defined by recursion on the structure of φ\varphi: atomic formulas are checked directly against the interpreted relations, ∧,∨,¬\wedge, \vee, \neg follow the truth tables, and ∀x ψ\forall x\, \psi, ∃x ψ\exists x\, \psi quantify over the elements of MM. Two structures are elementarily equivalent, written M≡N\mathcal{M} \equiv \mathcal{N}, if they satisfy exactly the same L\mathcal{L}-sentences.

M⊨φiffφ holds in M under Tarski’s recursive clauses\mathcal{M} \models \varphi \quad \text{iff} \quad \varphi \text{ holds in } \mathcal{M} \text{ under Tarski's recursive clauses}

A related but stronger notion is the elementary substructure: N⪯M\mathcal{N} \preceq \mathcal{M} means N⊆MN \subseteq M as an L\mathcal{L}-structure, and moreover every L\mathcal{L}-formula with parameters in NN is satisfied in N\mathcal{N} exactly when it is satisfied in M\mathcal{M} — not just for sentences, but for formulas with free variables plugged in by elements of NN. This is the key relation used in the Löwenheim–Skolem construction below.

N⪯M  ⟺  ∀ψ(x,yˉ) ∀aˉ∈N (∃b∈M M⊨ψ(b,aˉ)→∃b∈N M⊨ψ(b,aˉ))\mathcal{N} \preceq \mathcal{M} \iff \forall \psi(x,\bar y)\, \forall \bar a \in N\, \big(\exists b \in M\, \mathcal{M}\models\psi(b,\bar a) \to \exists b \in N\, \mathcal{M}\models\psi(b,\bar a)\big)
Three ways structures can relate to each other
RelationDefinitionExample
Isomorphism M≅N\mathcal{M} \cong \mathcal{N}A bijection M→NM \to N preserving all functions/relations(Z,+)≅(2Z,+)(\mathbb{Z},+) \cong (2\mathbb{Z},+)
Elementary equivalence M≡N\mathcal{M} \equiv \mathcal{N}Same truth first-order sentences, domains may differ in sizeR\mathbb{R} and a nonstandard ∗R^{*}\mathbb{R}
Elementary substructure N⪯M\mathcal{N} \preceq \mathcal{M}Substructure that agrees with the ambient one on every formula with parametersA countable N⪯M\mathcal{N} \preceq \mathcal{M}-copy of an uncountable model

AdvancedTwo pillars: Compactness and Löwenheim–Skolem

Let Σ\Sigma be a set of L\mathcal{L}-sentences. If every finite Σ0⊆Σ\Sigma_0 \subseteq \Sigma has a model, then Σ\Sigma itself has a model.

Why is it true?

This is startling: Σ\Sigma can be infinite, even encoding infinitely many constraints, yet consistency need only be checked finitely many constraints at a time. It is the bridge from finitary proof (a formal derivation is always a finite object) to infinitary semantics (a model can be infinite), and it is the single theorem responsible for the existence of infinite and nonstandard models throughout model theory.

Proof

We prove the contrapositive: if Σ\Sigma has no model, then some finite Σ0⊆Σ\Sigma_0 \subseteq \Sigma has no model.

Suppose Σ\Sigma is unsatisfiable. By Gödel's Completeness Theorem for first-order logic (semantic entailment coincides with syntactic derivability: Σ⊨⊥\Sigma \models \bot iff Σ⊢⊥\Sigma \vdash \bot), Σ\Sigma being unsatisfiable is equivalent to Σ\Sigma being syntactically inconsistent, i.e. Σ⊢⊥\Sigma \vdash \bot — a contradiction is formally derivable from Σ\Sigma.

A formal derivation is by definition a finite sequence of formulas, each justified by an axiom, a premise from Σ\Sigma, or an inference rule applied to earlier lines. Since the derivation of ⊥\bot is finite, it cites only finitely many premises from Σ\Sigma; collect them into a finite set Σ0={σ1,…,σn}⊆Σ\Sigma_0 = \{\sigma_1, \dots, \sigma_n\} \subseteq \Sigma.

The very same finite derivation, using only premises from Σ0\Sigma_0, witnesses Σ0⊢⊥\Sigma_0 \vdash \bot. By soundness of first-order logic (derivability implies entailment), Σ0⊨⊥\Sigma_0 \models \bot, i.e. Σ0\Sigma_0 is unsatisfiable — it has no model.

So we have produced a finite Σ0⊆Σ\Sigma_0 \subseteq \Sigma with no model, proving the contrapositive. Equivalently: if every finite subset of Σ\Sigma has a model, no such inconsistent finite derivation can exist, so Σ\Sigma cannot be unsatisfiable, hence Σ\Sigma has a model.

Let L\mathcal{L} be a countable language and M\mathcal{M} an infinite L\mathcal{L}-structure. Then M\mathcal{M} has a countable elementary substructure N\mathcal{N}, i.e. there is N\mathcal{N} with N⪯M\mathcal{N} \preceq \mathcal{M} and NN countably infinite.

Why is it true?

This shows first-order logic cannot pin down cardinality: any theory with an infinite model (e.g. the axioms of a field, of set theory, ...) already has a countable model, no matter how "big" the original model was built to be. Combined with the upward version (any infinite model has elementary extensions of every larger cardinality), this is the source of Skolem's Paradox — a countable structure can satisfy the same first-order sentences as an uncountable one, including sentences that "assert" uncountability from the inside.

Proof

We build NN as the union of a countable increasing chain of countable subsets of MM, using the Tarski–Vaught test: a subset N⊆MN \subseteq M (as a substructure) is elementary iff for every L\mathcal{L}-formula ψ(x,yˉ)\psi(x, \bar{y}) and every tuple aˉ\bar{a} from NN, if there is some b∈Mb \in M with M⊨ψ(b,aˉ)\mathcal{M} \models \psi(b, \bar{a}), then there is already such a witness b∈Nb \in N.

Since L\mathcal{L} is countable, there are only countably many formulas ψ(x,yˉ)\psi(x,\bar y). Start with any countably infinite X0⊆MX_0 \subseteq M (possible since MM is infinite). Given a countable XnX_n, for each formula ψ(x,yˉ)\psi(x,\bar y) and each tuple aˉ\bar a from XnX_n (still only countably many pairs, since XnX_n is countable and L\mathcal{L} is countable), if ∃b∈M M⊨ψ(b,aˉ)\exists b \in M\, \mathcal{M} \models \psi(b,\bar a), choose one such witness bb (using the Axiom of Choice) and add it to form Xn+1X_{n+1}; this adds only countably many new elements, so Xn+1X_{n+1} stays countable.

Let N=⋃n<ωXnN = \bigcup_{n<\omega} X_n; a countable union of countable sets, so NN is countable (and infinite, since X0⊆NX_0 \subseteq N). We check the Tarski–Vaught test for NN: given ψ(x,yˉ)\psi(x,\bar y) and aˉ\bar a from NN, since aˉ\bar a is a finite tuple it lies entirely in some single XnX_n (the chain is increasing); if a witness b∈Mb \in M exists for ψ(b,aˉ)\psi(b, \bar a), then by construction of Xn+1X_{n+1}, a witness was already chosen and placed into Xn+1⊆NX_{n+1} \subseteq N.

By the Tarski–Vaught test, NN (with the induced L\mathcal{L}-structure N\mathcal{N}) satisfies N⪯M\mathcal{N} \preceq \mathcal{M}. Elementary substructures satisfy exactly the same sentences as the ambient structure, so N\mathcal{N} is a countably infinite model witnessing the theorem.

AdvancedReal-World Applications and Worked Examples

Tarski proved that the theory RCF\mathrm{RCF} of real closed fields (ordered fields where every positive element has a square root and every odd-degree polynomial has a root — R\mathbb{R} is the canonical example) admits quantifier elimination: every formula is equivalent, provably in RCF\mathrm{RCF}, to a quantifier-free formula in polynomial inequalities. Consequence: RCF\mathrm{RCF} is decidable, giving an algorithm (however expensive) for elementary Euclidean geometry and polynomial optimization, used today in robotics motion planning and formal verification of hybrid control systems. Applying compactness to R\mathbb{R} with a new constant ε\varepsilon satisfying 0<ε<1/n0 < \varepsilon < 1/n for every nn produces a nonstandard elementarily equivalent extension ∗R^{*}\mathbb{R} containing genuine infinitesimals, the starting point of Abraham Robinson's nonstandard analysis. The tame quantifier-elimination behavior of RCF\mathrm{RCF} was later abstracted into o-minimality, a framework now central to unlikely-intersections results in arithmetic geometry (the Pila–Zannier method).

Example: Tarski's quantifier elimination in action

Eliminate the quantifier from ∃x (ax2+bx+c=0)\exists x\, (a x^2 + bx + c = 0) over the reals (with a≠0a \ne 0), producing an equivalent quantifier-free condition on a,b,ca, b, c alone — exactly the kind of step Tarski's algorithm performs.

Solution

By the quadratic formula, ax2+bx+c=0ax^2+bx+c=0 has a real solution xx iff the discriminant is nonnegative: b2−4ac≥0b^2 - 4ac \ge 0.

So ∃x (ax2+bx+c=0)\exists x\, (ax^2+bx+c=0) is equivalent, provably in the theory of real closed fields, to the quantifier-free formula b2−4ac≥0b^2 - 4ac \ge 0 (given a≠0a \ne 0) — the existential quantifier over xx has been completely eliminated, replaced by a polynomial inequality in the remaining variables a,b,ca,b,c.

This is a single instance of Tarski's general theorem: every formula in the language of ordered fields is equivalent to a Boolean combination of polynomial equalities/inequalities in the free variables, with no quantifiers, and the elimination is uniform and effective — an actual algorithm computes it for formulas of arbitrary complexity, which is why RCF is a decidable theory.

Example: Building an infinitesimal via Compactness

Let Σ\Sigma be the elementary diagram of R\mathbb{R} (all first-order sentences with parameters from R\mathbb{R} true in R\mathbb{R}) together with a new constant symbol ε\varepsilon and the infinite set of sentences {0<ε<1/n:n=1,2,3,… }\{0 < \varepsilon < 1/n : n = 1,2,3,\dots\}. Use the Compactness Theorem to show Σ\Sigma has a model, and explain why this model contains a genuine infinitesimal.

Solution

Take any finite Σ0⊆Σ\Sigma_0 \subseteq \Sigma. It mentions only finitely many of the sentences 0<ε<1/n0 < \varepsilon < 1/n, say for n≤Nn \le N. Interpret ε\varepsilon in the ordinary structure R\mathbb{R} as the specific real number 1/(N+1)1/(N+1): this satisfies 0<ε<1/n0 < \varepsilon < 1/n for every n≤Nn \le N (since 1/(N+1)<1/n1/(N+1) < 1/n whenever n≤Nn \le N), and all the elementary-diagram sentences are true in R\mathbb{R} by construction. So Σ0\Sigma_0 has a model.

Since every finite Σ0⊆Σ\Sigma_0 \subseteq \Sigma has a model, the Compactness Theorem proved above gives a model ∗R^{*}\mathbb{R} of the full infinite set Σ\Sigma.

In this model, the interpretation of ε\varepsilon satisfies 0<ε<1/n0 < \varepsilon < 1/n for every positive integer nn simultaneously — no single real number has this property (any real 1/(N+1)1/(N+1) fails the sentence for n=N+1n=N+1), so ε\varepsilon must be a new element of ∗R∖R^{*}\mathbb{R} \setminus \mathbb{R}: a positive infinitesimal, smaller than every positive rational 1/n1/n yet still greater than 00. Because ∗R^{*}\mathbb{R} satisfies the elementary diagram of R\mathbb{R}, it is elementarily equivalent to R\mathbb{R} and obeys every first-order property R\mathbb{R} does — this is exactly Abraham Robinson's construction underlying nonstandard analysis.

If every finite subset of a set of sentences Σ\Sigma has a model, what does the Compactness Theorem conclude?

The downward Löwenheim–Skolem theorem is proved using which key tool?

Tarski's quantifier elimination for RCF\mathrm{RCF} turns ∃x (ax2+bx+c=0)\exists x\, (ax^2+bx+c=0) (with a≠0a \ne 0) into which quantifier-free condition?

Why is Skolem's Paradox not a genuine contradiction?

References

  1. Katrin Tent, Martin Ziegler (2012). A Course in Model Theory
  2. Lou van den Dries (1998). Tame Topology and O-minimal Structures
  3. Jonathan Pila, Alex J. Wilkie (2006). The rational points of a definable set