A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Column Space and Row Space

College Depth 56 in the knowledge graph ☐ I know this ☆ Set as goal
128topics build on this
239prerequisites beneath it
See this on the map →
Span, Linear Independence, and BasisSubspaces→→Least Squares Approximation and Normal EquationsThe Row Space of a Matrix
column-space row-space image

Core Idea

The column space col(A) is the span of the columns of A; it equals the image of the linear transformation x ↦ Ax. The row space row(A) is the span of the rows of A, equal to col(Aᵀ). Both are fundamental subspaces determined by A; rank(A) is the dimension of each.

Explainer

From your prerequisite on span of vectors, you know that the span of a set of vectors is all linear combinations of those vectors — it is the smallest subspace containing them all. The column space of a matrix A, written col(A), applies this idea directly: take the columns of A as your set of vectors and form their span. If A is m × n, its columns are vectors in ℝᵐ, so col(A) is a subspace of ℝᵐ. From your subspaces prerequisite, you know this span is guaranteed to be a subspace: it contains the zero vector and is closed under addition and scalar multiplication.

The geometric interpretation is the most important thing to understand. Multiplying A by a vector x computes a linear combination of the columns of A, where the entries of x are the coefficients. So the set of all vectors Ax, as x ranges over all of ℝⁿ, is exactly col(A). This means col(A) is the image of the linear transformation T(x) = Ax — the set of all outputs the transformation can possibly produce. The equation Ax = b has a solution if and only if b is in col(A). Geometrically: b must lie in the space that A's columns can reach.

The row space row(A) is the span of the rows of A, viewed as vectors in ℝⁿ. Equivalently, it is the column space of Aᵀ. A crucial fact: row reduction preserves the row space but can change the column space. When you row-reduce A to its echelon form, the nonzero rows of the echelon form span the same row space as the original rows of A. The pivot columns of A (not the echelon form) form a basis for the column space. This asymmetry is a source of many student errors — do not take the pivot columns from the reduced form and declare them a basis for col(A); go back to the original matrix.

The rank of A is defined as the dimension of the column space, and it equals the dimension of the row space — these two numbers always agree, a non-obvious theorem. The rank counts the number of pivot columns (or pivot rows) after row reduction. Together with the rank-nullity theorem, which you will use extensively in least-squares approximation, rank organizes all four fundamental subspaces of a matrix: the column space, the row space, the null space, and the left null space. Understanding which space a given vector belongs to — and why — is the unifying question of linear algebra.

Practice Questions 5 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Making 10 as an Addition Strategy → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts Through 10 → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Opposites and Additive Inverses → Absolute Value → Adding Integers → Coordinate Plane — All Four Quadrants → Vectors in R^n: Addition and Scalar Multiplication → Vector Spaces → Subspaces → Linear Independence and Linear Dependence → Span, Linear Independence, and Basis → Column Space and Row Space

Longest path: 57 steps · 239 total prerequisite topics

Prerequisites (2)

Leads To (2)