A topic in the Open Knowledge Graph — a free, open map of 15,290 topics and the order to learn them in.

Network Information Theory

Research Depth 100 in the knowledge graph ☐ I know this ☆ Set as goal
5topics build on this
447prerequisites beneath it
See this on the map →
Channel CapacityChannel Coding Theorem+1 more→→Broadcast ChannelMultiple Access Channel+1 more
network multi-user distributed relay interference

Core Idea

Network information theory extends Shannon's point-to-point results to multi-user communication networks. When multiple senders and/or receivers share a channel, new phenomena arise that have no single-user analog: cooperation, interference, distributed compression, and capacity regions (sets of achievable rate tuples rather than single numbers). The capacity of the multiple access channel, broadcast channel, and interference channel are central problems. While some multi-user capacity regions are fully characterized (multiple access channel, degraded broadcast channel), others remain open after 50+ years (general interference channel, relay channel), making network information theory one of the most active areas of information-theoretic research.

Explainer

Shannon's original theory considers one sender and one receiver. Real communication systems involve many users: cell phones sharing a base station, devices on a Wi-Fi network, satellites communicating with ground stations. Network information theory asks: what are the fundamental limits when multiple communication sessions share the same physical medium?

The simplest multi-user channels illustrate the key ideas. The multiple access channel (MAC) has K senders transmitting independent messages to one receiver. The capacity region is the set of rate tuples (R_1, ..., R_K) such that for every subset S of users, sum_{i in S} R_i <= I(X_S; Y | X_{Sc}). The receiver can decode all messages using successive interference cancellation: decode one user, subtract their signal, decode the next. The broadcast channel (BC) has one sender transmitting different messages to K receivers. The sender uses superposition coding: layering messages at different power levels so that stronger receivers can decode more layers. The interference channel has K sender-receiver pairs sharing the same medium, where each receiver wants only its own message but hears everyone's signal.

The mathematical challenge is that multi-user problems rarely decompose into independent single-user problems. Interference creates coupling between users. Cooperation (through relays or user coordination) can increase capacity beyond what independent links achieve. Distributed source coding (Slepian-Wolf) shows that correlated sources can be compressed to their joint entropy even when the encoders do not communicate. These phenomena — interference, cooperation, and correlation — are fundamentally multi-user and have no single-user analog.

The state of knowledge is uneven. The MAC capacity region is fully known. The degraded broadcast channel capacity is known (superposition coding). The Gaussian interference channel capacity is known in certain regimes (strong interference, very weak interference) but not in general. The relay channel capacity remains open despite being posed by van der Meulen in 1971. Each unsolved problem reveals gaps in our understanding of how information flows through networks — making network information theory one of the richest and most challenging areas of the field.

Practice Questions 3 questions

Prerequisite Chain

Understanding Zero → The Number Zero → Counting to Five → Counting to 10 → Counting to 20 → Counting a Set of Objects Up to 20 → Cardinality: The Last Number Counted → Matching Numerals to Quantities → Subitizing Small Quantities → Addition Within 10 → Number Bonds to 10 → Addition Within 20 → Doubles and Near Doubles → Doubles Facts Within 10 → Near Doubles Facts Within 20 → Mental Math Strategies for Addition → Mental Math: Adding and Subtracting Tens → Addition Within 100 → Repeated Addition as Multiplication → Multiplication as Equal Groups → Multiplication: Arrays → Basic Multiplication Facts (0s, 1s, 2s, 5s, 10s) → Multiplication Facts Within 100 → Division as Equal Sharing → Division as Grouping (Measurement Division) → Division: Grouping (Repeated Subtraction) Model → Division: Fair Sharing Model → Division as Equal Sharing → Division as Grouping → Basic Division Facts → Division Facts Within 100 → Multiplication and Division Fact Families → Relationship Between Multiplication and Division → Division Facts as Inverse of Multiplication → Remainders and Quotients in Division → Division Word Problems → Multi-Step Word Problems → Solving Multi-Step Word Problems → Multiplication Word Problems → Division Word Problems → Introduction to Long Division → Factors and Multiples → Prime and Composite Numbers → Equivalent Fractions → Relating Fractions and Decimals → Decimal Place Value → Integers and the Number Line → Comparing and Ordering Integers → Absolute Value → Adding Integers → Subtracting Integers → Multiplying Integers → Dividing Integers → Unit Rates → Proportions → Percent Concept → Converting Between Fractions, Decimals, and Percents → Operations with Rational Numbers → Two-Step Equations → Solving Multi-Step Equations → Equations with Variables on Both Sides → Angle Pairs: Complementary, Supplementary, and Vertical → Parallel Lines and Transversals → Corresponding Angles → Alternate Interior Angles → Triangle Angle Sum Theorem → Exterior Angle Theorem → Triangle Inequality Theorem → Similar Triangles: AA Similarity → Similar Triangles: SSS and SAS Similarity → Proportions in Similar Triangles → Right Triangle Trigonometry Introduction → Sine, Cosine, and Tangent Ratios → Trigonometric Ratios Review → Radian Measure → Converting Between Degrees and Radians → The Unit Circle → Graphing Sine and Cosine → Graphing Tangent and Reciprocal Trigonometric Functions → Derivatives of Trigonometric Functions → Antiderivatives → Indefinite Integrals → Basic Integration Rules → Riemann Sums → Definite Integral Definition → Probability Density Functions and Continuous Distributions → Cumulative Distribution Functions → Continuous Random Variables → Probability Density Functions → Expected Value → Weak Law of Large Numbers → Probability Axioms and Rules → Conditional Probability → Law of Total Probability → Bayes' Theorem → Joint and Conditional Entropy → Mutual Information → Channel Capacity → Binary Symmetric Channel → Channel Coding Theorem → Network Information Theory

Longest path: 101 steps · 447 total prerequisite topics

Prerequisites (3)

Leads To (3)