Reproductive isolation mechanisms prevent gene flow between species and can be prezygotic (behavioral, temporal, mechanical barriers) or postzygotic (hybrid inviability, sterility, breakdown). Dobzhansky-Muller incompatibilities show how neutral divergence can create reproductive isolation without direct selection.
From your study of speciation, you know that new species form when populations diverge enough that they can no longer interbreed successfully. But what, specifically, prevents interbreeding? Reproductive isolation mechanisms are the concrete barriers that block gene flow between populations, and understanding them is essential for understanding how one species becomes two.
These barriers fall into two broad categories based on when they act. Prezygotic barriers prevent a hybrid zygote from ever forming. Temporal isolation means two species breed at different times — one frog species calls in early spring, another in late summer, so they never encounter each other's mates. Behavioral isolation involves differences in courtship signals: firefly species use distinct flash patterns, and a female will only respond to her own species' code. Mechanical isolation means the reproductive structures are physically incompatible — think of flowers shaped to be pollinated only by a specific insect. Gametic isolation means that even if sperm meets egg, the molecular recognition between them fails, preventing fertilization. Each of these barriers acts before a hybrid can form.
Postzygotic barriers act after a hybrid zygote has formed, reducing its fitness. Hybrid inviability means the embryo fails to develop properly — certain crosses between sheep and goat species produce embryos that die early in development. Hybrid sterility means the offspring survives but cannot reproduce — the mule, a cross between horse and donkey, is the classic example. Its mismatched chromosomes cannot pair properly during meiosis, so it produces no viable gametes. Hybrid breakdown appears in later generations: the first hybrid generation (F1) may be fine, but F2 or backcross offspring show reduced fitness as incompatible gene combinations segregate out.
One of the deepest insights about reproductive isolation comes from the Dobzhansky-Muller model. It explains how incompatibilities can arise without any single harmful mutation. Imagine an ancestral population with genotype AABB that splits into two isolated populations. In one, a neutral mutation changes A to a (giving aaBB), and in the other, a neutral mutation changes B to b (giving AAbb). Each mutation is perfectly fine in its own genetic background. But when the populations meet again and a hybrid forms with genotype aabb (or AaBb), the a and b alleles interact for the first time — and this novel combination may be lethal or cause sterility. No single step was disadvantageous; the incompatibility emerges only from the combination. This model elegantly explains why reproductive isolation can evolve as a byproduct of ordinary genetic divergence in separated populations, without natural selection directly favoring barriers to interbreeding.