Questions: Genealogical and Coalescent Methods in Phylogenetics

Question 1

Two closely related species are analyzed with 20 independent genetic loci. Three loci show genealogies that conflict with the majority topology. Traditional phylogenetic methods treat these as noise. A coalescent-based genealogical method would instead:

• A. Average all 20 gene trees to produce a consensus topology that suppresses minority signals
• B. Model the probability of each gene genealogy under a proposed population history, using the conflicting trees to estimate ancestral population sizes and divergence times
• C. Conclude the species cannot be resolved due to insufficient phylogenetic signal
• D. Attribute all conflicting genealogies to horizontal gene transfer and exclude those loci

Answer: (B)

Coalescent methods treat gene tree variation as a statistical signal rather than noise. Conflicting genealogies arise from incomplete lineage sorting — ancient polymorphisms that were distributed to descendant species randomly at speciation. The distribution and depth of conflicting gene trees encodes information about ancestral population sizes and divergence timing. A coalescent model uses this variation to estimate demographic parameters that traditional phylogenetics cannot access.

Question 2

Genealogical and coalescent methods are most valuable for which type of phylogenetic question?

• A. Reconstructing deep relationships between distantly related phyla (e.g., vertebrates vs. mollusks)
• B. Estimating divergence times, ancestral population sizes, and migration rates at the boundary between populations and recently diverged species
• C. Identifying ancient horizontal gene transfer events between bacteria and early eukaryotes
• D. Resolving deep divergences obscured by mutational saturation at rapidly evolving sites

Answer: (B)

Coalescent methods shine precisely where traditional phylogenetics struggles most: recently diverged lineages where gene tree variation due to incomplete lineage sorting is high, and where the distinction between population history and species history becomes critical. For distantly related taxa, traditional methods work well because gene trees and species trees are effectively identical. Coalescent methods add the most value when population-level processes are still shaping the genomic record.

Question 3

In phylogenetics, most genes within an organism share the same genealogical history, so using multiple loci simply provides more data to estimate the single correct species tree.

• T. True
• F. False

Answer: False

Different genes can have different genealogies due to incomplete lineage sorting, recombination, and gene flow. A gene that coalesced in the ancestral population before a speciation event may show a genealogy that contradicts the true species tree. This gene tree discordance is not error — it reflects the stochastic nature of the coalescent process. Coalescent-based methods are built on this reality, modeling the distribution of gene trees rather than forcing all genes onto a single topology.

Question 4

Genealogical methods can estimate not just the branching order of lineages but also the sizes of ancestral populations and whether diverging lineages exchanged migrants after splitting.

• T. True
• F. False

Answer: True

This is the core advantage of coalescent-based phylogenetic methods over traditional approaches. By modeling how gene genealogies are generated by demographic processes, these methods can estimate ancestral effective population sizes (from how deeply gene lineages coalesce within populations), divergence times (from when lineages stop sharing coalescent events), and migration rates (from the rate and pattern of conflicting genealogies). The output is a full demographic model, not just a topology.

Question 5

Explain why two recently diverged species might show conflicting gene genealogies across different loci, and how genealogical methods turn this apparent problem into useful information.

Model answer: Before speciation, the ancestral population contained multiple gene lineages that had not yet coalesced to a common ancestor. When the population split, these lineages were randomly distributed to descendant species — a process called incomplete lineage sorting. Different loci underwent this process independently, so some genes will show genealogies that conflict with the true species tree. Genealogical methods treat this variation as signal: the proportion of conflicting genealogies and the depth of coalescence within populations together constrain ancestral population size and divergence timing. More ancestral gene tree discordance implies a larger ancestral population; the pattern of discordance across loci informs whether lineages exchanged migrants after splitting.

The key insight is that gene tree variation, far from being a problem, is a direct record of population history. Traditional methods that force all genes onto one tree discard this record; coalescent methods read it.