Derivation Versus Generation in Formal Grammar

Graduate Depth 191 in the knowledge graph I know this Set as goal
Unlocks 3 downstream topics
formalism grammar computation

Core Idea

Generative approaches show how rules progressively build structures from base elements (derivation). Constraint-based approaches specify well-formedness conditions that structures must satisfy (generation). Both can model the same phenomena but differ in how they organize formal knowledge.

Explainer

From your work with constituent trees and phrase structure rules, you know that a grammar can be written as a set of rules like S → NP VP, NP → Det N, and so on. These rules work by expansion: start with the symbol S, pick a rule that rewrites it, apply more rules to the resulting symbols, and continue until you have a string of words. The sequence of steps — each rule application transforming one symbolic expression into another — is a derivation. The final tree records the history of those steps. Derivational thinking asks: what is the *procedure* that built this structure?

Constraint-based frameworks invert the question. Instead of asking how a structure is built step by step, they ask: what conditions must any well-formed structure satisfy? A constraint-based grammar specifies a set of constraints — requirements about word order, case, agreement, argument structure — and a structure is grammatical if and only if it satisfies all of them simultaneously. There is no ordered sequence of rule applications; all constraints evaluate the candidate structure at once. Lexical-Functional Grammar (LFG), Head-Driven Phrase Structure Grammar (HPSG), and Optimality Theory (OT) all work in this mode.

The conceptual difference matters because it changes what "explanation" looks like. In a derivational account, explaining why a structure is ill-formed means showing that no valid derivation produces it — some rule was violated or failed to apply. In a constraint-based account, an ill-formed structure violates one or more constraints, and explaining it means identifying which constraints are at stake. In practice, both frameworks can capture the same empirical facts; the debate is partly about which organization better reflects the mental grammar humans actually use and which scales more gracefully to complex phenomena like long-distance dependencies, ellipsis, or cross-linguistic variation.

The distinction also maps onto a broader division in formal systems: procedural versus declarative representations. A derivational grammar is procedural — it describes a process. A constraint-based grammar is declarative — it describes a state of affairs that must hold. This same split appears in programming languages (imperative vs. declarative), logic (proof-theoretic vs. model-theoretic), and machine learning (generative models vs. discriminative models). Recognizing this isomorphism helps you transfer intuitions across fields: whenever you see a system that generates outputs via sequential rule application versus one that filters candidates against constraints, you are encountering the derivation/constraint distinction in another domain.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIterated Integrals and Fubini's TheoremDouble Integrals in Cartesian CoordinatesDouble Integrals over Rectangular RegionsDouble Integrals in Polar CoordinatesDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsTriple Integrals in Cartesian CoordinatesTriple Integrals in Cylindrical and Spherical CoordinatesChange of Variables and the Jacobian DeterminantApplications of Triple Integrals: Volume and MassVector Fields and Their RepresentationsLine Integrals of Vector FieldsGreen's TheoremSurface Integrals and Flux of Vector FieldsSurface Integrals and Flux of Vector FieldsDivergence Theorem: Flux and OutflowDivergence TheoremElectric FluxGauss's LawConductors in Electrostatic EquilibriumCapacitance and CapacitorsDielectricsDielectric Constant and Relative PermittivityElectric Field Inside Dielectric MaterialsDielectric Materials and PolarizationDielectric Susceptibility and PermittivityEnergy Density in Electric FieldsElectric Current and Current DensityElectrical Resistance and ResistivityOhm's Law and Circuit ElementsElectromotive Force (EMF) and BatteriesKirchhoff's Circuit Laws: Voltage and CurrentDC Circuit Network Analysis MethodsTransient Response in RC CircuitsRC CircuitsLC and RLC CircuitsAC Circuits: FundamentalsImpedance and ReactanceAC Power and ResonanceElectromagnetic WavesThe Electromagnetic SpectrumBlackbody Radiation and Planck's LawPhotoelectric EffectThe Photon: Light as QuantaCompton ScatteringWave-Particle Dualityde Broglie WavelengthHeisenberg Uncertainty PrincipleWavefunction and the Born RuleThe Schrödinger EquationState Vectors and WavefunctionsQuantum SuperpositionQuantum EntanglementBell Theorem and Bell InequalitiesPostulates of Quantum MechanicsScattering TheoryIntroduction to Scattering TheoryPartial Wave Analysis in ScatteringSpin Angular MomentumElectron Spin and Intrinsic Magnetic MomentStern-Gerlach Experiment: Spin Quantization and MeasurementElectron Diffraction and Matter Wave PropertiesDavisson-Germer Experiment: Crystal Diffraction of ElectronsElectron Diffraction and Matter Wave InterferenceWavefunctions and Probability Density InterpretationQuantum Superposition and Linear Combinations of StatesQuantum Operators and ObservablesCanonical Commutation Relations and UncertaintyHeisenberg Uncertainty Principle and Measurement LimitsTime-Independent Schrödinger Equation and EigenvaluesHydrogen Atom in Quantum MechanicsSpectral Lines and Energy TransitionsSelection Rules for Atomic TransitionsLS and jj Coupling Schemes in Multi-Electron AtomsPauli Exclusion Principle and Antisymmetric WavefunctionsElectron Configuration and the Aufbau PrincipleThe Periodic Table and Atomic Electronic StructureThe Periodic TableElectron ConfigurationPeriodic TrendsIonization EnergyIonic BondingLewis StructuresResonance Structures and Delocalized ElectronsResonance and Formal ChargeMolecular Polarity and Dipole MomentsIntermolecular ForcesStates of Matter and Phase Changes: Melting, Boiling, and SublimationGas Laws and the Ideal Gas EquationGas Stoichiometry and Volume-Volume CalculationsThermochemistry and EnthalpyHeat Capacity and CalorimetryEntropy and Molecular DisorderSpontaneity and ΔGEntropy and Gibbs Free EnergyChemical EquilibriumAcid-Base ChemistryOrganic Reaction Mechanisms and Arrow PushingSN2 Substitution ReactionsSN1 Substitution ReactionsE1 Elimination ReactionsAlcohols and Ethers: Structure, Properties, and NomenclatureReactions of AlcoholsAldehydes and Ketones: Structure and ReactivityNucleophilic Addition to Aldehydes and KetonesCarboxylic Acids and Their DerivativesNucleophilic Acyl SubstitutionAmines: Structure, Basicity, and ReactionsAmine Reactivity: Nucleophilicity and BasicityAmino Acid Structure and PropertiesAmino Acid Classification and Biochemical PropertiesProtein Primary StructureProtein Secondary StructureProtein Tertiary StructureIon Channels and Selective Permeability MechanismsSensory Receptor Transduction and AdaptationSensory Transduction and EncodingSensory Pathways OverviewAuditory Processing PathwayLanguage Comprehension and Sentence ProcessingPragmatic Implicature and Context-Dependent InterpretationComputational PragmaticsDerivation Versus Generation in Formal Grammar

Longest path: 192 steps · 1112 total prerequisite topics

Prerequisites (4)

Leads To (1)