Problem Solving and Heuristic Strategies

College Depth 172 in the knowledge graph I know this Set as goal
Unlocks 129 downstream topics
problem-solving heuristics algorithms insight

Core Idea

Problem solving involves moving from a current state to a goal state through a problem space of possible operators and intermediate states. Newell and Simon's general problem solver framework distinguishes exhaustive algorithms (guaranteed solutions but computationally expensive) from heuristics such as means-ends analysis, hill-climbing, and working backward (fast but fallible). Insight problems involve a sudden restructuring of the problem representation after an impasse, reflecting constraint relaxation rather than mere incremental search.

How It's Best Learned

Work through the Tower of Hanoi and introspect on means-ends analysis in action. Then attempt insight problems (nine-dot problem, matchstick problems) to experience impasse and restructuring as phenomenologically distinct from systematic search.

Common Misconceptions

Explainer

Your prerequisite knowledge of working memory and cognitive psychology gives you the foundation to understand problem solving as a process of navigating a problem space: a mental representation of all possible states, operators (moves), and paths from the current state to the goal. The question is not whether you can solve a problem — it is how you search through that space efficiently given the severe limits of working memory and processing time.

Two broad search strategies bracket the space. Algorithms are exhaustive procedures guaranteed to find a solution if one exists: systematically try every possible combination, every permutation, every branch of the decision tree. They work perfectly — in principle. In practice, they are computationally ruinous for most real-world problems because the problem space is too large. Chess has more possible game positions than atoms in the observable universe; exhaustive search is impossible. Heuristics are selective search strategies that use knowledge about the problem structure to prune the search space. Means-ends analysis is the most studied: identify the most important difference between the current state and the goal, and apply an operator that reduces that difference. This is the strategy you use implicitly when writing an essay (the goal is a finished draft; the most important current gap is having no introduction; write an introduction). Hill-climbing always moves toward states that look more similar to the goal — efficient but prone to getting stuck at local maxima from which every immediate move seems like a regression. Working backward from the goal is especially useful when the goal state is well-defined but the starting operators are unclear.

Insight problems expose a third process that is qualitatively distinct from search. In problems like the nine-dot problem or classic matchstick puzzles, the solver gets stuck — not because they haven't tried enough moves, but because they have implicitly misrepresented the problem. The nine-dot problem seems to require staying inside the square formed by the dots, but the instructions never say this; solvers project a constraint that isn't there. Insight occurs when this false constraint is relaxed and the representation restructures, revealing a solution path that was always available but perceptually invisible. Neuroimaging studies show a burst of right anterior temporal activity at the moment of insight, consistent with remote associative connections suddenly becoming active. The "aha" feeling is real — it reflects a genuine shift in representation — but it isn't magical; it's constraint relaxation driven by spreading activation through conceptual memory, often facilitated by stepping away (incubation) from the impasse.

The practical upshot is that expert problem solvers differ from novices less in raw intelligence than in chunk quality and representation skill. Experts have large, well-organized schemas from their domain — chess masters see meaningful piece configurations, not 32 individual pieces — which means their initial problem representation is already closer to useful solution structures. This is why domain knowledge dramatically accelerates problem solving in a given field, and why trying to solve a problem in an unfamiliar domain forces you back into slow, effortful search. Improving problem solving therefore means two things in parallel: building better domain schemas (knowledge acquisition) and developing metacognitive skill in diagnosing when you're stuck in a bad representation versus simply needing to search further.

Practice Questions 5 questions

Prerequisite Chain

Counting to 10Counting to 20Understanding ZeroThe Number ZeroCounting to FiveOne-to-One CorrespondenceCombining Small Groups Within 5Addition Within 10Addition Within 20Two-Digit Addition Without RegroupingTwo-Digit Addition with RegroupingAddition Within 100Repeated Addition as MultiplicationMultiplication Facts Within 100Division as Equal SharingDivision as Grouping (Measurement Division)Division: Grouping (Repeated Subtraction) ModelDivision: Fair Sharing ModelDivision as Equal SharingDivision as GroupingBasic Division FactsDivision Facts Within 100Two-Digit by One-Digit DivisionDivision with RemaindersRemainders and Quotients in DivisionDivision Word ProblemsIntroduction to Long DivisionFactors and MultiplesPrime and Composite NumbersEquivalent FractionsRelating Fractions and DecimalsDecimal Place ValueReading and Writing DecimalsComparing and Ordering DecimalsAdding and Subtracting DecimalsMultiplying DecimalsDividing DecimalsDividing FractionsMixed Number ArithmeticOrder of OperationsInteger Order of OperationsVariable ExpressionsCombining Like TermsOne-Step EquationsTwo-Step EquationsSolving Multi-Step EquationsEquations with Variables on Both SidesAngle Pairs: Complementary, Supplementary, and VerticalParallel Lines and TransversalsCorresponding AnglesAlternate Interior AnglesTriangle Angle Sum TheoremExterior Angle TheoremTriangle Inequality TheoremSimilar Triangles: AA SimilaritySimilar Triangles: SSS and SAS SimilarityProportions in Similar TrianglesRight Triangle Trigonometry IntroductionTrigonometric Ratios ReviewRadian MeasureConverting Between Degrees and RadiansThe Unit CircleGraphing Sine and CosineGraphing Tangent and Reciprocal Trigonometric FunctionsDerivatives of Trigonometric FunctionsAntiderivativesIterated Integrals and Fubini's TheoremDouble Integrals in Cartesian CoordinatesDouble Integrals over Rectangular RegionsDouble Integrals in Polar CoordinatesDouble Integrals: Definition and SetupIterated Integrals and Fubini's TheoremDouble Integrals over Rectangular RegionsDouble Integrals over General RegionsApplications of Double Integrals: Area, Mass, and MomentsTriple Integrals in Cartesian CoordinatesTriple Integrals in Cylindrical and Spherical CoordinatesChange of Variables and the Jacobian DeterminantApplications of Triple Integrals: Volume and MassVector Fields and Their RepresentationsLine Integrals of Vector FieldsGreen's TheoremSurface Integrals and Flux of Vector FieldsSurface Integrals and Flux of Vector FieldsDivergence Theorem: Flux and OutflowDivergence TheoremElectric FluxGauss's LawConductors in Electrostatic EquilibriumCapacitance and CapacitorsDielectricsDielectric Constant and Relative PermittivityElectric Field Inside Dielectric MaterialsDielectric Materials and PolarizationDielectric Susceptibility and PermittivityEnergy Density in Electric FieldsElectric Current and Current DensityElectrical Resistance and ResistivityOhm's Law and Circuit ElementsElectromotive Force (EMF) and BatteriesKirchhoff's Circuit Laws: Voltage and CurrentDC Circuit Network Analysis MethodsTransient Response in RC CircuitsRC CircuitsLC and RLC CircuitsAC Circuits: FundamentalsImpedance and ReactanceAC Power and ResonanceElectromagnetic WavesThe Electromagnetic SpectrumBlackbody Radiation and Planck's LawPhotoelectric EffectThe Photon: Light as QuantaCompton ScatteringWave-Particle Dualityde Broglie WavelengthHeisenberg Uncertainty PrincipleWavefunction and the Born RuleThe Schrödinger EquationState Vectors and WavefunctionsQuantum SuperpositionQuantum EntanglementBell Theorem and Bell InequalitiesPostulates of Quantum MechanicsScattering TheoryIntroduction to Scattering TheoryPartial Wave Analysis in ScatteringSpin Angular MomentumElectron Spin and Intrinsic Magnetic MomentStern-Gerlach Experiment: Spin Quantization and MeasurementElectron Diffraction and Matter Wave PropertiesDavisson-Germer Experiment: Crystal Diffraction of ElectronsElectron Diffraction and Matter Wave InterferenceWavefunctions and Probability Density InterpretationQuantum Superposition and Linear Combinations of StatesQuantum Operators and ObservablesCanonical Commutation Relations and UncertaintyHeisenberg Uncertainty Principle and Measurement LimitsTime-Independent Schrödinger Equation and EigenvaluesHydrogen Atom in Quantum MechanicsSpectral Lines and Energy TransitionsSelection Rules for Atomic TransitionsLS and jj Coupling Schemes in Multi-Electron AtomsPauli Exclusion Principle and Antisymmetric WavefunctionsElectron Configuration and the Aufbau PrincipleThe Periodic Table and Atomic Electronic StructureThe Periodic TableElectron ConfigurationPeriodic TrendsIonization EnergyIonic BondingLewis StructuresResonance Structures and Delocalized ElectronsResonance and Formal ChargeMolecular Polarity and Dipole MomentsIntermolecular ForcesStates of Matter and Phase Changes: Melting, Boiling, and SublimationGas Laws and the Ideal Gas EquationGas Stoichiometry and Volume-Volume CalculationsThermochemistry and EnthalpyHeat Capacity and CalorimetryEntropy and Molecular DisorderSpontaneity and ΔGEntropy and Gibbs Free EnergyChemical EquilibriumAction PotentialSynaptic TransmissionNervous System OverviewCentral vs. Peripheral Nervous SystemBiological Psychology OverviewCognitive Psychology: An OverviewWorking MemoryProblem Solving and Heuristic Strategies

Longest path: 173 steps · 769 total prerequisite topics

Prerequisites (2)

Leads To (7)