Definition
An education research concept defining methods used to evaluate interventions, programs, and policy impacts. It governs study design, measurement, and interpretation practices used to estimate effects and assess implementation quality. It does not establish causation without appropriate design choices and careful handling of bias and uncertainty. It supports improvement by identifying what works and under what implementation conditions. The concept is generally stable, though methods and reporting standards evolve over time.
Principle
Principle
Define clear inputs, outputs, responsibilities, decision gates, timelines, and data-handling steps so that evaluation activities produce comparable, actionable evidence over time.
Demonstration
Demonstration
An example workflow: (1) Clarify evaluation questions and stakeholders; (2) Design methods and instruments; (3) Collect data (surveys, observations, administrative data); (4) Clean and analyze data; (5) Draft findings and implications; (6) Convene stakeholders for interpretation; (7) Produce recommendations and assign action items; (8) Monitor implementation and update the workflow. For instance, a district evaluating after-school tutoring might follow these steps each semester while adapting instruments to grade level—there can be uncertainty about how formal each stage must be for small pilots.
Misapplication
Misapplication
Treating the workflow as a rigid checklist that must be followed without adapting to context, or conversely treating it as optional so that steps like stakeholder interpretation or data cleaning are skipped.
Consequence
Consequence
When applied correctly the workflow yields consistent evidence across cycles, clearer allocation of responsibilities, reduced duplication, and a verifiable chain from data to decisions.
Reversal
Reversal
An ad hoc, undocumented approach where evaluations are one-off activities with no standard steps, making comparisons and learning across time unreliable.
Boundary
Boundary
Covers processes specific to program evaluation (planning, data lifecycle, decision gates). It does not replace classroom-level instructional planning, formal experimental research protocols, or general project management artifacts unrelated to evaluation purpose.
Semantic Tension
Semantic Tension
Differs from a research study protocol (which prioritizes internal validity and publication) and from a generic project management workflow (which prioritizes task completion rather than evidence synthesis and stakeholder interpretation).
Synthesis
Synthesis
A program evaluation workflow aligns concrete steps, roles, and data practices into a repeatable process that turns raw information into stakeholder-validated decisions for program improvement.