Definition
An education research concept defining methods used to evaluate interventions, programs, and policy impacts. It governs study design, measurement, and interpretation practices used to estimate effects and assess implementation quality. It does not establish causation without appropriate design choices and careful handling of bias and uncertainty. It supports improvement by identifying what works and under what implementation conditions. The concept is generally stable, though methods and reporting standards evolve over time.
Principle
Principle
Detect and correct errors, document data provenance and transformation, and ensure analytic assumptions are supported by the empirical record before conclusions are drawn.
Demonstration
Demonstration
A data review identifies duplicated participant IDs, verifies score ranges against codebooks, reconciles missingness patterns with enrollment logs, and documents imputation decisions prior to statistical modeling.
Misapplication
Misapplication
Treating superficial frequency checks as sufficient or conducting review after analysis (post hoc) so that discovered issues invalidate prior results instead of being prevented.
Consequence
Consequence
A rigorous data review increases confidence in analytic results, reduces rework, prevents misleading conclusions, and streamlines transparent reporting to stakeholders.
Reversal
Reversal
Skipping formal data review and relying on raw exports can speed initial analysis but increases risk of bias, analytic error, and the need for corrective reanalysis.
Boundary
Boundary
Concerns the quality and fitness-for-purpose of data for analysis and reporting; it does not itself perform causal estimation or substitute for peer methodological review of analytic strategy.
Semantic Tension
Semantic Tension
Tension between rapid preliminary checks for operational decisions and deep audits for publication-grade analysis; the former sacrifices depth for speed, the latter demands thorough documentation.
Synthesis
Synthesis
Program Evaluation Data Review is a quality-assurance stage that verifies data integrity and documents decisions so analysis rests on a transparent, defensible empirical foundation.