##  [Evaluation Data Review](/evaluation-data-review-0) 

 Definition

An education research concept defining methods used to evaluate interventions, programs, and policy impacts. It governs study design, measurement, and interpretation practices used to estimate effects and assess implementation quality. It does not establish causation without appropriate design choices and careful handling of bias and uncertainty. It supports improvement by identifying what works and under what implementation conditions. The concept is generally stable, though methods and reporting standards evolve over time.



 

 

 

 

 

 





## Principle

Principle

Prioritize data quality through systematic checks, documentation of anomalies, cross-source triangulation, and explicit assessment of bias and uncertainty.

 

 

 

 

 





## Demonstration

Demonstration

A scheduled data review meeting where survey response patterns, missing-data logs, observation score distributions, and coding reliability are reconciled and action items assigned to resolve discrepancies.

 

 

 

 

## Misapplication

Misapplication

Cherry-picking favorable subsets of data, ignoring metadata about collection conditions, or performing cursory checks that fail to detect systematic measurement error.

 

 

 

 

 





## Consequence

Consequence

Thorough data review yields more credible findings, clearer confidence bounds around conclusions, and defensible decisions for program adaptation or policy advice.

 

 

 

 

## Reversal

Reversal

Publishing or acting on raw, unreviewed datasets that contain unaddressed errors, duplicates, or divergent definitions across sources.

 

 

 

 

 





## Boundary

Boundary

Covers post-collection processing and preliminary interpretation; it does not replace rigorous statistical modeling, formal peer review, or the original instrument design process.

 

 

 

 

 





## Semantic Tension

Semantic Tension

Tension exists between expedited operational checks for program managers and deep methodological audits by statisticians; both are reviews but with different depth and aims.

 

 

 

 

 





## Synthesis

Synthesis

Evaluation data review is an iterative quality-assurance stage that transforms raw observations into reliable inputs for analysis and reporting by detecting errors, reconciling sources, and documenting uncertainty.