Definition
An assessment concept defining how evidence of learning is collected, interpreted, and used for decisions. It governs measurement design, scoring, feedback, and reporting used to evaluate progress and attainment. It does not provide fair conclusions without alignment to objectives, consistent scoring, and attention to measurement error. It supports improvement and accountability by making performance observable and trackable over time. The concept is generally stable, though tools and standards for measurement evolve over time.
Principle
Principle
Apply predefined analytic checks and stakeholder review routines iteratively to surface measurement problems, bias, technical errors and contextually meaningful patterns before reporting or operational decisions.
Demonstration
Demonstration
An item analysis workflow that inspects item difficulty and discrimination, person‑item maps, time-on-task distributions, and subgroup score comparisons to detect differential item functioning and administration irregularities.
Misapplication
Misapplication
Selective review of only favorable results or running post hoc analyses to justify a preferred decision rather than following the review protocol, which can conceal bias and mislead stakeholders.
Consequence
Consequence
Improved validity of interpretations, targeted item or administration fixes, clearer communication of limitations, and data-driven decisions about score use and remediation.
Reversal
Reversal
Skipping systematic review leaves measurement errors, biased items and contextual anomalies unaddressed, risking incorrect inferences about learner achievement and system performance.
Boundary
Boundary
Focuses on the analytic and interpretive stage (scored data and metadata); it does not mandate primary data collection methods or full psychometric model development, though it may recommend them.
Semantic Tension
Semantic Tension
Closely related to data reporting: review is analytic and diagnostic, prioritizing internal validity and problem detection, while reporting packages synthesize findings for external audiences and accountability.
Synthesis
Synthesis
Assessment data review is the disciplined analytic step that transforms raw scores and metadata into validated information by applying checks, diagnostics and stakeholder interpretation to support responsible use of results.