An assessment concept defining how evidence of learning is collected, interpreted, and used for decisions. It governs measurement design, scoring, feedback, and reporting used to evaluate progress and attainment. It does not provide fair conclusions without alignment to objectives, consistent scoring, and attention to measurement error. It supports improvement and accountability by making performance observable and trackable over time. The concept is generally stable, though tools and standards for measurement evolve over time.

Principle

Combine quantitative indices and qualitative review to judge whether each item measures the intended construct reliably and fairly for the target population.

Demonstration

After a pilot test, psychometricians compute item p-values (proportion correct), point-biserial correlations for discrimination, examine distractor choice frequencies, and review item stems for ambiguity to decide which items to revise or retire.

Misapplication

Eliminating items solely because they have extreme difficulty values without checking content alignment, small-sample instability, or subgroup performance patterns that might reveal bias.

Consequence

Systematic item analysis improves test reliability, validity, and fairness by identifying faulty items, strengthening content coverage, and informing item banking and calibration.

Reversal

Accepting only total test scores for decisions and ignoring which items drive performance, thereby missing specific content weaknesses or biases at the item level.

Boundary

Focused on item-level evidence; it complements but does not replace broader validation activities such as curriculum alignment studies, consequential validity reviews, or large-scale standard setting.

Semantic Tension

Often conflated with test-level psychometrics: item analysis is micro-level (items and distractors), whereas test-level analysis focuses on score reliability, test information curves, and population-level score properties.

Synthesis

Item analysis integrates numeric statistics and content review to determine an item's quality and suitability, producing actionable recommendations for revision, retention, or removal.