Testing the Test: Item Response Curves and Test Quality

Authors

Gary A. Morris, Valparaiso University
Lee Branum-Martin, University of Houston - Main
Nathan Harshman, American University
Stephen F. Baxter, Rice University
Eric Mazur, Harvard University
Suvendra Dutta, Harvard University
Taha Mzoughi, Kennesaw State University
Veronica McCauley, National University of Ireland

Document Type

Article

Publication Date

5-2006

Abstract

We present a simple technique for evaluating multiple-choice questions and their answers beyond the usual measures of difficulty and the effectiveness of distractors. The technique involves the construction and qualitative consideration of item response curves and is based on item response theory from the field of education measurement. To demonstrate the technique, we apply item response curve analysis to three questions from the Force Concept Inventory. Item response curve analysis allows us to characterize qualitatively whether these questions are efficient, where efficient is defined in terms of the construction, performance, and discrimination of a question and its answer choices. This technique can be used to develop future multiple-choice examination questions and a better understanding of results from existing diagnostic instruments.

Recommended Citation

Morris GA, Branum-Martin L, Harshman N, Baker SD, Mazur E, Dutta S, Mzoughi T, McCauley V. 2006. Testing the test: Item response curves and test quality. Am J Phys 74 (5): 449-53.