Essay Selection Methods for Adaptive Rater Monitoring

摘要: Constructed-response items are commonly used in educational and psychological testing, the answers to those typically scored by human raters. In current rater monitoring processes, validity scoring is ensure that scores assigned raters do not deviate severely from standards of rating quality. this article, an adaptive approach may potentially improve efficiency practice proposed. Based on Rasch partial credit model known development multidimensional computerized two essay selection methods-namely, D-optimal method Single Fisher information method-are These methods intend select most appropriate essays based what already about a rater's performance. Simulation studies, using simulated bank cloned real bank, show proposed can recover parameters with much fewer questions. Future challenges potential solutions discussed end.