Effects of Practical Constraints on Item Selection Rules at the Early Stages of Computerized Adaptive Testing

作者: Shu-Ying Chen , Robert D. Ankenman

DOI: 10.1111/J.1745-3984.2004.TB01112.X

关键词:

摘要: The purpose of this study was to compare the effects four item selection rules—(1) Fisher information (F), (2) with a posterior distribution (FP), (3) Kullback-Leibler (KP), and (4) completely randomized (RN)—with respect precision trait estimation extent usage at early stages computerized adaptive testing. comparison rules carried out under three conditions: (1) using only function as criterion; both content balancing; function, balancing, exposure control. When test length less than 10 items, FP KP tended outperform F extreme levels in Condition 1. However, more realistic settings, it could not be concluded that outperformed F, especially when control imposed. greater nonrandom procedures performed similarly no matter what condition was, while had slightly higher usage.

参考文章(16)
Martha L. Stocking, Charles Lewis, Methods of Controlling the Exposure of Items in CAT Springer, Dordrecht. pp. 163- 182 ,(2000) , 10.1007/0-306-47531-6_9
JAMES R. McBRIDE, JOHN T. MARTIN, Reliability and Validity of Adaptive Ability Tests in a Military Setting New Horizons in Testing#R##N#Latent Trait Test Theory and Computerized Adaptive Testing. pp. 223- 236 ,(1983) , 10.1016/B978-0-12-742780-5.50022-6
William C. Ward, The College Board computerized placement tests: an application of computerized adaptive testing Machine-Mediated Learning archive. ,vol. 2, pp. 271- 282 ,(1987)
Hua-Hua Chang, Zhiliang Ying, A Global Information Approach to Computerized Adaptive Testing Applied Psychological Measurement. ,vol. 20, pp. 213- 229 ,(1996) , 10.1177/014662169602000303
Martha L. Stocking, Len Swanson, A Method for Severely Constrained Item Selection in Adaptive Testing Applied Psychological Measurement. ,vol. 17, pp. 277- 292 ,(1992) , 10.1177/014662169301700308
Tianyou Wang, Walter P. Vispoel, Properties of Ability Estimation Methods in Computerized Adaptive Testing Journal of Educational Measurement. ,vol. 35, pp. 109- 135 ,(1998) , 10.1111/J.1745-3984.1998.TB00530.X
Ronald K. Hambleton, Hariharan Swaminathan, H. Jane Rogers, Fundamentals of Item Response Theory ,(1991)
Walter D. Way, Protecting the Integrity of Computerized Testing Item Pools Educational Measurement: Issues and Practice. ,vol. 17, pp. 17- 27 ,(1998) , 10.1111/J.1745-3992.1998.TB00632.X