Can you test me now? Equivalence of GMA tests on mobile and non-mobile devices

作者: Matt I. Brown , Michael A. Grossenbacher

DOI: 10.1111/IJSA.12160

关键词:

摘要: As technology continues to evolve, organizations seek use personal electronics like smartphones for selection and assessment. While this promises increase access a more diverse applicant pool, research is needed examine whether commonly used assessments function similarly on these devices as conventional computer. Contrary past research, we did not find meaningful differences in general mental ability (GMA) test scores between device groups. We also observed few item functioning devices. Screen size had positive, but marginal effect scores. These results are optimistic the of mobile GMA testing, additional alternative tests administered

参考文章(36)
Natalie A. Wright, Adam W. Meade, Sara L. Gutierrez, Using Invariance to Examine Cheating in Unproctored Ability Tests International Journal of Selection and Assessment. ,vol. 22, pp. 12- 22 ,(2014) , 10.1111/IJSA.12053
Neil A. Morelli, Robert P. Mahan, A. James Illingworth, Establishing the Measurement Equivalence of Online Selection Assessments Delivered on Mobile versus Nonmobile Devices International Journal of Selection and Assessment. ,vol. 22, pp. 124- 138 ,(2014) , 10.1111/IJSA.12063
Danielle D. King, Ann Marie Ryan, Tracy Kantrowitz, Darrin Grelle, Amanda Dainis, Mobile Internet Testing: An analysis of equivalence, individual differences, and reactions International Journal of Selection and Assessment. ,vol. 23, pp. 382- 394 ,(2015) , 10.1111/IJSA.12122
Winfred Arthur, Dennis Doverspike, Gonzalo J. Muñoz, Jason E. Taylor, Alison E. Carr, The Use of Mobile Devices in High‐stakes Remotely Delivered Assessments and Testing International Journal of Selection and Assessment. ,vol. 22, pp. 113- 123 ,(2014) , 10.1111/IJSA.12062
Alan D. Mead, Fritz Drasgow, Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin. ,vol. 114, pp. 449- 458 ,(1993) , 10.1037/0033-2909.114.3.449
Winfred Arthur, Ryan M. Glaze, Anton J. Villado, Jason E. Taylor, The Magnitude and Extent of Cheating and Response Distortion Effects on Unproctored Internet-Based Tests of Cognitive Ability and Personality International Journal of Selection and Assessment. ,vol. 18, pp. 1- 16 ,(2010) , 10.1111/J.1468-2389.2010.00476.X
Adam W. Meade, A taxonomy of effect size measures for the differential functioning of items and scales. Journal of Applied Psychology. ,vol. 95, pp. 728- 743 ,(2010) , 10.1037/A0018966
John F. Binning, Gerald V. Barrett, Validity of Personnel Decisions: A Conceptual Analysis of the Inferential and Evidential Bases Journal of Applied Psychology. ,vol. 74, pp. 478- 494 ,(1989) , 10.1037/0021-9010.74.3.478
Kyle C. Huff, The comparison of mobile devices to computers for web-based assessments Computers in Human Behavior. ,vol. 49, pp. 208- 212 ,(2015) , 10.1016/J.CHB.2015.03.008
Donald T. Campbell, Donald W. Fiske, Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin. ,vol. 56, pp. 81- 105 ,(1959) , 10.1037/H0046016