Automated Essay Scoring Versus Human Scoring: A Comparative Study
作者： Jinhao Wang , Michelle Stallone Brown
DOI:
关键词:
摘要: The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned AES and human raters. Data collection included two standardized writing tests – WritePlacer Plus Texas Higher Education Assessment (THEA) test. sample 107 participants drawn from a Hispanic serving institution in South Texas. One-Way Repeated-Measures ANOVA follow-up Paired Samples t test were examine differences. Results indicated that score IntelliMetric™ significantly higher than faculty raters’ on WriterPlacer test, also THEA raters National Evaluation Systems. A statistically significant difference existed between THEA. These findings did not corroborate previous studies reported non-significant differences scoring.
参考文章(23)
Julie Cheville, Automated Scoring Technologies and the Rising Influence of Error. English Journal. ,vol. 93, pp. 47- ,(2004) , 10.2307/4128980
Karen Kukich, Beyond Automated Essay Scoring ,(2000)
Timothy Z. Keith, John P. Poggio, Ellis B. Page, Computer Analysis of Student Essays: Finding Trait Differences in Student Profile American Educational Research Association Annual Meeting. ,vol. 1997, ,(1997)
Alan McCurry, Niki McCurry, Writing Assessment for the 21st Century. The Computing Teacher. ,vol. 19, pp. 35- 37 ,(1992)
Kathryn R. Fitzgerald, Computerized Scoring? A Question of Theory and Practice. Journal of Basic Writing. ,vol. 13, pp. 3- 17 ,(1994) , 10.37514/JBW-J.1994.13.2.02
Veronica Garcia, Catherine Welch, Lawrence M. Rudner, An Evaluation of the IntelliMetric[SM] Essay Scoring System. Journal of Technology, Learning, and Assessment. ,vol. 4, ,(2006)
Anne Herrington, Charles Moran, What Happens When Machines Read Our Students' Writing? College English. ,vol. 63, pp. 480- ,(2001) , 10.2307/378891
Norman E. Wallen, Jack R. Fraenkel, How to Design and Evaluate Research in Education ,(1990)
Neil J. Salkind, Samuel B. Green, Using SPSS for Windows and Macintosh : Analyzing and Understanding Data ,(2004)
Semire Dikli, An Overview of Automated Scoring of Essays. The Journal of Technology, Learning and Assessment. ,vol. 5, ,(2006)