A Computer-Based Approach for Deriving and Measuring Individual and Team Knowledge Structure from Essay Questions

作者: Roy B. Clariana , Patricia Wallace

DOI: 10.2190/EC.37.3.A

关键词: Concept mapSoftwareHigher educationTest (assessment)PsychologyEducational technologyMathematics educationConstruct validityFinal examinationInter-rater reliability

摘要: This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and groups from their written essays, considers convergent criterion-related validity scores relative to human rater essay multiple-choice test scores. After completing classroom-based course, undergraduate participants in sophomore-level management course completed 100-item final examination then answered an extended-response question comparing four theories. The essays were quantified with ALA-Reader software applying both sentencewise linear lexical aggregate approaches, analyzed Pathfinder KNOT software. was better measure content sentence-wise approach, significant Spearman correlations 0.60 0.45 group network representations low high performing students reasonable straightforward interpret, being more similar expert, each other than expert. Suggestions further research are provided.

参考文章(30)
Naomi Chudowsky, Robert Glaser, James W. Pellegrino, Knowing What Students Know: The Science and Design of Educational Assessment ,(2013)
Robert J. Sternberg, Advances in the psychology of human intelligence Lawrence Erlbaum Associates. ,(1982)
Anthony J. Nitko, Educational Assessment of Students ,(1996)
Tahung Liang, Lawrence M. Rudner, Automated Essay Scoring Using Bayes' Theorem National Council on Measurement in Education. New Orleans, LA. ,vol. 1, ,(2002)
Robert Glaser, Michelene T H Chi, Ernest Rees, Expertise in Problem Solving. Advances in the Psychology of Human Intelligence. ,vol. 1, ,(1981)
David H. Jonassen, Sherwood Wang, Acquiring Structural Knowledge from Semantically Structured Hypertext. The Journal of Computer Based Instruction. ,vol. 20, pp. 1- 8 ,(1992)
David E. Rumelhart, James L. McClelland, , Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations Computational Models of Cognition and Perception. ,(1986) , 10.7551/MITPRESS/5236.001.0001
John R. Anderson, The Architecture of Cognition ,(1995)
Michelene TH Chi, Robert Glaser, Marshall J Farr, The Nature of Expertise Psychology Press. ,(2014) , 10.4324/9781315799681