Written and multimodal representations as predictors of expertise and problem-solving success in mathematics

作者: Sharon Oviatt , Adrienne Cohen

DOI: 10.1145/2522848.2533793

关键词:

摘要: One aim of multimodal learning analytics is to analyze rich natural communication modalities identify domain expertise and rapidly reliably. In this research, written representations are analyzed from the Math Data Corpus, which involves data (digital pen, speech, images) on collaborating students as they solve math problems. Findings reveal that in 96-97% cases correctness a group's solution was predictable advance based students' work content. addition, linear regression revealed 65% variance individual rankings could be accounted for their A content analysis both spoken input correctly predicted dominant expert group 100% time, exceeding unimodal prediction rates. Further reversal between experts non-experts percentage time match versus mismatch present oral answer contributions, with demonstrating higher mismatches. Implications discussed developing reliable systems incorporate digital pen automatically track consolidation expertise.

参考文章(13)
Daniël H. J. Wigboldus, Jeffrey W. Sherman, Heather L. Franzese, Ad van Knippenberg, Capacity and Comprehension: Spontaneous Stereotyping Under Cognitive Load Social Cognition. ,vol. 22, pp. 292- 309 ,(2004) , 10.1521/SOCO.22.3.292.35967
Ryan SJD Baker, Kalina Yacef, None, The State of Educational Data Mining in 2009: A Review and Future Visions. educational data mining. ,vol. 1, pp. 3- 17 ,(2009) , 10.5281/ZENODO.3554657
Amruta Purandare, Diane J. Litman, Content-learning correlations in spoken tutoring dialogs at word, turn and discourse levels the florida ai research society. pp. 439- 443 ,(2008)
Jeroen Dral, Dirk Heylen, Rieks op den Akker, Detecting Uncertainty in Spoken Dialogues: An Exploratory Research for the Automatic Detection of Speaker Uncertainty by Using Prosodic Markers Affective Computing and Sentiment Analysis. ,vol. 45, pp. 67- 77 ,(2011) , 10.1007/978-94-007-1757-2_6
M.W. Alibali, S. Goldinmeadow, Gesture-Speech Mismatch and Mechanisms of Learning: What the Hands Reveal about a Child's State of Mind. Cognitive Psychology. ,vol. 25, pp. 468- 523 ,(1993) , 10.1006/COGP.1993.1012
Sharon Oviatt, Alexander Arthur, Yaro Brock, Julia Cohen, Expressive pen-based interfaces for math education Proceedings of the 8th iternational conference on Computer supported collaborative learning - CSCL'07. pp. 573- 582 ,(2007) , 10.3115/1599600.1599708
Alexander M. Arthur, Rebecca Lunsford, Matt Wesson, Sharon Oviatt, Prototyping novel collaborative multimodal systems Proceedings of the 8th international conference on Multimodal interfaces - ICMI '06. pp. 209- 216 ,(2006) , 10.1145/1180995.1181039
Sharon Oviatt, Adrienne Cohen, Nadir Weibel, Multimodal learning analytics Proceedings of the 15th ACM on International conference on multimodal interaction - ICMI '13. pp. 563- 568 ,(2013) , 10.1145/2522848.2533790
Sharon Oviatt, Problem solving, domain expertise and learning Proceedings of the 15th ACM on International conference on multimodal interaction - ICMI '13. pp. 569- 574 ,(2013) , 10.1145/2522848.2533791
Stefan Scherer, Nadir Weibel, Louis-Philippe Morency, Sharon Oviatt, Multimodal prediction of expertise and leadership in learning groups Proceedings of the 1st International Workshop on Multimodal Learning Analytics. pp. 1- 8 ,(2012) , 10.1145/2389268.2389269