Socially Interactive Robotic Platforms as Sign Language Tutors

作者: Hatice Kose , Neziha Akalin , Pinar Uluer

DOI: 10.1142/S0219843614500030

关键词:

摘要: This paper investigates the role of interaction and communication kinesics in human–robot interaction. study is part a novel research project on sign language (SL) tutoring through games with humanoid robots. The main goal to motivate children problems understand imitate signs implemented by robot using basic upper torso gestures sound. We present an empirical exploratory investigating effect nonverbal consisting hand movements, body face expressed robot, having comprehended word, participants will give relevant feedback SL. way participant both passive observer active imitator throughout learning process different phases game. A five-fingered R3 platform three-fingered Nao H-25 are employed within games. Vision-, sound-, touch- motion-based cues used for multimodal between child therapist/parent study. presents preliminary results proposed game tested adult participants. aim evaluate SL ability from compare platforms this setup.

参考文章(28)
Heung-Il Suk, Bong-Kee Sin, Seong-Whan Lee, Hand gesture recognition based on dynamic Bayesian network framework Pattern Recognition. ,vol. 43, pp. 3059- 3072 ,(2010) , 10.1016/J.PATCOG.2010.03.016
Bekir Sıtkı Ertuğrul, Cemal Gurpinar, Hasan Kivrak, Hatice Kose, None, Gesture recognition for humanoid assisted interactive sign language tutoring 2013 21st Signal Processing and Communications Applications Conference (SIU). pp. 1- 4 ,(2013) , 10.1109/SIU.2013.6531542
Hatice Kose, Rabia Yorganci, Esra H. Algan, Dag S. Syrdal, Evaluation of the Robot Assisted Sign Language Tutoring Using Video-Based Studies International Journal of Social Robotics. ,vol. 4, pp. 273- 283 ,(2012) , 10.1007/S12369-012-0142-2
Liya Ding, Aleix M. Martinez, Modelling and recognition of the linguistic components in American Sign Language Image and Vision Computing. ,vol. 27, pp. 1826- 1844 ,(2009) , 10.1016/J.IMAVIS.2009.02.005
Marco Nalin, Ilaria Baroni, Ivana Kruijff-Korbayova, Lola Canamero, Matthew Lewis, Aryel Beck, Heriberto Cuayahuitl, Alberto Sanna, Children's adaptation in multi-session interaction with a humanoid robot 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication. pp. 351- 357 ,(2012) , 10.1109/ROMAN.2012.6343778
CHAORAN LIU, CARLOS T. ISHI, HIROSHI ISHIGURO, NORIHIRO HAGITA, GENERATION OF NODDING, HEAD TILTING AND GAZING FOR HUMAN–ROBOT SPEECH INTERACTION International Journal of Humanoid Robotics. ,vol. 10, pp. 1350009- ,(2013) , 10.1142/S0219843613500096
Hatice Kose, Rabia Yorganci, Tale of a robot: Humanoid robot assisted sign language tutoring ieee-ras international conference on humanoid robots. pp. 105- 111 ,(2011) , 10.1109/HUMANOIDS.2011.6100846
Aude Billard, Ben Robins, Jacqueline Nadel, Kerstin Dautenhahn, Building Robota, a mini-humanoid robot for the rehabilitation of children with autism. Assistive Technology. ,vol. 19, pp. 37- 49 ,(2007) , 10.1080/10400435.2007.10131864
ANDREA BAUER, DIRK WOLLHERR, MARTIN BUSS, HUMAN–ROBOT COLLABORATION: A SURVEY International Journal of Humanoid Robotics. ,vol. 5, pp. 47- 66 ,(2008) , 10.1142/S0219843608001303