Harnessing Audio in Auto Control: The Challenge of Sonifying Virtual Objects for Gesture Control of Cars

作者: Benjamin Bressolette , Sebastien Denjean , Vincent Roussarie , Mitsuko Aramaki , Solvi Ystad

DOI: 10.1109/MCE.2017.2721678

关键词:

摘要: This article presents a gesture sonification system for blind interface manipulation based on interaction with virtual object (VO). Commands are given through gestures, and sounds carry the feedback how VO was affected. The sound allows user to manipulate without vision. Here, we chose focus swipe gesture. In first part of article, study different curves that relate parameters create most natural association between two.

参考文章(24)
Vietminh Paz-Villagrán, Céline Petroz, Richard Kronland-Martinet, Etienne Thoret, Mitsuko Aramaki, Charles Gondre, Annabelle Capel, Jérémy Danna, Jean-Luc Velay, Solvi Ystad, Handwriting Movement Sonification for the Rehabilitation of Dysgraphia 10th International Symposium on Computer Music Multidisciplinary Research (CMMR) - Sound, Music & Motion - 15 - 18 oct. 2013 - Marseille, France. pp. 200- 208 ,(2013)
Mmj Mark Houben, The sound of rolling objects : perception of size and speed Technische Universiteit Eindhoven. ,(2002) , 10.6100/IR556897
James W. Beauchamp, Synthesis by Spectral Amplitude and "Brightness" Matching of Analyzed Musical Instrument Tones Journal of The Audio Engineering Society. ,vol. 30, pp. 396- 406 ,(1981)
Stephen Mcadams, Recognition of sound sources and events Oxford University Press. pp. 146- 198 ,(1993) , 10.1093/ACPROF:OSO/9780198522577.003.0006
Jack M. Loomis, Reginald G. Golledge, Roberta L. Klatzky, Navigation System for the Blind: Auditory Display Modes and Guidance Presence: Teleoperators & Virtual Environments. ,vol. 7, pp. 193- 203 ,(1998) , 10.1162/105474698565677
Grega Jakus, Christina Dicke, Jaka Sodnik, A user study of auditory, head-up and multi-modal displays in vehicles. Applied Ergonomics. ,vol. 46, pp. 184- 192 ,(2015) , 10.1016/J.APERGO.2014.08.008
Jérémy Danna, Maureen Fontaine, Vietminh Paz-Villagrán, Charles Gondre, Etienne Thoret, Mitsuko Aramaki, Richard Kronland-Martinet, Sølvi Ystad, Jean-Luc Velay, The effect of real-time auditory feedback on learning new characters Human Movement Science. ,vol. 43, pp. 216- 228 ,(2015) , 10.1016/J.HUMOV.2014.12.002
Matthias Rath, Robert Schleicher, On the Relevance of Auditory Feedback for Quality of Control in a Balancing Task Acta Acustica United With Acustica. ,vol. 94, pp. 12- 20 ,(2008) , 10.3813/AAA.918003