Towards an Audio-Locative Mobile Application for Immersive Storytelling

作者: Reinis Indans , Eva Hauthal , Dirk Burghardt

DOI: 10.1007/S42489-019-00007-1

关键词:

摘要: We live in an age which digital media is omnipresent and augmented reality beginning to find its way into our everyday lives, GPS allows us determine position with meter precision the sensor capabilities of smartphones are increasing. All these technologies combination enable explore one oldest human art forms a new way: storytelling. The presented work aims at developing approaches that combine different elements audio playback, geolocation other allow creation immersive geolocated narratives within mobile application. Thus, narrative can be precisely adjusted specific spatial temporal context user. One main goals such would influence cognitive processing users. As visual perception location stays same while using app, it only auditory cognition causes subtle enhancement thus alteration could result very strong sense immersion. There many location-based applications on market. Most them intended for tourism form tour guide. Some those have been analyzed before own ideas how intertwine sound, space time application storytelling semi-linear structures including map. Possible features influenceability by, e.g., speed or approach direction user, sound movement over predetermined routes, etc. first prototype implemented some audiovisual presentations among others.

参考文章(31)
Barbaros Bostan, Tim Marsh, The 'interactive' of interactive storytelling: customizing the gaming experience international conference on entertainment computing. pp. 472- 475 ,(2010) , 10.1007/978-3-642-15399-0_63
Niklas Röber, Cornelius Huber, Knut Hartmann, Matthias Feustel, Maic Masuch, Interactive audiobooks: combining narratives with game elements Lecture Notes in Computer Science. pp. 358- 369 ,(2006) , 10.1007/11944577_36
Lars Nyre, designing the Amplifon: A Locative sound Medium to supplement dAB radio The Journal of Media Innovations. ,vol. 2, pp. 58- 73 ,(2015) , 10.5617/JMI.V2I2.985
Sébastien Caquard, William Cartwright, Narrative Cartography: From Mapping Stories to the Narrative of Maps and Mapping Cartographic Journal. ,vol. 51, pp. 101- 106 ,(2014) , 10.1179/0008704114Z.000000000130
REGINALD G. GOLLEDGE, ROBERTA L. KLATZKY, JACK M. LOOMIS, JON SPEIGLE, JEROME TIETZ, A geographical information system for a GPS based personal guidance system International Journal of Geographical Information Science. ,vol. 12, pp. 727- 749 ,(1998) , 10.1080/136588198241635
M. F. Dahlstrom, Using narratives and storytelling to communicate science with nonexpert audiences Proceedings of the National Academy of Sciences of the United States of America. ,vol. 111, pp. 13614- 13620 ,(2014) , 10.1073/PNAS.1320645111
N. Helyer, F. Veronesi, Artful Media: The Sonic Nomadic: Exploring Mobile Surround-Sound Interactions IEEE MultiMedia. ,vol. 16, pp. 12- 15 ,(2009) , 10.1109/MMUL.2009.38
Adriana de Souza e Silva, From Cyber to Hybrid Mobile Technologies as Interfaces of Hybrid Spaces Space and Culture. ,vol. 9, pp. 261- 278 ,(2006) , 10.1177/1206331206289022
A. -L. Kornfeld, J. Schiewe, J. Dykes, Audio Cartography: Visual Encoding of Acoustic Parameters Springer, Berlin, Heidelberg. pp. 13- 31 ,(2011) , 10.1007/978-3-642-19143-5_2