Direct Segmented Sonification of Characteristic Features of the Data Domain

作者: Paul Vickers , Robert Höldrich

DOI:

关键词:

摘要: Sonification and audification create auditory displays of datasets. Audification translates data points into digital audio samples the display's duration is determined by playback rate. Like audification, graphs maintain temporal relationships while using parameter mappings (typically data-to-frequency) to represent ordinate values. Such direct approaches have advantage presenting stream `as is' without imposed interpretations or accentuation particular features found in indirect approaches. However, datasets can often be subdivided short non-overlapping variable length segments that each encapsulate a discrete unit domain-specific significant information current cannot these. We present Direct Segmented (DSSon) for highlighting segments' distributions as individual sonic events. Using domain knowledge segment data, DSSon presents gestalts retaining overall regime dataset. The method's structural decoupling from sound stream's formation means speed independent event durations, thereby offering highly flexible time compression/stretching allow zooming out data. Demonstrated three models applied biomechanical high directness, letting `speak' themselves.

参考文章(7)
Paul Vickers, James L. Alty, Musical program auralization ACM Transactions on Applied Perception. ,vol. 2, pp. 477- 489 ,(2005) , 10.1145/1101530.1101546
Gaetan Parseihian, Charles Gondre, Mitsuko Aramaki, Solvi Ystad, Richard Kronland-Martinet, Comparison and Evaluation of Sonification Strategies for Guidance Tasks IEEE Transactions on Multimedia. ,vol. 18, pp. 674- 686 ,(2016) , 10.1109/TMM.2016.2531978
Pubudu Madhawa Silva, Thrasyvoulos N. Pappas, Joshua Atkins, James E. West, Perceiving Graphical and Pictorial Information via Hearing and Touch IEEE Transactions on Multimedia. ,vol. 18, pp. 2432- 2445 ,(2016) , 10.1109/TMM.2016.2601029
A. Winnard, D. Debuse, M. Wilkinson, L. Samson, T. Weber, Nick Caplan, Movement amplitude on the Functional Re-adaptive Exercise Device: deep spinal muscle activity and movement control European Journal of Applied Physiology. ,vol. 117, pp. 1597- 1606 ,(2017) , 10.1007/S00421-017-3648-3
Hessam Roodaki, Navid Navab, Abouzar Eslami, Christopher Stapleton, Nassir Navab, None, SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis IEEE Transactions on Visualization and Computer Graphics. ,vol. 23, pp. 2366- 2371 ,(2017) , 10.1109/TVCG.2017.2734327