Physiosonic - movement sonification as auditory feedback

摘要: We detect human body movement interactively via a tracking system. This data is used to synthesize sound and transform files (music or text). A subject triggers controls parameters with his her within pre-set range of motion. The resulting acoustic feedback enhances new modalities perception the awareness movements. It ideal for application in physiotherapy other training contexts. sounds we use depend on context aesthetic preferences subject. On one hand, metaphorical are indicate leaving motion make unintended movements aware. material like music speech played as intuitive means motivating address humans. transformed order deviations from target movement. With this sonification approach, subjects perceive they have chosen themselves undistorted playback long perform task appropriately. Our main premises simple mapping common sense metaphors, that both enhance understanding