This project aims at finding solutions for the semantic gap between music experience and digital encoding of music. To close this gap, this project aims at investigating how the human body can be given a technological extension so taht fluent activities in music production and music information retrieval become possible. The focus is on subjective-oriente approaches (such as multi-modality, cultural/social contexts, subjective factors) that are complementary to the objective-oriented appoaches (such as feature extraction, and bottom-up classification). Via concrete applications, this project aims at developing an empirical support for the musical communciation theory that is based on the concept of embodied music cognition.