

Human–computer interaction and music
pp. 367-389
in: Rolf Bader (ed), Sound - perception - performance, Berlin, Springer, 2013Abstract
In this chapter, the use of advanced human computer interfaces to create innovative interaction paradigms for music applications (music creation, music manipulation, music games, etc.) is explored. The advances in the design and implementation of sensing technologies have provided the means to create new ways to interact with computers in a more natural way than the conventional computer framework with a mouse and a keyboard. More involving ans immersive experiences can be offered to the user than to these technologies. However, there is no silver bullet: each kind of sensing technology excels at some fields and lack others. Each application will demand its very own selection of sensors and the development of an adequate interaction metaphor. In this chapter, some of the most commonly used technologies for motion sensing are presented with as special focus on the possibilities of a 3D camera sensor (i.e. kinect) with regard to the design of human computer interfaces for musin interaction. We will present our findings in the studies we have conducted using these devices to develop augmented instruments. These include a drumkit stimulator or a virtual theremin. Additionally, the use of this type of interface for other music applications will be discussed. A description of the technical issues that need to be addressed to successfully implement these interaction paradigms is also given.