Gesture Capture

Gesture capture has recently witnessed a considerable expansion as an area of technological research. In musical terms, the concept of gesture capture is a simple one that nevertheless has an enormous range of creative applications. Gesture capture may be used to refer to the tracking of the physical actions of a musical performer of an acoustic instrument (key movements, finger action, breath control and so on) or of an electronic instrument (where performance information may be mapped elsewhere to creative ends). Gesture capture may also be used to describe any system that analyses acoustic data to glean information concerning musical performance. In interactive works, the information 'captured' in such a process is mapped in such a way as to have an effect on some other aspect of the performance, for example the real-time processing or synthesis of other musical material. It may also be used to describe any system that tracks visual movements through optical means.

Gesture capture is not restricted to the physical actions of musicians. The gestures of dancers, for example, could be 'translated' to create or have an affect on electroacoustic music.

Capture de geste

Cette technique a récemment connu un développement considérable dans le domaine de la recherche technologique. Dans celui de la musique, le concept de capture de gestes est très simple, ce qui ne l'empêche pas d'avoir un champs d'application très vaste. Le terme désigne le suivi des actions physiques d'un musicien jouant d'un instrument acoustique (mouvement de clés, action des doigts, contrôle du souffle, etc.) ou électronique (cas dans lequel les informations de performance peuvent être utilisées pour des objectifs non créatifs). Le terme peut aussi être employé afin de décrire tout système qui analyse des données acoustiques afin de recueillir des informations concernant la performance musicale. Dans le cas des œuvres interactives, l'information ainsi captée au cours du processus peut avoir un effet sur un autre aspect de la performance, par exemple le traitement ou la synthèse en temps réel d'autres matériaux musicaux. Il peut aussi décrire un système permettant de suivre les mouvements visuels grâce à des techniques optiques.

Enfin, la capture de geste n'est pas restreinte aux actions physiques des musiciens. Par exemple, les gestes des danseurs peuvent être traduits afin de créer ou d'avoir un effet sur une musique électroacoustique.

Captazione gestuale

Questa tecnica ha conosciuto di recente un notevole sviluppo nel campo della ricerca tecnologica. In musica, il concetto di captazione gestuale è molto semplice, sebbene conosca un campo di applicazione estremamente vasto. Il termine designa l'intercettazione delle azioni fisiche che un musicista esegue mentre suona uno strumento acustico (movimento delle chiavi, azione delle dita, controllo del respiro, ecc.) o elettronico (in tal caso le informazioni della performance possono essere utilizzare per altri scopi creativi). Il termine può anche descrivere qualunque sistema di analisi dei dati acustici, utile per reperire informazioni sulla performance musicale. Nel caso delle opere interattive, l'informazione captata nel corso del processo di messa in atto può influire su un altro aspetto della performance, per esempio sul trattamento o la sintesi in tempo reale dei materiali musicali. Il termine può anche descrivere un sistema che permettere di seguire i movimenti visuali, grazie a sistemi ottici.

La captazione gestuale non è ristretta solamente alle azioni fisiche dei musicisti. Infatti anche la gestualità dei danzatori, per esempio, può esser ‘tradotta', in modo da generare o avere effetti sulla creazione di musica elettroacustica.

Gestenerfassung

Gesture capture has recently witnessed a considerable expansion as an area of technological research. In musical terms, the concept of gesture capture is a simple one that nevertheless has an enormous range of creative applications. Gesture capture may be used to refer to the tracking of the physical actions of a musical performer of an acoustic instrument (key movements, finger action, breath control and so on) or of an electronic instrument (where performance information may be mapped elsewhere to creative ends). Gesture capture may also be used to describe any system that analyses acoustic data to glean information concerning musical performance. In interactive works, the information 'captured' in such a process is mapped in such a way as to have an effect on some other aspect of the performance, for example the real-time processing or synthesis of other musical material. It may also be used to describe any system that tracks visual movements through optical means.

Gesture capture is not restricted to the physical actions of musicians. The gestures of dancers, for example, could be 'translated' to create or have an affect on electroacoustic music.

Captura de Gestos

La captura de gestos ha sido testigo, recientemente, de una considerable expansión como área de investigación tecnológica. En términos musicales, el concepto de la captura de gestos es simple pero sin embargo tiene un enorme rango de aplicaciones creativas. El término captura de gestos puede ser empleado en referencia al seguimiento de las acciones físicas de un intérprete musical con un instrumento acústico (movimientos de llaves, acciones de los dedos, control de la respiración, etc.) o de un instrumento electrónico (donde la información de la ejecución puede ser mapeada hacia algún otro sitio con fines creativos). Además, captura de gestos puede ser utilizado también en la descripción de cualquier sistema que analice datos acústicos para extraer información de una interpretación musical. En las obras interactivas, la información "capturada" durante el proceso es mapeada de tal forma que pueda causar un efecto sobre otro aspecto de la ejecución, por ejemplo, la síntesis o procesamiento en tiempo real de otro material musical. El término también puede ser empleado para describir a cualquier sistema de seguimiento de movimientos visuales por medios ópticos.

La Captura de Gestos no está restringida a las acciones físicas de los músicos. Los gestos de los bailarines, por ejemplo, podrían ser "traducidos" para crear o causar un efecto sobre la música electroacústica.

References

Allen J. A. (2004) Playing with Fire: An unexpected collaboration
Ashley R. (1991) Two Reponses
Battier M. (1999) L'approche gestuelle dans l'histoire de la lutherie électronique. Étude de cas : le theremin
Burtner M. (2005) Ecoacoustic and Shamanic Technologies for Multimedia Composition and Performance
Cadoz C. (1988) Instrumental Gesture and Musical Composition
Cadoz C. (1999) Musique, geste, technologie
Cerena C. (2000) Gesture Control of Musical Processes: A MAX environment for Buchla's ‘Lightning'
Essl G. (2003) On Gender in New Music Interface Technology
Hahn T., Bahn C. (2002) Pikapika - The collaborative composition of an interactive sonic character
Krefeld V. (1990) The Hand in the Web: An Interview with Michel Waisvisz
Landy L., Jamieson E., Ng K. (2003) In Transit or Realising One's Aesthetic when the Technology Finally Catches Up
Marrin T., Picard R. (1998) The “Conductors Jacket”: A Device for Recording Expressive Musical Gestures
Mulder A. (1996) Getting a Grip on Alternate Controllers: Addressing the Variability of Gestural Expression in Musical Instrument Design
Ng K. (2002) Sensing and Mapping for Interactive Performance
Nichols C. (2002) The vBow: A virtual violin bow controller for mapping gesture to synthesis with haptic feedback
Overholt D., Poepel C. (2006) Recent Developments in Violin-Related Digital Musical Instruments: Where Are We and Where Are We Going?
Paradiso J., Marrin T. (1997) The Digital Baton: A Versatile Performance Instrument
Pascal M. (1999) Le studio instrumental : les données d'une virtuosité à l'intérieur même du son
Rubine D., McAvinney P. (1990) Programmable Finger-tracking Instrument Controllers
Wilson-Bokowiec J., Bokowiec M. A. (2000) Lifting Bodies: Interactive dance - finding new methodologies in the motifs prompted by new technology - a critique and progress report with particular reference to the Bodycoder System