Hostname: page-component-848d4c4894-pftt2 Total loading time: 0 Render date: 2024-05-04T13:28:52.813Z Has data issue: false hasContentIssue false
  • English
  • Français

Instrumental Listening: sonic gesture as design principle

Published online by Cambridge University Press:  29 June 2009

Doug Van Nort
Doug Van Nort*
Affiliation:
Department of Music Research, McGill University, Montreal, QC, CANADA
*
E-mail: doug@music.mcgill.ca
Get access Rights & Permissions [Opens in a new window]

Abstract

In the majority of discussions surrounding the design of digital instruments and real-time performance systems, notions such as control and mapping are seen from a classical systems point of view: the former is often seen as a variable from an input device or perhaps some driving signal, while the latter is considered as the liaison between input and output parameters. At the same time there is a large body of research regarding gesture in performance that is concerned with the expressive and communicative nature of musical performance. While these views are certainly central to a conceptual understanding of ‘instrument’, it can be limiting to consider them a priori as the only proper model, and to mediate one’s conception of digital instrument design by fixed notions of control, mapping and gesture. As an example of an alternative way to view instrumental response, control structuring and mapping design, this paper discusses the concept of gesture from the point of view of the perception of human intentionality in sound and how one might consider this in interaction design.

Type
Articles
Information
Organised Sound , Volume 14 , Issue 2 , August 2009 , pp. 177 - 187
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Cadoz, C. Wanderley, M. M. 2000. Gesture-Music. In Marcelo M. Wanderley and Marc Battier (eds.) Trends in Gestural Control of Music. Paris: IRCAM – Centre Pompidou, 315–334.Google Scholar
Chadabe, J. 2004. Electronic Music and Life. Organised Sound 9(2): 3–6.Google Scholar
Chion, M. 1983. Guide des objets sonores. Paris: Buchet/Chastel/INA-GRM.Google Scholar
Choi, I. 2000. Gestural Primitives and the Context for Computational Processing in an Interactive Performance System. In Marcelo M. Wanderley and Marc Battier (eds.) Trends In Gestural Control of Music. Paris: IRCAM – Centre Pompidou.Google Scholar
Daniel, P. Weber, R. 1997. Psychoacoustical Roughness: Implementation of an Optimized Model. Acustica 83: 113–123.Google Scholar
Delalande, F. 1988. La gestique de Gould: Elements pour une sémiologie du geste musicale. In G. Guertin (ed.) Glenn Gould Pluriel. Quebec: Louise Courteau Editrice, 85–111.Google Scholar
Emmerson, S. (ed.) 1986. The Language of Electroacoustic Music. London: Palgrave Macmillan.Google Scholar
Flandrin, P., Rilling, G. Goncalves, P. 2004. Empirical Mode Decomposition as a Filter Bank. IEEE Signal Processing Letters 11: 112–114.Google Scholar
Gaver, W. 1993a. How do we Hear in the World? Explorations in Ecological Acoustics. Journal of Ecological Psychology 5(4): 285–313.CrossRefGoogle Scholar
Gaver, W. 1993b. What in the World do we Hear? An Ecological Approach to Auditory Event Perception. Journal of Ecological Psychology 5(1): 1–29.CrossRefGoogle Scholar
Giordano, B. McAdams, S. 2006. Material Identification of Real Impact Sounds: Effects of Size Variation in Steel, Glass, Wood, and Plexiglass Plates. Journal of the Acoustical Society of America 119(2): 1171–1181.CrossRefGoogle ScholarPubMed
Godoy, R. I. 2003. Motor-Mimetic Music Cognition. Leonardo 36(4): 317–319.CrossRefGoogle Scholar
Godoy, R. I. 2006. Gestural-Sonorous Objects: Embodied Extensions of Schaeffer’s Conceptual Apparatus. Organised Sound 11(2): 149–157.CrossRefGoogle Scholar
Godoy, R.I., Haga, E. Refsum-Jensenius, A. 2006a. Exploring Music-Related Gestures by Sound-Tracing – A Preliminary Study. 2nd ConGAS International Symposium on Gesture Interfaces for Multimedia Systems, Leeds, UK.Google Scholar
Godoy, R. I., Haga, E. Refsum-Jensenius, A. 2006b. Playing ‘Air Instruments’: Mimicry of Sound-Producing Gestures by Novices and Experts. In S. Gibet, N. Courty and J.-F. Kamp (eds.) Gesture in Human-Computer Interaction and Simulation: 6th International Gesture Workshop (GW 2005). Berlin, Heidelberg: Springer-Verlag, 256–267.CrossRefGoogle Scholar
Gygi, B. 2001. Factors in the Identification of Environmental Sound. PhD thesis, Indiana University.Google Scholar
Hatten, R. S. 2004. Interpreting Musical Gestures, Topics, and Tropes: Mozart, Beethoven, Schubert. Bloomington: Indiana University Press.Google Scholar
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C. Liu, H. H. 1998. The Empirical Mode Decomposition and the Hilbert Spectrum for Nonlinear and Non-Stationary Time Series Analysis. Proceedings: Mathematical, Physical and Engineering Sciences 454: 903–995.Google Scholar
Lakatos, S., McAdams, S. Causse, R. 1997. The Representation of Auditory Source Characteristics: Simple Geometric Form. Perception and Psychophysics 59(8): 1180–1190.CrossRefGoogle ScholarPubMed
Levitin, D., McAdams, S. Adams, R. L. 2002. Control Parameters for Musical Instruments: A Foundation for New Mappings of Gesture to Sound. Organised Sound 7(2): 171–189.Google Scholar
Liberman, A. Mattingly, I. 1985. The Motor Theory of Speech Perception Revised. Cognition 21: 1–36.Google Scholar
Paine, G. 2004. Gesture and Musical Interaction: Interactive Engagement Through Dynamic Morphology. Proceedings of the 2004 Conference on New Interfaces for Musical Expression (NIME), Hamamatsu, Japan, 80–6.Google Scholar
Schaeffer, P. 1966. Traité des cbjets musicaux: Essai interdisciplines. Paris: Éditions du Seuil.Google Scholar
Schaeffer, P. 1998. Solfège de l’objet sonore. Paris: INA/GRM.Google Scholar
Schnell, N. Battier, M. 2002. Introducing Composed Instruments, Technical and Musicological Implications. Proceedings of the 2002 Conference on New Interfaces for Musical Expression (NIME 02), Dublin, Ireland, 1–5.Google Scholar
Smalley, D. 1997. Spectromorphology: Explaining Sound-Shapes. Organised Sound 2(2): 107–126.Google Scholar
Strobl, G., Eckel, G. Rocchesso, D. 2006. Sound Texture Modeling: A Survey. Proceedings of the 2006 Sound and Music Computing (SMC) International Conference, Marseilles, France, 61–5.Google Scholar
Thoresen, L. 2007. Spectromorphological analysis of sound objects: an adaptation of Pierre Schaeffer’s typomorphology. Organised Sound 12(2): 129–141.CrossRefGoogle Scholar
Van Nort, D. 2007. Texture Modeling: Signal Models and Compositional Approaches. Proceedings of the 2007 Conference of the Society for Music Perception and Cognition (SMPC 07), Montreal, Canada, 71–2.Google Scholar
Van Nort, D. 2009. Modular and Adaptive Control of Sound Processing. PhD thesis, McGill University.Google Scholar
Wishart, T. 1994. Audible Design. York: Orpheus the Pantomime Ltd.Google Scholar
Wishart, T. 1996. On Sonic Art. Amsterdam: Harwood Academic Publishers.Google Scholar