Hostname: page-component-848d4c4894-75dct Total loading time: 0 Render date: 2024-05-06T09:10:24.728Z Has data issue: false hasContentIssue false
  • English
  • Français

Electroacoustic Music with Moving Images: the art of media pairing

Published online by Cambridge University Press:  11 March 2010

John Coulter
John Coulter*
Affiliation:
C/- School of Music, National Institute of Creative Arts and Industries, University of Auckland, 6 Symonds, Auckland, New Zealand
*
E-mail: j.coulter@auckland.ac.nz
Get access Rights & Permissions [Opens in a new window]

Abstract

Composers working with sounds and moving images are immediately confronted with a paradox. On one hand, audiovisual materials appear to offer the possibility of complementing one another – of forming a highly effective means of communicating artistic ideas – and on the other, they appear to carry the risk of detracting from one another – of deforming the musical language that he or she has worked so hard to create. Durk Talsma and Max Mathews succinctly state the opposing principles. ‘Many behavioural studies have provided evidence for the hypothesis that integrating visual and auditory stimuli serves the purpose of enhancing perceptual clarity … These results suggest that communication between the visual and auditory brain areas is a highly effective and relatively automatic process’ (Talsma, Doty and Waldorff 2007: 679). ‘I personally find most combined music-video art problematic. It seems to me that the sound and images often compete for my attention … If I pay attention to what I am seeing, I often miss what I am hearing, and if I try to concentrate on the music, the images can often be an irritating distraction…’ (Mathews 2007: 94). This article seeks to transcend this paradox through the identification of audiovisual materials that function in different ways. Examples of creative work are offered to illustrate more general points of ‘language’, a model for classifying media pairs is put forward, and practical methods of audiovisual composition are proposed. The narrow findings of the study offer a vocabulary for discussing the functionality of audiovisual materials, detailed methods of media pairing, and techniques of parametric alignment, while the wider findings extend to associated domains such as live electronic music, and hyper-instrument design.

Type
Articles
Information
Organised Sound , Volume 15 , Issue 1: Sonic imagery , April 2010 , pp. 26 - 34
Copyright
Copyright © Cambridge University Press 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Chion, M. 1994. Audio-Vision: Sound On Screen, ed. Claudia Gorbman. New York: Columbia University Press.Google Scholar
Cook, N. 1998. Analysing Musical Multimedia. New York: Oxford University Press.CrossRefGoogle Scholar
Coulter, J. 2007. The Language of Electroacoustic Music with Moving Images. Proceedings of the Electroacoustic Music Studies Network International Conference Series: EMS07 12–15 June 2007, De Montfort University, Leicester, UK. http://www.ems-network.org.Google Scholar
Emmerson, S. 2007. Seeing (or not Seeing) the Loudspeaker; Seeing (or not Seeing) the Music. In F. Barrière and C. Clozier (eds.) Relationships Between Audition and Vision in the Creation in Electroacoustic Music. Academie Internationale de Musique Electroacoustique/Bourges, Institut International de Musique Electroacoustique de Bourges/IMEB, Bourges cedex, France. Volume VIII (2004–05), 85–8.Google Scholar
Kröpfl, F. 2007. Integrating Sound and Visual Image as Artform. In Relationships Between Audition and Vision in the Creation in Electroacoustic Music. Academie Internationale de Musique Electroacoustique/Bourges, Institut International de Musique Electroacoustique de Bourges/IMEB, Bourges cedex, France. Volume VIII (2004–05), 89–90.Google Scholar
Landy, L. 2000. I Conduct Electricity. Video file. In L. Landy and E. Jamieson (eds.) Devising Dance and Music: I.D.Φ.X Idée Fixe Experimental Sound and Movement Theatre. Sunderland: University of Sunderland Press. http://www.mti.dmu.ac.uk/~llandy/dance.html, Intermezzo: key company ingredients (web link), Part2.mov, 17:30–19:50.Google Scholar
Landy, L. 2007. Understanding the Art of Sound Organization. Cambridge, MA: The MIT Press.CrossRefGoogle Scholar
Mathews, M. 2007. Music and Video Discussion in Relationships Between Audition and Vision in the Creation. In Relationships Between Audition and Vision in the Creation in Electroacoustic Music. Academie Internationale de Musique Electroacoustique/Bourges, Institut International de Musique Electroacoustique de Bourges/IMEB, Bourges cedex, France. Volume VIII (2004–05), 94–5.Google Scholar
OED 2009. The Oxford English Dictionary Online, 3rd edn (J. Simpson, Chief Editor). Retrieved December 2009 from http://dictionary.oed.com.Google Scholar
Riess Jones, M., Yee, W. 1993. Attending to Auditory Events: The Role of Temporal Organization. In Stephen McAdams (ed.) Thinking in Sound: The Cognitive Psychology of Human Audition. Oxford: Oxford University Press, pp. 69–112.CrossRefGoogle Scholar
Smalley, D. 1986. Spectro-morphology and Structuring Processes. In S. Emmerson (ed.) The Language of Electroacoustic Music. Basingstoke: Macmillan, pp. 61–93.CrossRefGoogle Scholar
Talsma, D., Doty, T., Waldorff, M. 2007. Selective Attention and Audiovisual Integration: Is Attending to Both Modalities a Prerequisite for Early Integration? Cerebral Cortex 17(3): 679–690.CrossRefGoogle ScholarPubMed
Supplementary material: File

Coulter movies

Coulter movies

Download Coulter movies(File)
File 98.9 MB