Transcoding as a Compositional Paradigm

The Association of Compositional Parameters and Computer Analysis of Moving Images in Outer Space

Authors

  • Javier Elipe-Gimeno Aix-Marseille University, CNRS, PRISM, Marseille, France
  • Charles de Paiva Santana Aix-Marseille University, CNRS, PRISM, Marseille, France

DOI:

https://doi.org/10.4312/mz.58.2.155-174

Keywords:

algorithmic music, musical composition, experimental film, video analysis, Max/MSP, orchestration

Abstract

This paper focuses on one of the author’s compositions, Outer Space, conceived using transcoding techniques between musical and visual parameters, such as the relative percentage of black and white dots per frame and the difference between the position of the dots from one frame to another.

Downloads

Download data is not yet available.

References

References

Berry, David M. “The Computational Turn: Thinking About the Digital Humanities.” Culture Machine 12 (2011): 1–22.

Bonnet, Antoine. “Ecriture and Perception: On Messagesquisse by Pierre Boulez.” Contemporary Music Review 2, no. 1 (1987): 173–209. DOI: https://doi.org/10.1080/07494468708567058

Buelow, George J., and Hans Joachim Marx. New Mattheson Studies. Cambridge University Press, 2007.

Carpenter, Grégoire, Victor Cordero, and Éric Daubresse. “Cartographier le timbre.” Dissonance 119 (2012): 48–63. Accessed June 2022. https://www.dissonance.ch/upload/pdf/diss119web_hb_daubresse_exemples.pdf.

Davis, Hannah, and Saif Mohammad. “Generating Music from Literature.” Paper presented at Proceedings of the 3rd Workshop on Computational Linguistics for Literature (CLFL 2014), Gotheburg, Sweden, April 27, 2014, 1–10. DOI:10.3115/v1/W14-0901. DOI: https://doi.org/10.3115/v1/W14-0901

Edmonds, Ernest, Andrew Martin, and Sandra Pauletto. “Audio-Visual Interfaces in Digital Art.” Paper presented at Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE 2004), Singapore, 331–336. DOI:10.1145/1067343.1067392. DOI: https://doi.org/10.1145/1067343.1067392

Elipe, Javier-Gimeno. “Outer Space.” Unpublished edition. Paris, 2019.

Gall, Marina, and Nick Breeze. “Music Composition Lessons: The Multimodal Affordances of Technology.” Educational Review 57, no. 4 (2005): 415–433. DOI: https://doi.org/10.1080/00131910500278314

Good, Michael. “MusicXML for Notation and Analysis.” In The Virtual Score: Representation, Retrieval, Restoration, edited by Walter B. Hewlett and Eleanor Selfridge-Field, 113–124. Cambridge, MA: Mit Press, 2001.

Huron, David. “Humdrum and Kern: Selective Feature Encoding.” In Beyond MIDI: The Handbook of Musical Codes, 375–401. Cambridge, Ma: MIT Press, 1997.

Huron, David. “Music Information Processing Using the Humdrum Toolkit: Concepts, Examples, and Lessons.” Computer Music Journal 26, no. 2 (2002): 11–26. DOI: https://doi.org/10.1162/014892602760137158

Jacob, Bruce L. “Algorithmic Composition as a Model of Creativity.” Organized Sound 1, no. 3 (1996): 157–165. DOI: 10.1017/S1355771896000222. DOI: https://doi.org/10.1017/S1355771896000222

Kirchmeyer, Helmut. “On the Historical Constitution of a Rationalistic Music.” Die Reihe 8 (1968): 11–24.

Lemi, Esther, Anastasia Georgaki, and James Whitney. “Reviewing the Transformation of Sound to Image in New Computer Music Software.” Paper presented at Proceedings of the 4th Sound and Music Computing Conference (SMC 2007). DOI:10.5281/zenodo.849384.

Levine, Matthew. “Controlled Chaos: The Cinematic Unconscious of Peter Tscherkassky.” Found Footage Magazine 4 (2018).

Little, David. “Composing With Chaos: Applications of a New Science for Music.” Journal of New Music Research 22, no. 1 (1993): 23–51. DOI: https://doi.org/10.1080/09298219308570617

Lockwood, Lewis. “Soggetto cavato.” New Grove Dictionary of Music and Musicians, edited by Stanley Sadie. London: Macmillan, 1980. 17: 442–443.

López-Ortega, Omar, and Shani Ioana López-Popa. “Fractals, Fuzzy Logic and Expert Systems to Assist in the Construction of Musical Pieces.” Expert Systems with Applications 39, no. 15 (2012): 11911–11923. DOI: https://doi.org/10.1016/j.eswa.2012.02.089

Macleod, Catriona. Elective Affinities: Testing Word and Image Relationships. Amsterdam: Rodopi, 2009.

Mattheson, Johann. Der vollkommene Capellmeister, edited by Friederike Ramm. Bärenreiter-Verlag, 1999.

Miranda, Eduardo. Composing music with computers. London: Routledge, 2001. DOI: https://doi.org/10.4324/9780080502403

Müller, Meinard, Verena Konz, Michael Clausen, Sebastian Ewert, and Christian Fremerey. “A Multimodal Way of Experiencing and Exploring Music.” Interdisciplinary Science Reviews 35, no. 2 (2010): 138–153. DOI: https://doi.org/10.1179/030801810X12723585301110

Nierhaus, Gerhard. Algorithmic Composition: Paradigms of Automated Music Generation. Berlin: Springer Science & Business Media, 2009. DOI: https://doi.org/10.1007/978-3-211-75540-2

Palisca, Claude V., ed. Hucbald, Guido, and John on Music: Three Medieval Treatises. New Haven: Yale University Press, 1977.

Parra, Hèctor. Pour une approche créatrice des interrelations structurelles entre les espaces acoustiques et visuels. Mémoire de DEA, Université Paris 8 Vincennes – Saint Denis, 2005.

Polo, Antonio, and Xavier Sevillano. “Musical Vision: An Interactive Bio-Inspired Sonification Tool to Convert Images into Music.” Journal on Multimodal User Interfaces 13, no. 3 (2019): 231–243. DOI: https://doi.org/10.1007/s12193-018-0280-4

Ribas, Luísa. “Sound and Image Relations: A History of Convergence and Divergence.” Divergence Press 1, no. 2 (2014). DOI: https://doi.org/10.5920/divp.2014.22

Roland, Perry. “The Music Encoding Initiative (MEI).” Paper presented at MAX2002: Proceedings of the First International Conference on Musical Applications Using XML, 55–59. http://xml.coverpages.org/MAX2002-PRoland.pdf.

Rosenbaum, Jonathan. “Lost Material and Found Footage: Peter Tscherkassky’s Dark Room – and Ours.” Found Footage 4 (2018). Published also at https://jonathanrosenbaum.net/2021/08/lost-material-and-found-footage-peter-tscherkasskys-dark-room-and-ours-tk/.

Schedel, Margaret. “Colour Is the Keyboard: Case Studies in Transcoding Visual to Sonic.” The Oxford Handbook of Algorithmic Music, edited by Roger T. Dean and Alex McLean. Oxford Handbooks Online. Oxford: Oxford University Press, 2018. DOI:/10.1093/oxfordhb/9780190226992.013.8. DOI: https://doi.org/10.1093/oxfordhb/9780190226992.013.8

Shenton, Andrew. Olivier Messiaen’s System of Signs: Notes Towards Understanding His Music. London: Taylor & Francis, 2017. DOI: https://doi.org/10.4324/9781315090368

Stone, Kurt. “Reviews of Records: Xenakis: Metastaseis (1953–54); Pithoprakta (1955–56); Eonta for Piano, Two Trumpets, and Three Trombones (1963–64).” The Musical Quarterly 54, no. 3 (1968): 387–395. DOI:/10.1093/mq/LIV.3.387. DOI: https://doi.org/10.1093/mq/LIV.3.387

Studemann, Frederick. “The Sounds of the Financial Crisis.” Interview with Julian Anderson. The Financial Times. Podcast Audio. December 21, 2010. https://www.ft.com/content/56f5a76f-bca1-4312-b234-0aebbea3eb19.

“What is Max?” Cycling ’74. Accessed November 19, 2022. https://cycling74.com/products/max.

Wiggins, Geraint A. “Computer Representation of Music in the Research Environment.” In Modern Methods for Musicology: Prospects, Proposals, and Realities, edited by Tim Crawford and Lorna Gibson, 27–42. London: Routledge, 2016. DOI: https://doi.org/10.4324/9781315595894-12

Wöllner, Clemens. Body, Sound and Space in Music and Beyond: Multimodal Explorations. 1st Edition. London: Routledge, 2018. DOI: https://doi.org/10.4324/9781315569628-1

*****

Videography

“Cinémas de traverse (excerpt): Peter Tscherkassky Interview.” YouTube video, 0:40. May 26, 2015. Accessed November 19, 2022. https://www.youtube.com/watch?v=aitaaM-ZmHU.

Dream Work, Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.

Outer Space, Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.

“Peter Tscherkassky – Outer Space.” Vimeo Video, 9:22. January 30, 2019. In Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006. https://vimeo.com/314251447.

The Entity. DVD. Directed by Sidney J. Furie. Los Angeles: Twentieth Century Fox, 1982.

Downloads

Published

27. 12. 2022

Issue

Section

Articles

How to Cite

Elipe-Gimeno, J., & Paiva Santana, C. de. (2022). Transcoding as a Compositional Paradigm: The Association of Compositional Parameters and Computer Analysis of Moving Images in Outer Space. Musicological Annual, 58(2), 155-174. https://doi.org/10.4312/mz.58.2.155-174

Most read articles by the same author(s)