Transcoding as a Compositional Paradigm
The Association of Compositional Parameters and Computer Analysis of Moving Images in Outer Space
Keywords:algorithmic music, musical composition, experimental film, video analysis, Max/MSP, orchestration
This paper focuses on one of the author’s compositions, Outer Space, conceived using transcoding techniques between musical and visual parameters, such as the relative percentage of black and white dots per frame and the difference between the position of the dots from one frame to another.
Berry, David M. “The Computational Turn: Thinking About the Digital Humanities.” Culture Machine 12 (2011): 1–22.
Bonnet, Antoine. “Ecriture and Perception: On Messagesquisse by Pierre Boulez.” Contemporary Music Review 2, no. 1 (1987): 173–209. DOI: https://doi.org/10.1080/07494468708567058
Buelow, George J., and Hans Joachim Marx. New Mattheson Studies. Cambridge University Press, 2007.
Carpenter, Grégoire, Victor Cordero, and Éric Daubresse. “Cartographier le timbre.” Dissonance 119 (2012): 48–63. Accessed June 2022. https://www.dissonance.ch/upload/pdf/diss119web_hb_daubresse_exemples.pdf.
Davis, Hannah, and Saif Mohammad. “Generating Music from Literature.” Paper presented at Proceedings of the 3rd Workshop on Computational Linguistics for Literature (CLFL 2014), Gotheburg, Sweden, April 27, 2014, 1–10. DOI:10.3115/v1/W14-0901. DOI: https://doi.org/10.3115/v1/W14-0901
Edmonds, Ernest, Andrew Martin, and Sandra Pauletto. “Audio-Visual Interfaces in Digital Art.” Paper presented at Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE 2004), Singapore, 331–336. DOI:10.1145/1067343.1067392. DOI: https://doi.org/10.1145/1067343.1067392
Elipe, Javier-Gimeno. “Outer Space.” Unpublished edition. Paris, 2019.
Gall, Marina, and Nick Breeze. “Music Composition Lessons: The Multimodal Affordances of Technology.” Educational Review 57, no. 4 (2005): 415–433. DOI: https://doi.org/10.1080/00131910500278314
Good, Michael. “MusicXML for Notation and Analysis.” In The Virtual Score: Representation, Retrieval, Restoration, edited by Walter B. Hewlett and Eleanor Selfridge-Field, 113–124. Cambridge, MA: Mit Press, 2001.
Huron, David. “Humdrum and Kern: Selective Feature Encoding.” In Beyond MIDI: The Handbook of Musical Codes, 375–401. Cambridge, Ma: MIT Press, 1997.
Huron, David. “Music Information Processing Using the Humdrum Toolkit: Concepts, Examples, and Lessons.” Computer Music Journal 26, no. 2 (2002): 11–26. DOI: https://doi.org/10.1162/014892602760137158
Jacob, Bruce L. “Algorithmic Composition as a Model of Creativity.” Organized Sound 1, no. 3 (1996): 157–165. DOI: 10.1017/S1355771896000222. DOI: https://doi.org/10.1017/S1355771896000222
Kirchmeyer, Helmut. “On the Historical Constitution of a Rationalistic Music.” Die Reihe 8 (1968): 11–24.
Lemi, Esther, Anastasia Georgaki, and James Whitney. “Reviewing the Transformation of Sound to Image in New Computer Music Software.” Paper presented at Proceedings of the 4th Sound and Music Computing Conference (SMC 2007). DOI:10.5281/zenodo.849384.
Levine, Matthew. “Controlled Chaos: The Cinematic Unconscious of Peter Tscherkassky.” Found Footage Magazine 4 (2018).
Little, David. “Composing With Chaos: Applications of a New Science for Music.” Journal of New Music Research 22, no. 1 (1993): 23–51. DOI: https://doi.org/10.1080/09298219308570617
Lockwood, Lewis. “Soggetto cavato.” New Grove Dictionary of Music and Musicians, edited by Stanley Sadie. London: Macmillan, 1980. 17: 442–443.
López-Ortega, Omar, and Shani Ioana López-Popa. “Fractals, Fuzzy Logic and Expert Systems to Assist in the Construction of Musical Pieces.” Expert Systems with Applications 39, no. 15 (2012): 11911–11923. DOI: https://doi.org/10.1016/j.eswa.2012.02.089
Macleod, Catriona. Elective Affinities: Testing Word and Image Relationships. Amsterdam: Rodopi, 2009.
Mattheson, Johann. Der vollkommene Capellmeister, edited by Friederike Ramm. Bärenreiter-Verlag, 1999.
Miranda, Eduardo. Composing music with computers. London: Routledge, 2001. DOI: https://doi.org/10.4324/9780080502403
Müller, Meinard, Verena Konz, Michael Clausen, Sebastian Ewert, and Christian Fremerey. “A Multimodal Way of Experiencing and Exploring Music.” Interdisciplinary Science Reviews 35, no. 2 (2010): 138–153. DOI: https://doi.org/10.1179/030801810X12723585301110
Nierhaus, Gerhard. Algorithmic Composition: Paradigms of Automated Music Generation. Berlin: Springer Science & Business Media, 2009. DOI: https://doi.org/10.1007/978-3-211-75540-2
Palisca, Claude V., ed. Hucbald, Guido, and John on Music: Three Medieval Treatises. New Haven: Yale University Press, 1977.
Parra, Hèctor. Pour une approche créatrice des interrelations structurelles entre les espaces acoustiques et visuels. Mémoire de DEA, Université Paris 8 Vincennes – Saint Denis, 2005.
Polo, Antonio, and Xavier Sevillano. “Musical Vision: An Interactive Bio-Inspired Sonification Tool to Convert Images into Music.” Journal on Multimodal User Interfaces 13, no. 3 (2019): 231–243. DOI: https://doi.org/10.1007/s12193-018-0280-4
Ribas, Luísa. “Sound and Image Relations: A History of Convergence and Divergence.” Divergence Press 1, no. 2 (2014). DOI: https://doi.org/10.5920/divp.2014.22
Roland, Perry. “The Music Encoding Initiative (MEI).” Paper presented at MAX2002: Proceedings of the First International Conference on Musical Applications Using XML, 55–59. http://xml.coverpages.org/MAX2002-PRoland.pdf.
Rosenbaum, Jonathan. “Lost Material and Found Footage: Peter Tscherkassky’s Dark Room – and Ours.” Found Footage 4 (2018). Published also at https://jonathanrosenbaum.net/2021/08/lost-material-and-found-footage-peter-tscherkasskys-dark-room-and-ours-tk/.
Schedel, Margaret. “Colour Is the Keyboard: Case Studies in Transcoding Visual to Sonic.” The Oxford Handbook of Algorithmic Music, edited by Roger T. Dean and Alex McLean. Oxford Handbooks Online. Oxford: Oxford University Press, 2018. DOI:/10.1093/oxfordhb/9780190226992.013.8. DOI: https://doi.org/10.1093/oxfordhb/9780190226992.013.8
Shenton, Andrew. Olivier Messiaen’s System of Signs: Notes Towards Understanding His Music. London: Taylor & Francis, 2017. DOI: https://doi.org/10.4324/9781315090368
Stone, Kurt. “Reviews of Records: Xenakis: Metastaseis (1953–54); Pithoprakta (1955–56); Eonta for Piano, Two Trumpets, and Three Trombones (1963–64).” The Musical Quarterly 54, no. 3 (1968): 387–395. DOI:/10.1093/mq/LIV.3.387. DOI: https://doi.org/10.1093/mq/LIV.3.387
Studemann, Frederick. “The Sounds of the Financial Crisis.” Interview with Julian Anderson. The Financial Times. Podcast Audio. December 21, 2010. https://www.ft.com/content/56f5a76f-bca1-4312-b234-0aebbea3eb19.
“What is Max?” Cycling ’74. Accessed November 19, 2022. https://cycling74.com/products/max.
Wiggins, Geraint A. “Computer Representation of Music in the Research Environment.” In Modern Methods for Musicology: Prospects, Proposals, and Realities, edited by Tim Crawford and Lorna Gibson, 27–42. London: Routledge, 2016. DOI: https://doi.org/10.4324/9781315595894-12
Wöllner, Clemens. Body, Sound and Space in Music and Beyond: Multimodal Explorations. 1st Edition. London: Routledge, 2018. DOI: https://doi.org/10.4324/9781315569628-1
“Cinémas de traverse (excerpt): Peter Tscherkassky Interview.” YouTube video, 0:40. May 26, 2015. Accessed November 19, 2022. https://www.youtube.com/watch?v=aitaaM-ZmHU.
Dream Work, Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.
Outer Space, Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.
“Peter Tscherkassky – Outer Space.” Vimeo Video, 9:22. January 30, 2019. In Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006. https://vimeo.com/314251447.
The Entity. DVD. Directed by Sidney J. Furie. Los Angeles: Twentieth Century Fox, 1982.
How to Cite
Copyright (c) 2022 Javier Elipe-Gimeno, Charles de Paiva Santana
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors are confirming that they are the authors of the submitting article, which will be published (print and online) in journal Musicological Annual by Znanstvena založba Filozofske fakultete Univerze v Ljubljani (University of Ljubljana, Faculty of Arts, Aškerčeva 2, 1000 Ljubljana, Slovenia). Author’s name will be evident in the article in journal. All decisions regarding layout and distribution of the work are in hands of the publisher.
- Authors guarantee that the work is their own original creation and does not infringe any statutory or common-law copyright or any proprietary right of any third party. In case of claims by third parties, authors commit their self to defend the interests of the publisher, and shall cover any potential costs.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.