Transcoding as a Compositional Paradigm

The Association of Compositional Parameters and Computer Analysis of Moving Images in Outer Space


  • Javier Elipe-Gimeno Aix-Marseille University, CNRS, PRISM, Marseille, France
  • Charles de Paiva Santana Aix-Marseille University, CNRS, PRISM, Marseille, France



algorithmic music, musical composition, experimental film, video analysis, Max/MSP, orchestration


This paper focuses on one of the author’s compositions, Outer Space, conceived using transcoding techniques between musical and visual parameters, such as the relative percentage of black and white dots per frame and the difference between the position of the dots from one frame to another.


Download data is not yet available.



Berry, David M. “The Computational Turn: Thinking About the Digital Humanities.” Culture Machine 12 (2011): 1–22.

Bonnet, Antoine. “Ecriture and Perception: On Messagesquisse by Pierre Boulez.” Contemporary Music Review 2, no. 1 (1987): 173–209. DOI:

Buelow, George J., and Hans Joachim Marx. New Mattheson Studies. Cambridge University Press, 2007.

Carpenter, Grégoire, Victor Cordero, and Éric Daubresse. “Cartographier le timbre.” Dissonance 119 (2012): 48–63. Accessed June 2022.

Davis, Hannah, and Saif Mohammad. “Generating Music from Literature.” Paper presented at Proceedings of the 3rd Workshop on Computational Linguistics for Literature (CLFL 2014), Gotheburg, Sweden, April 27, 2014, 1–10. DOI:10.3115/v1/W14-0901. DOI:

Edmonds, Ernest, Andrew Martin, and Sandra Pauletto. “Audio-Visual Interfaces in Digital Art.” Paper presented at Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE 2004), Singapore, 331–336. DOI:10.1145/1067343.1067392. DOI:

Elipe, Javier-Gimeno. “Outer Space.” Unpublished edition. Paris, 2019.

Gall, Marina, and Nick Breeze. “Music Composition Lessons: The Multimodal Affordances of Technology.” Educational Review 57, no. 4 (2005): 415–433. DOI:

Good, Michael. “MusicXML for Notation and Analysis.” In The Virtual Score: Representation, Retrieval, Restoration, edited by Walter B. Hewlett and Eleanor Selfridge-Field, 113–124. Cambridge, MA: Mit Press, 2001.

Huron, David. “Humdrum and Kern: Selective Feature Encoding.” In Beyond MIDI: The Handbook of Musical Codes, 375–401. Cambridge, Ma: MIT Press, 1997.

Huron, David. “Music Information Processing Using the Humdrum Toolkit: Concepts, Examples, and Lessons.” Computer Music Journal 26, no. 2 (2002): 11–26. DOI:

Jacob, Bruce L. “Algorithmic Composition as a Model of Creativity.” Organized Sound 1, no. 3 (1996): 157–165. DOI: 10.1017/S1355771896000222. DOI:

Kirchmeyer, Helmut. “On the Historical Constitution of a Rationalistic Music.” Die Reihe 8 (1968): 11–24.

Lemi, Esther, Anastasia Georgaki, and James Whitney. “Reviewing the Transformation of Sound to Image in New Computer Music Software.” Paper presented at Proceedings of the 4th Sound and Music Computing Conference (SMC 2007). DOI:10.5281/zenodo.849384.

Levine, Matthew. “Controlled Chaos: The Cinematic Unconscious of Peter Tscherkassky.” Found Footage Magazine 4 (2018).

Little, David. “Composing With Chaos: Applications of a New Science for Music.” Journal of New Music Research 22, no. 1 (1993): 23–51. DOI:

Lockwood, Lewis. “Soggetto cavato.” New Grove Dictionary of Music and Musicians, edited by Stanley Sadie. London: Macmillan, 1980. 17: 442–443.

López-Ortega, Omar, and Shani Ioana López-Popa. “Fractals, Fuzzy Logic and Expert Systems to Assist in the Construction of Musical Pieces.” Expert Systems with Applications 39, no. 15 (2012): 11911–11923. DOI:

Macleod, Catriona. Elective Affinities: Testing Word and Image Relationships. Amsterdam: Rodopi, 2009.

Mattheson, Johann. Der vollkommene Capellmeister, edited by Friederike Ramm. Bärenreiter-Verlag, 1999.

Miranda, Eduardo. Composing music with computers. London: Routledge, 2001. DOI:

Müller, Meinard, Verena Konz, Michael Clausen, Sebastian Ewert, and Christian Fremerey. “A Multimodal Way of Experiencing and Exploring Music.” Interdisciplinary Science Reviews 35, no. 2 (2010): 138–153. DOI:

Nierhaus, Gerhard. Algorithmic Composition: Paradigms of Automated Music Generation. Berlin: Springer Science & Business Media, 2009. DOI:

Palisca, Claude V., ed. Hucbald, Guido, and John on Music: Three Medieval Treatises. New Haven: Yale University Press, 1977.

Parra, Hèctor. Pour une approche créatrice des interrelations structurelles entre les espaces acoustiques et visuels. Mémoire de DEA, Université Paris 8 Vincennes – Saint Denis, 2005.

Polo, Antonio, and Xavier Sevillano. “Musical Vision: An Interactive Bio-Inspired Sonification Tool to Convert Images into Music.” Journal on Multimodal User Interfaces 13, no. 3 (2019): 231–243. DOI:

Ribas, Luísa. “Sound and Image Relations: A History of Convergence and Divergence.” Divergence Press 1, no. 2 (2014). DOI:

Roland, Perry. “The Music Encoding Initiative (MEI).” Paper presented at MAX2002: Proceedings of the First International Conference on Musical Applications Using XML, 55–59.

Rosenbaum, Jonathan. “Lost Material and Found Footage: Peter Tscherkassky’s Dark Room – and Ours.” Found Footage 4 (2018). Published also at

Schedel, Margaret. “Colour Is the Keyboard: Case Studies in Transcoding Visual to Sonic.” The Oxford Handbook of Algorithmic Music, edited by Roger T. Dean and Alex McLean. Oxford Handbooks Online. Oxford: Oxford University Press, 2018. DOI:/10.1093/oxfordhb/9780190226992.013.8. DOI:

Shenton, Andrew. Olivier Messiaen’s System of Signs: Notes Towards Understanding His Music. London: Taylor & Francis, 2017. DOI:

Stone, Kurt. “Reviews of Records: Xenakis: Metastaseis (1953–54); Pithoprakta (1955–56); Eonta for Piano, Two Trumpets, and Three Trombones (1963–64).” The Musical Quarterly 54, no. 3 (1968): 387–395. DOI:/10.1093/mq/LIV.3.387. DOI:

Studemann, Frederick. “The Sounds of the Financial Crisis.” Interview with Julian Anderson. The Financial Times. Podcast Audio. December 21, 2010.

“What is Max?” Cycling ’74. Accessed November 19, 2022.

Wiggins, Geraint A. “Computer Representation of Music in the Research Environment.” In Modern Methods for Musicology: Prospects, Proposals, and Realities, edited by Tim Crawford and Lorna Gibson, 27–42. London: Routledge, 2016. DOI:

Wöllner, Clemens. Body, Sound and Space in Music and Beyond: Multimodal Explorations. 1st Edition. London: Routledge, 2018. DOI:



“Cinémas de traverse (excerpt): Peter Tscherkassky Interview.” YouTube video, 0:40. May 26, 2015. Accessed November 19, 2022.

Dream Work, Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.

Outer Space, Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.

“Peter Tscherkassky – Outer Space.” Vimeo Video, 9:22. January 30, 2019. In Index 8: Films From a Dark Room. DVD. Directed by Peter Tscherkassky. Vienna: Index Edition, 2006.

The Entity. DVD. Directed by Sidney J. Furie. Los Angeles: Twentieth Century Fox, 1982.




How to Cite

Elipe-Gimeno, J., & Paiva Santana, C. de. (2022). Transcoding as a Compositional Paradigm: The Association of Compositional Parameters and Computer Analysis of Moving Images in Outer Space. Musicological Annual, 58(2), 155–174.




Most read articles by the same author(s)