Introduction of Machine Translation into Audiovisual Translation Teaching

Silvana Orel Kos

doi:10.4312/elope.21.1.185-208

Authors

Silvana Orel Kos University of Ljubljana

DOI:

https://doi.org/10.4312/elope.21.1.185-208

Keywords:

subtitling, AVT teaching, machine translation, post-editing, multimodal awareness

Abstract

Subtitling has long been the primary type of audiovisual translation in Slovenia. A steady increase in the production of audiovisual content, including English-speaking movies and TV series, along with the development of machine translation, have seen a growing need and opportunity for subtitling globally. The Department of Translation Studies (University of Ljubljana) has offered courses in subtitling to MA students for over twenty years. In the course of this time, teaching methods have been adapted to embrace new technologies. Recently, students have shown interest in incorporating machine translation into the subtitling course. The paper presents an analysis of a subtitling assignment in which students were asked to post-edit DeepL’s Slovene translation of English formatted movie subtitles. The post-edited subtitles were compared with the subtitles done by a group of students from scratch. The results show considerable differences in the students’ multimodal awareness and the overall quality of the subtitles between the two groups.

Downloads

Download data is not yet available.

References

Agrawal, Milind, Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Claudia Borg, Marine Carpuat, et al. 2023. “Findings of the IWSLT 2023 evaluation campaign.” In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), edited by Elizabeth Salesky, Marcello Federico and Marine Carpuat, 1–61. Toronto, Canada: Association for Computational Linguistics. https://aclanthology.org/2023.iwslt-1.1.pdf.

Armstrong, Stephen, Andy Way, Colm Caffrey, Marian Flanagan, Dorothy Kenny, and Minako O’Hagan. 2006. “Improving the quality of automated DVD subtitles via example-based machine translation.” In Proceedings of Translating and the Computer 28, 1–13. London: Aslib. https://aclanthology.org/2006.tc-1.9.pdf.

Bywood, Lindsay, Panayota Georgakopoulou, and Thierry Etchegoyhen. 2017. “Embracing the threat: Machine translation as a solution for subtitling.” Perspectives 25 (3): 492–508. https://doi.org/10.1080/0907676X.2017.1291695.

Deryagin, Max, Miroslav Pošta, and Daniel Landes. 2021. AVTE Machine Translation Manifesto. Audiovisual Translators Europe. https://avteurope.eu/wp-content/uploads/2021/09/Machine-Translation-ManifestoENG.pdf.

Díaz Cintas, Jorge. 2005. “The ever-changing world of subtitling: Some major developments.” Research on Translation for Subtitling in Spain and Italy, edited by John D. Sanderson, 17–26. Universidad de Alicante. https://spiral.imperial.ac.uk/bitstream/10044/1/1401/1/Alicante_05.pdf.

Díaz Cintas, Jorge, and Aline Remael. 2007. Audiovisual Translation: Subtitling. Manchester: St. Jerome.

Díaz-Pérez, Francisco Javier. 2020. “Translating swear words from English into Galician in film subtitles. A corpus-based study.” Babel 66 (3): 393–419. https://doi.org/10.1075/babel.00162.dia.

Etchegoyhen, Thierry, Lindsay Bywood, Mark Fishel, Panayota Georgakopoulou, Jie Jiang, Gerard van Loenhout, Arantza del Pozo, et al. 2014. “Machine translation for subtitling: A large-scale evaluation.” In Proceedings of the Ninth International Conference on Language Resources and Evaluation LREC'14, May 2014, edited by Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, et al., 46–53. Reykjavik, Iceland. http://www.lrec-conf.org/proceedings/lrec2014/pdf/463_Paper.pdf.

European Commission. 2008. “Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions: Multilingualism: an asset for Europe and a shared commitment.” September 18, 2008. https://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=COM:2008:0566:FIN:EN:PDF.

—. 2010. “Directive 2010/13/EU of the European Parliament and of the Council.” March 10, 2010. https://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:095:0001:0024:en:PDF.

—. 2018. “Directive (EU) 2018/1808 of the European Parliament and of the Council.” November 14, 2018. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32018L1808.

Europeana. “Europeana Subtitled AI pipeline and training suite.” Accessed April 20, 2024. https://pro.europeana.eu/page/europeana-subtitled-ai-pipeline-and-training-suite.

Georgakopoulou, Panayota. 2012. “Challenges for the Audiovisual industry in the digital age: The everchanging needs of subtitle production.” The Journal of Specialised Translation 17: 78–103.

Gottlieb, Henrik. 1992. “Subtitling – A new university discipline.” In Teaching Translation and Interpreting: Training, Talent and Experience. Papers from the First Language International Conference, Elsinore, Denmark 31 May-2 June 1991, edited by Cay Dollerup, and Anne Loddegaard, 161–70. Amsterdam: John Benjamins Publishing.

Kammerevert, Petra. 2023. “REPORT on the Implementation of the Revised Audiovisual Media Services Directive (2022/2038(INI)).” European Parliament, Committee on Culture and Education. April 12, 2023. https://www.europarl.europa.eu/doceo/document/A-9-2023-0139_EN.pdf.

Karakanta, Alina, Luisa Bentivogli, Mauro Cettolo, Matteo Negri, and Marco Turchi. 2022. “Post-editing in automatic subtitling: A subtitlers’ perspective.” In Proceedings of EAMT-Translators’ Track, 1–3 June 2022, edited by Helena Moniz, Lieve Macken, Andrew Rufener, Loïc Barrault, Marta R. Costa-jussà, Christophe Declercq, Maarit Koponen, et al., 261–70. Ghent. https://aclanthology.org/2022.eamt-1.29.pdf.

Koletnik Korošec, Melita. 2011. “Applicability and challenges of using machine translation in translator training.” ELOPE: English Language Overseas Perspectives and Enquiries 8 (2): 7–18. https://doi.org/10.4312/elope.8.2.7-18.

Mattsson, Jenny. 2006. “Linguistic variation in subtitling: The subtitling of swearwords and discourse markers on public television, commercial television and DVD.” In MuTra 2006 – Audiovisual Translation Scenarios: Conference Proceedings, edited by Mary Carroll, Heidrun Gerzymisch-Arbogast, and Sandra Nauert. 47–56. Copenhagen. http://www.euroconferences.info/proceedings/2006_Proceedings/2006_Mattsson_Jenny.pdf.

Media Consulting Group. 2011. “Study on the use of subtitling. The potential of subtitling to encourage foreign language learning and improve the mastery of foreign languages. EACEA/2009/01.” European Commission, Directorate-General Education and Culture. June, 2011. http://publications.europa.eu/resource/cellar/e4d5cbf4-a839-4a8a-81d0-7b19a22cc5ce.0003.01/DOC_1.

Mezeg, Adriana. 2023. “Ali sploh še potrebujemo prevajalce?” Ars et humanitas 17 (1): 139–54. https://doi.org/10.4312/ars.17.1.139-154.

Mohar, Tjaša, Sara Orthaber, and Tomaž Onič. 2020. “Machine translated Atwood: Utopia or dystopia?” ELOPE: English Language Overseas Perspectives and Enquiries 17 (1): 125–41. https://doi.org/10.4312/elope.17.1.125-141.

Petukhova, Volha, Rodrigo Agerri, Mark Fishel, Sergio Penkale, Arantza del Pozo, Mirjam Sepesy Maučec, Andy Way, et al. 2012. “SUMAT: Data collection and parallel corpus compilation for machine translation of subtitles.” In Published Scientific Conference Contribution, 21–28. http://www.lrecconf.org/proceedings/lrec2012/pdf/154_Paper.pdf.

Poibeau, Thierry. 2022. “On ‘Human Parity’ and ‘Super Human Performance’ in machine translation evaluation.” In Proceedings of the Thirteenth Language Resources and Evaluation Conference, edited by Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, et al., 6018–23. Marseille, France: European Language Resources Association. https://aclanthology.org/2022.lrec-1.647.

—. 2023. “How machine translation changed the translation industry.” The Responsible AI Forum, TUM, Sep 2023, Munich (Allemagne), Germany. https://hal.science/hal-04242026.

Popowich, Fred, Paul McFetridge, Davide Turcato, and Janine Toole. 2000. “Machine translation of closed captions.” Machine Translation 15: 311–41. https://www.jstor.org/stable/20060451.

Reiner, Rob, dir. 2014. And So It Goes. Škofljica: Blitz Film & Video Distribution. DVD.

Sepesy Maučec, Mirjam, Marko Presker, Danilo Zimšek, Matej Rojc, Damjan Vlaj, Darinka Verdonik, and Zdravko Kačič. 2012. “Izdelava slovensko-srbskega vzporednega korpusa podnapisov za razvoj strojnega prevajanja v projektu SUMAT.” In Zbornik Osme konference Jezikovne tehnologije, 8. do 12. oktober 2012, [Ljubljana, Slovenia] = Proceedings of the Eighth Language Technologies Conference, October 8th-12th, 2012, Ljubljana, Slovenia: zbornik 15. mednarodne multikonference Informacijska družba - IS 2012, zvezek C; proceedings of the 15th International Multiconference Information Society - IS 2012, vol. C, 167–72. Ljubljana. http://nl.ijs.si/isjt12/JezikovneTehnologije2012.pdf.

Simič, Nina. 2022. “Googlov angleško slovenski prevajalnik ni več najboljši.” Moje finance, June 30, 2022. Accessed December 27, 2023. https://mojefinance.finance.si/9001658/prevajalniki?src=undefined.

Smith, Chris A. 2023. “Productivity from a metapragmatic perspective: Measuring the diachronic coverage of the low level lexico-grammatical construction Have the N (Body Part/Attitude) to ←→< Metapragmatic Comment> using the COHA.” Languages 8 (2): 92: 1–23. https://doi.org/10.3390/languages8020092.

Sonix. “Sonix.ai.” Accessed December 27, 2023. https://sonix.ai.

Tiedemann, Jörg. 2007. “Improved sentence alignment for movie subtitles.” In Recent Advances in Natural Language Processing RANLP 2007, edited by Galia Angelova, Kalina Bontchevam Ruslan Mitkov, Nicolas Nicolov, and Nikolai Nikolov, 582–88. Borovets: Bulgaria.

Trupej, Janko. 2015. “Strategije za podnaslovno prevajanje profanosti v slovenščino.” Slavistična revija 63 (1): 17–28. https://www.dlib.si/details/URN:NBN:SI:DOC-0XTSKK8O.

Volk, Martin. 2009. “The Automatic Translation of Film Subtitles. A Machine Translation Success Story?” Journal for Language Technology and Computational Linguistics 24 (3):115–28.

Volk, Martin, and Søren Harder. 2007. “Evaluating MT with Translations or Translators. What is the Difference?” In Proceedings of Machine Translation Summit XI: Papers, edited by Bente Maegaard, 499–506. Copenhagen, Denmark. https://aclanthology.org/2007.mtsummit-papers.