COMPUTERISED GYMNASTICS JUDGING SCORING SYSTEM IMPLEMENTATION – AN EXPLORATION OF STAKEHOLDERS’ PERCEPTIONS
DOI:
https://doi.org/10.52165/sgj.13.3.357-370Keywords:
gymnastics, judging, bias, technology, sportAbstract
Gymnastics is one of the original Olympic sports, subjectively judged by humans. Judging errors and bias can occur, resulting in medals being incorrectly awarded. The International Gymnastics Federation (FIG) with Fujitsu are introducing a computerised gymnastics judging support system (CGJSS), a technology aimed to enhance fairness and accuracy but there is very little literature evaluating this technology and perceptions. This project aimed to explore stakeholders’ reactions at this critical time. Therefore, interviews were conducted with coaches, judges, media, former and current international gymnasts. The findings concurred with the literature review of judging problems with the current system, including bias and subjectivity. New findings show, among other things, that gymnasts’ scores can differ depending on which round they compete in. The findings also suggest that the CGJSS would be a great innovation for gymnastics to improve credibility by removing bias and helping to make the sport more objective. However, the majority of the participants believed it could not judge the artistry element of the sport. Close monitoring of the effectiveness of the CGJSS is therefore required to identify enhancement and to ensure the investment produces fairer, more reliable and credible results. Successful implementation of the CGJSS could also allow it to be introduced into other subjectively judged sports.
Downloads
References
Ansorge, C. J., Scheer, J. K., Laub, J., & Howard, J. (1978). Bias in Judging Women’s Gymnastics Induced by Expectations of Within-Team Order. Research Quarterly, 49(4), 399-405. doi: 10.1080/10671315.1978.10615552. DOI: https://doi.org/10.1080/10671315.1978.10615552
Ansorge, C. J., & Scheer, J. K. (1988). International Bias Detected in judging Gymnastic Competition at the 1984 Olympic Games. Research Quarterly for Exercise and Sport, 59(2), 103-107. doi: 10.1080/0270367.1988.10605486. DOI: https://doi.org/10.1080/02701367.1988.10605486
Atikovic, A., Kalinski, S. D., Bijelic, S., & Vukadinovic, N. A. (2011). Analysis Results Judging World Championships in Men’s Artistic Gymnastics in London 2009 Year. SportLogia 7(2), 95-102. doi:10.5550/sgia.110702.en.095A. DOI: https://doi.org/10.5550/sgia.110702.en.095A
Bard, C., Fleury M., Carriere, L., & Halle, M. (1980). Analysis of gymnastics Judges’ Visual Search. Research Quarterly for Exercise and Sport, 51(2), 267-273. doi: 10.1080/02701367.1980.10605195. DOI: https://doi.org/10.1080/02701367.1980.10605195
Bucar, M., Cuk, I. Pajek, J., Karacsony, I., & Leskosek, B. (2012). Reliability and validity of judging in women’s artistic gymnastics at University Games 2009. European Journal of Sport Science, 12(3), 207-215. doi: 10.1080/17461391.2010.551416. DOI: https://doi.org/10.1080/17461391.2010.551416
Cashmore, E. (2010). Making sense of sports (5th ed.). New York: Routledge. DOI: https://doi.org/10.4324/9780203872697
Clarkson, B. G., Culvin, A., Pope, S., & Parry, K. D. (2020). Covid-19: Reflections on threat and uncertainty for the future of elite women’s football in England. Managing Sport and Leisure, 1-12. doi:10.1080/23750472.2020.1766377. DOI: https://doi.org/10.1080/23750472.2020.1766377
Collins, H., & Evans, R. (2011). Sport-decision aids and the “CSI-effect”: Why cricket uses Hawk-Eye well and tennis uses it badly. Public Understanding of Science, 21(8), 904-921. doi: 10.1177/0963662511407991. DOI: https://doi.org/10.1177/0963662511407991
Dallas, G., & Kirialanis, P. (2010). Judges’ evaluation of routines in men’s artistic gymnastics. Science of Gymnastics Journal, 2(2), 49-58.
Duda, J. L., Brown Borysowicz, M. A., & St. Germaine, K. (1996). Women’s Artistic Gymnastics Judges’ Sources of Stress. Retrieved 7 February, from https://usagym.org/pages/home/publications/technique/1996/10/judge.pdf.
Fujitsu. (2018). The International Gymnastics Federation to Implement Fujitsu's Judging Support System. Retrieved 22 November, 2018, from http://www.fujitsu.com/global/about/resources/news/press-releases/2018/1120-01.html
Fujitsu. (2019). “A step towards the future” with the first official use of Fujitsu technology to support judging at the 2019 Artistic Gymnastics World Championships. Retrieved 14 November, 2019, from https://www.fujitsu.com/global/about/resources/news/press-releases/2019/1002-01.html
Fusch, P. I., & Ness, L. R. (2015). Are we there yet? Data Saturation in Qualitative Research. The Qualitative report, 20(9), 1408-1416. DOI: https://doi.org/10.46743/2160-3715/2015.2281
Green, L., & Allen, L. (1984). Judgement Day. Women’s sport and fitness, 6, 47-53.
IT News Online. (2019). "A step towards the future" with the First Official Use of Fujitsu Technology to Support Judging at the 2019 Artistic Gymnastics World Championships. Retrieved 2 October, 2019, from http://www.itnewsonline.com/jcn/quotA-step-towards-the-futurequot-with-the-First-Official-Use-of-Fujitsu-Technology-to-Support-Judging-at-the-2019-Artistic-Gymnastics-World-Championships/2010.
Kelso, P. (2004, 25 August). Uproar in the gym: Russians complain to the IOC. The Guardian. Retrieved from https://www.theguardian.com/sport/2004/aug/25/athensolympics2004.gymnastics
Leskosek, B., Cuk, I., Karacsony, I., Pajek, J., & Bucar, M. (2010). Reliability and validity of judging in Men's artistic gymnastics at the 2009 University Games. Science of gymnastics 2(1), 25-34.
Leskosek, B., Cuk, I., Pajek, J., Forbes, W., & Bucar-Pajek, M. (2012). Bias of Judging In the Men’s Artistic Gymnastics at the European Championships 2011. Biology of Sport, 29(2), 107-113. doi: 10.5604/20831862.988884 DOI: https://doi.org/10.5604/20831862.988884
Logothetis, P. (2017, 4 November). Cracking the vault: Artificial intelligence judging comes to gymnastics. The Guardian. Retrieved from https://www.theguardian.com/sport/blog/2017/nov/04/ai-judges-gymnastics-olympics.
Mears, C. L. (2009). Interviewing for education and Social Science Research: The Gateway approach. New York: Palgrave Macmillan. DOI: https://doi.org/10.1057/9780230623774_8
Mercier, H. , & Heiniger, S. Judging the Judges: Evaluating the Performance of International Gymnastics Judges. MIT SLOAN, Sport Analytics Conference, Hynes Convention Centre, March 3-4, 2017, (2017), 1-18.
Perederji, V. V. (2013). The problem of the quality of judging in rhythmic gymnastics. Pedagogics, 17(3), 43-46. doi: 10.6084/m9.figshare.647325
Plessner, H. (1999). Expectation biases in gymnastics judging. Journal of Sport & Exercise Psychology, 21(2), 131-144. doi: 10.1123/jsep.21.2.131 DOI: https://doi.org/10.1123/jsep.21.2.131
Polit, D., & Beck, C. T. (2006). Essentials of nursing research: Methods, appraisal, and utilization (6th ed.). London: Lippincott Williams & Wilkins.
Popovic, R. (2000). International Bias detected in judging rhythmic gymnastics competition at Sydney-2000 Olympic Games. Facta Universitatis (Series: Physical Education and Sport), 1(7), 1-13.
Reuters. (2004). Nemov uproar overshadows Ponor show. Retrieved 20 February, 2019, from https://www.eurosport.co.uk/artistic-gymnastics/athens/2004/uproar-over-nemov-marks_sto630585/story.shtml
Scheer, J. K., & Ansorge, C. J. (1975). Effects of Naturally Induced Judges’ Expectations on the Ratings of Physical Performances. Research Quarterly. American Alliance for Health, Physical Education and Recreation, 46(4), 463-470. doi: 10.1080/10671315.1975.10616704 DOI: https://doi.org/10.1080/10671315.1975.10616704
Scheer, J. K., & Ansorge, C. J. (1979). Influence Due to Expectations of Judges: A Function of Internal-External Locus of Control. Journal of Sports Psychology, 1(1), 53-58. doi: 10.1123/jsp.1.1.53 DOI: https://doi.org/10.1123/jsp.1.1.53
Ste-Marie, D. M. (1996). International bias in gymnastics judging: Conscious or unconscious influences? Perceptual and Motor Skills, 85(3), 963 -975. Retrieved from https://journals.sagepub.com DOI: https://doi.org/10.2466/pms.1996.83.3.963
Ste-Marie, D. M. (1999). Expert-Novice Differences in Gymnastic Judging: An Information-processing Perspective. Applied Cognitive Psychology 13(3), 269-281. doi: 10.1002/(SICI)1099-0720(199906)13.3<269::AID-ACP567>3.0.CO;2-Y DOI: https://doi.org/10.1002/(SICI)1099-0720(199906)13:3<269::AID-ACP567>3.0.CO;2-Y
Ste-Marie, D. M. (2000). Expertise in Women’s Gymnastics Judging: An Observational Approach. Perceptual and Motor Skills, 90(2), 543-546. doi: 10.2466/pms.2000.90.2.543 DOI: https://doi.org/10.2466/pms.2000.90.2.543
Ste-Marie, D. M., & Lee, T. D. (1991). Prior Processing Effects on Gymnastics Judging. Journal of Experimental Psychology: Learning, Memory and Cognition, 17(1), 126-136. doi: 10.1037/0278-7393.17.1.126 DOI: https://doi.org/10.1037/0278-7393.17.1.126
Ste-Marie, D. M., & Valiquette, S. M. (1996). Enduring Memory-Influenced Biases in Gymnastic Judging. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6). 1498-1502. doi: 10.1037/0278-7393.22.6.1498 DOI: https://doi.org/10.1037/0278-7393.22.6.1498
Sys-Con Media. (2019). "A step towards the future" with the First Official Use of Fujitsu Technology to Support Judging at the 2019 Artistic Gymnastics World Championships. Retrieved 2 October, 2019, from http://www.sys-con.com/node/4410402
Trivedi, P. K., & Zimmer, D. M. (2014). Success at the Summer Olympics: How Much Do Economic Factors Explain? Econometrics, 2(4), 169-202. doi:http://dx.doi.org/10.3390/econometrics2040169 DOI: https://doi.org/10.3390/econometrics2040169
Turner. A (2014). FIG wants scoring overhaul. Retrieved 20 February, 2019, from http://www.intlgymnast.com/index.php?option=com_content&view=article&id=4174:fig-president-wants-scoring-overhaul&catid=3:interviews&Itemid=56
Vera-Rivera, J. L., Ortega-Parra, A. J., & Ramírez-Ortiz, Y. A. (2019). Impact of technology on the evolution of sports training. Journal of Physics: Conference Series, 1386, 012144. doi:10.1088/1742-6596/1386/1/012144 DOI: https://doi.org/10.1088/1742-6596/1386/1/012144
Wilson, C. (2014). Interview Techniques for UX Practitioners: A User-Centred Design Method. Waltham, MA: Elsevier.
Zaccardi, N. (2012). Explaining the inquiry system that has wreaked havoc on London gym. Retrieved 19 February, 2019, from https://www.si.com/more-sports/2012/08/07/aly-raisman-inquiry-gymnastics