Jezikovno procesiranje med naravnim branjem: koregistracija gibanja oči in nevronskih odzivov
DOI:
https://doi.org/10.4312/jis.68.1.3-18Ključne besede:
jezikovno procesiranje, bralni proces, hkratno snemanje gibanja oči in elektroencefalografije (koregistracija), nevronski korelati, s fiksacijo izzvani potenciali (FRP)Povzetek
V psiho- in nevrolingvističnih raziskavah jezikovnega procesiranja med branjem se v zadnjem času vse bolj izrazito poudarja pomen, ki ga ima premik od obravnave procesiranja besed v izolaciji, ki je sicer izjemno pripomogla k našemu razumevanju vidne identifikacije besed, k proučevanju bralnega procesa v njegovi naravni obliki, torej med branjem celih stavkov ali daljših besedil. Vendar pa proučevanje nevronskih korelatov jezikovnega procesiranja med branjem ni enostavno. Trenutno najbolj priljubljena metoda za tovrstne raziskave, elektroencefalografija, vpogleda v korelate jezikovnega procesiranja med naravnim branjem namreč ne omogoča. V prispevku osvetljujemo to problematiko in predstavljamo način, kako lahko s sočasno aplikacijo dveh različnih metod, tako imenovano koregistracijo, preučujemo nevronske korelate jezikovnega procesiranja med naravnim branjem.
Prenosi
Literatura
Antúnez, Martín, Milligan, Sara, Hernández-Cabrera, Juan A., Horacio A. Barber in Schotter, Elizabeth R., 2022: Semantic parafoveal processing in natural reading: Insight from fixation-related potentials & eye movements. Psychophysiology 59/4 . e13986. DOI: https://doi.org/10.1111/psyp.13986
Bianchi, Bruno, Loredo, Rodrigo, Carden, Julia, Jaichenco, Virginia, von der Malsburg, Titus, Shalom, Diego in Kamienkowski, Juan, 2020: Different sources of predictions during natural reading: an eeg and eye-tracking co-registration study. Journal of Vision 20. 1308–1308. DOI: https://doi.org/10.1167/jov.20.11.1308
Degno, Federica in Liversedge, Simon P., 2020: Eye movements and fixation-related potentials in reading: A review. Vision 4/1. 11. DOI: https://doi.org/10.3390/vision4010011
Degno, Federica, Loberg, Otto, Zang, Chunali, Zhang, Manman, Donnelly, Nick in Liversedge, Simon P., 2018: Parafoveal previews and lexical frequency in natural reading: Evidence from eye movements and fixation-related potentials. Journal of Experimental Psychology: General 148/3. 453–474. DOI: https://doi.org/10.1037/xge0000494
Dimigen, Olaf, Sommer, Werner, Hohlfeld, Anenette, Jacobs, Arthur M. in Kliegl, Reinhold, 2011: Coregistration of eye movements and EEG in natural reading: Analyses and review. Journal of experimental psychology: General 140/4. 552–572. DOI: https://doi.org/10.1037/a0023885
Duffy, Susan A., Henderson, John M., Morris in Robin K., 1989: Semantic facilitation of lexical access during sentence processing. Journal of Experimental Psychology: Learning, Memory, and Cognition 15/5. 791–801. DOI: https://doi.org/10.1037/0278-7393.15.5.791
Ehinger, Benedikt V. in Dimigen, Olaf, 2019: Unfold: an integrated toolbox for overlap correction, non-linear modeling, and regression-based eeg analysis. PeerJ 7. e7838. DOI: https://doi.org/10.7717/peerj.7838
Engbert, Ralf, Nuthmann, Antje, Richter, Eike M. in Kliegl, Reinhold, 2005: SWIFT: a dynamical model of saccade generation during reading. Psychological review 112/4. 777–813. DOI: https://doi.org/10.1037/0033-295X.112.4.777
Federmeier, Kara D., 2007: Thinking ahead: the role and roots of prediction in language comprehension. Psychophysiology 44/4. 491–505. DOI: https://doi.org/10.1111/j.1469-8986.2007.00531.x
Frank, Stefan L. in Aumeistere, Anna, 2022: An eye-tracking-with-eeg coregistration corpus of narrative sentences. PsyArXiv. DOI: https://doi.org/10.31234/osf.io/j5fgd
Friederici, Angela D., 2002: Towards a neural basis of auditory sentence processing. Trends in cognitive sciences 6/2. 78–84. DOI: https://doi.org/10.1016/S1364-6613(00)01839-8
Friederici, Angela D., Pfeifer, Erdmut in Hahne, Anja, 1993: Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. Cognitive Brain Research 1/3. 183–192. DOI: https://doi.org/10.1016/0926-6410(93)90026-2
Frömer, Romy, Maier, Martin in Abdel, Rahman, 2018: Group-level eeg-processing pipeline for flexible single trial-based analyses including linear mixed models. Frontiers in neuroscience 12. 12–48. DOI: https://doi.org/10.3389/fnins.2018.00048
Gaarder, Kenneth, Krauskopf, John., Graf, Virgil, Kropfl, Walter in Armington, John C., 1964: Averaged brain activity following saccadic eye movement. Science 146/3650. 1481–1483. DOI: https://doi.org/10.1126/science.146.3650.1481
Groznik, Vida in Sadikov, Aleksander, 2021: Analiza gibanja oči med branjem pri bolnikih z različnimi stopnjami kognitivnega upada. Uporabna informatika 29/3. 155–162. DOI: https://doi.org/10.31449/upinf.131
Hagoort, Peter, 2003: Interplay between syntax and semantics during sentence comprehension: ERP effects of combining syntactic and semantic violations. Journal of cognitive neuroscience 15/6. 883–899. DOI: https://doi.org/10.1162/089892903322370807
Henderson, John M. in Ferreira, Fernanda, 1990: Effects of foveal processing difficulty on the perceptual span in reading: Implications for attention and eye movement control. Journal of Experimental Psychology: Learning, Memory, and Cognition 16. 417–429. DOI: https://doi.org/10.1037/0278-7393.16.3.417
Henderson, John M., Luke, Steven G., Schmidt, Joseph in Richards, John E., 2013: Co-registration of eye movements and event-related potentials in connected-text paragraph reading. Frontiers in systems neuroscience 7. 28. DOI: https://doi.org/10.3389/fnsys.2013.00028
Himmelstoss, N. A., Schuster, S., Hutzler, F., Moran, R. in Hawelka, S., 2020: Co-registration of eye movements and neuroimaging for studying contextual predictions in natural reading. Language, Cognition and Neuroscience 35/5. 595–612. DOI: https://doi.org/10.1080/23273798.2019.1616102
Jung, Tzyy P., Makeig, Scott, Humphries, Colin, Lee, Te W., McKeown, Martin J., Iragui, Vicente in Sejnowski, Terrence J., 2000: Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37/2. 163–78. DOI: https://doi.org/10.1111/1469-8986.3720163
Kretzschmar, Franziska, Bornkessel-Schlesewsky, Ina in Schlesewsky, Matthias, 2009: Parafoveal versus foveal n400s dissociate spreading activation from contextual fit. NeuroReport 20/18. 1613–1618. DOI: https://doi.org/10.1097/WNR.0b013e328332c4f4
Kretzschmar, Franziska, Schlesewsky, Matthias in Staub, Adrian, 2015: Dissociating word frequency and predictability effects in reading: Evidence from coregistration of eye movements and EEG. Journal of Experimental Psychology: Learning, Memory, and Cognition 41/6. 1648–1662. DOI: https://doi.org/10.1037/xlm0000128
Kutas, Marta in Federmeier, Kara D., 2011: Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annual review of psychology 62. 621–647. DOI: https://doi.org/10.1146/annurev.psych.093008.131123
Kutas, Marta in Hillyard, Steven A., 1984: Brain potentials during reading reflect word expectancy and semantic association. Nature 307/5947. 161–163. DOI: https://doi.org/10.1038/307161a0
Marelli, Marco, Amenta, Simona in Crepaldi, Davide, 2015: Semantic transparency in free stems: The effect of Orthography-Semantics consistency on word recognition. Quarterly Journal of Experimental Psychology 68/8. 1571–1583. DOI: https://doi.org/10.1080/17470218.2014.959709
Marjanovič, Katarina, 2019: Towards a comprehensive understanding of reading. Ph.D. thesis. Trieste: International School for Advanced Studies.
Marjanovič, Katarina, Vidal, Yamil in Crepaldi, Davide, 2022: Oculomotor and neural correlates of semantic and morphological priming in natural sentence reading. bioRxiv. DOI: https://doi.org/10.1101/2022.08.31.506138
Metzner, Paul, von der Malsburg, Titus, Vasishth, Shravan in Rösler, Frank, 2017: The importance of reading naturally: Evidence from combined recordings of eye movements and electric brain potentials. Cognitive Science 41/6. 1232–1263. DOI: https://doi.org/10.1111/cogs.12384
Molinaro, Nicola, Barber, Horacio A. in Carreiras, Manuel, 2011: Grammatical agreement processing in reading: ERP findings and future directions. Cortex 47/8. 908–930. DOI: https://doi.org/10.1016/j.cortex.2011.02.019
Morris, Robin K. in Folk, Jocelyn R., 1998: Focus as a contextual priming mechanism in reading. Memory & Cognition 26/6. 1313–1322. DOI: https://doi.org/10.3758/BF03201203
Paterson, Kevin B., Almabruk, Almabruk A. A., McGowan, Victoria A., White, Sarah J. in Jordan, Timothy R., 2015: Effects of word length on eye movement control: The evidence from Arabic. Psychonomic bulletin & review 22. 1443–1450. DOI: https://doi.org/10.3758/s13423-015-0809-4
Perenič, Urška in Bon, Jurij, 2015: Eksperimentalna uporaba kvantitativne elektroencefalografije pri analizi (literarnega) branja: z dogodkom povezani ERP valovi (Event-Related-Potentials). Slavistična revija 63/2. 135–153.
Plöchl, Michael, Ossandón, Jose P. in König, Peter 2012: Combining eeg and eye tracking: identification, characterization, and correction of eye movement artifacts in electroencephalographic data. Frontiers in Human Neuroscience 6. 278. DOI: https://doi.org/10.3389/fnhum.2012.00278
Prado, Chloe, Dubois, Matthieu in Valdois, Sylviane, 2007: The eye movements of dyslexic children during reading and visual search: impact of the visual attention span. Vision research 47/19. 2521–2530. DOI: https://doi.org/10.1016/j.visres.2007.06.001
Rastle, Kathleen, Davis, Matt H., Marslen-Wilson, William D. in Tyler, Lorraine K., 2000: Morphological and semantic effects in visual word recognition: A time-course study. Language and cognitive processes 15/4–5. 507–537. DOI: https://doi.org/10.1080/01690960050119689
Rayner, Keith, 1993: Eye movements in reading: Recent developments. Current directions in psychological science 2/3. 81–86. DOI: https://doi.org/10.1111/1467-8721.ep10770940
Rayner, Keith, 1995: Eye movements and cognitive processes in reading, visual search, and scene perception. Findlay, J. M., Walker, R. in Kentridge, R. W. (ur.): Eye Movement Research. Volume 6 of Studies in Visual Information Processing. North-Holland: Elsevier. 3–22. DOI: https://doi.org/10.1016/S0926-907X(05)80003-0
Rayner, Keith, Foorman, Barbara R., Perfetti, Charles A., Pesetsky, David., Seidenberg in Mark S., 2001: How psychological science informs the teaching of reading. Psychological science in the public interest 2/2. 31–74. DOI: https://doi.org/10.1111/1529-1006.00004
Rayner, Keith in Morris, Robin K., 1991: Comprehension processes in reading ambiguous sentences: Reflections from eye movements. Advances in Psychology 77. 175–198. DOI: https://doi.org/10.1016/S0166-4115(08)61533-2
Rayner, Keith in Reichle, Erik D., 2010: Models of the reading process. Wiley Interdisciplinary Reviews: Cognitive Science 1/6. 787–799. DOI: https://doi.org/10.1002/wcs.68
Rayner, Keith, Slattery, Timothy J., Drieghe, Denis in Liversedge, Simon P., 2011: Eye movements and word skipping during reading: effects of word length and predictability. Journal of Experimental Psychology: Human Perception and Performance 37/2. 514–528. DOI: https://doi.org/10.1037/a0020990
Reichle, Erik D., Pollatsek, Alexander, Fisher, Donald L. in Rayner, Keith, 1998: Toward a model of eye movement control in reading. Psychological review 105/1. 125–157. DOI: https://doi.org/10.1037/0033-295X.105.1.125
Schacht, Annekathrin, Sommer, Werner, Shmuilovich, Olga, Martíenz, Pilar C. in Martín-Loeches, Manuel, 2014: Differential task effects on n400 and p600 elicited by semantic and syntactic violations. PLOS ONE 9/3. 1–7. DOI: https://doi.org/10.1371/journal.pone.0091226
Sereno, Sara C. in Rayner, Keith, 2003: Measuring word recognition in reading: eye movements and event-related potentials. Trends in cognitive sciences 7/11. 489–493. DOI: https://doi.org/10.1016/j.tics.2003.09.010
Smith, Nathaniel in Kutas, Marta, 2015: Regression-based estimation of erp waveforms: I. the erp framework. Psychophysiology 52/2. 157–168. DOI: https://doi.org/10.1111/psyp.12317
Snell, Joshua, van Leipsig, Sam, Grainger, Jonathan in Meeter, Martijn, 2018: Ob1-reader: A model of word recognition and eye movements in text reading. Psychological Review 125/6. 969–984. DOI: https://doi.org/10.1037/rev0000119
Staub, Adrian, 2011: The effect of lexical predictability on distributions of eye fixation durations. Psychonomic bulletin & review 18. 371–376. DOI: https://doi.org/10.3758/s13423-010-0046-9
Steinhauer, Karsten in Drury, John E., 2012: On the early left-anterior negativity (ELAN) in syntax studies. Brain and language 120/2. 135–162. DOI: https://doi.org/10.1016/j.bandl.2011.07.001
Su, Xiaogang, Yan, Xin in Tsai, Chih-Ling, 2012: Linear regression. Wiley Interdisciplinary Reviews: Computational Statistics 4/3. 275–294. DOI: https://doi.org/10.1002/wics.1198
Veldre, Aaron in Andrews, Sally, 2018: How does foveal processing difficulty affect parafoveal processing during reading? Journal of Memory and Language 103. 74–90. DOI: https://doi.org/10.1016/j.jml.2018.08.001
Prenosi
Objavljeno
Številka
Rubrika
Licenca
Avtorske pravice (c) 2023 Katarina Marjanovič
To delo je licencirano pod Creative Commons Priznanje avtorstva-Deljenje pod enakimi pogoji 4.0 mednarodno licenco.
Kako citirati
