Effect of Subtitles on Gaze Behavior during Shot Changes: An Eye-tracking Study
Authors
PDF
FLIP
How to Cite
Padakannaya, P., & Joy, J. (2023). Effect of Subtitles on Gaze Behavior during Shot Changes: An Eye-tracking Study. International Journal of Psychological Research, 16(2), 4–13. https://doi.org/10.21500/20112084.5831
More Citation Formats
License terms
▼
The work that is sent to this journal must be original, not published or sent to be published elsewhere; and if it is accepted for publication, authors will agree to transfer copyright to International Journal of Psychological Research.
To give up copyright, the authors allow that, International Journal of Psychological Research, distribute the work more broadly, check for the reuse by others and take care of the necessary procedures for the registration and administration of copyright; at the same time, our editorial board represents the interests of the author and allows authors to re-use his work in various forms. In response to the above, authors transfer copyright to the journal, International Journal of Psychological Research. This transfer does not imply other rights which are not those of authorship (for example those that concern about patents). Likewise, preserves the authors rights to use the work integral or partially in lectures, books and courses, as well as make copies for educational purposes. Finally, the authors may use freely the tables and figures in its future work, wherever make explicit reference to the previous publication in International Journal of Psychological Research. The assignment of copyright includes both virtual rights and forms of the article to allow the editorial to disseminate the work in the manner which it deems appropriate.
The editorial board reserves the right of amendments deemed necessary in the application of the rules of publication.
To give up copyright, the authors allow that, International Journal of Psychological Research, distribute the work more broadly, check for the reuse by others and take care of the necessary procedures for the registration and administration of copyright; at the same time, our editorial board represents the interests of the author and allows authors to re-use his work in various forms. In response to the above, authors transfer copyright to the journal, International Journal of Psychological Research. This transfer does not imply other rights which are not those of authorship (for example those that concern about patents). Likewise, preserves the authors rights to use the work integral or partially in lectures, books and courses, as well as make copies for educational purposes. Finally, the authors may use freely the tables and figures in its future work, wherever make explicit reference to the previous publication in International Journal of Psychological Research. The assignment of copyright includes both virtual rights and forms of the article to allow the editorial to disseminate the work in the manner which it deems appropriate.
The editorial board reserves the right of amendments deemed necessary in the application of the rules of publication.
Abstract
The study provides a comprehensive picture of the effect of subtitles on the gaze behavior of the participants while watching continuity editing and discontinuity editing style cinema. Three video clips (with English subtitles and without subtitles) of continuity editing and discontinuity editing styles were presented to participants. The video clips came from English movies and the participants were not native English speakers. Entry time, dwell time, first fixation time, scan path, and average fixation duration were taken as dependent variables in this within-group study. The eye-tracking data gathered were subjected to repeated measures of two-way ANOVA and paired t-test. Results revealed that the appearance of subtitles at the bottom of the screen changed the eye movement pattern of the participants during the shot changes. Timing of the subtitle starting point (before the cut or after the cut) also affected the gaze behavior. The editing style, however, did not make any difference in the gaze behavior of participants while watching subtitled video clips. Further, participants preferred reading subtitles to seeing visual images even if the subtitles were presented during the shot changes.
References
Bordwell, D. (2006). The Way Hollywood Tells It: Story and Style in Modern Movies.
Bordwell, D., & Thompson, K. (2008). Film Art: An Introduction. McGraw Hill.
Borell, J. (2000). Subtitling or dubbing? An investigation of the effects from reading subtitles on understanding audiovisual material.
d’Ydewalle, G., & De Bruycker, W. (2007). Eye Movements of Children and Adults While Reading Television Subtitles. European Psychologist, 12(3), 196–205. https://doi.org/10.1027/1016-9040.12.3.196
De Linde, Z., & Kay, N. (1999). The Semiotics of Subtitling. https://www.routledge.com/The-Semiotics-of-Subtitling/Linde-Kay/p/book/9781900650182
Diaz-Cintas, J. (2010). Subtitling (pp. 344–349).
Gambier, Y. (2003). Introduction. The Translator, 9(2), 171–189. https://doi.org/10.1080/13556509.2003.10799152
Germeys, F., & d’Ydewalle, G. (2007). The psychology of film: Perceiving beyond the cut. Psychological Research, 71, 458–466. https://doi.org/10.1007/s00426-005-0025-3
Hansen-Schirra, S., Grucza, S., Lång, J., Fox, W., O’Hagan, M., Sasamoto, R., Lång, J., Nitzke, J., Alves, F., Szpak, K. S., Gonçalves, J. L., Sekino, K., Aquino, M., Koglin, A., Castro, R. A. e, Fonseca, N. B. de L., Mesa-Lao, B., Rösener, C., & Wolfer, S. (2016). Eyetracking and Applied Linguistics. In Language Science Press. Language Science Press. https://doi.org/10.17169/langsci.b108.230
Hanson, C. (1997). L.A. Confidential. Regency Enterprises.
Hitchcock, A. (1954). Rear Window. Patron Inc.
Jensema, C. J., el Sharkawy, S., Danturthi, R. S., Burch, R., & Hsu, D. (2000). Eye movement patterns of captioned television viewers. American Annals of the Deaf, 145(3), 275–285. https://doi.org/10.1353/aad.2012.0093
Korine, H. (1997). Gummo. Fine Line Features.
Krejtz, I., Szarkowska, A., & Krejtz, K. (2013). The Effects of Shot Changes on Eye Movements in Subtitling. Journal of Eye Movement Research, 6, 1–12. https://doi.org/10.16910/jemr.6.5.3
Kruger, J.-L., Szarkowska, A., & Krejtz, I. (2015). Subtitles on the Moving Image: An Overview of Eye Tracking Studies. Refractory: A Journal of Entertainment Media, 25.
Kubrick, S. (n.d.). The Shining. Retrieved January 2, 2022, from https://www.imdb.com/title/tt0081505/
Penn, S. (2007). Into the Wild. Paramount Vantage.
Polcz, K. (2008). Jorge Díaz Cintas and Aline Remael: Audiovisual translation: Subtitling. Across Languages and Cultures - ACROSS LANG CULT, 9, 291–299. https://doi.org/10.1556/Acr.9.2008.2.8
Rayner, K. (Ed.). (1992). Eye Movements and Visual Cognition: Scene Perception and Reading. Springer New York. https://doi.org/10.1007/978-1-4612-2852-3
Shimamura, A. P. (2014). Psychocinematics: Exploring Cognition at the Movies. Oxford University Press.
Smith, T. J. (2013). Watching you watch movies: Using eye tracking to inform cognitive film theory. In Psychocinematics: Exploring cognition at the movies (pp. 165–190). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199862139.003.0009
Szarkowska, A., & Gerber-Morón, O. (2018). Viewers can keep up with fast subtitles: Evidence from eye movements. PLOS ONE, 13(6), e0199331. https://doi.org/10.1371/journal.pone.0199331
Szarkowska, A., Krejtz, I., Pilipczuk, O., Dutka, Ł., & Kruger, J.-L. (2016). The effects of text editing and subtitle presentation rate on the comprehension and reading patterns of interlingual and intralingual subtitles among deaf, hard of hearing and hearing viewers. Across Languages and Cultures, 17(2), 183–204. https://doi.org/10.1556/084.2016.17.2.3
Thompson, K., & Bordwell, D. (2011). The eye’s mind. Observations on Film Art. http://www.davidbordwell.net/blog/2011/02/06/the-eyes-mind/
Trier, L. V. (2000). Dancer in the Dark. Zentropa Entertainments; Canal+; FilmFour; France 3 Cinéma.
Bordwell, D., & Thompson, K. (2008). Film Art: An Introduction. McGraw Hill.
Borell, J. (2000). Subtitling or dubbing? An investigation of the effects from reading subtitles on understanding audiovisual material.
d’Ydewalle, G., & De Bruycker, W. (2007). Eye Movements of Children and Adults While Reading Television Subtitles. European Psychologist, 12(3), 196–205. https://doi.org/10.1027/1016-9040.12.3.196
De Linde, Z., & Kay, N. (1999). The Semiotics of Subtitling. https://www.routledge.com/The-Semiotics-of-Subtitling/Linde-Kay/p/book/9781900650182
Diaz-Cintas, J. (2010). Subtitling (pp. 344–349).
Gambier, Y. (2003). Introduction. The Translator, 9(2), 171–189. https://doi.org/10.1080/13556509.2003.10799152
Germeys, F., & d’Ydewalle, G. (2007). The psychology of film: Perceiving beyond the cut. Psychological Research, 71, 458–466. https://doi.org/10.1007/s00426-005-0025-3
Hansen-Schirra, S., Grucza, S., Lång, J., Fox, W., O’Hagan, M., Sasamoto, R., Lång, J., Nitzke, J., Alves, F., Szpak, K. S., Gonçalves, J. L., Sekino, K., Aquino, M., Koglin, A., Castro, R. A. e, Fonseca, N. B. de L., Mesa-Lao, B., Rösener, C., & Wolfer, S. (2016). Eyetracking and Applied Linguistics. In Language Science Press. Language Science Press. https://doi.org/10.17169/langsci.b108.230
Hanson, C. (1997). L.A. Confidential. Regency Enterprises.
Hitchcock, A. (1954). Rear Window. Patron Inc.
Jensema, C. J., el Sharkawy, S., Danturthi, R. S., Burch, R., & Hsu, D. (2000). Eye movement patterns of captioned television viewers. American Annals of the Deaf, 145(3), 275–285. https://doi.org/10.1353/aad.2012.0093
Korine, H. (1997). Gummo. Fine Line Features.
Krejtz, I., Szarkowska, A., & Krejtz, K. (2013). The Effects of Shot Changes on Eye Movements in Subtitling. Journal of Eye Movement Research, 6, 1–12. https://doi.org/10.16910/jemr.6.5.3
Kruger, J.-L., Szarkowska, A., & Krejtz, I. (2015). Subtitles on the Moving Image: An Overview of Eye Tracking Studies. Refractory: A Journal of Entertainment Media, 25.
Kubrick, S. (n.d.). The Shining. Retrieved January 2, 2022, from https://www.imdb.com/title/tt0081505/
Penn, S. (2007). Into the Wild. Paramount Vantage.
Polcz, K. (2008). Jorge Díaz Cintas and Aline Remael: Audiovisual translation: Subtitling. Across Languages and Cultures - ACROSS LANG CULT, 9, 291–299. https://doi.org/10.1556/Acr.9.2008.2.8
Rayner, K. (Ed.). (1992). Eye Movements and Visual Cognition: Scene Perception and Reading. Springer New York. https://doi.org/10.1007/978-1-4612-2852-3
Shimamura, A. P. (2014). Psychocinematics: Exploring Cognition at the Movies. Oxford University Press.
Smith, T. J. (2013). Watching you watch movies: Using eye tracking to inform cognitive film theory. In Psychocinematics: Exploring cognition at the movies (pp. 165–190). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199862139.003.0009
Szarkowska, A., & Gerber-Morón, O. (2018). Viewers can keep up with fast subtitles: Evidence from eye movements. PLOS ONE, 13(6), e0199331. https://doi.org/10.1371/journal.pone.0199331
Szarkowska, A., Krejtz, I., Pilipczuk, O., Dutka, Ł., & Kruger, J.-L. (2016). The effects of text editing and subtitle presentation rate on the comprehension and reading patterns of interlingual and intralingual subtitles among deaf, hard of hearing and hearing viewers. Across Languages and Cultures, 17(2), 183–204. https://doi.org/10.1556/084.2016.17.2.3
Thompson, K., & Bordwell, D. (2011). The eye’s mind. Observations on Film Art. http://www.davidbordwell.net/blog/2011/02/06/the-eyes-mind/
Trier, L. V. (2000). Dancer in the Dark. Zentropa Entertainments; Canal+; FilmFour; France 3 Cinéma.
Downloads
Download data is not yet available.
Cited by
