Eye-tracking Recordings as Data in EMCA Studies
Exploring Possibilities and Limitations
DOI:
https://doi.org/10.7146/si.v4i4.121776Keywords:
ethnomethodological conversation analysis, eye-tracking, gaze behaviourAbstract
The article contributes to the ongoing discussion of the potential of using eye-tracking recordings in ethnomethodological conversation analysis (EMCA) by exploring to what extent and under what circumstances such recordings may be useful for EMCA studies of multimodal social interaction. For this purpose, it analyzes examples of social conduct recorded by one video camera and one set of eye-tracking glasses. The article concludes that while eye-tracking recordings may, in some specific cases, provide new analytic possibilities for studying social action, they are by no means indispensable for EMCA research in multimodal social interaction, and making use of mobile eye-tracking equipment and recordings may compromise the data as well as the analytic procedure.
References
Atkinson, J. M., & Heritage, J. (Eds.). (1984). Structures of social action: Studies in conversation analysis. Cambridge University Press, Editions de la Maison des Sciences de l'Homme.
Auer, P. (2018). Gaze, addressee selection and turn-taking in three-party interaction. In G. Brône & B. Oben (Eds.), Eye-tracking in Interaction: Studies on the role of eye gaze in dialogue (Vol. 10, pp. 197-232). John Benjamins Publishing Company.
Brône, G., & Oben, B. (Eds.). (2018a). Eye-tracking in Interaction: Studies on the role of eye gaze in dialogue (Vol. 10). John Benjamins Publishing Company.
Brône, G., & Oben, B. (2018b). Introduction. Gaze, interaction and eye-tracking: A multidisciplinary endeavour. In G. Brône & B. Oben (Eds.), Eye-tracking in Interaction: Studies on the role of eye gaze in dialogue (Vol. 10, pp. 1-18). John Benjamins Publishing Company.
Clark, C., & Pinch, T. (2010). Some major organisational consequences of some ‘minor’, organised conduct: evidence from video analysis of pre-verbal service encounters in service encounters in a showroom retail store. In N. Llewellyn & J. Hindmarsh (Eds.), Organisation, interaction and practice: Studies of ethnomethodology and conversation analysis (pp. 140-171). Cambridge University Press.
Coulter, J. (1991). Cognition: 'cognition' in an ethnomethodological mode. In G. Button (Ed.), Ethnomethodology and the human sciences (pp. 176-195). Cambridge University Press.
De Stefani, E. (2013). The collaborative organisation of next actions in a semiotically rich environment: shopping as a couple. In P. Haddington, L. Mondada, & M. Nevile (Eds.), Interaction and mobility: Language and the body in motion (pp. 123-151). De Gruyter.
Deppermann, A. (2013). Conversation analytic studies of multimodal interaction. Special issue of Journal of Pragmatics. Journal of Pragmatics, 46(1), 1-172.
Duchowski, A. T. (2007). Eye tracking methodology: Theory and practice. Springer.
Due, B. L. (Ed.). (forthc.). The Practical Accomplishment of Blind People’s Ordinary Activities. Routledge.
Fasulo, A., & Monzoni, C. (2009). Assessing mutable objects: A multimodal analysis. Research on Language and Social Interaction, 42(4), 362-376.
Ferguson, H. J., Apperly, I., & Cane, J. E. (2017). Eye tracking reveals the cost of switching between self and other perspectives in a visual perspective-taking task. Quarterly Journal of Experimental Psychology, 70(8), 1646-1660. https://doi.org/10.1080/17470218.2016.1199716
Garfinkel, H. (1967). Studies in Ethnomethodology. Prentice Hall.
Garfinkel, H., & Wieder, D. L. (1992). Two incommensurable, asymmetrically alternate technologies of social analysis. In G. Watson & R. M. Seiler (Eds.), Text in context: Contributions to ethnomethodology (pp. 175-206). Sage Publications
Goffman, E. (1963). Behavior in public places. Notes on the social organization of gatherings. The Free Press.
Goodwin, C. (1979). The interactive construction of a sentence in natural conversation. In G. Psathas (Ed.), Everyday language: Studies in ethnomethodology (pp. 97-121). Halsted Press.
Goodwin, C. (1980). Restarts, Pauses, and the Achievement of a State of Mutual Gaze at Turn‐Beginning. Sociological inquiry, 50(3‐4), 272-302. https://doi.org/10.1111/j.1475-682X.1980.tb00023.x
Goodwin, C. (2000). Action and embodiment within situated human interaction. Journal of Pragmatics, 32(10), 1489-1522.
Haddington, P., Keisanen, T., Mondada, L., & Nevile, M. (2014). Multiactivity in social interaction: Beyond multitasking. John Benjamins Publishing Company.
Harjunpää, K., Mondada, L., & Svinhufvud, K. (2018). The Coordinated Entry into Service Encounters in Food Shops: Managing Interactional Space, Availability, and Service During Openings. Research on Language and Social Interaction, 51(3), 271-291. https://doi.org/10.1080/08351813.2018.1485231
Hayashi, M. (2005). Joint turn construction through language and the body: Notes on embodiment in coordinated participation in situated activities. Semiotica: Journal of the International Association for Semiotic Studies/Revue de l'Association Internationale de Sémiotique, 156(1), 21-53.
Hazel, S., Mortensen, K., & Rasmussen, G. (2014). Introduction: A body of resources - CA studies of social conduct. Journal of Pragmatics, 65, 1-9.
Heath, C. (1986). Body movement and speech in medical interaction. Cambridge University Press/Editions de la Maison des Sciences de l'Homme.
Heath, C., Hindmarsh, J., & Luff, P. (2010). Video in Qualitative Research: Analysing Social Interaction in Everyday Life. Sage.
Heath, C., & Luff, P. (1992). Collaboration and control: Crisis management and multimedia technology in London Underground Line Control Rooms. Computer Supported Cooperative Work (CSCW), 1(1-2), 69-94.
Hodge, R., & Kress, G. R. (1998). Social semiotics. Polity Press.
Holler, J., & Kendrick, K. H. (2015). Unaddressed participants’ gaze in multi-person interaction: optimizing recipiency. Frontiers in psychology, 6(98), 76-89.
Jefferson, G. (1972). Side sequences. In D. Sudnow (Ed.), Studies in social interaction (pp. 294-338). The Free Press.
Jewitt, C. (2008). Technology, literacy and learning: A multimodal approach. Routledge.
Jones, R. H. (2005). ‘You show me yours, I’ll show you mine’: The negotiation of shifts from textual to visual modes in computer-mediated interaction among gay men. Visual communication, 4(1), 69-92.
Kawulich, B. B. (2005). Participant observation as a data collection method. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research,
Keevallik, L. (2010). Bodily Quoting in Dance Correction. Research on Language and Social Interaction, 43(4), 401-426. https://doi.org/10.1080/08351813.2010.518065
Kendon, A. (1967). Some functions of gaze-direction in social interaction. Acta psychologica, 26, 22-63.
Kendon, A. (1973). The role of visible behavior in the organization of social interaction. In M. v. Carnach & I. Vine (Eds.), Social communication and movement (pp. 29-74). Academic Press.
Knoblauch, H., Schnettler, B., Raab, J., & Soeffner, H.-G. (Eds.). (2006). Video analysis: methodology and methods. Qualitative Audiovisual Data Analysis in Sociology. Peter Lang.
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The Modes and Media of Contemporary Communication. Cappelen.
Kristiansen, E. D., & Rasmussen, G. (forthc.). Would you like a bag for that? Environmental awareness and changing practices for closing buying and selling encounters in retail shopping.
Licoppe, C., & Morel, J. (2012). Video-in-interaction:“Talking heads” and the multimodal organization of mobile and Skype video calls. Research on Language & Social Interaction, 45(4), 399-429.
Lohse, G. L., & Wu, D. (2001). Eye movement patterns on Chinese yellow pages advertising. Electronic Markets, 11(2), 87-96.
Macbeth, D. (1999). Glances, trances, and their relevance for a visual sociology. In P. L. Jalbert (Ed.), Media studies: Ethnomethodological approaches (pp. 135-170). University Press of America.
Maynard, D. W., & Clayman, S. E. (1991). The diversity of ethnomethodology. Annual review of sociology, 385-418.
McIlvenny, P. (2019). Inhabiting spatial video and audio data: Towards a scenographic turn in the analysis of social interaction. Social Interaction. Video-Based Studies of Human Sociality, 2(1). https://doi.org/10.7146/si.v2i1.110409
Meißner, M., Pfeiffer, J., Pfeiffer, T., & Oppewal, H. (2019). Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. Journal of Business Research, 100, 445-458. https://doi.org/https://doi.org/10.1016/j.jbusres.2017.09.028
Meyer, C., & Streeck, J. (2020). Ambivalences of touch: An epilogue. In A. Cekaite & L. Mondada (Eds.), Touch in social interaction: touch, language and body (pp. 311-325). Routledge.
Mondada, L. (2006). Video recording as the reflexive preservation and configuration of phenomenal features for analysis. In H. Knoblauch, B. Schnettler, J. Raab, & H.-G. Soeffner (Eds.), Video Analysis: Methodology and methods. Qualitative audio-visual data analysis in sociology (pp. 51-68). Peter Lang.
Mondada, L. (2012). The Conversation Analytic Approach to Data Collection. In J. Sidnell & T. Stivers (Eds.), The handbook of conversation analysis (pp. 32-56). https://doi.org/https://doi.org/10.1002/9781118325001.ch3
Mondada, L. (2014). The local constitution of multimodal resources for social interaction. Journal of Pragmatics, 65, 137-156.
Mondada, L. (2017). Walking and talking together: Questions/answers and mobile participation in guided visits. Social science information, 56(2), 220-253.
Nevile, M. (2015). The embodied turn in research on language and social interaction. Research on Language and Social Interaction, 48(2), 121-151.
Oben, B. (2018). Gaze as a predictor for lexical and gestural alignment. In G. Brône & B. Oben (Eds.), Eyetracking in interaction: Studies on the role of eye gaze in dialogue (pp. 233-262). John Benjamins Publishing Company.
Pfeiffer, U. J., Vogeley, K., & Schilbach, L. (2013). From gaze cueing to dual eye-tracking: Novel approaches to investigate the neural correlates of gaze in social interaction. Neuroscience & Biobehavioral Reviews, 37(10, Part 2), 2516-2528. https://doi.org/https://doi.org/10.1016/j.neubiorev.2013.07.017
Pieters, R., & Warlop, L. (1999). Visual attention during brand choice: The impact of time pressure and task motivation. International Journal of research in Marketing, 16(1), 1-16.
Poulsen, S. V., Rasmussen, G., & Boeriis, M. (forthc.). What's in a semiotic resource?
Rasmussen, G. (2018). On the social constraints of having a world. RASK: International journal of language and communication, 7(Special Issue: The World at Your Feet), 79-107.
Rasmussen, G. (2019). Emergence and Human Communication. In J. S. Damico & M. J. Ball (Eds.), The SAGE Encyclopedia of Human Communication Sciences and Disorders (pp. 681-683). SAGE Publications.
Rasmussen, G., & Kristiansen, E. D. (2021). The sociality of minimizing involvement in Danish self-service shops: Danish customers’ multi-modal practices of being, getting and staying out of the way. Discourse & Communication, Special issue: The ‘human touch’ in online and offline buying and selling interaction (Gitte Rasmussen, Theo van Leeuwen, eds.).
Rasmussen, G., Kristiansen, E. D., & Andersen, E. M. (2019). Working out availability, unavailability and awayness in social face-to-face encounters: The case of dementia. Discourse Studies, 21(3), 258-279.
Rasmussen, G., Kristiansen, E. D., & Poulsen, S. V. (forthc.). The World of Daily Life: Doing a search for (e-)shopping purposes.
Risko, E. F., & Kingstone, A. (2011). Eyes wide shut: implied social presence, eye tracking and attention. Attention, Perception, & Psychophysics, 73(2), 291-296.
Rossano, F. (2012). Gaze behavior in face-to-face interaction. Max Planck Institute for Psycholinguistics Series.
Sacks, H. (1984). Notes on methodology. In J. M. Atkinson & J. Heritage (Eds.), Structures of social action: Studies in conversation analysis (pp. 21-27). Cambridge University Press, Editions de la Maison des Sciences de l'Homme. https://doi.org/10.1017/CBO9780511665868.005
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language: Journal of the Linguistic Society of America, 696-735. https://doi.org/10.2307/412243
Schegloff, E. A. (1972). Notes on a conversational practice: Formulating place. In J. Coulter (Ed.), Ethnomethodological sociology (pp. 75-119). Edward Elgar Publishing.
Schegloff, E. A. (2007). Sequence organization in interaction: Volume 1: A primer in conversation analysis (Vol. 1). Cambridge University Press.
Schmidt, R., & Wiesse, B. (2019). Online Participant Videos: A New Type of Data for Interpretative Social Research. Qualitative Social Research, 20(2).
Streeck, J. (1993). Gesture as communication I: Its coordination with gaze and speech. Communications Monographs, 60(4), 275-299.
Stukenbrock, A. (2015). Deixis in der face-to-face-Interaktion. de Gruyter.
Stukenbrock, A. (2018). Mobile dual eye-tracking in face-to-face interaction: The case of deixis and joint attention. In G. Brône & B. Oben (Eds.), Eye-tracking in Interaction: Studies on the role of eye gaze in dialogue (Vol. 10, pp. 265-300). John Benjamins Publishing Company.
Stukenbrock, A. (2020). Deixis, Meta-Perceptive Gaze Practices, and the Interactional Achievement of Joint Attention [Original Research]. Frontiers in psychology, 11(1779). https://doi.org/10.3389/fpsyg.2020.01779
Stukenbrock, A., & Dao, A. N. (2019). Joint attention in passing: What dual mobile eye tracking reveals about gaze in coordinating embodied activities at a market. In R. E. & G. C. (Eds.), Embodied Activities in Face-to-face and Mediated Settings (pp. 177-213). Palgrave MacMillan.
ten Have, P. (2005). The notion of member is the heart of the matter: On the role of membership knowledge in ethnomethodological inquiry. Historical Social Research/Historische Sozialforschung, 30(1), 28-53.
vom Lehn, D., & Heath, C. (2016). Action at the exhibit face: video and the analysis of social interaction in museums and galleries. Journal of Marketing Management, 32(15-16), 1441-1457. https://doi.org/10.1080/0267257X.2016.1188846
Wedel, M., & Pieters, R. (2008). A review of eye-tracking research in marketing. In M. N. K. (Ed.), Review of marketing research (Vol. 4, pp. 123-147). M. E. Sharpe.
Weiß, C., & Auer, P. (2016). Das Blickverhalten des Rezipienten bei Sprecherhäsitationen: eine explorative Studie. Gesprächsforschung Online Zeitschrift verbalen Interaktion, 17, 32-167.
Wooffitt, R., & Hutchby, I. (1998). Conversation Analysis: Principles, Practices and Applications. Polity Press.
Zhu, H., Otsuji, E., & Pennycook, A. (2017). Multilingual, multisensory and multimodal repertoires in corner shops, streets and markets: introduction. Social Semiotics, 27(4), 383-393.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Author and Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
We follow the Budapest Open Access Initiative's definition of Open Access.
The journal allows the author(s) to hold the copyright without restrictions.
The journal allows software/spiders to automatically crawl the journal content (also known as text mining)
The journal provides article level metadata to DOAJ
The journal allows readers to read, download, distribute, print, search, or link to the full texts of its articles and allow readers to use them for any other lawful purpose.
