Halting the Decay of Talk
How Atypical Interactants Adapt their Virtual Worlds
DOI:
https://doi.org/10.7146/si.v6i1.136903Keywords:
technologically mediated communication, atypical interaction, virtual reality, multimodal conversation analysisAbstract
We investigate how people with atypical bodily capabilities interact within virtual reality (VR) and the way they overcome interactional challenges in these emerging social environments. Based on a videographic multimodal single case analysis, we demonstrate how non-speaking VR participants furnish their bodies, at-hand instruments, and their interactive environment for their practical purposes. Our findings are subsequently related to renewed discussions of the relationship between agency and environment, and the co-constructed nature of situated action. We thus aim to contribute to the growing vocabulary of atypical interaction analysis and the broader context of ethnomethodological conceptualizations of unorthodox and fractured interactional ecologies.
References
Arminen, I., Licoppe, C., & Spagnolli, A. (2016). Respecifying Mediated Interaction. Research on Language and Social Interaction, 49(4), 290–309. https://doi.org/10.1080/08351813.2016.1234614
Auer, P., & Hörmeyer, I. (2017). Achieving Intersubjectivity in Augmentative and Alternative Communication (AAC): Intercorporeal, Embodied, and Disembodied Practices. In C. Meyer, J. Streeck, & J. S. Jordan (Eds.), Foundations of human interaction. Intercorporeality: Emerging socialities in interaction (pp. 323–360). Oxford University Press.
Auer, P., & Stukenbrock, A. (2022). Deictic reference in space. In A. H. Jucker & H. Hausendorf (Eds.), Pragmatics of Space (pp. 23–62). De Gruyter. https://doi.org/10.1515/9783110693713-002
Barnes, S. (2014). Managing Intersubjectivity in Aphasia. Research on Language and Social Interaction, 47(2), 130–150. https://doi.org/10.1080/08351813.2014.900216
Brassac, C., Fixmer, P., Mondada, L., & Vinck, D. (2008). Interweaving Objects, Gestures, and Talk in Context. Mind, Culture, and Activity, 15(3), 208–233. https://doi.org/10.1080/10749030802186686
Brüning, B., Schnier, C., Pitsch, K., & Wachsmuth, S. (2012). Integrating PAMOCAT in the research cycle. In L.-P. Morency, D. Bohus, H. Aghajan, J. Cassell, A. Nijholt, & J. Epps (Eds.), Proceedings of the 14th ACM international conference on Multimodal interaction (pp. 201–208). ACM. https://doi.org/10.1145/2388676.2388716
Caronia, L., & Mortari, L. (2015). The agency of things: how spaces and artefacts organize the moral order of an intensive care unit. Social Semiotics, 25(4), 401–422. https://doi.org/10.1080/10350330.2015.1059576
Cekaite, A., & Mondada, L. (Eds.). (2021). Touch in social interaction: Touch, Language, and Body. Routledge.
Day, D., & Wagner, J. (2014). Objects as tools for talk. In M. Nevile, P. Haddington, T. Heinemann, & M. Rauniomaa (Eds.), Interacting with objects: Language, materiality, and social activity (pp. 101–124). John Benjamins Publishing Company.
Erofeeva, M. (2019). On multiple agencies: when do things matter? Information, Communication & Society, 22(5), 590–604. https://doi.org/10.1080/1369118X.2019.1566486
Erofeeva, M., & Klowait, N. O. (2021). The Impact of Virtual Reality, Augmented Reality, and Interactive Whiteboards on the Attention Management in Secondary School STEM Teaching. In 2021 7th International Conference of the Immersive Learning Research Network (iLRN).
Fox, B. A., & Heinemann, T. (2015). The Alignment of Manual and Verbal Displays in Requests for the Repair of an Object. Research on Language and Social Interaction, 48(3), 342–362. https://doi.org/10.1080/08351813.2015.1058608
Garland-Thomson, R. (1997). Exceptional bodies: Figuring physical disability in American literature and culture. Columbia University Press.
Goffman, E. (1981). Forms of talk. University of Pennsylvania Press.
Goodwin, C. (1981). Conversational organization: Interaction between speakers and hearers. Academic Press.
Goodwin, C. (1995). Co-Constructing Meaning in Conversations With an Aphasie Man. Research on Language and Social Interaction, 28(3), 233–260. https://doi.org/10.1207/s15327973rlsi2803_4
Goodwin, C. (2000). Action and embodiment within situated human interaction. Journal of Pragmatics, 32(10), 1489–1522. https://doi.org/10.1016/S0378-2166(99)00096-X
Goodwin, C. (2018). Co-operative action. Learning in doing. Cambridge University Press.
Goodwin, M. H. (2017). Haptic Sociality: The Embodied Interactive Constitution of Intimacy through Touch. In C. Meyer, J. Streeck, & J. S. Jordan (Eds.), Intercorporeality Emerging Socialities in Interaction (pp. 73–102). Oxford University Press.
Goodwin, M. H., & Cekaite, A. (2019). Embodied family choreography: Practices of control, care, and mundane creativity. Routledge.
Haddington, P., & Oittinen, T. (2022). Interactional spaces in stationary, mobile, video-mediated and virtual encounters. In A. H. Jucker & H. Hausendorf (Eds.), Pragmatics of Space (pp. 317–362). De Gruyter. https://doi.org/10.1515/9783110693713-011
(n.d). Helping Hands mission statement. https://docs.google.com/document/d/1KFTiPRlER_Lf0aIbqfHDOWGqsl9aoyY2DGzeoqz5zD0/edit
Kendon, A. (2009). Conducting interaction: Patterns of behavior in focused encounters. Cambridge University Press.
Klowait N. O. (2023). On the Multimodal Resolution of a Search Sequence in Virtual Reality. Human Behavior and Emerging Technologies, article ID 8417012. https://doi.org/10.1155/2023/8417012
Latour, B. (2005). Reassembling the social: An introduction to actor-network-theory. Clarendon lectures in management studies. Oxford University Press.
Licoppe, C., Luff, P. K., Heath, C., Kuzuoka, H., Yamashita, N., & Tuncer, S. (2017). Showing Objects. In G. Mark, S. Fussell, C. Lampe, m. schraefel, J. P. Hourcade, C. Appert, & D. Wigdor (Eds.), Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 5295–5306). ACM. https://doi.org/10.1145/3025453.3025848
Lindström, J. K., Norrby, C., Wide, C., & Nilsson, J. (2017). Intersubjectivity at the counter: Artefacts and multimodal interaction in theatre box office encounters. Journal of Pragmatics, 108, 81–97. https://doi.org/10.1016/j.pragma.2016.11.009
Luff, P., Heath, C., Kuzuoka, H., Hindmarsh, J., Yamazaki, K., & Oyama, S. (2003). Fractured Ecologies: Creating Environments for Collaboration. Human–Computer Interaction, 18(1-2), 51–84. https://doi.org/10.1207/S15327051HCI1812_3
Merlino, S., Mondada, L., & Söderström, O. (2022). Walking through the city soundscape: an audio-visual analysis of sensory experience for people with psychosis. Visual Communication, 22(1): 71-95. https://doi.org/10.1177/14703572211052638
Mondada, L. (2001). Conventions for multimodal transcription. https://www.lorenzamondada.net/multimodal-transcription
Mondada, L. (2013). Interactional space and the study of embodied talk-in-interaction. In P. Auer, M. Hilpert, A. Stukenbrock, & B. Szmrecsanyi (Eds.), Space in Language and Linguistics (pp. 247–275). De Gruyter. https://doi.org/10.1515/9783110312027.247
Mondada, L. (2016). Challenges of multimodality: Language and the body in social interaction. Journal of Sociolinguistics, 20(3), 336–366. https://doi.org/10.1111/josl.1_12177
Mondada, L. (2019). Contemporary issues in conversation analysis: Embodiment and materiality, multimodality and multisensoriality in social interaction. Journal of Pragmatics, 145, 47–62. https://doi.org/10.1016/j.pragma.2019.01.016
Nevile, M. (2015). The Embodied Turn in Research on Language and Social Interaction. Research on Language and Social Interaction, 48(2), 121–151. https://doi.org/10.1080/08351813.2015.1025499
Nevile, M., Haddington, P., Heinemann, T., & Rauniomaa, M. (Eds.). (2014). Interacting with objects: Language, materiality, and social activity. John Benjamins Publishing Company.
Raudaskoski, P. (2020). Participant status through touch-in-interaction in a residential home for people with acquired brain injury. Social Interaction. Video-Based Studies of Human Sociality, 3(1). https://doi.org/10.7146/si.v3i1.120269
Seuren, L. M., Wherton, J., Greenhalgh, T., & Shaw, S. E. (2021). Whose turn is it anyway? Latency and the organization of turn-taking in video-mediated interaction. Journal of Pragmatics, 172, 63–78. https://doi.org/10.1016/j.pragma.2020.11.005
Wilkinson, R., Rae, J. P., & Rasmussen, G. (2020). Atypical Interaction. Springer International Publishing. https://doi.org/10.1007/978-3-030-28799-3
Zhao, S. (2005). The Digital Self: Through the Looking Glass of Telecopresent Others. Symbolic Interaction, 28(3), 387–405. https://doi.org/10.1525/si.2005.28.3.387
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Author and Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
We follow the Budapest Open Access Initiative's definition of Open Access.
The journal allows the author(s) to hold the copyright without restrictions.
The journal allows software/spiders to automatically crawl the journal content (also known as text mining)
The journal provides article level metadata to DOAJ
The journal allows readers to read, download, distribute, print, search, or link to the full texts of its articles and allow readers to use them for any other lawful purpose.
