Sustained Pointing Gestures in Instructions and Questions
How the Temporal Extent of a Gesture matters in Interaction
DOI:
https://doi.org/10.7146/si.v7i2.137058Keywords:
pointing gesture, gestural hold, TRP, questions, instructionsAbstract
Gestures can be brief and compact in their execution, but also elaborate and extended. One way to utilise this kinetic flexibility is to extend one’s gesture in time by holding it in its stroke position. This study explores the interactional function of gestural holds by investigating pointing gestures that are sustained beyond a sequence-initiating turn and into the responsive space following it. The study draws on video data from naturally occurring conversations in German and focuses on held pointing gestures after instructions and questions. It is shown that in both action environments, participants delay gestural closure to indicate that they still consider the addressee’s response to be insufficient.
References
Andrén, M. (2011). The organization of children’s pointing stroke endpoints. In G. Stam Gale & M. Ishino (Eds.), Integrating Gestures: The interdisciplinary nature of Gesture (pp. 153–162). John Benjamin Publishing.
Balantani, A. (2022). Coordinating individual actions in joint activities: The case of the German deictic so. Lingua, 277. https://doi.org/10.1016/j.lingua.2022.103402
Barske, T., & Golato, A. (2010). German so: managing sequence and action. Text & Talk, 30(3), 245–266. https://doi.org/10.1515/text.2010.013
Blythe, J., Gardner, R., Mushin, I., & Stirling, L. (2018). Tools of Engagement: Selecting a Next Speaker in Australian Aboriginal Multiparty Conversations. ROLSI, 51(2), 145–170. https://doi.org/10.1080/08351813.2018.1449441
Bühler, K. (1934). Sprachtheorie: Die Darstellungsfunktion der Sprache. Gustav Fischer Verlag.
Butterworth, G. (2003). Pointing is the royal road to language for babies. In S. Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp. 9–33). Erlbaum.
Clark, H. H. (1996). Using language. Cambridge University Press.
Clark, H. H. (2003). Pointing and placing. In S. Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp. 243–268). Erlbaum.
Clark, H. H. (2005). Coordinating with each other in a material world. Discourse Studies, 7(4–5), 507–525. https://doi.org/10.1177/1461445605054404
Clark, H. H. (2012). Wordless questions, wordless answers. In J. de Ruiter (Ed.), Questions: formal, functional and interactional perspectives (pp. 81–100). Cambridge University Press.
Cooperrider, K. (2016). The Co-Organization of Demonstratives and Pointing Gestures. Discourse Processes, 53(8), 632–656. https://doi.org/10.1080/0163853X.2015.1094280
Cooperrider, K., Fenlon, J., Keane, J., Brentari, D., & Goldin-Meadow, S. (2021). How Pointing is Integrated into Language: Evidence From Speakers and Signers. Frontiers in Communication 6:567774. https://doi.org/10.3389/fcomm.2021.567774.
Couper-Kuhlen, E., & Selting, M. (2018). Interactional Linguistics: Studying Language in Social Interaction. Cambridge University Press
Curl, T. S. & Drew, P. (2008). Contingency and Action: A Comparison of Two Forms of Requesting. ROLSI, 41(2), 129–153.
Deppermann, A. (2008). Gespräche analysieren: Eine Einführung. Verlag für Sozialwissenschaften.
Deppermann, A. (2018a). Instruction practices in German driving lessons: Differential uses of declaratives and imperatives. International Journal of Applied Linguistics, 28(2), 265–282.
Deppermann, A. (2018b). Sprache in der multimodalen Interaktion. In A. Deppermann & S. Reineke (Eds.), Sprache im kommunikativen, interaktiven und kulturellen Kontext (pp. 51–86). De Gruyter.
Deppermann, A. (2021). Imperative im Deutschen: Konstruktionen, Praktiken oder social action formats? In B. Weidner, K. König, W. Imo, & L. Wegner (Eds.), Verfestigungen in der Interaktion. Konstruktionen, sequenzielle Muster, kommunikative Gattungen (pp. 195–229). De Gruyter.
Deppermann, A. & Streeck, J. (2018). The body in interaction: Its multiple modalities and temporalities. In A. Deppermann & J. Streeck (Eds.), Time in Embodied Interaction: Synchronicity and Sequentiality of Multimodal Resources (pp. 1–29). John Benjamins.
De Stefani, E. (2014). Rearranging (in) space: On mobility and its relevance for the study of face-to-face interaction. In P. Auer, M. Hilpert, A. Stukenbrock, & B. Szmrecsanyi (Eds.), Space in Language and Linguistics: Geographical, Interactional, and Cognitive Perspectives (pp. 434–463). De Gruyter. https://doi.org/10.1515/9783110312027.434
De Ruiter, J. P. (Ed.) (2012). Questions: formal, functional and interactional perspectives. Cambridge University Press.
Drew, P. & Couper-Kuhlen, E. (Eds.) (2014). Requesting in Social Interaction. John Benjamins.
Enfield, N. J. (2009). The Anatomy of Meaning: Speech, Gesture, and Composite Utterances (Language Culture and Cognition). Cambridge University Press. https://doi.org/10.1017/CBO9780511576737
Enfield, N. J., Kita, S., & de Ruiter, J. P. (2007). Primary and secondary pragmatic functions of pointing gestures. JoP, 39(10), 1722–1741. https://doi.org/10.1016/j.pragma.2007.03.001.
Erikson, M. (2009). Referring as interaction: On the interplay between linguistic and bodily practices. JoP, 41, 240–262.
Floyd, S., Rossi, G., & Enfield, N. J. (Eds.) (2020). Getting others to do things. A pragmatic typology of recruitments. Language Science Press.
Ford, C. E., & Thompson, S. A. (1996). Interactional units in conversation: syntactic, intonational, and pragmatic resources for the management of turns. In E. Ochs, E. A. Schegloff, & S. A. Thompson (Eds.), Interaction and Grammar (pp. 134–184). Cambridge University Press.
Goodwin, C. (1981a). Exophoric Reference as an Interactive Resource. In J. N. Deely & M. D. Lenhart (Eds.), Semiotics (pp. 119–128.). Plenum Press.
Goodwin, C. (1981b). Conversational Organization: Interaction between Speakers and Hearers. Academic Press.
Gubina, A. (2021). Availability, Grammar, and Action Formation: On Simple and Modal Interrogative Request Formats in Spoken German. In O. Ehmer, H. Helmer, F. Oloff, & S. Reineke (Eds.), 'How to get things done' - Aufforderungen und Instruktionen in der multimodalen Interaktion [Special Issue]. Gesprächsforschung - Online-Zeitschrift zur verbalen Interaktion, 22, 272–303.
Haddington, P., Keisanen, T., Mondada, L., & Nevile, M. (2014) (Eds.). Multiactivity in Social Interaction: Beyond Multitasking. John Benjamins.
Heritage, J. (1984). A change-of-state token and aspects of its sequential placement. In J.M. Atkinson & J. Heritage (Eds.), Structures of Social Action: Studies in Conversation Analysis (pp. 299–345). Cambridge University Press.
Heritage, J. & Raymond, G. (2012). Navigating epistemic landscapes: acquiesence, agency and resistance in responses to polar questions. In J. P. de Ruiter (Ed), Questions: Formal, Functional and Interactional Perspectives (pp. 179–192). Cambridge University Press.
Hindmarsh, J. & Heath, C. (2000). Embodied reference: A study of deixis in workplace interaction. JoP, 32(12), 1855–1878.
Jefferson, G. (2004). Glossary of transcript symbols with an introduction. In G. Lerner (Ed.), Conversation Analysis: Studies from the First Generation (pp. 13–31). John Benjamins.
Kendon, A. (1980). Gesticulation and Speech: Two Aspects of the Process of Utterance. In M. R. Key (Ed.), The Relationship of Verbal and Nonverbal Communication (pp. 207–228). De Gruyter. https://doi.org/10.1515/9783110813098.207
Kendon, A. (2004). Gesture: Visible Action as Utterance. Cambridge University Press.
Kita, S. (Ed.) (2003). Pointing: Where language, culture and cognition meet. Erlbaum.
Kita, S., Gijn, I.v., & Hulst, H.v.d. (1998). Movement phases in signs and co-speech gestures, and their transcription by human coders. In I. Wachsmuth & M. Fröhlich (Eds.), Gesture and sign language in human-computer interaction: international gesture workshop Bielefeld, Germany, September 17–19, 1997: proceedings (pp. 23–35). Springer.
Krug, M. & Schmidt, A. (2020). Zwischenfazit: Sukzessive und simultane Verzahnung von Spiel- und Besprechungsaktivitäten – eine Instruktionsmatrix für Proben. Gesprächsforschung Online, 21, 264–277.
Labov, W., & Fanshel, D. (1977). Therapeutic discourse: Psychotherapy as conversation. Academic Press.
Lerner, G. H. (2003). Selecting next speaker: The context-sensitive operation of a context-free organization. Language in Society, 32(2), 177–201.
Lerner, G. H. (2004). On the place of linguistic resources in the organization of talk-in-interaction: Grammar as action in prompting a speaker to elaborate. Research on Language and Social Interaction, 37(2), 151–185.
Lindwall, O., Lymer, G., Greiffenhagen, C. (2015). The sequential analysis of instruction. In N. Markee (Ed.), The handbook of classroom discourse and interaction (pp. 142–157). Wiley.
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.
McNeill, D., Cassell, J., & Levy, E. T. (1993). Abstract deixis. Semiotica, 95(1–2), 5–19.
Mondada, L. (2007). Multimodal resources for turn-taking: pointing and the emergence of possible next speakers. Discourse Studies, 9(2), 194–225.
Mondada, L. (2013). Conversation analysis: Talk and bodily resources for the organization of social interaction. In C. Müller, A. Cienki, E. Fricke, S. Ladewig, D. McNeill & S. Tessendorf (Eds.), Body - Language - Communication: An international Handbook on Multimodality in Human Interaction (Vol. 1) (pp. 218–226). De Gruyter.
Mondada, L. (2015). Multimodal completions. In A. Deppermann & S. Günthner (Eds.), Temporality in Interaction (pp. 267–308.). John Benjamins.
Mondada, L. (2016). Challenges of multimodality: Language and the body in social interaction. Journal of Sociolinguistics, 20(3), 336–366.
Mondada, L. (2019). Conventions for multimodal transcription. https://www.lorenzamondada.net/multimodal-transcription.
Mondada, L. (2021). Sensing in Social Interaction. Cambridge University Press.
Persson, R. (2017). Fill-in-the-Blank Questions in Interaction: Incomplete Utterances as a Resource for Doing Inquiries. ROLSI, 50(3), 227–248. https://doi.org/10.1080/08351813.2017.1340698
Raymond, G. (2003). Grammar and social organization: yes/no interrogatives and the structure of responding. American Sociological Review, 68(6), 939–967.
Rossi, G. (2014). When do people not use language to make requests? In P. Drew & E. Couper-Kuhlen (Eds.), Requesting in Social Interaction (pp. 303–334). John Benjamins.
Sacks, H. (1992). Lectures on Conversation. Volume II. Edited by Gail Jefferson. Blackwell Publishing.
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A Simplest Systematics for the Organization of Turn-Taking for Conversation. Language, 50(4/1), 696–735.
Schegloff, E. A. (1984). On some gestures' relation to talk. In J. M. Atkinson & J. Heritage (Eds.), Structures of Social Action: Studies in Conversation Analysis (pp. 266–295). Cambridge University Press.
Schegloff, E. A. (2007). Sequence Organization in Interaction: A Primer in Conversation Analysis. Cambridge University Press.
Schmidt, T. (2016). Good practices in the compilation of FOLK, the Research and Teaching Corpus of Spoken German. In: J. M. Kirk & G. Andersen (Eds.), Compilation, transcription, markup and annotation of spoken corpora. Special Issue of the International Journal of Corpus Linguistics [IJCL 21:3], (pp. 396–418).
Selting, M. (2000). The construction of units in conversational talk. Language in Society, 29(4), 477–517.
Seyfeddinipur, M. (2006). Disfluency: Interrupting speech and gesture. [Doctoral dissertation, Radboud University Nijmegen].
Sidnell, J. (2005). Gesture in the pursuit and display of recognition: A Caribbean case study. Semiotica, 156, 55–87.
Sidnell, J. (2013). Basic conversation analytic methods, In J. Sidnell & T. Stivers (Eds.), The Handbook of Conversation Analysis (pp. 77–99). Wiley-Blackwell.
Sikveland, R.O., & Ogden, R. A. (2012). Holding gestures across turns: Moments to generate shared understanding. Gesture, 12(2), 166–199.
Steensig, J., & Heinemann, T. (2013). When “yes” is not enough – as an answer to a yes/no question. In B. Szczepek Reed & G. Raymond (Eds.), Units of Talk – Units of Action (pp. 207–242). John Benjamins.
Stevanovic, M. & Peräkylä, A. (2014). Three orders in the organization of human action: On the interface between knowledge, power, and emotion in interaction and social relations. Language in Society, 43(2), 185–207.
Stivers, T. (2010). An overview of the question–response system in American English conversation, JoP, 42(10), 2772–2781.
Stivers, T., & Hayashi, M. (2010). Transformative answers: One way to resist a question's constraints. Language in Society, 39, 1–25. doi:10.1017/S0047404509990637.
Streeck, J. (2017). Self-Making Man: A Day of Action, Life, and Language. Cambridge University Press.
Stukenbrock, A. (2015). Deixis in der face-to-face-Interaktion. De Gruyter.
ter Bekke, M., Drijvers, L., & Holler, J. (2020). The predictive potential of hand gestures during conversation: An investigation of the timing of gestures in relation to speech. In Proceedings of the 7th GESPIN - Gesture and Speech in Interaction Conference. Stockholm: KTH Royal Institute of Technology.
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. (2006). ELAN: A Professional Framework for Multimodality Research. In Proceedings of LREC 2006, Fifth International Conference on Language Resources and Evaluation.
Zinken, J., & Deppermann, A. (2017). A cline of visible commitment in the situated design of imperative turns. Evidence from German and Polish. In M.-L. Sorjonen, L. Raevaara & E. Couper-Kuhlen (Eds.), Imperative turns at talk: The design of directives in action (pp. 27–63). Benjamins.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Author and Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
We follow the Budapest Open Access Initiative's definition of Open Access.
The journal allows the author(s) to hold the copyright without restrictions.
The journal allows software/spiders to automatically crawl the journal content (also known as text mining)
The journal provides article level metadata to DOAJ
The journal allows readers to read, download, distribute, print, search, or link to the full texts of its articles and allow readers to use them for any other lawful purpose.
