Multimodal displays of understanding in vocabulary-oriented sequences
DOI:
https://doi.org/10.7146/si.v3i2.114992Keywords:
conversation analysis;, multimodality, embodiment, understanding, change-of-state, iconic gesture, smiling, language caféAbstract
How do participants use multimodal means to display joint understanding after dealing with vocabulary problems in second language interactions? In this article, we investigate the resolution phase of vocabulary-oriented sequences, more specifically word searches, word explanation sequences and vocabulary checks. We argue that understanding is displayed not only by change-of-state tokens, but typically by a more encompassing multimodal gestalt involving facial expression, gestures, and torso movements. A central feature of this gestalt is what we propose to call the change-of-state face, which consists in raised eyebrows and widened eyes and is produced while the head and/or the torso is raised upwards. Typically, this display of a change-of-state is followed by further demonstrations of understanding, such as verbal and gestural repeats. Finally, the solution of the problem is often ‘celebrated’ by means of reciprocal smiling. Not all vocabulary-oriented sequences are equally successful. Facial expression and gesture may also be used to resist and question a proposal of a candidate solution to a word search or a request for an explanation. In this way, multimodal means are crucial to establishing the success of vocabulary-oriented sequences and returning to the main business of the talk.
References
Aoki, H. (2011). Some functions of speakers head nods. In: Streeck, J., Goodwin, C.
and LeBaron, C. (Ed.), Embodied Interaction: Language and Body in the
Material World (pp. 93-105). Cambridge: Cambridge University Press.
Darwin, C. (2007). The expression of the emotions in man and animals. Chicago:
Filiquarian Publishing. (Original work published 1872).
Ekman, P. and Friesen, W. V. (1975) Unmasking the Face: A guide to Recognizing Emotions from Facial Clues. Englewood Cliffs, NJ: Prentice-Hall. Reprint edn, Palo Alto, CA: Consulting Psychologists Press, 1984.
Emmertsen, S. and Heinemann, T. (2010). Realization as a Device for Remedying Problems of Affiliation in Interaction. Research on Language and Social Interaction, 43 (2), 109-132.
Eskildsen, S. W. (2018). ’We’re Learning a Lot of New Words’ Encountering New L2
Vocabulary Outside of Class. The Modern Language Journal, 102 (supplement 2018), 46-63.
Eskildsen, S. W. and Wagner, J. (2013). Recurring and shared gestures in the L2
classroom: Resources for teaching and learning. European Journal of Applied Linguistics, 1, 139-161.
Eskildsen, S. W. and Wagner, J. (2015). Embodied L2 Construction Learning.
Language Learning, 65, 268-297.
Fukuda, C. and Burdelski, M. (2019). Multimodal Demonstrations of Understanding of
visible, imagined and tactile objects in guided tours. Research on Language
and Social Interaction, 52(1), 20-40.
Goodwin, C. and Goodwin, M.H. (1986). Gestures and coparticipation in the activity
of searching for a word. Semiotica, 62, 51-75.
Goodwin, C. (1994). Professional vision. American Antropologist, 96(3), 606-633.
Greer, T., (2013). Word search sequences in bilingual interaction: codeswitching and
embodied orientation toward shifting participant constellations. Journal of
Pragmatics, 57, 100-117.
Gudmundsen, J. (2019). Felles forståelse på prøve. En multimodal samtaleanalyse av språkorienterte sekvenser i andrespråkssamtaler. [Mutual understanding at risk: A multimodal conversation analysis of vocabulary-oriented sequences in second language conversations] MA thesis. Oslo: Department of Linguistics and Scandinavian Studies, University of Oslo.
Gullberg, M. (2011). Multilingual Multimodality: Communicative Difficulties and Their
Solutions in Second-Language Use. In: Streeck, J., Goodwin, C. and LeBaron, C. (Ed.), Embodied Interaction: Language and Body in the Material World (pp.137-151). Cambridge: Cambridge University Press.
Gundersen, A. (2011). Norwegian libraries and special services for immigrant women
Paper presented at World Library and Information Congress: 77. IFLA General
Conference and Assembly, 12.-18. August 2011, San Juan, Puero Rico.
Downloaded from: http://conference.ifla.org/past/ifla77/150-gundersen-en.pdf
Hayashi, M. (2003). Language and the body as resources for collaborative action: a
study of word searches in Japanese conversation. Research on Language and
Social Interaction, 36, 109-141.
Heath, C., Vom Lehn, D., Cleverly, J. and Luff, P. (2012) Revealing Surprise. Peräkylä, A. and Sornojen, M. L. (Ed.) Emotion in Interaction (pp.212-234). Oxford: OUP.
Heinemann, T. (2016). From ‘looking’ to ‘seeing’: Indexing delayed intelligibility of an object with the Danish change-of-state token n↑ å↓. Journal of Pragmatics, 104, 108-132.
Heinemann, T., & Koivisto, A. L. (2016). Indicating a change-of-state in interaction: cross-linguistic explorations. Journal of Pragmatics, 104, 83–88.
Heritage, J. (1984). A change-of-state token and aspects of its sequential placement.
In: Atkinson, J.M. and Heritage, J. (Ed.), Structures of Social Action (pp. 299-
. Cambridge: Cambridge University Press.
Hindmarsh, J., Reynolds, P. and Dunne, S. (2011). Exhibiting understanding: The
body in the apprenticeship. Journal of Pragmatics, 43, 489-503.
Hosoda, Y., (2000). Other-Repair in Japanese Conversations Between Nonnative
and Native Speakers. Applied Linguistics, 11, 39-63.
Hosoda, Y. (2006). Repair and relevance of differential language expertise in second
language conversations. Applied Linguistics, 27, 25-50.
Hutchins, E. (1995). Cognition in the wild. Cambridge: MA: The MIT Press.
Johnston, J. and Audunson, R. (2017). Supporting immigrant’s political integration
through discussion and debate in public libraries. Journal of Librarianship and
Information Science, 00 (0), 1-15.
Kendon, A. (1975). Gesticulation, speech and the gesture theory of language origins. Sign Language Studies, 9, 349-373.
Kendon, A. (2004). Gesture: visible action as utterance. Cambridge: Cambridge
University Press.
Koivisto, A. (2015). Displaying now-understanding: The Finnish change-of-state token aa. Discourse Processes, 52, 111-148.
Kurhila, S. (2006). Second Language Interaction. Amsterdam: John Benjamins.
McNeill, D. (1992). Hand and Mind. Chicago: Chicago University Press.
Mazeland H. and Zaman-Zadeh, M. (2004). The Logic of Clarification: Some
Observations about Word-Clarification Repairs in Finnish-as-a-Lingua-Franca
Interactions. In: Gardner, R. and Wagner, J. (Ed.), Second language
conversations (pp. 132-156). New York, NY: Continuum.
Mondada, L. (2007). Multimodal resources for turn-taking: pointing and the
emergence of possible next speakers. Discourse studies, 9, 194-225.
Mondada L. (2011). Understanding as an embodied, situated and sequential
achievement in interaction. Journal of Pragmatics, 43, 542-552.
Mondada, L. (2014). The local constitution of multimodal resources for social
interaction. Journal of Pragmatics, 65, 137-156.
Park, I. (2007). Co-construction of word search activities in native and non-native
speaker interaction. Working Papers in TESOL & Applied Linguistics, 7(2), 1
Peräkylä, A. and Ruusuvuori, J. (2009). Facial and Verbal Expressions in Assessing
Stories and Topics. Research on language and social interaction, 42, 377-394.
Rossano, F. (2012). Gaze in Conversation. In: Sidnell, J. and Stivers, T. (Ed), The
Handbook of Conversation Analysis (1th ed., pp. 229-256). Chichester: Wiley-
Blackwell.
Sacks, H. (1992). Lectures on Conversation. Vol 2. Jefferson, G., introduction by
Schegloff, E.A (Ed.). Oxford: Basil Blackwell.
Schegloff, E. A. (1992). Repair after next turn: The last structurally provided defense of intersubjectivity in conversation. American Journal of Sociology, 1295-1345.
Seuren, L. M., Huiskes, M. & Koole, T. (2016). Remembering and understanding with oh-prefaced yes/no declaratives in Dutch. Journal of Pragmatics, 104, 180- 192.
Sorjonen, M. L. (1996). On repeats and responses in Finnish conversations. In:
Ochs, E.,Schegloff, E. A.; Thompson, S.A. (Ed.), Interaction and Grammar (pp.
-327). Cambridge: Cambridge University Press.
Streeck, J. (2009). Gesture as Communication 1: It’s Coordination With Gaze and Speech. Communication Monographs, 60, 275-299.
Svennevig, J. (2004). Other-repetition as display of hearing, understanding and
emotional stance. Discourse Studies, 6, 489-516.
Svennevig, J. (2018a). ”What’s it called in Norwegian?” Acquiring L2 vocabulary
items in the workplace. Journal of Pragmatics, 126, 68-77.
Svennevig, J. (2018b). Decomposing turns to enhance understanding by L2
speakers. Research on language and social interaction, 51, 398-416.
Theodórsdóttir, G. (2018). A Closer Look at Correction and Explanation
Practices in Everyday L2 Interaction. The Modern Language Journal, 102
(supplement 2018), 30-45.
Theodórsdóttir, G. and Eskildsen, S.W. (2011). The use of English in everyday as a
second language: Establishing intersubjectivity and doing learning. Nordand,
, 59-85.
Wagner, J. (2015). Designing for language learning in the wild. Creating social
infrastructures for second language learning. In: Cadierno, T. and Eskildsen,
S.W. (Ed.), Usuage based perspectives on second language learning (pp.75-
. Berlin: de Gruyter Mouton.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Author and Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
We follow the Budapest Open Access Initiative's definition of Open Access.
The journal allows the author(s) to hold the copyright without restrictions.
The journal allows software/spiders to automatically crawl the journal content (also known as text mining)
The journal provides article level metadata to DOAJ
The journal allows readers to read, download, distribute, print, search, or link to the full texts of its articles and allow readers to use them for any other lawful purpose.
