Multimodal displays of understanding in vocabulary-oriented sequences


  • Jenny Gudmundsen University of Oslo
  • Jan Svennevig



conversation analysis;, multimodality, embodiment, understanding, change-of-state, iconic gesture, smiling, language café


How do participants use multimodal means to display joint understanding after dealing with vocabulary problems in second language interactions? In this article, we investigate the resolution phase of vocabulary-oriented sequences, more specifically word searches, word explanation sequences and vocabulary checks. We argue that understanding is displayed not only by change-of-state tokens, but typically by a more encompassing multimodal gestalt involving facial expression, gestures, and torso movements. A central feature of this gestalt is what we propose to call the change-of-state face, which consists in raised eyebrows and widened eyes and is produced while the head and/or the torso is raised upwards. Typically, this display of a change-of-state is followed by further demonstrations of understanding, such as verbal and gestural repeats. Finally, the solution of the problem is often ‘celebrated’ by means of reciprocal smiling. Not all vocabulary-oriented sequences are equally successful. Facial expression and gesture may also be used to resist and question a proposal of a candidate solution to a word search or a request for an explanation. In this way, multimodal means are crucial to establishing the success of vocabulary-oriented sequences and returning to the main business of the talk.


Aoki, H. (2011). Some functions of speakers head nods. In: Streeck, J., Goodwin, C.

and LeBaron, C. (Ed.), Embodied Interaction: Language and Body in the

Material World (pp. 93-105). Cambridge: Cambridge University Press.

Darwin, C. (2007). The expression of the emotions in man and animals. Chicago:

Filiquarian Publishing. (Original work published 1872).

Ekman, P. and Friesen, W. V. (1975) Unmasking the Face: A guide to Recognizing Emotions from Facial Clues. Englewood Cliffs, NJ: Prentice-Hall. Reprint edn, Palo Alto, CA: Consulting Psychologists Press, 1984.

Emmertsen, S. and Heinemann, T. (2010). Realization as a Device for Remedying Problems of Affiliation in Interaction. Research on Language and Social Interaction, 43 (2), 109-132.

Eskildsen, S. W. (2018). ’We’re Learning a Lot of New Words’ Encountering New L2

Vocabulary Outside of Class. The Modern Language Journal, 102 (supplement 2018), 46-63.

Eskildsen, S. W. and Wagner, J. (2013). Recurring and shared gestures in the L2

classroom: Resources for teaching and learning. European Journal of Applied Linguistics, 1, 139-161.

Eskildsen, S. W. and Wagner, J. (2015). Embodied L2 Construction Learning.

Language Learning, 65, 268-297.

Fukuda, C. and Burdelski, M. (2019). Multimodal Demonstrations of Understanding of

visible, imagined and tactile objects in guided tours. Research on Language

and Social Interaction, 52(1), 20-40.

Goodwin, C. and Goodwin, M.H. (1986). Gestures and coparticipation in the activity

of searching for a word. Semiotica, 62, 51-75.

Goodwin, C. (1994). Professional vision. American Antropologist, 96(3), 606-633.

Greer, T., (2013). Word search sequences in bilingual interaction: codeswitching and

embodied orientation toward shifting participant constellations. Journal of

Pragmatics, 57, 100-117.

Gudmundsen, J. (2019). Felles forståelse på prøve. En multimodal samtaleanalyse av språkorienterte sekvenser i andrespråkssamtaler. [Mutual understanding at risk: A multimodal conversation analysis of vocabulary-oriented sequences in second language conversations] MA thesis. Oslo: Department of Linguistics and Scandinavian Studies, University of Oslo.

Gullberg, M. (2011). Multilingual Multimodality: Communicative Difficulties and Their

Solutions in Second-Language Use. In: Streeck, J., Goodwin, C. and LeBaron, C. (Ed.), Embodied Interaction: Language and Body in the Material World (pp.137-151). Cambridge: Cambridge University Press.

Gundersen, A. (2011). Norwegian libraries and special services for immigrant women

Paper presented at World Library and Information Congress: 77. IFLA General

Conference and Assembly, 12.-18. August 2011, San Juan, Puero Rico.

Downloaded from:

Hayashi, M. (2003). Language and the body as resources for collaborative action: a

study of word searches in Japanese conversation. Research on Language and

Social Interaction, 36, 109-141.

Heath, C., Vom Lehn, D., Cleverly, J. and Luff, P. (2012) Revealing Surprise. Peräkylä, A. and Sornojen, M. L. (Ed.) Emotion in Interaction (pp.212-234). Oxford: OUP.

Heinemann, T. (2016). From ‘looking’ to ‘seeing’: Indexing delayed intelligibility of an object with the Danish change-of-state token n↑ å↓. Journal of Pragmatics, 104, 108-132.

Heinemann, T., & Koivisto, A. L. (2016). Indicating a change-of-state in interaction: cross-linguistic explorations. Journal of Pragmatics, 104, 83–88.

Heritage, J. (1984). A change-of-state token and aspects of its sequential placement.

In: Atkinson, J.M. and Heritage, J. (Ed.), Structures of Social Action (pp. 299-

. Cambridge: Cambridge University Press.

Hindmarsh, J., Reynolds, P. and Dunne, S. (2011). Exhibiting understanding: The

body in the apprenticeship. Journal of Pragmatics, 43, 489-503.

Hosoda, Y., (2000). Other-Repair in Japanese Conversations Between Nonnative

and Native Speakers. Applied Linguistics, 11, 39-63.

Hosoda, Y. (2006). Repair and relevance of differential language expertise in second

language conversations. Applied Linguistics, 27, 25-50.

Hutchins, E. (1995). Cognition in the wild. Cambridge: MA: The MIT Press.

Johnston, J. and Audunson, R. (2017). Supporting immigrant’s political integration

through discussion and debate in public libraries. Journal of Librarianship and

Information Science, 00 (0), 1-15.

Kendon, A. (1975). Gesticulation, speech and the gesture theory of language origins. Sign Language Studies, 9, 349-373.

Kendon, A. (2004). Gesture: visible action as utterance. Cambridge: Cambridge

University Press.

Koivisto, A. (2015). Displaying now-understanding: The Finnish change-of-state token aa. Discourse Processes, 52, 111-148.

Kurhila, S. (2006). Second Language Interaction. Amsterdam: John Benjamins.

McNeill, D. (1992). Hand and Mind. Chicago: Chicago University Press.

Mazeland H. and Zaman-Zadeh, M. (2004). The Logic of Clarification: Some

Observations about Word-Clarification Repairs in Finnish-as-a-Lingua-Franca

Interactions. In: Gardner, R. and Wagner, J. (Ed.), Second language

conversations (pp. 132-156). New York, NY: Continuum.

Mondada, L. (2007). Multimodal resources for turn-taking: pointing and the

emergence of possible next speakers. Discourse studies, 9, 194-225.

Mondada L. (2011). Understanding as an embodied, situated and sequential

achievement in interaction. Journal of Pragmatics, 43, 542-552.

Mondada, L. (2014). The local constitution of multimodal resources for social

interaction. Journal of Pragmatics, 65, 137-156.

Park, I. (2007). Co-construction of word search activities in native and non-native

speaker interaction. Working Papers in TESOL & Applied Linguistics, 7(2), 1

Peräkylä, A. and Ruusuvuori, J. (2009). Facial and Verbal Expressions in Assessing

Stories and Topics. Research on language and social interaction, 42, 377-394.

Rossano, F. (2012). Gaze in Conversation. In: Sidnell, J. and Stivers, T. (Ed), The

Handbook of Conversation Analysis (1th ed., pp. 229-256). Chichester: Wiley-


Sacks, H. (1992). Lectures on Conversation. Vol 2. Jefferson, G., introduction by

Schegloff, E.A (Ed.). Oxford: Basil Blackwell.

Schegloff, E. A. (1992). Repair after next turn: The last structurally provided defense of intersubjectivity in conversation. American Journal of Sociology, 1295-1345.

Seuren, L. M., Huiskes, M. & Koole, T. (2016). Remembering and understanding with oh-prefaced yes/no declaratives in Dutch. Journal of Pragmatics, 104, 180- 192.

Sorjonen, M. L. (1996). On repeats and responses in Finnish conversations. In:

Ochs, E.,Schegloff, E. A.; Thompson, S.A. (Ed.), Interaction and Grammar (pp.

-327). Cambridge: Cambridge University Press.

Streeck, J. (2009). Gesture as Communication 1: It’s Coordination With Gaze and Speech. Communication Monographs, 60, 275-299.

Svennevig, J. (2004). Other-repetition as display of hearing, understanding and

emotional stance. Discourse Studies, 6, 489-516.

Svennevig, J. (2018a). ”What’s it called in Norwegian?” Acquiring L2 vocabulary

items in the workplace. Journal of Pragmatics, 126, 68-77.

Svennevig, J. (2018b). Decomposing turns to enhance understanding by L2

speakers. Research on language and social interaction, 51, 398-416.

Theodórsdóttir, G. (2018). A Closer Look at Correction and Explanation

Practices in Everyday L2 Interaction. The Modern Language Journal, 102

(supplement 2018), 30-45.

Theodórsdóttir, G. and Eskildsen, S.W. (2011). The use of English in everyday as a

second language: Establishing intersubjectivity and doing learning. Nordand,

, 59-85.

Wagner, J. (2015). Designing for language learning in the wild. Creating social

infrastructures for second language learning. In: Cadierno, T. and Eskildsen,

S.W. (Ed.), Usuage based perspectives on second language learning (pp.75-

. Berlin: de Gruyter Mouton.




How to Cite

Gudmundsen, J., & Svennevig, J. (2020). Multimodal displays of understanding in vocabulary-oriented sequences. Social Interaction. Video-Based Studies of Human Sociality, 3(2).