Facial Gestures in Social Interaction

Introduction to the Special Issue

Authors

  • Alexandra Groß University of Bayreuth
  • Carolin Dix University of Innsbruck
  • Johanna Ruusuvuori Tampere University
  • Anssi Peräkylä University of Helsinki

DOI:

https://doi.org/10.7146/si.v6i3.142894

Keywords:

face-to-face communication, facial gestures, facial expressions, multimodality, multimodal conversation analysis

Abstract

NA

References

Aguert, M. (2022). Paraverbal Expression of Verbal Irony: Vocal Cues Matter and Facial Cues Even More. Journal of Nonverbal Behavior, 46, 45–70.

Alt, F. (2020). Report on the international workshop “Facial Gestures in Interaction”, 30-31. January 2020, University of Bayreuth. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion, 21, 133–141.

Ambrazaitis, G. & House, D. (2017). Multimodal prominence: Exploring the pattern and usage of focal pitch accents, head beats and eyebrow beats in Swedish television. Speech Communication, 95, 100–113.

Baltrusaitis, T., Zadeh, A., Lim, Y. C. & Morency, L. P. (2018). Openface 2.0: Facial behavior analysis toolkit. 13th IEEE international conference on automatic face & gesture recognition, 59–66.

Bavelas, J., Gerwing, J. & Healing, S. (2014). Including facial gestures in gesture-speech ensembles. In Seyfeddinipur, M. & Gullberg, M. (Eds.): From gesture in conversation to visible action as utterance: Essays in honor of Adam Kendon. John Benjamins, 15–33.

Bavelas, J. & Chovil, N. (2018). Some Pragmatic Functions of Conversational Facial Gestures. Gesture, 17(1), 98–127.

Beskow, J., Granström, B. & House, D. (2009). Focal Accent and facial movements in expressive speech. Working Papers Lund University, 52, 9–12.

Brunner, L. J. (1979). Smiles can be back channels. Journal of Personality and Social Psychology, 37(5), 728–734.

Clift, R. (2021). Embodiment in dissent: The eye roll as an Interactional Practice. Research on Language and Social Interaction, 54(1), 1–16.

Darwin, C. R. (1872). The expression of the emotions in man and animals. John Murray.

Enfield, N. J. (2001). ‘Lip-pointing’: A discussion of form and function with reference to

data from Laos. Gesture, 1(2), 185–212.

Ekman, P. & Friesen, W.V. (1969). The Repertoire of Nonverbal Behavior. Categories, Origins, Usage, and Coding. Semiotica, 1(1), 49–98.

Ekman, P. & Oster H. (1979). Facial expressions of emotion. Annual Review of Psychology, 30, 527–554.

Ekman, P. (1979). About brows: emotional and conversational signals. In von Cranach, M., Foppa, K., Lepenies, W. & Ploog, D. (Eds.): Human ethology. Cambridge University Press, 169–249.

Ekman, P. (1999). Emotional and conversational nonverbal signals. In Messing, L., & R. Campbell (Eds.): Gesture, speech, and sign. Oxford University Press, 45–56.

Flecha-Garcia, M. (2010). Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English. Speech Communication, 52, 542–554.

Floyd, S., Manrique, E., Rossi, G. & Torreira, F. (2016). Timing of visual bodily behavior in repair sequences: evidence from three languages. Discourse Processes, 53(3), 175–204.

Fridlund, A.J., Ekman, P. & Oster, H. (1987). Facial expressions of emotion. Review of literature. In Siegman, A.W., & S. Felstein (Eds.): Nonverbal Communication and Behavior (2nd ed.). Erlbaum, 143–224.

Fridlund, A. J., & Russell, J. A. (2006). The Functions of Facial Expressions: What's in a Face? In Manusov, V. & M. L. Patterson (Eds.), The Sage handbook of nonverbal communication. Sage publications, 299–319.

Gäberlein, A. (2023). Report on the 2nd international workshop “Facial Gerstures in Interaction” from 7th – 9th October 2021. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaction, 26–42.

Goodwin, M. H. & Goodwin, C. (1986). Gesture and coparticipation in the activity of searching for a word. Semiotica, 62(1-2), 51–75.

Goodwin M.H., Cekaite, A. & Goodwin, C. (2012). Emotion as stance. In Peräkylä, A., & M.L. Sorjonen (Eds.): Emotion in Interaction. New York: Oxford University Press, 16–41.

Groß, A. & Dix, C. (2023). Protruding one's lips for managing (personal) knowledge in talk-in-interaction. KnowInt (Knowledge in Talk-in-Interaction), 7.11.2023, University of Lausanne/Swizzerland. Oral presentation.

Heller, V. (2021). Embodied displays of ‘doing thinking’. Epistemic and interactive functions of thinking displays in children’s argumentative activities. Frontiers in Psychology, 12, 1–21.

Kärkkäinen, E. & Keisanen, T. (2012). Linguistic and embodied formats of making (concrete) offers. Discourse Studies, 14(5), 587–611.

Kaukomaa, T., Peräkylä, A. & Ruusuvuori, J. (2013). Turn-Opening Smiles: Facial Expression Constructing Emotional Transition in Conversation. Journal of Pragmatics, 55, 21–42.

Kaukomaa, T., Peräkylä, A. & Ruusuvuori, J. (2014). Foreshadowing a Problem: Turn-Opening Frowns in Conversation. Journal of Pragmatics, 71, 132–147.

Kaukomaa, T., Peräkylä, A. & Ruusuvuori, J. (2015). How Listeners Use Facial Expression to Shift the Emotional Stance of the Speaker’s Utterance. Research on Language and Social Interaction, 48(3), 319–341.

Kendon, A. (2004). Gesture. Visible action as utterance. Cambridge University Press.

Kraut, R. E. & Johnston, R. E. (1979). Social and emotional messages of smiling: An

ethological approach. Journal of Personality and Social Psychology, 37(9), 1539–1553.

Kupetz, M. (2014). Empathy displays as interactional achievements. Multimodal and sequential aspects. Journal of Pragmatics, 61, 4–34.

Lewinski, P., Den Uyl, T. M. & Butler, C. (2014). Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader. Journal of Neuroscience, Psychology, and Economics, 7(4), 227.

Mondada, L. (2016). Challenges of multimodality. Language and the body in social interaction. Journal of Sociolinguistics, 20(3), 336–366.

Mondada, L. (2019). Contemporary issues in conversation analysis: Embodiment and materiality, multimodality and multisensoriality in social interaction. Journal of Pragmatics, 145, 47–62.

Nota, N.; Trujillo, J. P. & Holler, J. (2021). Facial Signals and Social Actions in Multimodal Face-to-Face Interaction. Brain Sciences, 11(8), 1017.

Oloff, F. (2018). ‘Sorry?’/‘Como?’/‘Was?’ – Open class and embodied repair initiators in international workplace interactions. Journal of Pragmatics, 126, 29–51.

Peräkylä, A. & Ruusuvuori, J. (2012). Facial expression and interactional regulation of emotion. In Peräkylä, A. & M.-L. Sorjonen (Eds.): Emotion in Interaction. Oxford University Press, 64–9.

Ruusuvuori , J. & Peräkylä , A. (2009). Facial and verbal expressions in assessing stories and topics. Research on Language and Social Interaction, 42(4), 377–394.

Ruusuvuori, J., Asmuß, B., Henttonen, P. & Ravaja, N. (2021). Shared affective stance displays as preliminary to complaining. In Robles, J. & A. Weatherall (Eds.): How emotions are made in talk. John Benjamins, 129–162.

Schegloff, E. (1996). Turn Organization: One Intersection of Grammar and Interaction. In: Ochs, E., et al. (Eds.): Interaction and Grammar. Cambridge University Press, 52–133.

Selting, M. (2017). The display and management of affectivity in climaxes of amusing stories. Journal of Pragmatics, 111, 1–32.

Stivers, T. Sidnell, J. (2005). Introduction: Multimodal Interaction. Semiotica, 156(1/4), 1–20.

Stukenbrock, A. (2018). Mobile dual eye-tracking in face-to-face interaction: The case of deixis and joint attention. In Brone, G. & B. Oben (Eds.): Eye-tracking in Interaction. John Benjamins, 265–300.

Downloads

Published

2023-12-28

How to Cite

Groß, A., Dix, C., Ruusuvuori, J., & Peräkylä, A. (2023). Facial Gestures in Social Interaction: Introduction to the Special Issue. Social Interaction. Video-Based Studies of Human Sociality, 6(3). https://doi.org/10.7146/si.v6i3.142894