Multimodal discourse analysis in health communication: sketching out the field
DOI:
https://doi.org/10.7146/qhc.148808Keywords:
Discourse analysis, Multimodality, Multimodal discourse analysis, health communicationAbstract
Background: Multimodal discourse approaches have only recently gained consistent prominence in health communication research. The theoretical and methodological underpinnings of each approach, and their contribution to the health communication domain, require further articulation. Aim: This article aims to sketch out the field, showcasing the methodological strengths and limitations of multimodal discourse approaches, and their potential contribution to health research. Methods: The article reviews four established and emerging multimodal discourse approaches used in health communication research. A comparative lens is taken, scrutinising each approach in terms of its theoretical underpinnings, methodological implications, and analytical constraints. Findings: Key points of convergence and divergence among the approaches are identified, with all approaches sharing a commitment to investigating multiple modes and their relationships in creating meaning within health research. The main point of differentiation lies in what each approach considers the unit of analysis: Systemic Functional Multimodal Discourse Analysis focuses on semiotic resources, Mediated Discourse Analysis on action, Conversation Analysis on conversational order, and Multimodal Critical Discourse Analysis on power and social structures. Conclusions: Future directions include a focus on materiality, the integration of emerging technologies, and the development of new analytical tools for investigating crisis communication. All these can offer deeper insights into health communication and enhance professional practices and patient outcomes.
References
Albers, P. (2013). Visual discourse analysis. In P. Albers, T. Holbrook, & A. Flint (Eds.), New methods of literacy research (pp. 85–98). Routledge.
Al-Subhi, A. S. (2024). Interactional multimodal metadiscourse in public health posters during the COVID-19 pandemic. Pragmatics & Society. https://doi.org/10.1075/ps.22092.als
Bezemer, J., & Jewitt, C. (2010). Multimodal analysis: Key issues. In L. Litosseliti (Ed.), Research methods in linguistics (pp. 180–197). Continuum.
Brookes, G., Harvey, K., Chadborn, N., & Dening, T. (2018). “Our biggest killer”: Multimodal discourse representations of dementia in the British press. Social Semiotics, 28(3), 371–395. https://doi.org/10.1080/10350330.2017.1345111
Brookes, G., & Hunt, D. (Eds.). (2021). Analysing health communication: Discourse approaches. Palgrave Macmillan. https://doi.org/10.1007/978-3-030-68184-5
De Fina, A., & Georgakopoulou, A. (Eds.). (2020). Discourse materialities and embodiment: Introduction. In The Cambridge handbook of discourse studies (pp. 255–370). Cambridge University Press.
Fairclough, N. (1995). Critical discourse analysis: The critical study of language. Longman.
Fatigante, M., Zucchermaglio, C., & Alby, F. (2021). Being in place: A multimodal analysis of the contribution of the patient's companion to "first time" oncological visits. Frontiers in Psychology, 12, 664747. https://doi.org/10.3389/fpsyg.2021.664747
Garfinkel, H. (1967). Studies in ethnomethodology. Prentice-Hall.
Gill, K. A., & Lennon, H. (2022). Conformity through fear: A multimodal critical discourse analysis of COVID-19 information adverts. Critical Approaches to Discourse Analysis across Disciplines Journal, 14(1), 22–44.
Giorgi, A. (1985). Phenomenology and psychological research. Duquesne University Press.
Goodwin, C. (1979). The interactive construction of a sentence in natural conversation. In G. Psathas (Ed.), Everyday language: Studies in ethnomethodology (pp. 97–121). Irvington Publishers.
Goodwin, C., & Goodwin, M. (1992). Context, activity, and participation. In A. Luzio & P. Auer (Eds.), The contextualization of language (pp. 77–99). John Benjamins. https://doi.org/10.1075/pbns.22
Halliday, M. (1978). Language as social semiotic: The social interpretation of language and meaning. Arnold.
Halliday, M., & Hasan, R. (1985). Language, context, and text: Aspects of language in a social-semiotic perspective. Deakin University Press.
Heath, C., Luff, P., Sanchez-Svensson, M., & Nicholls, M. (2018). Exchanging implements: The micro-materialities of multidisciplinary work in the operating theatre. Sociology of Health and Illness, 40, 297–313. https://doi.org/10.1111/1467-9566.12594
Iedema, R. (2001). Analysing film and television: A social semiotic account of Hospital: An unhealthy business. In T. van Leeuwen & C. Jewitt (Eds.), The handbook of visual analysis (pp. 183–204). Sage. https://doi.org/10.4135/9780857020062
Jerome, C., & Ting, S. H. (2022). What's in a message: A systemic functional analysis of cancer prevention messages. International Journal of Applied Linguistics, 32, 57–75. https://doi.org/10.1111/ijal.12380
Jewitt, C. (2013). Multimodal methods for researching digital technologies. In S. Price, C. Jewitt, & B. Brown (Eds.), The SAGE handbook of digital technology research (pp. 250–265). SAGE. https://doi.org/10.4135/9781446282229
Jewitt, C., Bezemer, J., & O’Halloran, K. (Eds.). (2016). Systemic functional linguistics. In Introducing multimodality (pp. 30–57). Routledge.
Jewitt, C., & Kress, G. (2003). Multimodal literacy. Peter Lang Publishing.
Jones, R. (2014). Health risks and mediated discourse: A case study of 'AIDS in action'. In H. Hamilton & S. Chou (Eds.), Routledge handbook of language and health communication (pp. 109–122). Routledge.
Jones, R. H., & Norris, S. (2005). Discourse in action: Introducing mediated discourse analysis. Routledge. https://doi.org/10.4324/9780203018767
Kress, G. (2009). Multimodality: A social semiotic approach to communication. Routledge. https://doi.org/10.4324/9780203970034
Kress, G., & van Leeuwen, T. (1996). Reading images: The grammar of visual design. Routledge. https://doi.org/10.4324/9781003099857
Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.
Landqvist, M., & Blåsjö, M. (2024). Collaboration, reinvented tools, and specialist knowledge: Communication professionals’ experiences of global health crisis management. Discourse & Communication, 18(4), 514–534. https://doi.org/10.1177/17504813241227590
Lane, P. (2014). Nexus analysis. In J. Östman & J. Verschueren (Eds.), Handbook of pragmatics online (pp. 1–18). John Benjamins. https://doi.org/10.1075/hop.18.nex1
Ledin, P., & Machin, D. (2018). Doing critical discourse studies with multimodality: From metafunctions to materiality. Critical Discourse Studies, 16(5), 497–513. https://doi.org/10.1080/17405904.2018.1468789
Liang, M.-Y. (2019). Beyond elocution: Multimodal narrative discourse analysis of L2 storytelling. ReCALL, 31(1), 56–74. https://doi.org/10.1017/S0958344018000095
Machin, D. (2013). What is multimodal critical discourse studies? Critical Discourse Studies, 10(4), 347–355. https://doi.org/10.1080/17405904.2013.813770
Machin, D. (2016). The need for a social and affordance-driven multimodal critical discourse studies. Discourse & Society, 27(3), 322–334. https://doi.org/10.1177/0957926516630903
Machin, D., & Mayr, A. (2012). How to do critical discourse analysis: A multimodal introduction. Sage.
Mesinioti, P. (2021). ‘GET the oxygen get an airway’: Doing leadership in medical emergencies (Unpublished PhD thesis). University of Warwick.
Mesinioti, P., Angouri, J., & Turner, C. (2023). ‘Do you want me to take over?’: Displaying epistemic primacy in medical emergencies. Journal of Applied Linguistics and Professional Practice, 17(2), 161–187. https://doi.org/10.1558/jalpp.21858
Mondada, L. (2014). Instructions in the operating room: How the surgeon directs their assistant’s hands. Discourse Studies, 16(2), 131–161. https://doi.org/10.1177/1461445613515325
Mondada, L. (2016). Challenges of multimodality: Language and the body in social interaction. Journal of Sociolinguistics, 20(3), 336–366. https://doi.org/10.1111/josl.1_12177
Mondada, L. (2018). Multiple temporalities of language and body in interaction: Challenges for transcribing multimodality. Research on Language and Social Interaction, 51(1), 85–106. https://doi.org/10.1080/08351813.2018.1413878
Mondada, L. (2019). Contemporary issues in conversation analysis: Embodiment and materiality, multimodality, and multisensoriality in social interaction. Journal of Pragmatics, 145, 47–62. https://doi.org/10.1016/j.pragma.2019.01.016
Murdoch, J., Salter, C., Poland, F., & Cross, J. (2015). Challenging social cognition models of adherence: Cycles of discourse, historical bodies, and interactional order. Qualitative Health Research, 25(2), 283–294. https://doi.org/10.1177/1049732314552074
Nevile, M. (2015). The embodied turn in research on language and social interaction. Research on Language and Social Interaction, 48(2), 121–151. https://doi.org/10.1080/08351813.2015.1025499
Norris, S. (2004). Analyzing multimodal interaction: A methodological framework. Routledge. https://doi.org/10.4324/9780203379493
O’Halloran, K. L. (2008). Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery. Visual Communication, 7(4), 443–475. https://doi.org/10.1177/1470357208096210
O’Halloran, K. L., Tan, S., & Wignell, P. (2019). SFL and multimodal discourse analysis. In G. Thompson, W. L. Bowcher, L. Fontaine, & D. Schönthal (Eds.), The Cambridge handbook of systemic functional linguistics (pp. 433–461). Cambridge University Press. https://doi.org/10.1017/9781316337936.019
Ope-Davies, T., & Shodipe, M. (2023). A multimodal discourse study of selected COVID-19 online public health campaign texts in Nigeria. Discourse & Society, 34(1), 96–119. https://doi.org/10.1177/09579265221145098
O’Toole, M. (1994). The language of displayed art. Routledge.
Putland, E., Chikodzore-Paterson, C., & Brookes, G. (2023). Artificial intelligence and visual discourse: A multimodal critical discourse analysis of AI-generated images of “Dementia.” Social Semiotics, 1–26. https://doi.org/10.1080/10350330.2023.2290555
Sacks, H. (1992). Lectures on conversation (Vols. 1 & 2). Blackwell.
Schegloff, E. (1984). On some gestures' relation to talk. In J. Atkinson & J. Heritage (Eds.), Structures of social action: Studies in conversation analysis (pp. 266–295). Cambridge University Press.
Schegloff, E. A., & Sacks, H. (1973). Opening up closings. Semiotica, 8, 289–327. https://doi.org/10.1515/semi.1973.8.4.289
Scollon, R. (2001). Mediated discourse: The nexus of practice. Routledge. https://doi.org/10.4324/9780203420065
Scollon, R., & Scollon, S. (2004). Nexus analysis: Discourse and the emerging internet. Routledge. https://doi.org/10.4324/9780203694343
ten Have, P. (2012). Ethnomethodology and conversation analysis. In H. Cooper, P. M. Camic, D. L. Long, et al. (Eds.), APA handbook of research methods in psychology, Vol. 2: Research designs: Quantitative, qualitative, neuropsychological, and biological (pp. 103–117). American Psychological Association. https://doi.org/10.1037/13620-007
Traue, B., Blanc, M., & Cambre, C. (2019). Visibilities and visual discourses: Rethinking the social with the image. Qualitative Inquiry, 25(4), 327–337. https://doi.org/10.1177/1077800418792946
Vygotsky, L. S. (1981). The instrumental method in psychology. In J. V. Wertsch (Ed.), The concept of activity in Soviet psychology (pp. 134–143). M. E. Sharpe.
Wodak, R. E., & Meyer, M. (Eds.). (2015). Methods of critical discourse studies (3rd ed.). Sage.
Yang, Y. (2017). Living healthy versus looking attractive: The multimodal portrayal of skin cancer in women's magazines in the United States. Journal of Magazine Media, 18(1). https://dx.doi.org/10.1353/jmm.2017.0005
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Polina Mesinioti
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Articles submitted to Qualitative Health Communication should not be submitted to or published in other journals.
Articles published in Qualitative Health Communication may be used (downloaded) and reused (distributed, copied, cited) for non-commercial purposes with reference to the authors and publication host.
For all publications published in the first four issues, i.e. 1(1), 1(2), 2(1) and 3(1), copyright is shared between the author and QHC. For all future publications, the author is the sole copyright holder.
