The Regarded Listener

Transcribing the Multiparty Social Ecology of Children’s Collaborative Storytelling


  • Sarah Jean Johnson University of Texas at El Paso
  • Frederick Erickson University of California Los Angeles



multimodal transcription, participation frameworks, oral narrative, peer interaction


Current theories of human social interaction characterize interactants, both speakers and hearers, as possessing a rich cognitive and reflexive life achieved through collaboratively built action. However, prevailing transcription approaches, which tend to neglect listening activity, do not adequately incorporate such understandings of the phenomena they represent transcriptively. We review the history and scholarship of video-based studies of human sociality. We then present an example of horizontal transcription to demonstrate the utility of this approach in capturing the spatial, temporal, and visual components of human social interaction—in this case, that of young children telling stories as they are writing them.


Alkemeyer, T., Brümmer, K., Pille, T. (2017). Intercoproreality at the motor block: On the importance of practical sense for social cooperation and coordination. In C. Meyer, J. Streeck, & J. Scott Jordan (Eds.), Intercorporeality: Emerging socialities in interaction (pp. 203-236). UK: Oxford University Press.

Andrén, M. (2017). Children’s expressive handling of objects in a shared world. In C. Meyer, J. Streeck, & J. Scott Jordan (Eds.), Intercorporeality: Emerging socialities in interaction (pp. 105-141). UK: Oxford University Press.

Arbeau, T. (1589/1967). Orchésographie. Initially published in Langres. Translated and republished in New York: Dover Press.

Auer, P., & Hörmeyer, I. (2017). Achieving intersubjectivity in augmented and alternative communication (AAC): Intercorporeal, embodied and disembodied practices. In C. Meyer, J. Streeck, & J. Scott Jordan (Eds.), Intercorporeality: Emerging socialities in interaction (pp. 323-360). UK: Oxford University Press.

Bakhtin, M. (1973). Problems of Dostoevsky’s poetics. Ann Arbor, MI: Ardis.

Bucholtz, M. (2000). The politics of transcription. Journal of Pragmatics, 32, 1439-1465.

Calkins, L. M. (2001). The art of teaching reading. New York: Longman.

Churchill, E. (2022). The education of attention in enskillment. Journal of Pragmatics, 193, 155-172.

Condon, W. and Ogston (1967). A segmentation of behavior. Journal of Psychiatric Research, 5, 221-235.

de Souza, D. K., Park, S. H., Wei, W., Zhan, K., Bolden, G. B., Hepburn, A., Mandelbaum, J., Mikesell, L., & Potter, J. (2021). The Gratitude Opportunity Space: The timing of gratitude expressions in object passes. Social Interaction. Video-Based Studies of Human Sociality, 4(1).

Duranti, A. (2006). Transcripts, like shadows on a wall. Mind, Culture, and Activity, 13(4), 301-310.

Ehlich, K. and Rehbein, J. (1976). Halbinterpretive Arbeitstranscriptionen. Linguistische Berichte, 45, 21-41.

Ehlich, K. (2014). HIAT: A transcription system for discourse data. In J. Edwards & M. Lampert (Eds.), Talking data: Transcription and coding in discourse research, (2nd ed., pp. 123-148). New York: Psychology Press.

Enfield, N. and Kockelman, P. (2017). Distributed agency. Oxford UK: Oxford University Press.

Erickson, F. (1982). Money tree, lasagna bush, salt and pepper: Social construction of topical cohesion in a conversation among Italian-Americans. In D. Tannen (Ed.), Analyzing discourse: Text and talk (pp. 43-70). Washington, D.C.: Georgetown University Press.

Erickson, F. (1986). Listening and speaking. In D. Tannen and J.E. Alatis, (Eds.), Language and linguistics: The interdependence of theory, data, and application (pp. 294–319). Washington, DC: Georgetown University Press.

Erickson, F. (2009). Musicality in talk and listening: A key element in classroom discourse as an environment for learning. In S. Malloch & C. Trevarthen (Eds.), Communicative musicality: Exploring the basis of human companionship (pp. 449-463). Oxford, UK: Oxford University Press.

Erickson, F. (2015). Oral discourse as a semiotic ecology. In D. Tannen, H. Hamilton, and D. Schiffrin (Eds.), The Handbook of Discourse Analysis (2nd ed., pp. 422-446). Hoboken, NJ: John Wiley & Sons.

Erickson, F., & Shultz, J. (1982). The Counselor as Gatekeeper: Social Interaction in Interviews. New York: Academic Press.

Goffman, E. (1964). The neglected situation. In Gumperz, J. and Hymes, D. (Eds.) The ethnography of communication. Special issue of American Anthropologist, 66(6) Part 2, 133-136.

Goodwin, C. (1981). Conversational organization: Interaction between speakers and hearers. New York: Academic Press.

Goodwin, C. (1986). Audience diversity, participation and interpretation. Text-Interdisciplinary Journal for the Study of Discourse, 6(3), 283-316.

Goodwin, C. (2018). Co-operative action. Cambridge, UK: Cambridge University Press.

Goodwin, C., & Goodwin, M. H. (1987). Concurrent operations on talk: Notes on the interactive organization of assessments. IPrA papers in pragmatics, 1(1), 1-54.

Goodwin, M. H. (2021). The interactive construction of a hug sequence. In A. Cekaite and L. Mondada (Eds.), Touch in social interaction (pp. 27-53). New York: Routledge.

Goodwin, M. H. (1990). He-said-she-said: Talk as social organization among black children (Vol. 618). Bloomington, IN: Indiana University Press.

Goodwin, M. H., & Cekaite, A. (2018). Embodied family choreography: Practices of control, care, and mundane creativity. New York: Routledge.

Goodwin, M.H., & Goodwin, C. (1986). Gesture and coparticipation in the activity of searching for a word. Semiotica, 62, 51-75.

Gumperz, J. J. (1982). Discourse strategies (No. 1). Cambridge University Press.

Heath, C., & Christian, H. (1986). Body movement and speech in medical interaction. Cambridge University Press.

Heath, C., & Luff, P. (2021). Embodied Action, Projection, and Institutional Action: The Exchange of Tools and Implements During Surgical Procedures. Discourse Processes, 58(3), 233-250.

Hutchins, E. (1995). Cognition in the Wild (No. 1995). Cambridge, MA: MIT Press.

İkizoğlu, D. (2019). " What did it say?": Mobile phone translation app as participant and object in family discourse. Journal of Pragmatics, 147, 1-16.

İkizoğlu, D. (2021). Agency and participation in multilingual family interaction. [Doctoral dissertation, Georgetown University]. ProQuest dissertation publishing.

Iwasaki, S., Bartlett, M., Manns, H., & Willoughby, L. (2019). The challenges of multimodality and multi-sensoriality: Methodological issues in analyzing tactile signed interaction. Journal of Pragmatics, 143, 215–227.

Johnson, S. J. (2015). The social and cognitive worlds of young children reading together. [Doctoral dissertation, University of California, Los Angeles]. ProQuest dissertation publishing.

Johnson, S. J. (2017). Multimodality and footing in peer correction in reading picture books. Linguistics and Education, 41, 20-34.

Kamunen, A. (2019). How to disengage: suspension, body torque, and repair. Research on Language and Social Interaction, 52(4), 406-426.

Kendon, A. (1970). Movement coordination in social interaction: Some examples described. Acta Ppsychologica, 32, 101-125.

Kendon, A. (1990). Some context for context analysis. In A. Kendon (Ed.), Conducting interaction: Patterns of Behavior In Focused Encounters (pp. 15-48). New York: Cambridge University Press.

Kendon, A. (2002). Some uses of the head shake. Gesture, 2(2), 147-182.

Klein, G. (2020). Pina Bausch's dance theater: Company, artistic practices and reception (Vol. 56). Aachen, Germany: Transcript.

Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse. The modes and media of contemporary communication. London: Arnold.

Labov, W. (1972). Language in the inner city: Studies in the Black English vernacular (No. 3). Philadelphia, PA: University of Pennsylvania Press.

Leeds-Hurwitz, W. (1987). The social history of the natural history of an interview: A multidisciplinary investigation of social communication. Research on Language and Social Interaction 20(1-4), 1-51.

Lerner, G.H., Zimmerman, D.H. and Kidwell, M. (2011). Formal structures of practical tasks: a resource for action in the social life of very young children. In E. Streek, C. Goodwin and C. LeBaron (Eds). Embodied interaction: Language and body in the material world (pp. 44-58). Cambridge: Cambridge University Press.

Laurier, E. (2014). The graphic transcript: Poaching comic book grammar for inscribing the visual, spatial and temporal aspects of action. Geography Compass, 8(4), 235-248.

Linell, P. (2009). Rethinking language, mind, and world dialogically: Interactional and contextual theories of human sense-making. Charlotte, NC: Information Age.

McDermott, R. (1976). Kids make sense: An ethnographic account of the interactional management of success and failure in one first grade classroom. [Unpublished doctoral dissertation, Stanford University].

Merlino, S. (2021). Professional touch in speech and language therapy for the treatment of post-stroke aphasia. In A. Cekaite and L. Mondada (Eds.), Touch in Social Interaction (pp. 197-223). New York: Routledge.

Meyer, C., & Wedelstaedt, U. V. (2020). Achieving Competitive Hardness: The Preference for Hard Touch as Practical Accomplishment in Professional Handball. Social Interaction. Video-Based Studies of Human Sociality, 3(1).

Mode transcription bank (nd). University College London. Retrieved January 23, 2022, from

Mondad, L. (nd). Conventions for transcribing multimodality. Retrieved January 23, 2022, from

Mondada, L. (2019). Transcribing silent actions: A multimodal approach of sequence organization. Social Interaction. Video-based Studies of Human Sociality, 2(1).

Mondada, L., Monteiro, D., & Tekin, B. S. (2021). The tactility and visibility of kissing: Intercorporeal configurations of kissing bodies in family photography sessions. In A. Cekaite and L. Mondada (Eds.), Touch in social interaction (pp. 54-80). New York: Routledge.

Norris, S. 2004. Analyzing multimodal interaction. London: Routledge Falmer.

Ochs, E. (1979). Transcription as theory. In E. Ochs and B. Schieffelin. (Eds.), Developmental pragmatics (pp. 43-72). New York: Academic Press.

Ochs, E., & Capps, L. (2009). Living narrative: Creating lives in everyday storytelling. Cambridge: Harvard University Press.

Poylanyi, L. (1982). Linguistic and social constraints on storytelling. Journal of Pragmatics, 6, 509-524.

Plowman, L., & Stephen, C. (2008). The big picture? Video and the representation of interaction. British Educational Research Journal, 34(4), 541-565.

Routarinne, S., Heinonen, P., Karvonen, U., Tainio, L., & Ahlholm, M. (2020). Touch in achieving a pedagogically relevant focus in classrooms. Social interaction: Video-based Studies of Human Sociality, 3(1).

Rogoff, B. (2014). Learning by observing and pitching in to family and community endeavors: An orientation. Human development, 57(2-3), 69-81.

Sacks, H. (1967). Transcribed lectures. March 9th, University of California, Irvine.

Sacks, H., Schegloff, M., and Jefferson, G. (1974). A simplest systematics for the organization of turn-taking in conversation. Language, 50, 696-735.

Scollon, R. (1982). The rhythmic integration of ordinary talk. In D. Tannen (Ed.), Analyzing discourse: Text and talk (pp. 335-49). Washington, D.C.: Georgetown University Press.

Scollon, R. (2001). Action and text: towards an integrated understanding of the place of text in social (inter) action, mediated discourse analysis and the problem of social action, In R. Wodak & M. Meyer (Eds.), Methods of critical discourse analysis (pp. 139-183) London, UK: Sage Publications.

Scheflen, A. (1973). Communicational structure: Analysis of a psychotherapy transaction. Bloomington, IN: University of Indiana Press.

Schiffrin, D. (1987). Discourse markers (No. 5). Cambridge, UK: Cambridge University Press.

Sicoli, M. A. (2020). Modality, Multimodality. In J. Stanlaw (Ed.) The International Encyclopedia of Linguistic Anthropology (pp, 1-5). Hoboken, NJ: John Wiley and Sons.

Slembrouck, S. (2007). Transcription—the extended directions of data histories: a response to M. Bucholtz's' Variation in Transcription'. Discourse Studies, 9(6), 822-827.

Streeck, J. (1984). Embodied contexts, transcontextuals, and the timing of speech acts. Journal of Pragmatics, 8(1), 113-137.

Shultz, J. J., Florio, S., & Erickson, F. (1982). Where’s the floor: Aspects of the cultural organization of social relationships in communication at home and in school. P. Gilmore and A.A. Glatthorn (Eds.), Ethnography and education, 88-123. Washington, D.C.: Center for Applied Linguistics.

Tomlinson, K. (1735). The art of dancing, explained by reading and figures. London: Printed for the author.

Tufte, E. (1990). Envisioning information. Cheshire CT: Graphics Press.

von Laban, Rudolf (1928). Schriftanz: Methodik, orthographie, erlaeuterungen (German). Vienna: Universal Edition.

Weber, M. (1922/1978). Economy and society: An outline of interpretive sociology. G. Roth & C. Wittich (Trans.). Berkeley CA: University of California Press.




How to Cite

Johnson, S. J., & Erickson, F. (2022). The Regarded Listener: Transcribing the Multiparty Social Ecology of Children’s Collaborative Storytelling. Social Interaction. Video-Based Studies of Human Sociality, 5(3).