This book is a first attempt to map the broad context of performance studies from a multimodal perspective. It collects original research on traditional performing arts (theatre, dance, opera), live (durational performance) and mediated/recorded performances (films, television shows), as well as performative discursive practices on social media by adopting several theories and methodologies all dealing with the notion of multimodality. As a mostly dynamic and also interactive environment for various text types and genres, the context of performance studies provides many opportunities to produce meaning verbally and non-verbally. All chapters in this book develop frameworks for the analysis of performance-related events and activities and explore empirical case studies in a range of different ages and cultures. A further focus lies on the communicative strategies deployed by different communities of practice, taking into account processes of production, distribution, and consumption of such texts in diverse spatial and temporal contexts.
This book is a first attempt to map the broad context of performance studies from a multimodal perspective. It collects original research on traditional performing arts (theatre, dance, opera), live (durational performance) and mediated/recorded performances (films, television shows), as well as performative discursive practices on social media by adopting several theories and methodologies all dealing with the notion of multimodality. As a mostly dynamic and also interactive environment for various text types and genres, the context of performance studies provides many opportunities to produce meaning verbally and non-verbally. All chapters in this book develop frameworks for the analysis of performance-related events and activities and explore empirical case studies in a range of different ages and cultures. A further focus lies on the communicative strategies deployed by different communities of practice, taking into account processes of production, distribution, and consumption of such texts in diverse spatial and temporal contexts.
This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.
This volume advances the data-based study of multimodal artefacts and performances by showcasing methods and results from the latest endeavors in empirical multimodal research, representing a vibrant international and interdisciplinary research community. The collated chapters identify and seek to inspire novel, mixed-method approaches to investigate meaning-making mechanisms in current communicative artifacts, designs, and contexts; while attending to their immersive, aesthetic, and ideological dimensions. Each contribution details innovative aspects of empirical multimodality research, offering insights into challenges evolving from quantitative approaches, particular corpus work, results from eye-tracking and psychological experiments, and analyses of dynamic interactive experiences. The approaches and results presented foreground the inherent multidisciplinary nature and implications of multimodality, renegotiating concepts across linguistics, media studies, (social) semiotics, game studies, and design. With this, the volume will inform both current and future developments in theory, methods, and transdisciplinary contexts and become a landmark reference for anyone interested in the empirical study of multimodality.
Multimodality is one of the most popular and influential semiotic theories for analysing media. However, the application and conceptual anchoring of multimodality often remains geographically and disciplinarily grounded within local systems of thought. New Studies in Multimodality combines the expertise of multimodalists from around the globe, offering novel readings and applications of central concepts in multimodality and inviting innovative synergies between previously disparate schools. Combining perspectives from the most actively developing traditions of theory and research, this book progresses from classic concepts to more empirically and practice-motivated contributions. Contributors engage in mutual dialogue to present new theoretical perspectives and compelling applications to a variety of old and new media. Expanding the basis and scope of multimodality, this volume shows awareness and experience of this field in many disciplines and illustrates how versatile, pervasive and relevant it is for studying today's communication phenomena.
In this volume, Soe Marlar Lwin proposes a contextualized multimodal framework that brings together storytelling practitioners’ and academic researchers’ conceptions of storytelling. It aims to highlight the ways in which various institutions in contemporary society have been using live storytelling performances as an effective communicative, educative and meaning-making tool. Drawing on theories of narrative from narratology as well as from related fields such as discourse analysis, multimodal analysis, communication and performance studies, the author proposes a contextualized multimodal framework to (a) uncover the potential narrativity of a live storytelling performance through an analysis of narrative elements constituting the story, (b) capture the process of developing actual narrativity through a multimodal analysis of performance features in the storytelling discourse, and (c) highlight the importance of context and dynamics between the storyteller and audience for an achievement of optimal narrativity in a particular storytelling event. The sample analysis shows how the framework not only describes the system governing institutionalized storytelling performances in general but also serves as a useful model to examine individual performance as a unique realization of the general system. The book also offers implications for possible applications of such contextualized multimodal frameworks more broadly across the disciplines.
This rigorous yet accessible collection demystifies the principles of intermediality whilst examining its place in 21st century theatrical practice. Bringing together chapters and case studies from top thinkers in the field, this book clarifies the key theoretical ideas and practical impacts of intermediality while encouraging students to experiment with it in their own practical work. Offering an engaging insight into one of the most dominant trends in contemporary theatre, this is essential reading for students of theatre, performance and media studies.
Multimodality has most recently been described no longer as a research field or discipline on its own, but rather as a “stage of development within a field” (Bateman 2022a, 49). The realization that (1) many different fields and disciplines now enter their own multimodal phase with new interest in multimodal phenomena and that (2) these disciplines all commit to the development of multimodality research with their own theoretical principles and methodological tools, brings with it not only an immense breadth of potential analytical objects, but also many new meta-methodological issues. “We need to find ways of ‘combining’ insights from the variously imported theoretical and methodological backgrounds brought along by previous non-multimodal stages of any contributing disciplines” (Bateman 2022a, 49). At the same time, the search for a meta-methodology for multimodal analyses is pushed further by the recent trend towards more empirical approaches to multimodal phenomena and the development and use of larger multimodal corpora that just as well require theoretical and methodological refinements. “We need to develop ways of strengthening claims with robustly applicable methods which nevertheless remain firmly anchored theoretically” (Bateman 2022b, 64). For a productive handling of these issues, disciplinary triangulation and finding a ‘common language’ or metalanguage (Maton & Chen 2016) for an ‘integrationist interdisciplinarity’ (van Leeuwen 2005) are the greatest challenges in contemporary multimodality research (Bateman 2022a). Also, there is a need for reconceptualizing the practice of analysis by making available large-scale corpora and broader and more complex empirical setups to fully process the ‘move from theory to data,’ and to substantiate long-lasting theoretical and methodological hypotheses (Pflaeging et al. 2021). For this project, we see these challenges productively as “a multimodal task from the ground up,” as John Bateman (2022b, 64) has phrased it in one of his most recent papers. This Research Topic will address this task by convening the most recent theoretical, methodological, practical, and empirical developments within contemporary multimodality research. The aim is to gain new insights in • the metalanguages or external languages that are currently being developed for multimodal analysis in many different research fields and disciplines, e.g., in pedagogy, literary theory, cultural studies, design, argumentation theory, computer science, and (experimental) psychology; • newest results from data collection methods and multimodal corpus analyses that expand the current quantitative work by, e.g., applying existing theories and methods to larger datasets, or exploring the newest communication technologies. We are particularly interested in seeing how works addressing these aspects contribute to finding ways of productive triangulation and integration for and within a meta-methodology for multimodality research. This Research Topic aims to bring together scholars from a variety of disciplines interested in multimodality research to review, explore, and advance the contributions that John Bateman, as one of the key figures in multimodality research, has made to both theory- and method-building as well as to the driving forward of multimodal empirical and corpus analyses. We welcome contributions that, for example, • critically address the theoretical and methodological advancements that John Bateman has made with regard to the notions of semiotic mode, discourse semantics, genre, textuality, etc.; • apply one of the many approaches that John Bateman has developed for the empirical analysis of multimodal artefacts (e.g., the GeM model for page-based documents, his work on multimodal film and audio-visual analysis, and the discourse semantics and/or annotation approach to visual narratives) to larger corpora or currently newly developing communicative situations; • expand on one of the abovementioned aspects with new ideas and insights from disciplines that have not yet been included in multimodality research.
This volume explores the relationship between aesthetics and traditional multimodal communication to show how all semiotic resources, not just those situated within fine arts, have an aesthetic function. Bringing together contributions from an interdisciplinary group of researchers, the book meditates on the role of aesthetics in a broader range of semiotic resources, including urban spaces, blogs, digital scrapbooks, children’s literature, music, and online learning environments. The result is a comprehensive collection of new perspectives on how communication and aesthetics enrich and complement one another when meaning is made with semiotic resources, making this key reading for students and scholars in multimodality, fine arts, education studies, and visual culture.
This volume presents a comprehensive overview of multimodal approaches to curriculum and programmatic implementation across a diverse range of teaching environments and across geographic and cultural boundaries. Featuring contributions from scholars within and across both disciplines, the book examines the ways in which new technologies link to expanding definitions of literacy and, building on this, how multimodal approaches might most effectively address the unique opportunities and challenges instructors face in contemporary classrooms and professional development programs. Chapters draw on case studies from both existing scholarship and findings from the authors’ own experiences in practice, including examples from writing, rhetoric, and composition courses, open online learning courses, and interdisciplinary faculty training programs. The final section of the book showcases how the conversation might be further extended to address increasingly multilingual classrooms by exploring how multimodality has been implemented in transnational settings. Engaging with key questions at the intersection of programmatic and curricular development and multimodal studies, this book is a fundamental resource for graduate students and scholars in multimodality, rhetoric studies, language education, applied linguistics, and communication studies.
