The book takes differences in multimodality research as a starting point to discuss old and new theoretical, methodological as well as analytical ideas for building bridges between various disciplines and approaches.
This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.
Multimodality’s popularity as a semiotic approach has not resulted in a common voice yet. Its conceptual anchoring as well as its empirical applications often remain localized and disparate, and ideas of a theory of multimodality are heterogeneous and uncoordinated. For the field to move ahead, it must achieve a more mature status of reflection, mutual support, and interaction with regard to both past and future directions. The red thread across the disciplines reflected in this book is a common goal of capturing the mechanisms of synergetic knowledge construction and transmission using diverse forms of expressions, i.e., multimodality. The collection of chapters brought together in the book reflects both a diversity of disciplines and common interests and challenges, thereby establishing an excellent roadmap for the future. The contributions revisit and redefine theoretical concepts or empirical analyses, which are crucial to the study of multimodality from various perspectives, with a view towards evolving issues of multimodal analysis. With this, the book aims at repositioning the field as a well-grounded scientific discipline with significant implications for future communication research in many fields of study.
Multimodality is one of the most popular and influential semiotic theories for analysing media. However, the application and conceptual anchoring of multimodality often remains geographically and disciplinarily grounded within local systems of thought. New Studies in Multimodality combines the expertise of multimodalists from around the globe, offering novel readings and applications of central concepts in multimodality and inviting innovative synergies between previously disparate schools. Combining perspectives from the most actively developing traditions of theory and research, this book progresses from classic concepts to more empirically and practice-motivated contributions. Contributors engage in mutual dialogue to present new theoretical perspectives and compelling applications to a variety of old and new media. Expanding the basis and scope of multimodality, this volume shows awareness and experience of this field in many disciplines and illustrates how versatile, pervasive and relevant it is for studying today's communication phenomena.
This edited book is a collection of papers, written by language assessment professionals to reflect the guidance of Professor Lyle F. Bachman, one of the leading second language assessment experts in the field for decades. It has three sub-themes: assessment of evolving language ability constructs, validity and validation of language assessments, and understanding internal structures of language assessments. It provides theoretical guidelines for practical language assessment challenges. Chapters are written by language assessment researchers who graduated from the University of California, Los Angeles, where Professor Bachman trained them including the book editors.
This collection explores the links between multimodality and multilingualism, charting the interplay between languages, channels and forms of communication in multilingual written texts from historical manuscripts through to the new media of today and the non-verbal associations they evoke. The volume argues that features of written texts such as graphics, layout, boundary marking and typography are inseparable from verbal content. Taken together, the chapters adopt a systematic historical perspective to investigate this interplay over time and highlight the ways in which the two disciplines might further inform one another in the future as new technologies emerge. The first half of the volume considers texts where semiotic resources are the sites of modes, where multiple linguistic codes interact on the page and generate extralinguistic associations through visual features and spatial organizaisation. The second half of the book looks at texts where this interface occurs not in the text but rather in the cultural practices involved in social materiality and text transmission. Enhancing our understandings of multimodal resources in both historical and contemporary communication, this book will be of interest to scholars in multimodality, multilingualism, historical communication, discourse analysis and cultural studies. Chapters 1, 4, and 5 of this book are available for free in PDF format as Open Access from the individual product page at www.routledge.com. Chapters 1 & 4 have been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license, with Chapter 5 being made available under a Creative Commons Attribution 4.0 license.
This volume explores the relationship between aesthetics and traditional multimodal communication to show how all semiotic resources, not just those situated within fine arts, have an aesthetic function. Bringing together contributions from an interdisciplinary group of researchers, the book meditates on the role of aesthetics in a broader range of semiotic resources, including urban spaces, blogs, digital scrapbooks, children’s literature, music, and online learning environments. The result is a comprehensive collection of new perspectives on how communication and aesthetics enrich and complement one another when meaning is made with semiotic resources, making this key reading for students and scholars in multimodality, fine arts, education studies, and visual culture.
This book examines film as a multimodal text and an audiovisual synthesis, bringing together current work within the fields of narratology, philosophy, multimodal analysis, sound as well as cultural studies in order to cover a wide range of international academic interest. The book provides new insights into current work and turns the discussion towards recent research questions and analyses, representing and constituting in each contribution new work in the discipline of film text analysis. With the help of various example analyses, all showing the methodological applicability of the discussed issues, the collection provides novel ways of considering film as one of the most complex and at the same time broadly comprehensible texts.
Metaphors in audiovisual media receive increasing attention from film and communication studies as well as from linguistics and multimodal metaphor research. The specific media character of film, and thus of cinematic metaphor, remains, however, largely ignored. Audiovisual images are all too frequently understood as iconic representations and material carriers of information. Cinematic Metaphor proposes an alternative: starting from film images as affective experience of movement-images, it replaces the cognitive idea of viewers as information-processing machines, and heals the break with rhetoric established by conceptual metaphor theory. Subscribing to a phenomenological concept of embodiment, a shared vantage point for metaphorical meaning-making in film-viewing and face-to-face interaction is developed. The book offers a critique of cognitive film and metaphor theories and a theory of cinematic metaphor as performative action of meaning-making, grounded in the dynamics of viewers' embodied experiences with a film. Fine-grained case studies ranging from Hollywood to German feature film and TV news, from tango lesson to electoral campaign commercial, illustrate the framework’s application to media and multimodality analysis.
This collection advances the study of context-dependent characteristics of argumentative discourse by examining a variety of media genres in which text and image (and other semiotic modes) combine to create meaning. The chapters have been written by an international group of senior and junior scholars researching multimodal argumentation in the last two decades. In each chapter, a specific approach to argumentation and rhetoric is combined with insights from visual studies, metaphor theory, scientific visualization, cognitive science, semiotics, conversation analysis, or (documentary) film theory in order to explain how multimodal genres function argumentatively and rhetorically. Together the chapters present a state-of-the-art in the analysis of multimodal argumentation in such diverse genres as print advertisements, news photographs, scientific illustrations, political cartoons, documentaries, film trailers, political TV advertisements, public debates, and political speeches. The volume will be of interest to advanced students and scholars in argumentation studies, rhetoric, and multimodal communication.