"Drawing on a wide range of examples, Kress and Van Leeuwen outline an approach to social discourse in which colour plays a role equal to language, and show how two kinds of thought processes interact in the design and production of communicative messages: 'design thinking' and 'production thinking', the kind of thinking which occurs in direct interaction with the materials and media used. Above all the authors stress communicative practice and interactivity. Their question throughout is: how do people use communicative modes and media in actual, concrete, interactive instances of communicative practice?" "This book is a text for courses in language, media and communication willing to take on the theoretical challenges posed by multimodality, multimedia and multi-skilling, and it provides inspiring theoretical input for courses in interactive multimedia design."--BOOK JACKET.
New Directions in the Analysis of Multimodal Discourse offers a comprehensive international view of multimodal discourse and presents new directions for research and application in this growing field. With contributions from top scholars around the world, this work opens up the field of multimodal discourse analysis as it covers a wide range of interests such as computational linguistics, education, ideology, and media discourse. The range and scope of the chapters in this book provide groundbreaking insights into exploring and accounting for the various facets of multimodality in a range of texts and contexts. Initial chapters specifically aim to tackle theoretical issues, while subsequent chapters focus on important research areas such as writing and graphology, genre, ideology, computational concordancing, literacy, and cross cultural and cross linguistic issues. In the final chapters, an emphasis is placed on the educational implications of multimodality in first and second language contexts, a particularly new and interesting contribution.
The overarching theme of Discourse and Technology is cutting-edge in the field of linguistics: multimodal discourse. This volume opens up a discussion among discourse analysts and others in linguistics and related fields about the two-fold impact of new communication technologies: The impact on how discourse data is collected, transcribed, and analyzed—and the impact that these technologies are having on social interaction and discourse. As inexpensive tape recorders allowed the field to move beyond text, written or printed language, to capture talk—discourse as spoken language—the information explosion (including cell phones, video recorders, Internet chat rooms, online journals, and the like) has moved those in the field to recognize that all discourse is, in various ways, "multimodal," constructed through speech and gesture, as well as through typography, layout, and the materials employed in the making of texts. The contributors have responded to the expanding scope of discourse analysis by asking five key questions: Why should we study discourse and technology and multimodal discourse analysis? What is the role of the World Wide Web in discourse analysis? How does one analyze multimodal discourse in studies of social actions and interactions? How does one analyze multimodal discourse in educational social interactions? and, How does one use multimodal discourse analyses in the workplace? The vitality of these explorations opens windows onto even newer horizons of discourse and discourse analysis.
This book brings together cutting-edge research on multimodal texts and the "discourses" generated through the interaction of two or more modes of communication, for example pictures of language, typography and layout, body movement and camera movement. The contributors collected within this volume use systemic functional linguistics to analyze how meaning is generated within a series of case studies. The result is a comprehensive survey of the ways in which enhanced meaning emerges through the interaction of more than one mode of communication. Multimodal Discourse Analysis will be useful to researchers interested in the application of systemic functional linguistics to media studies, discourse analysis and cognitive linguistics.
"How great to have this practical introduction to doing critical discourse analysis, especially one that provides examples of multimodal discourse analysis. Extremely useful for students who need tools for the study of text, talk and images." - Teun van Dijk, Pompeu Fabra University "The authors have truly achieved the impossible: to make extremely complex phenomena accessible for students and scholars alike. Thus, this textbook will provide a most helpful guide when looking for adequate ways to grasp and analyze the intricate interdependence of written, oral and visual forms of semiosis." - Ruth Wodak, Lancaster University How do media texts manipulate and persuade us? How do language and images play out the ideas, values and identities? This book shows readers exactly how language, power and ideology are negotiated in media texts, from magazine and advertising, to YouTube and music videos. Presenting a systematic toolkit of theories, concepts and techniques for doing language and image analysis, students learn how to dig deep into discourses and the media landscape. With case studies and examples from a range of traditional and new media content, the book equips students to understand the relationship between language, discourse and social practices.
Contemporary society has witnessed radical changes in the field of communications in terms of how messages and meanings are disseminated. Digitalization and the Internet have signalled an exponential rise in the circulation of multimodal texts in which different semiotic resources are orchestrated together to construct meaning in all areas of social life, across languages and cultures, and in diverse specialized discourse domains. This has foregrounded the need to examine the semiotic functions, affordances, and issues at stake in a range of multimodal discourse forms, while simultaneously highlighting the importance of critical multimodal literacy in audiences and learners. This volume develops and extends pioneering research on the intersection between multimodality and specialized discourse. Eight newly commissioned studies offer innovative perspectives on multimodal research methodologies and applications in a variety of ESP (English for Specific Purposes) contexts for practitioners and scholars alike. The volume offers a glimpse at future directions in this dynamic and ever-evolving area of investigation focusing on the synergy between verbal and non-verbal modes of communication in the digital age. Each chapter explores an original area of application: academic, economic, scientific, marketing, legal, medical, political, and tourism. The contributors approach multimodality from a range of theoretical and methodological viewpoints including synchronic and diachronic corpus-based and corpus-aided studies, critical discourse analysis, and systemic functional linguistics. Analytical tools such as multimodal (critical) discourse analysis, multimodal transcription, and multimodal annotation software capable of representing the interplay of different semiotic modes - speech, intonation, direction of gaze, facial expressions, gesturing, and spatial positioning of interlocutors - are employed. The diversity of research strands contained in the volume illustrates just some of the vast areas of multimodal knowledge dissemination that are still unmapped. As a cornerstone of communication, multimodality needs exploring in all its facets. These contributions aim to further that cause.
The Discourse of YouTube explores the cutting edge of contemporary multimodal discourse through an in-depth analysis of structures, processes and content in YouTube discourse. YouTube is often seen as no more than a place to watch videos, but this book argues that YouTube and YouTube pages can also be read and analysed as complex, multi-authored, multimodal texts, emerging dynamically from processes of textually-mediated social interaction. The objective of the book is to show how multimodal discourse analysis tools can help us to understand the structures and processes involved in the production of YouTube texts. Philip Benson develops a framework for the analysis of multimodality in the structure of YouTube pages and of the multimodal interactions from which their content emerges. A second, and equally important, objective is to show how the globalization of YouTube is central to much of its discourse. The book identifies translingual practice as a key element in the global discourse of YouTube and discusses its roles in the negotiation of identities and intercultural learning in videos and comments. Focusing on YouTube as a key example of new digital media, The Discourse of YouTube makes a substantial contribution to conversations about new ways of producing multimodal text in a digital world.
This book offers a new framework for analysing textbook discourse, bridging the gap between contemporary ethnographic approaches and multimodality for a contextually sensitive approach which considers the multiplicity of multimodal resources involved in the production and use of textbooks. The volume makes the case for textbook discourse studies to go beyond studies of textual representation and critically consider the ways in which textbook discourse is situated within wider social practices. Each chapter considers a different social semiotic practice in which textbook and textbook discourse is involved: representation, communication, interaction, learning, and recontextualization. In bringing together this work with contemporary ethnography scholarship, the book offers a comprehensive toolkit for further research on textbook discourse and pushes the field forward into new directions. This innovative book will be of particular interest to students and scholars in discourse analysis, multimodality, social semiotics, language and communication, and curriculum studies.
As a founder and leading figure in multimodality and social semiotics, Theo van Leuween has made significant contributions to a variety of research fields, including discourse analysis, sociolinguistics, communication and media studies, education, and design. In celebration of his illustrious research career, this volume brings together a group of leading and emerging scholars in these fields to review, explore and advance two central research agendas set out by van Leeuwen: the categorisation of the meaning potential of various semiotic resources and the examination of their uses in different forms of communication, and the critical analysis of the interaction between semiotic forms, norms and technology in discursive practices. Through 11 cutting-edge research papers and an experimental visual essay, the book investigates a broad range of semiotic resources including touch, sound, image, texture, and discursive practices such as community currency, fitness regime, film scoring, and commodity upcycling. The book showcases how social semiotics and multimodality can provide insights into the burning issues of the day, such as global neoliberalism, terrorism, consumerism, and immigration.
This book contributes to the analysis of film from a multimodal and textual perspective by extending formal semantics into the realm of multimodal discourse analysis. It accounts for both the inferential as well as intersemiotic meaning making processes in filmic discourse and therefore addresses one of the main questions that have been asked within film theory and multimodal analysis: How do we understand film and multimodal texts? The book offers an analytical answer to this question by providing a systematic tool for the description of this comprehension process. It aims to advance knowledge of the various resources in filmic texts, the ways the resources work together in constructing meaning and the ways people understand this meaning construction. This new approach to film interpretation is thus able to remodel and improve the classical paradigm of film text analysis.
