This book draws on visual data, ranging from advertisements to postage stamps to digital personal photography, to offer a complex interpretation of the different social functions realised by these texts as semiotic artefacts. Framed within the media environment of the city of Hong Kong, the study demonstrates the importance of social context to meaning making and social semiotic multimodal analysis. This book will be of interest to readers in the arts, humanities and social sciences, particularly within the fields of semiotics, visual studies, design studies, media and cultural studies, anthropology and sociology.
This collection brings together a range of perspectives on multimodal communication in intercultural interaction, bridging cognitive, social, and functional approaches towards promoting cross-disciplinary dialogues and taking research at the intersections of these fields into new directions. The volume assembles conversationalist, socially oriented, cognitive, and sensory approaches in considering culture as a dynamic construct, co-constituted and (re)negotiated among participants in interaction and filtering it through a multimodal lens, drawing on a range of examples, such as educational settings or online video platforms. Each chapter offers a unique perspective on "culture" and "intercultural," while also situating their own definitions of these labels against those of the other chapters. Taken together, the chapters form a fluid conversation on the nature of intercultural encounters in today’s globalizsd world, as digital environments intertwine with the physical mobility of people, encouraging researchers across these fields to adopt a more holistic multimodal perspective to approach intercultural interaction. This book will be of interest to students and scholars in intercultural communication, multimodality, sociolinguistics, cognitive and interactional linguistics, and semiotics.
Dance Data, Cognition, and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world. It is a reflection on the observation of bodily movements in artistic settings, and one that views human social interactions, multimodal communication, and cognitive processes through a different lens—that of the close collaboration between performing artists, designers, and scholars. This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones. The book, which includes digital Support Material on the volume's Routledge website, will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, new media, and creativity studies.
Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.
Successful communication requires optimal relevance to a target audience. Relevance theory (RT) provides an excellent model based on this insight, but the impact of the theory has until now been restricted due to an almost exclusive focus on spoken face-to-face communication. Visual and Multimodal Communication: Applying the Relevance Principle is the first book to systematically demonstrate how RT can fulfill its promise to develop into an inclusive theory of communication. In this book, Charles Forceville refines and adapts RT's original claims to show its applicability to static visuals and multimodal discourses in popular culture genres. Using colorful examples, he explains how RT can be expanded and adapted to accommodate mass-communicative visual and visual-plus-verbal messages. Forceville addresses issues such as the difference between drawing prospective addressees' attention to a message and persuading them to accept it; the thorny continuum from implicit to explicit information; and the role of genre. Case studies of pictograms, advertisements, cartoons, and comics provide contemporary and accessible examples of the importance of genre and of how the RT model can be connected to other approaches. By expanding the application of relevance theory to include mass-communicative messages, Visual and Multimodal Communication reintroduces a central framework of cognitive linguistics and pragmatics to a new audience and paves the way for an inclusive theory of communication.
This book explores the use of technology to detect, predict and understand social cues, in order to analyze and prevent conflict. Traditional human sciences approaches are enriched with the latest developments in Social Signal Processing aimed at an automatic understanding of conflict and negotiation. Communication—both verbal and non-verbal, within the context of a conflict—is studied with the aim of promoting the use of intelligent machines that automatically measure and understand the escalation of conflict, and are able to manage it, in order to support the negotiation process. Particular attention is paid to the integration of human sciences findings with computational approaches, from the application of correct methodologies for the collection of valid data to the development of computational approaches inspired by research on verbal and multimodal communication. In the words of the trade unionist Pierre Carniti, "We should reevaluate conflict, since without conflict there is no social justice." With this in mind, this volume does not approach conflict simply as an obstacle to be overcome, but as a concept to be fully analyzed. The philosophical, linguistic and psychological aspects of conflict, once understood, can be used to promote conflict management as a means for change and social justice.
This state-of-the-art account of research and theorizing brings together multimodality, learning and communication through detailed analyses of signmakers and their meaning-making in museums, hospitals, schools and the home environment. By analyzing video recordings, photographs, screenshots and print materials, Jeff Bezemer and Gunther Kress go well beyond the comfortable domains of traditional sites of (social) semiotic and multimodal research. They steer away from spurious invention and naming of ever more new and exciting domains, focusing instead on fundamentals in assembling a set of tools for current tasks: namely, describing and analyzing learning and communication in the contemporary world as one integrated field. The theory outlined in the book is grounded in the findings of the authors’ wide-ranging empirical investigations. Each chapter evaluates the work that is being done and has been done, challenging accepted wisdom and standing much of it on its head. With extensive illustrations and many examples presented to show the reach and applicability of the theory, this book is essential reading for all those working in multimodality, semiotics, applied linguistics and related areas. Images from the book are also available to view online at www.routledge.com/9780415709620/
This volume examines the role of multimodal augmentative and alternative communication (AAC) in supporting speech, language, and communication of individuals with Down syndrome, across the lifespan.
Successful communication requires optimal relevance to a target audience. Relevance theory (RT) provides an excellent model based on this insight, but the impact of the theory has until now been restricted due to an almost exclusive focus on spoken face-to-face communication. Visual and Multimodal Communication: Applying the Relevance Principle is the first book to systematically demonstrate how RT can fulfill its promise to develop into an inclusive theory of communication. In this book, Charles Forceville refines and adapts RT's original claims to show its applicability to static visuals and multimodal discourses in popular culture genres. Using colorful examples, he explains how RT can be expanded and adapted to accommodate mass-communicative visual and visual-plus-verbal messages. Forceville addresses issues such as the difference between drawing prospective addressees' attention to a message and persuading them to accept it; the thorny continuum from implicit to explicit information; and the role of genre. Case studies of pictograms, advertisements, cartoons, and comics provide contemporary and accessible examples of the importance of genre and of how the RT model can be connected to other approaches. By expanding the application of relevance theory to include mass-communicative messages, Visual and Multimodal Communication reintroduces a central framework of cognitive linguistics and pragmatics to a new audience and paves the way for an inclusive theory of communication.
