"The representation of events is a central topic for cognitive science. In this series of lectures, Jeffrey M. Zacks situates event representations and their role in language within a theory of perception and memory. Event representations have a distinctive structure and format that result from computational and neural mechanisms operating during perception and language comprehension. A crucial aspect of the mechanisms is that event representations are updated to optimize their predictive utility. This updating has consequences for action control and for long-term memory. Event cognition changes across the adult lifespan and can be impaired by conditions including Alzheimer's disease. These mechanisms have broad impact on everyday activity, and have shaped the development of media such as cinema and narrative fiction"--
Multimodality has most recently been described no longer as a research field or discipline on its own, but rather as a “stage of development within a field” (Bateman 2022a, 49). The realization that (1) many different fields and disciplines now enter their own multimodal phase with new interest in multimodal phenomena and that (2) these disciplines all commit to the development of multimodality research with their own theoretical principles and methodological tools, brings with it not only an immense breadth of potential analytical objects, but also many new meta-methodological issues. “We need to find ways of ‘combining’ insights from the variously imported theoretical and methodological backgrounds brought along by previous non-multimodal stages of any contributing disciplines” (Bateman 2022a, 49). At the same time, the search for a meta-methodology for multimodal analyses is pushed further by the recent trend towards more empirical approaches to multimodal phenomena and the development and use of larger multimodal corpora that just as well require theoretical and methodological refinements. “We need to develop ways of strengthening claims with robustly applicable methods which nevertheless remain firmly anchored theoretically” (Bateman 2022b, 64). For a productive handling of these issues, disciplinary triangulation and finding a ‘common language’ or metalanguage (Maton & Chen 2016) for an ‘integrationist interdisciplinarity’ (van Leeuwen 2005) are the greatest challenges in contemporary multimodality research (Bateman 2022a). Also, there is a need for reconceptualizing the practice of analysis by making available large-scale corpora and broader and more complex empirical setups to fully process the ‘move from theory to data,’ and to substantiate long-lasting theoretical and methodological hypotheses (Pflaeging et al. 2021). For this project, we see these challenges productively as “a multimodal task from the ground up,” as John Bateman (2022b, 64) has phrased it in one of his most recent papers. This Research Topic will address this task by convening the most recent theoretical, methodological, practical, and empirical developments within contemporary multimodality research. The aim is to gain new insights in • the metalanguages or external languages that are currently being developed for multimodal analysis in many different research fields and disciplines, e.g., in pedagogy, literary theory, cultural studies, design, argumentation theory, computer science, and (experimental) psychology; • newest results from data collection methods and multimodal corpus analyses that expand the current quantitative work by, e.g., applying existing theories and methods to larger datasets, or exploring the newest communication technologies. We are particularly interested in seeing how works addressing these aspects contribute to finding ways of productive triangulation and integration for and within a meta-methodology for multimodality research. This Research Topic aims to bring together scholars from a variety of disciplines interested in multimodality research to review, explore, and advance the contributions that John Bateman, as one of the key figures in multimodality research, has made to both theory- and method-building as well as to the driving forward of multimodal empirical and corpus analyses. We welcome contributions that, for example, • critically address the theoretical and methodological advancements that John Bateman has made with regard to the notions of semiotic mode, discourse semantics, genre, textuality, etc.; • apply one of the many approaches that John Bateman has developed for the empirical analysis of multimodal artefacts (e.g., the GeM model for page-based documents, his work on multimodal film and audio-visual analysis, and the discourse semantics and/or annotation approach to visual narratives) to larger corpora or currently newly developing communicative situations; • expand on one of the abovementioned aspects with new ideas and insights from disciplines that have not yet been included in multimodality research.
This book is the first to bring together computational, neurological, and psychological research on how humans detect, classify, remember, and act on events. It provides a comprehensive collection of the latest research in these diverse fields.
In her Beijing lectures, Melissa Bowerman presents a lucid introduction and account of her research on a range of topics: how children acquire the semantics of spatial terms, how they construct categories and acquire the semantics of nouns, and how they master the semantics of verbs in early language acquisition. Bowerman also covers the learning of argument structure and expressions of end-state, with special attention to the adult speech that guides children, and hence also the role of typology in acquisition; how cross-linguistic variation affects, for example, how speakers represent ‘cutting’ and ‘breaking’ in different languages, and the relation of the Whorfian Hypothesis to cross-linguistic variations in the semantics of languages. Bowerman’s over-riding concern throughout is with how children come to master the first language being spoken to them by their parents and caregivers.
The Cambridge Handbook of Applied Perception Research covers core areas of research in perception with an emphasis on its application to real-world environments. Topics include multisensory processing of information, time perception, sustained attention, and signal detection, as well as pedagogical issues surrounding the training of applied perception researchers. In addition to familiar topics, such as perceptual learning, the Handbook focuses on emerging areas of importance, such as human-robot coordination, haptic interfaces, and issues facing societies in the twenty-first century (such as terrorism and threat detection, medical errors, and the broader implications of automation). Organized into sections representing major areas of theoretical and practical importance for the application of perception psychology to human performance and the design and operation of human-technology interdependence, it also addresses the challenges to basic research, including the problem of quantifying information, defining cognitive resources, and theoretical advances in the nature of attention and perceptual processes.
Much of our behavior is guided by our understanding of events. We perceive events when we observe the world unfolding around us, participate in events when we act on the world, simulate events that we hear or read about, and use our knowledge of events to solve problems. In this book, Gabriel A. Radvansky and Jeffrey M. Zacks provide the first integrated framework for event cognition and attempt to synthesize the available psychological and neuroscience data surrounding it. This synthesis leads to new proposals about several traditional areas in psychology and neuroscience including perception, attention, language understanding, memory, and problem solving. Radvansky and Zacks have written this book with a diverse readership in mind. It is intended for a range of researchers working within cognitive science including psychology, neuroscience, computer science, philosophy, anthropology, and education. Readers curious about events more generally such as those working in literature, film theory, and history will also find it of interest.
The idea that speech is a dynamic process is a tautology: whether from the standpoint of the talker, the listener, or the engineer, speech is an action, a sound, or a signal continuously changing in time. Yet, because phonetics and speech science are offspring of classical phonology, speech has been viewed as a sequence of discrete events-positions of the articulatory apparatus, waveform segments, and phonemes. Although this perspective has been mockingly referred to as "beads on a string", from the time of Henry Sweet's 19th century treatise almost up to our days specialists of speech science and speech technology have continued to conceptualize the speech signal as a sequence of static states interleaved with transitional elements reflecting the quasi-continuous nature of vocal production. This book, a collection of papers of which each looks at speech as a dynamic process and highlights one of its particularities, is dedicated to the memory of Ludmilla Andreevna Chistovich. At the outset, it was planned to be a Chistovich festschrift but, sadly, she passed away a few months before the book went to press. The 24 chapters of this volume testify to the enormous influence that she and her colleagues have had over the four decades since the publication of their 1965 monograph.
Conceiving of language and cognition as biological phenomena, these lectures provide and illustrate a coherent, integrated theoretical framework for studying essentially any aspect of language systems, language use, language change, and language evolution.
This book provides a comprehensive account of the intentionality of perceptual experience. With special emphasis on vision Searle explains how the raw phenomenology of perception sets the content and the conditions of satisfaction of experience. The central question concerns the relation between the subjective conscious perceptual field and the objective perceptual field. Everything in the objective field is either perceived or can be perceived. Nothing in the subjective field is perceived nor can be perceived precisely because the events in the subjective field consist of the perceivings, whether veridical or not, of the events in the objective field. Searle begins by criticizing the classical theories of perception and identifies a single fallacy, what he calls the Bad Argument, as the source of nearly all of the confusions in the history of the philosophy of perception. He next justifies the claim that perceptual experiences have presentational intentionality and shows how this justifies the direct realism of his account. In the central theoretical chapters, he shows how it is possible that the raw phenomenology must necessarily determine certain form of intentionality. Searle introduces, in detail, the distinction between different levels of perception from the basic level to the higher levels and shows the internal relation between the features of the experience and the states of affairs presented by the experience. The account applies not just to language possessing human beings but to infants and conscious animals. He also discusses how the account relates to certain traditional puzzles about spectrum inversion, color and size constancy and the brain-in-the-vat thought experiments. In the final chapters he explains and refutes Disjunctivist theories of perception, explains the role of unconscious perception, and concludes by discussing traditional problems of perception such as skepticism.
