Research is suggesting that rather than our senses being independent, perception is fundamentally a multisensory experience. This handbook reviews the evidence and explores the theory of broad underlying principles that govern sensory interactions, regardless of the specific senses involved.
It has become accepted in the neuroscience community that perception and performance are quintessentially multisensory by nature. Using the full palette of modern brain imaging and neuroscience methods, The Neural Bases of Multisensory Processes details current understanding in the neural bases for these phenomena as studied across species, stages of development, and clinical statuses. Organized thematically into nine sub-sections, the book is a collection of contributions by leading scientists in the field. Chapters build generally from basic to applied, allowing readers to ascertain how fundamental science informs the clinical and applied sciences. Topics discussed include: Anatomy, essential for understanding the neural substrates of multisensory processing Neurophysiological bases and how multisensory stimuli can dramatically change the encoding processes for sensory information Combinatorial principles and modeling, focusing on efforts to gain a better mechanistic handle on multisensory operations and their network dynamics Development and plasticity Clinical manifestations and how perception and action are affected by altered sensory experience Attention and spatial representations The last sections of the book focus on naturalistic multisensory processes in three separate contexts: motion signals, multisensory contributions to the perception and generation of communication signals, and how the perception of flavor is generated. The text provides a solid introduction for newcomers and a strong overview of the current state of the field for experts.
Multisensory Perception: From Laboratory to Clinic surveys the current state of knowledge on multisensory processes, synthesizing information from diverse streams of research and defining hypotheses and questions to direct future work. Reflecting the nature of the field, the book is interdisciplinary, comprising the findings and views of writers with diverse backgrounds and varied methods, including psychophysical, neuroanatomical, neurophysiological and neuroimaging approaches. Sections cover basic principles, specific interactions between the senses, the topic of crossmodal correspondences between particular sensory attributes, the related topic of synesthesia, and the clinic. - Offers a comprehensive, up-to-date overview of the current state of knowledge on multisensory processes - Coverage includes basic principles, specific interactions between the senses, crossmodal correspondences and the clinical aspects of multisensory processes - Includes psychophysical, neuroanatomical, neurophysiological and neuroimaging approaches
Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations. Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace Cue Combination within a Bayesian Framework David Alais and David Burr Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley Hearing in a "Moving" Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago.
Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations. Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace Cue Combination within a Bayesian Framework David Alais and David Burr Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley Hearing in a “Moving” Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago
Multisensory Flavor Perception: From Fundamental Neuroscience Through to the Marketplace provides state-of-the-art coverage of the latest insights from the rapidly-expanding world of multisensory flavor research. The book highlights the various types of crossmodal interactions, such as sound and taste, and vision and taste, showing their impact on sensory and hedonic perception, along with their consumption in the context of food and drink. The chapters in this edited volume review the existing literature, also explaining the underlying neural and psychological mechanisms which lead to crossmodal perception of flavor. The book brings together research which has not been presented before, making it the first book in the market to cover the literature of multisensory flavor perception by incorporating the latest in psychophysics and neuroscience. - Authored by top academics and world leaders in the field - Takes readers on a journey from the neurological underpinnings of multisensory flavor perception, then presenting insights that can be used by food companies to create better flavor sensations for consumers - Offers a wide perspective on multisensory flavor perception, an area of rapidly expanding knowledge
We perceive and understand our environment using many sensory systems-vision, touch, hearing, taste, smell, and proprioception. These multiple sensory modalities give us complementary sources of information about the environment. This book explores how we develop the ability to integrate our senses.
This textbook goes beyond introductory sensory perception by incorporating supplementary electronic materials to demonstrate the parallels between both hearing and seeing. Each chapter intermixes seeing and hearing processes so that students can easily understand that perceptual organization is the same across different kinds of sensations and modalities. Figures illustrating visual organization are paired with sound files demonstrating the analogous auditory organization. While most books on sensation and/or perception treat the senses individually there is growing awareness of just how important multisensory integration is to understanding the connection between sensory perception and cognition.
The major reference work for a rapidly advancing field synthesizes central themes, reports on current findings, and offers a blueprint for future research. Scientists' attempts to understand the physiology underlying our apprehension of the physical world was long dominated by a focus on the individual senses. The 1980s saw the beginning of systematic efforts to examine interactions among different sensory modalities at the level of the single neuron. And by the end of the 1990s, a recognizable and multidisciplinary field of "multisensory processes" had emerged. More recently, studies involving both human and nonhuman subjects have focused on relationships among multisensory neuronal ensembles and their behavioral, perceptual, and cognitive correlates. The New Handbook of Multisensory Processing synthesizes the central themes in this rapidly developing area, reports on current findings, and offers a blueprint for future research. The contributions, all of them written for this volume by leading experts, reflect the evolution and current state of the field. This handbook does more than simply review the field. Each of the volume's eleven sections broadly surveys a major topic, and each begins with a substantive and thought-provoking commentary by the section editor that identifies the major issues being explored, describes their treatment in the chapters that follow, and sets these findings within the context of the existing body of knowledge. Together, the commentaries and chapters provide an invaluable guide to areas of general agreement, unresolved issues, and topics that remain to be explored in this fast-moving field.