This book is a comprehensive introductory presentation of the key research areas in the interdisciplinary fields of sonification and auditory display. Chapters are written by leading experts, providing a wide-ranging coverage of the central issues, and can be read from start to finish, or dipped into as required. Sonification conveys information by using non-speech sounds. To listen to data as sound and noise can be a surprising new experience with diverse applications ranging from novel interfaces for visually impaired people to data analysis problems in many scientific fields. This book gives a solid introduction to the field of auditory display, the techniques for sonification, suitable technologies for developing sonification algorithms, and the most promising application areas. The book is accompanied by an online repository of sound examples.
The contemporary design practice known as data sonification allows us to experience information in data by listening. In doing so, we understand the source of the data in ways that support, and in some cases surpass, our ability to do so visually. In order to assist us in negotiating our environments, our senses have evolved differently. Our hearing affords us unparalleled temporal and locational precision. Biological survival has determined that the ears lead the eyes. For all moving creatures, in situations where sight is obscured, spatial auditory clarity plays a vital survival role in determining both from where the predator is approaching or to where the prey has escaped. So, when designing methods that enable listeners to extract information from data, both with and without visual support, different approaches are necessary. A scholarly yet approachable work by one of the recognized leaders in the field of auditory design, this book will - Lead you through some salient historical examples of how non-speech sounds have been used to inform and control people since ancient times. - Comprehensively summarize the contemporary practice of Data Sonification. - Provide a detailed overview of what information is and how our auditory perceptions can be used to enhance our knowledge of the source of data. - Show the importance of the dynamic relationships between hearing, cognitive load, comprehension, embodied knowledge and perceptual truth. - Discuss the role of aesthetics in the dynamic interplay between listenability and clarity. - Provide a mature software framework that supports the practice of data sonification design, together with a detailed discussion of some of the design principles used in various examples. David Worrall is an internationally recognized composer, sound artist and interdisciplinary researcher in the field of auditory design. He is Professor of Audio Arts and Acoustics at Columbia College Chicago and a former elected president of the International Community for Auditory Display (ICAD), the leading organization in the field since its inception over 25 years ago. Code and audio examples for this book are available at https://github.com/david-worrall/springer/ Here is an excellent review of the book by Dr Gregory Kramer: “Worrall proceeds bravely through the trees and vines of philosophy, information theory, aesthetics, and other contributors to sonification design theory. It’s a feat. He nails all of this down with the specific implementation system he’s designed over many years, and applies his theories to specific problems. In a field of research still in its first half century and setting its bearings in a world where human perception has become a sideshow to machine learning, deep learning, and artificial intelligence, the roots David provides will serve well.” Dr Gregory Kramer is the founding figure in the emerging field of sonification, founded the International Conference on Auditory Display (ICAD) and editor of the first book in the field, "Auditory Display: Sonification, Audification and Auditory Interfaces" (Addison Wesley, 1994).
With the ongoing development of algorithmic composition programs and communities of practice expanding, algorithmic music faces a turning point. Joining dozens of emerging and established scholars alongside leading practitioners in the field, chapters in this Handbook both describe the state of algorithmic composition and also set the agenda for critical research on and analysis of algorithmic music. Organized into four sections, chapters explore the music's history, utility, community, politics, and potential for mass consumption. Contributors address such issues as the role of algorithms as co-performers, live coding practices, and discussions of the algorithmic culture as it currently exists and what it can potentially contribute society, education, and ecommerce. Chapters engage particularly with post-human perspectives - what new musics are now being found through algorithmic means which humans could not otherwise have made - and, in reciprocation, how algorithmic music is being assimilated back into human culture and what meanings it subsequently takes. Blending technical, artistic, cultural, and scientific viewpoints, this Handbook positions algorithmic music making as an essentially human activity.
An overview of emerging topics, theories, methods, and practices in sonic interactive design, with a focus on the multisensory aspects of sonic experience. Sound is an integral part of every user experience but a neglected medium in design disciplines. Design of an artifact's sonic qualities is often limited to the shaping of functional, representational, and signaling roles of sound. The interdisciplinary field of sonic interaction design (SID) challenges these prevalent approaches by considering sound as an active medium that can enable novel sensory and social experiences through interactive technologies. This book offers an overview of the emerging SID research, discussing theories, methods, and practices, with a focus on the multisensory aspects of sonic experience. Sonic Interaction Design gathers contributions from scholars, artists, and designers working at the intersections of fields ranging from electronic music to cognitive science. They offer both theoretical considerations of key themes and case studies of products and systems created for such contexts as mobile music, sensorimotor learning, rehabilitation, and gaming. The goal is not only to extend the existing research and pedagogical approaches to SID but also to foster domains of practice for sound designers, architects, interaction designers, media artists, product designers, and urban planners. Taken together, the chapters provide a foundation for a still-emerging field, affording a new generation of designers a fresh perspective on interactive sound as a situated and multisensory experience. Contributors Federico Avanzini, Gerold Baier, Stephen Barrass, Olivier Bau, Karin Bijsterveld, Roberto Bresin, Stephen Brewster, Jeremy Coopersotck, Amalia De Gotzen, Stefano Delle Monache, Cumhur Erkut, George Essl, Karmen Franinović, Bruno L. Giordano, Antti Jylhä, Thomas Hermann, Daniel Hug, Johan Kildal, Stefan Krebs, Anatole Lecuyer, Wendy Mackay, David Merrill, Roderick Murray-Smith, Sile O'Modhrain, Pietro Polotti, Hayes Raffle, Michal Rinott, Davide Rocchesso, Antonio Rodà, Christopher Salter, Zack Settel, Stefania Serafin, Simone Spagnol, Jean Sreng, Patrick Susini, Atau Tanaka, Yon Visell, Mike Wezniewski, John Williamson
Written by the world's leading scholars and researchers in sound studies, this handbook offers new and engaging perspectives on the significance of sound in its material and cultural forms.
The book is a compendium of thinking on virtuality and its relationship to reality from the perspective of a variety of philosophical and applied fields of study. Topics covered include presence, immersion, emotion, ethics, utopias and dystopias, image, sound, literature, AI, law, economics, medical and military applications, religion, and sex.
Body and space refer to vital and interrelated dimensions in the experience of sounds and music. Sounds have an overwhelming impact on feelings of bodily presence and inform us about the space we experience. Even in situations where visual information is artificial or blurred, such as in virtual environments or certain genres of film and computer games, sounds may shape our perceptions and lead to surprising new experiences. This book discusses recent developments in a range of interdisciplinary fields, taking into account the rapidly changing ways of experiencing sounds and music, the consequences for how we engage with sonic events in daily life and the technological advancements that offer insights into state-of-the-art methods and future perspectives. Topics range from the pleasures of being locked into the beat of the music, perception–action coupling and bodily resonance, and affordances of musical instruments, to neural processing and cross-modal experiences of space and pitch. Applications of these findings are discussed for movement sonification, room acoustics, networked performance, and for the spatial coordination of movements in dance, computer gaming and interactive artistic installations.
With coverage of the entire research process in social media, data collection and analysis on specific platforms, and innovative developments in the field, this handbook is the ultimate resource for those looking to tackle the challenges that come with doing research in this sphere.
It is common for us today to associate the practice of science primarily with the act of seeing—with staring at computer screens, analyzing graphs, and presenting images. We may notice that physicians use stethoscopes to listen for disease, that biologists tune into sound recordings to understand birds, or that engineers have created Geiger tellers warning us for radiation through sound. But in the sciences overall, we think, seeing is believing. This open access book explains why, indeed, listening for knowledge plays an ambiguous, if fascinating, role in the sciences. For what purposes have scientists, engineers and physicians listened to the objects of their interest? How did they listen exactly? And why has listening often been contested as a legitimate form of access to scientific knowledge? This concise monograph combines historical and ethnographic evidence about the practices of listening on shop floors, in laboratories, field stations, hospitals, and conference halls, between the 1920s and today. It shows how scientists have used sonic skills—skills required for making, recording, storing, retrieving, and listening to sound—in ensembles: sets of instruments and techniques for particular situations of knowledge making. Yet rather than pleading for the emancipation of hearing at the expense of seeing, this essay investigates when, how, and under which conditions the ear has contributed to science dynamics, either in tandem with or without the eye.
