Game Sound Technology and Player Interaction: Concepts and Developments researches both how game sound affects a player psychologically, emotionally, and physiologically, and how this relationship itself impacts the design of computer game sound and the development of technology. This compilation also applies beyond the realm of video games to other types of immersive sound, such as soundscape design, gambling machines, emotive and fantastical sound to name a few. The application for this research is wide-ranging, interdisciplinary, and of primary importance for academics and practitioners searching for the right sounds.
An examination of the player's experience of sound in video games and the many ways that players interact with the sonic elements in games. In Playing with Sound, Karen Collins examines video game sound from the player's perspective. She explores the many ways that players interact with a game's sonic aspects—which include not only music but also sound effects, ambient sound, dialogue, and interface sounds—both within and outside of the game. She investigates the ways that meaning is found, embodied, created, evoked, hacked, remixed, negotiated, and renegotiated by players in the space of interactive sound in games. Drawing on disciplines that range from film studies and philosophy to psychology and computer science, Collins develops a theory of interactive sound experience that distinguishes between interacting with sound and simply listening without interacting. Her conceptual approach combines practice theory (which focuses on productive and consumptive practices around media) and embodied cognition (which holds that our understanding of the world is shaped by our physical interaction with it). Collins investigates the multimodal experience of sound, image, and touch in games; the role of interactive sound in creating an emotional experience through immersion and identification with the game character; the ways in which sound acts as a mediator for a variety of performative activities; and embodied interactions with sound beyond the game, including machinima, chip-tunes, circuit bending, and other practices that use elements from games in sonic performances.
A distinguishing feature of video games is their interactivity, and sound plays an important role in this: a player's actions can trigger dialogue, sound effects, ambient sound, and music. This book introduces readers to the various aspects of game audio, from its development in early games to theoretical discussions of immersion and realism.
What does it mean to interact with sound? How does interactivity alter our experience as creators and listeners? What does the future hold for interactive musical and sonic experiences? This book answers these questions with newly-commissioned chapters that explore the full range of interactive audio in games, performance, design, and practice.
Understanding Game Scoring explores the unique collaboration between gameplay and composition that defines musical scoring for video games. Using an array of case studies reaching back into the canon of classic video games, this book illuminates the musical flexibility, user interactivity and sound programming that make game scoring so different from traditional modes of composition. Mack Enns explores the collaboration between game scorers and players to produce the final score for a game, through case studies of the Nintendo Entertainment System sound hardware configuration, and game scores, including the canonic scores for Super Mario Bros. (1985) and The Legend of Zelda (1986). This book is recommended reading for students and researchers interested in the composition and production of video game scores, as well as those interested in ludo-musicology.
For most of the history of film-making, music has played an integral role serving many functions - such as conveying emotion, heightening tension, and influencing interpretation and inferences about events and characters. More recently, with the enormous growth of the gaming industry and the Internet, a new role for music has emerged. However, all of these applications of music depend on complex mental processes which are being identified through research on human participants in multimedia contexts. The Psychology of Music in Multimedia is the first book dedicated to this fascinating topic. The Psychology of Music in Multimedia presents a wide range of scientific research on the psychological processes involved in the integration of sound and image when engaging with film, television, video, interactive games, and computer interfaces. Collectively, the rich chapters in this edited volume represent a comprehensive treatment of the existing research on the multimedia experience, with the aim of disseminating the current knowledge base and inspiring future scholarship. The focus on empirical research and the strong psychological framework make this book an exceptional and distinctive contribution to the field. The international collection of contributors represents eight countries and a broad range of disciplines including psychology, musicology, neuroscience, media studies, film, and communications. Each chapter includes a comprehensive review of the topic and, where appropriate, identifies models that can be empirically tested. Part One presents contrasting theoretical approaches from cognitive psychology, philosophy, semiotics, communication, musicology, and neuroscience. Part Two reviews research on the structural aspects of music and multimedia, while Part Three focuses on research examining the influence of music on perceived meaning in the multimedia experience. Part Four explores empirical findings in a variety of real-world applications of music in multimedia including entertainment and educational media for children, video and computer games, television and online advertising, and auditory displays of information. Finally, the closing chapter in Part Five identifies emerging themes and points to the value of broadening the scope of research to encompass multisensory, multidisciplinary, and cross-cultural perspectives to advance our understanding of the role of music in multimedia. This is a valuable book for those in the fields of music psychology and musicology, as well as film and media studies.
Scholars consider sound and its concepts, taking as their premise the idea that popular culture can be analyzed in an innovative way through sound. The wide-ranging texts in this book take as their premise the idea that sound is a subject through which popular culture can be analyzed in an innovative way. From an infant's gurgles over a baby monitor to the roar of the crowd in a stadium to the sub-bass frequencies produced by sound systems in the disco era, sound—not necessarily aestheticized as music—is inextricably part of the many domains of popular culture. Expanding the view taken by many scholars of cultural studies, the contributors consider cultural practices concerning sound not merely as semiotic or signifying processes but as material, physical, perceptual, and sensory processes that integrate a multitude of cultural traditions and forms of knowledge. The chapters discuss conceptual issues as well as terminologies and research methods; analyze historical and contemporary case studies of listening in various sound cultures; and consider the ways contemporary practices of sound generation are applied in the diverse fields in which sounds are produced, mastered, distorted, processed, or enhanced. The chapters are not only about sound; they offer a study through sound—echoes from the past, resonances of the present, and the contradictions and discontinuities that suggest the future. Contributors Karin Bijsterveld, Susanne Binas-Preisendörfer, Carolyn Birdsall, Jochen Bonz, Michael Bull, Thomas Burkhalter, Mark J. Butler, Diedrich Diederichsen, Veit Erlmann, Franco Fabbri, Golo Föllmer, Marta García Quiñones, Mark Grimshaw, Rolf Großmann, Maria Hanáček, Thomas Hecken, Anahid Kassabian, Carla J. Maier, Andrea Mihm, Bodo Mrozek, Carlo Nardi, Jens Gerrit Papenburg, Thomas Schopp, Holger Schulze, Toby Seay, Jacob Smith, Paul Théberge, Peter Wicke, Simon Zagorski-Thomas
The Routledge Companion to Screen Music and Sound provides a detailed and comprehensive overview of screen music and sound studies, addressing the ways in which music and sound interact with forms of narrative media such as television, videogames, and film. The inclusive framework of "screen music and sound" allows readers to explore the intersections and connections between various types of media and music and sound, reflecting the current state of scholarship and the future of the field. A diverse range of international scholars have contributed an impressive set of forty-six chapters that move from foundational knowledge to cutting edge topics that highlight new key areas. The companion is thematically organized into five cohesive areas of study: Issues in the Study of Screen Music and Sound—discusses the essential topics of the discipline Historical Approaches—examines periods of historical change or transition Production and Process—focuses on issues of collaboration, institutional politics, and the impact of technology and industrial practices Cultural and Aesthetic Perspectives—contextualizes an aesthetic approach within a wider framework of cultural knowledge Analyses and Methodologies—explores potential methodologies for interrogating screen music and sound Covering a wide range of topic areas drawn from musicology, sound studies, and media studies, The Routledge Companion to Screen Music and Sound provides researchers and students with an effective overview of music’s role in narrative media, as well as new methodological and aesthetic insights.
This open access book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments.
This book constitutes the refereed proceedings of the 13th International Conference on Interactive Digital Storytelling, ICIDS 2020, held in Bournemouth, UK, in November 2020. The 15 full papers and 8 short papers presented together with 5 posters, were carefully reviewed and selected from 70 submissions. The conference offers topics in game narrative and interactive storytelling, including the theoretical, technological, and applied design practices, narrative systems, storytelling technology, and humanities-inspired theoretical inquiry, empirical research and artistic expression.
