This book constitutes revised selected papers from the 9th International Gesture Workshop, GW 2011, held in Athens, Greece, in May 2011. The 24 papers presented were carefully reviewed and selected from 35 submissions. They are ordered in five sections named: human computer interaction; cognitive processes; notation systems and animation; gestures and signs: linguistic analysis and tools; and gestures and speech.
The International Gesture Workshops (GW) are interdisciplinary events for those researching gesture-based communication across the disciplines. The focus of these events is a shared interest in understanding gestures and sign language in their many facets, and using them for advancing human–machine interaction. Since 1996, International Gesture Workshops have been held roughly every second year, with fully reviewed proceedings published by Springer. The International Gesture Workshop GW 2009 was hosted by Bielefeld University’s Center for Interdisciplinary Research (ZiF – Zentrum für interdisziplinäre Forschung) during February 25–27, 2009. Like its predecessors, GW 2009 aimed to provide a platform for participants to share, discuss, and criticize recent and novel research with a multidisciplinary audience. More than 70 computer scientists, linguistics, psychologists, neuroscientists as well as dance and music scientists from 16 countries met to present and exchange their newest results under the umbrella theme “Gesture in Embodied Communication and Human–Computer Interaction. ” Consistent with the steady growth of research activity in this area, a large number of high-quality submissions were received, which made GW 2009 an exciting and important event for anyone interested in gesture-related technological research relevant to human–computer interaction. In line with the practice of previous gesture workshops, presenters were invited to submit theirs papers for publication in a subsequent peer-reviewed publication of high quality. The present book is the outcome of this effort. Representing the research work from eight countries, it contains a selection of 28 thoroughly reviewed articles.
When people communicate face to face they don't just exchange verbal information. Rather, communication encompasses the whole body. Communication partners synchronize their body sway, and mimic or imitate each other's body postures and actions. They produce a multitude of manual and facial gestures that help to illustrate what is being said, show how communication partners feel, or or reveal verbal deception. Moreover, face-to-face communication takes place in shared contexts where partners jointly attend and refer to the same objects, often while working on joint tasks such as carrying a table or repairing a car together. Traditionally, communication research has neglected these parts of communication using the engineering model of signal transmission as the main theoretical metaphor. This book takes a new look at recent empirical findings in the cognitive and neurosciences, showing that the traditional approach is insufficient, and presenting a new interdisciplinary perspective, the Embodied Communication perspective. The core claim of the Embodied Communication perspective is that human communication involves parallel and highly interactive couplings between communication partners. These couplings range from low-level systems for performing and understanding instrumental actions, like the mirror system, to higher-systems that interpret symbols in a cultural context. The book can also serve as a guide for engineers who construct artificial agents and robots that should be able to interact with humans.
This book constitutes the thoroughly refereed post-proceedings of the International Workshop on Gesture and Sign Languages in Human-Computer Interaction, GW 2001, held in London, UK, in April 2001. The 25 revised full papers and 8 short papers were carefully reviewed and selected for inclusion in the post-proceedings. The papers are organized in topical sections on gesture recognition, recognition of sign languages, nature and notations of sign languages, gesture and sign language synthesis, gestural action and interaction, and applications based on gesture control.
The concept of “constraint” is widely used in linguistics, computer science, and psychology. However, its implementation varies widely depending on the research domain: namely, language description, knowledge representation, cognitive modelling, and problem solving. These various uses of constraints offer complementary views on intelligent mechanisms. For example, in-depth descriptions implementing constraints are used in linguistics to filter out syntactic or discursive structures by means of dedicated description languages and constraint ranking. In computer science, the constraint programming paradigm views constraints as a whole, which can be used, for example, to build specific structures. Finally, in psycholinguistics, experiments are carried out to investigate the role of constraints within cognitive processes (both in comprehension and production), with various applications such as dialog modelling for people with disabilities. In this context, Constraints and Language builds an extended overview of the use of constraints to model and process language. This book will be useful for researchers willing to get a grip on the various uses of constraints in natural language processing, and also as a class book for academic staff who want to set up advanced courses around the concept of constraint-based natural language processing.
Research Methods in Sign Language Studies is a landmark work on sign language research, which spans the fields of linguistics, experimental and developmental psychology, brain research, and language assessment. Examines a broad range of topics, including ethical and political issues, key methodologies, and the collection of linguistic, cognitive, neuroscientific, and neuropsychological data Provides tips and recommendations to improve research quality at all levels and encourages readers to approach the field from the perspective of diversity rather than disability Incorporates research on sign languages from Europe, Asia, North and South America, and Africa Brings together top researchers on the subject from around the world, including many who are themselves deaf
The Handbook on Socially Interactive Agents provides a comprehensive overview of the research fields of Embodied Conversational Agents;Intelligent Virtual Agents;and Social Robotics. Socially Interactive Agents (SIAs);whether virtually or physically embodied;are autonomous agents that are able to perceive an environment including people or other agents;reason;decide how to interact;and express attitudes such as emotions;engagement;or empathy. They are capable of interacting with people and one another in a socially intelligent manner using multimodal communicative behaviors;with the goal to support humans in various domains. Written by international experts in their respective fields;the book summarizes research in the many important research communities pertinent for SIAs;while discussing current challenges and future directions. The handbook provides easy access to modeling and studying SIAs for researchers and students;and aims at further bridging the gap between the research communities involved. In two volumes;the book clearly structures the vast body of research. The first volume starts by introducing what is involved in SIAs research;in particular research methodologies and ethical implications of developing SIAs. It further examines research on appearance and behavior;focusing on multimodality. Finally;social cognition for SIAs is investigated using different theoretical models and phenomena such as theory of mind or pro-sociality. The second volume starts with perspectives on interaction;examined from different angles such as interaction in social space;group interaction;or long-term interaction. It also includes an extensive overview summarizing research and systems of human–agent platforms and of some of the major application areas of SIAs such as education;aging support;autism;and games.
What is gesture and what does it do? What is the meaning of multimodality? What do these concepts signify within the different theoretical approaches to interaction and communication among human beings? Why do we study gesture and multimodality? The thirteen chapters that make up this volume provide answers to these questions. They bring together an eclectic set of recent studies on visible bodily actions conducted by junior and senior researchers and are a testimony to the curiosity and vitality that have always distinguished gesture studies. This young yet rapidly growing field investigates the semiotic features of gesture in relation to speech as integral parts of utterances, the different uses of gestures with and without speech, such as gestures in language acquisition, gestures in the performing arts (music, dance, theatre) and gestures in Artificial Intelligence.
This book explores the interplay between performing arts, intangible cultural heritage and digital environments through a compendium of essays on emerging practices and case studies, as well as critical, historical and theoretical perspectives. It features essays that engage with varied forms of intangible cultural heritage, from music and storytelling to dance, theatre and martial arts. Cases of digital technology interventions are provided from different geographical and cultural settings, from Europe to Asia and the Americas. Together, the collection reflects on the implications that digital interventions have on intangible cultural heritage engagements, its curation and transmission in diverse localities. The volume is a valuable resource for discovering the multiple ways in which cultural heritage is mediated through digital technologies, and engages with audiences, artists, users and researchers.
