This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.
A practical guide to understanding and investigating the multiple modes of communication, verbal and non-verbal. Sets out clear methodology to help readers conduct their own analysis and includes many real examples.
Human Machine Interaction, or more commonly Human Computer Interaction, is the study of interaction between people and computers. It is an interdisciplinary field, connecting computer science with many other disciplines such as psychology, sociology and the arts. The present volume documents the results of the MMI research program on Human Machine Interaction involving 8 projects (selected from a total of 80 proposals) funded by the Hasler Foundation between 2005 and 2008. These projects were also partially funded by the associated universities and other third parties such as the Swiss National Science Foundation. This state-of-the-art survey begins with three chapters giving overviews of the domains of multimodal user interfaces, interactive visualization, and mixed reality. These are followed by eight chapters presenting the results of the projects, grouped according to the three aforementioned themes.
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.
This two-volume set LNCS 12777 and 12778 constitutes the thoroughly refereed proceedings of the 12th International Conference on Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management, DHM 2021, which was held virtually as part of the 23rd HCI International Conference, HCII 2021, in July 2021. The total of 1276 papers and 241 posters included in the 39 HCII 2021 proceedings volumes was carefully reviewed and selected from 5222 submissions. DHM 2021 includes a total of 56 papers; they were organized in topical sections named: Part I, Human Body, Motion and Behavior: Ergonomics, human factors and occupational health; human body and motion modeling; and language, communication and behavior modeling. Part II, AI, Product and Service: Rethinking healthcare; artificial intelligence applications and ethical issues; and digital human modeling in product and service design.
This two-volume set LNCS 11578 and 11579 constitutes the refereed proceedings of the 11th International Conference on Social Computing and Social Media, SCSM 2019, held in July 2019 as part of HCI International 2019 in Orlando, FL, USA. HCII 2019 received a total of 5029 submissions, of which 1275 papers and 209 posters were accepted for publication after a careful reviewing process. The 81 papers presented in these two volumes are organized in topical sections named: Social Media Design and Development, Human Behaviour in Social Media, Social Network Analysis, Community Engagement and Social Participation, Computer Mediated Communication, Healthcare Communities, Social Media in Education, Digital Marketing and Consumer Experience.
"This book offers a variety of perspectives on multimodal user interface design, describes a variety of novel multimodal applications and provides several experience reports with experimental and industry-adopted mobile multimodal applications"--Provided by publisher.
The four-volume set LNCS 10513—10516 constitutes the proceedings of the 16th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2017, held in Mumbai, India, in September 2017. The total of 68 papers presented in these books was carefully reviewed and selected from 221 submissions. The contributions are organized in topical sections named: Part I: adaptive design and mobile applications; aging and disabilities; assistive technology for blind users; audience engagement; co-design studies; cultural differences and communication technology; design rationale and camera-control. Part II: digital inclusion; games; human perception, cognition and behavior; information on demand, on the move, and gesture interaction; interaction at the workplace; interaction with children. Part III: mediated communication in health; methods and tools for user interface evaluation; multi-touch interaction; new interact ion techniques; personalization and visualization; persuasive technology and rehabilitation; and pointing and target selection.
Die 11. Berliner Werkstatt hat neben einer stärkeren Förderung internationaler Beiträge im Bereich der Forschung zu Mensch-Maschine-Systemen einen englischsprachigen Focus Track eingeführt. Das Thema ‘Trends in Neuroergonomics‘ konzentrierte sich auf die Nutzung von psychophysiologischen Maßen in Mensch-Maschine-Systemen. Internationale Experten haben neue Ansätze der mobilen Bildgebung menschlicher Hirnaktivität sowie neue Erkenntnisse im Bereich neuroadaptiver Technologien vorgestellt. Zwei eingeladene Gastvorträge gaben auf der diesjährigen Werkstatt einen spezifischen Einblick in diesen neuen Forschungsbereich. Neben dem neuen Focus Track boten die bewährte Mischung von Werkstatt-, Research- und Poster Tracks, die Präsentation und aktive Diskussion von aktuellen und abgeschlossenen Forschungsarbeiten aus allen Bereichen der Mensch-Maschine-Systeme. Der vorliegende Tagungsband beinhaltet alle Beiträge der 11. BWMMS. In line with our aim to encourage international contributions, we have introduced the concept of the Focus Track to allow for a dedicated track of high impact research presentations on a specific topic in human factors. This year’s Focus Track centered on mobile brain/body imaging and neuroadaptive technology. Here, the focus was on the use of psychophysiological data for Human-Machine Systems. Two invited keynote lectures have provided a deepened insight into this new research area during this Berlin Workshop. Besides the new Focus Track, the well-established mixture of Research-, Workshop-, and Poster Tracks allowed for presentations and lively discussions research projects from all areas of human factors. This conference proceeding comprises all presented papers at the 11th BWMMS.
New technology in vehicles is transforming the way people move around as well as what they do in their vehicles. How does one communicate with an in-car speech system and how does this vary by language or cultural community? This book explores this process by focusing on the communication practices that people engage in when using their in-car systems and when talking about their vehicles with co-passengers. Chapters present a robust theory and methodology for studying communication in cars, how tasks are begun and ended, how people switch between tasks, how non-task talk appears, what ways and styles of communication drivers prefer, and how they expect the system voice to respond, among other things. Particular attention is given to cultural preferences as they are evident in this communication; these preferences are found to ground various trajectories in the use and meaning of in-car communication practices. The book explores these matters with a focus on the United States and Mainland China. Implications are drawn for the design and utilization of in-car communication systems.
