This is a compilation of the classic readings in intelligent user interfaces. This text focuses on intelligent, knowledge-based interfaces, combining spoken language, natural language processing, and multimedia and multimodal processing.
This edited book explores the many interesting questions that lie at the intersection between AI and HCI. It covers a comprehensive set of perspectives, methods and projects that present the challenges and opportunities that modern AI methods bring to HCI researchers and practitioners. The chapters take a clear departure from traditional HCI methods and leverage data-driven and deep learning methods to tackle HCI problems that were previously challenging or impossible to address. It starts with addressing classic HCI topics, including human behaviour modeling and input, and then dedicates a section to data and tools, two technical pillars of modern AI methods. These chapters exemplify how state-of-the-art deep learning methods infuse new directions and allow researchers to tackle long standing and newly emerging HCI problems alike. Artificial Intelligence for Human Computer Interaction: A Modern Approach concludes with a section on Specific Domains which covers a set of emerging HCI areas where modern AI methods start to show real impact, such as personalized medical, design, and UI automation.
This volume brings together papers by experts in different areas of computer science, who have a common interest in the design and management of visual interfaces. Since cognitive science and metaphor analysis prove useful for understanding the basic mechanisms which allow visual interfaces to be easy to learn and use, these topics are also featured. Other areas focused on are: visual languages, visual database systems, intelligent agents for system interaction, graphical and pictorial communication tools, multimedia environments and specific technological developments.
Editor's Introduction.- Dialogue Constraints in Instruction.- Asymmetry & Accommodation in Tutorial Dialogues.- Negotiation in Collaborative Problem-Solving Dialogues.- Using Rhetorical Relations in Building a Coherent Conversational Teaching Session.- Graphics & Natural Language in Design & Instruction.- Simulator-Based Training-Support Tools for Process-Control Operators.- Designing Newton's Laws: Patterns of Social & Representational Feedback in a Learning Task.- Learning by Explaining: Fostering Collaborative Progressive Discourse in Science.- Tools for Collaborative Learning in Optics.- Deciding What to Say: An Agent-Theoretic Approach to Tutorial Dialogue.- Feedback in Computer-Assisted Instruction: Complexity & Corrective Efficiency.- Relying on a Sophisticated Student Model to Derive Dialogue Strategies in an Intelligent Tutoring System.- Dialogue Control Functions & Interaction Design.- The Role of Feedback in a Layered Model of Communication.- Communicative Action & Feedback.- >Reasons for Management in Spoken Dialogue.- Context Change & Communicative Feedback.- The Design of Interacting Agents.- Method for Dialogue Protocol Analysis.- Natural Dialogue in Modes other than Natural Language.- Coherence & Portrayal in Human-Computer Interface Design.- Feedback Issues in Consumer Appliances.- Advertisements, Proxies, & Wear: Three Methods for Feedback in Interactive Systems.- Author Index.
This book is the proceedings of the 40th annual Graphics Interface conference-the oldest continuously scheduled conference in the field. The book includes high-quality papers on recent advances in interactive systems, human computer interaction, and graphics from around the world. It covers the following topics: shading and rendering, geometric modeling and meshing, image-based rendering, image synthesis and realism, computer animation, real-time rendering, non-photorealistic rendering, interaction techniques, human interface devices, augmented reality, data and information visualization, mobile computing, haptic and tangible interfaces, and perception.
Although there has been much progress in developing theories, models and systems in the areas of natural language processing (NLP) and vision processing (VP), there has hitherto been little progress in integrating these two subareas of artificial intelligence. The papers in Integration of Natural Language and Vision Processing focus on site descriptions, such as the work at Apple Computer, California, and the DFKI, Saarbrücken, on historical surveys and philosophical issues, on systems that have been built, enabling communication through text, speech, sound, touch, video, graphics and icons, and on the automatic presentation of information, whether it be in the form of instruction manuals, statistical data or visualisation of language. There is also a review of Mark Maybury's book Intelligent Multimedia Interfaces. Audience: Vital reading for all interested in the SuperInformationHighways of the future.
Despite the volume of research carried out into the design of database systems and the design of user interfaces, there is little cross-fertilization between the two areas. The control of user interfaces to database systems is, therefore, significantly less advanced than other aspects of DBMS design. As database functionality is used in a wider range of areas, such as design applications, the suitability of the user interface is becoming increasingly important. It is, therefore, necessary to begin applying the knowledge developed by HCI researchers to the specialised domain of database systems. This volume contains revised papers from the International Workshop on Interfaces to Database Systems, held in Glasgow, 1-3 July 1992. The workshop aimed to develop an interaction between the design of database systems and user interfaces. It discussed both the production of interfaces tailored to particular applications, and also more general systems within which interfaces can be developed. Some of the papers concentrate on usability aspects, some discuss different interface metaphors, whilst others tackle the question of designing a general conceptual model. The latter topic is of particular importance, as it is only by achieving an abstract model of what the user understands to be in the database that the data can be associated with appropriate interface facilities. Among the contents of the volume are: integrated interfaces to publicly available databases; database query interface for medical information systems; an integrated approach to task oriented database retrieval interfaces; GRADI: a graphical database interface for a multimedia DBMS; cognitive view mechanism for multimedia information systems; a graphical schema representation for object oriented databases; a conceptual framework for error analysis in SQL interfaces; a browser for a version entity relationship database. Interfaces to Database Systems (IDS92) is unique in that it brings together a variety of approaches from the database and HCI research communities. It will provide essential reading for researchers of database systems and also industrial developers of DBMS.
This book's main goal is to show readers how to use the linguistic theory of Noam Chomsky, called Universal Grammar, to represent English, French, and German on a computer using the Prolog computer language. In so doing, it presents a follow-the-dots approach to natural language processing, linguistic theory, artificial intelligence, and expert systems. The basic idea is to introduce meaningful answers to significant problems involved in representing human language data on a computer.
What the book is about This book is about the theory and practice of the use of multimedia, multimodal interfaces for leaming. Yet it is not about technology as such, at least in the sense that the authors do not subscribe to the idea that one should do something just because it is technologically possible. 'Multimedia' has been adopted in some commercial quarters to mean little more than a computer with some form of audio ar (more usually) video attachment. This is a trend which ought to be resisted, as exemplified by the material in this book. Rather than merely using a new technology 'because it is there', there is a need to examine how people leam and eommunicate, and to study diverse ways in which computers ean harness text, sounds, speech, images, moving pietures, gestures, touch, etc. , to promote effective human leaming. We need to identify which media, in whieh combinations, using what mappings of domain to representation, are appropriate far which educational purposes . . The word 'multimodal ' in the title underlies this perspective. The intention is to focus attention less on the technology and more on how to strueture different kinds of information via different sensory channels in order to yield the best possible quality of communication and educational interaction. (Though the reader should refer to Chapter 1 for a discussion of the use of the word 'multimodal' . ) Historically there was little problem.
Computer Graphics Tokyo, now in its fourth year, has established a world-wide reputation as an international technical conference, presenting work of high quality in the field of computer graphics. Each conference has been attended by a couple of thousand partiCipants from all over the world and tens of thousands have visited the exhibition. After strict peer review, 34 papers were accepted this year, of which about 40% were from the USA, 30% from Japan, 20% from Europe, and 10% from Canada. A good balance of papers on advanced research results, industrial/marketing surveys, and computer art technology has made Computer Graphics Tokyo an indispensable forum for researchers, engineers, and administrators working in this field. Computer graphics is a rapidly developing and expanding area and it is not easy to keep abreast of all the progress that has been made. This volume contains the proceedings of Computer Graphics Tokyo '86 and provides the reader with a comprehensive survey of the state of the art in computer graphics. Computational geometry (Chapter 1) is one of the fastest growing areas in computer graphics. This is well recognized as the basis of shape modeling. After shapes are modeled, they are displayed for visual observation. Chapter 2 on rendering presents various novel methods and technological innovations for visualizing shapes. To make display systems more acces sible to users, rich visual interfaces and languages are being designed, as shown in Chapter 3. Visual data bases for sharing graphics-and image-data are handled in Chapter 4.