Action Selection and Coordination

Action Selection and Coordination

Author: Sarah Frances Hillenbrand

Publisher:

Published: 2015

Total Pages: 105

ISBN-13:

DOWNLOAD EBOOK

In his 1945 book The Phenomenology of Perception, French philosopher Maurice Merleau-Ponty wrote, "The body is our general medium for having a world." When learning to move, our bodies implicitly know what to do, letting experiences tweak our neural circuits to etch in precise models of the world. These experiences wire up complex capabilities in bodies that were born ready to move, but did not yet know what a pen, a cartwheel, or a hug was. What is arguably more difficult is using our minds to gain explicit understanding of the processes governing learning and movement. For this, we have science. Merleau-Ponty later wrote, "Science manipulates things and gives up living in them. It makes its own limited models of things; operating upon these indices or variables to effect whatever transformations are permitted by their definition, it comes face to face with the real world only at rare intervals." In this dissertation, I present the outcomes of my own manipulations, my own limited models which, at rare intervals, come face to face with the ways in which our bodies construct our world. In Chapter 2, I investigated a potential problem for the use of functional magnetic resonance imaging (fMRI) to study human motor behavior. Task-related changes in heart rate can cause changes in the blood oxygen level dependent (BOLD) signal, potentially masking effects of interest. Correcting for heart rate fluctuations did not fundamentally change the brain's responses to arm movements. However, because these corrections did improve the explanatory power of fMRI analyses, my work stands as an illustration of the efficacy of this correction. In Chapter 3, I had people learn to produce movements of certain speeds in a virtual shuffleboard game. When learning movement directions, delayed feedback impairs performance due to processing limitations in a brain structure called the cerebellum. Because feedback is naturally delayed in shuffleboard, I asked whether delays affect learning of speeds, as well. They did not, suggesting that the cerebellum is not involved in learning movement speeds from errors. In Chapter 4, I sought to confirm this speculation using fMRI. I scanned the brains of people as they played shuffleboard. I found no evidence that the cerebellum was involved in the processing of errors of movement speed. However, successful task performance robustly activated the dorsal striatum, a structure involved in learning from rewards and forming habits. These results suggest that, when people learn to move at certain speeds, they depend more on memories of times they got it right than on feedback telling them to speed up or slow down.


Approximate Action Selection for Large, Coordinating, Multiagent Systems

Approximate Action Selection for Large, Coordinating, Multiagent Systems

Author: Scott T. Sosnowski

Publisher:

Published: 2016

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

Many practical decision-making problems involve coordinating teams of agents. In our work, we focus on the problem of coordinated action selection in reinforcement learning with large stochastic multi-agent systems that are centrally controlled. Previous work has shown how to formulate coordination as exact inference in a Markov network, but this becomes intractable for large teams of agents. We investigate the idea of "approximate coordination" as a solution to an approximate inference problem in a Markov network. We look at a pursuit domain and a simplified real-time strategy game and find that in these situations, such approaches are able to find good policies when exact approaches become intractable.


Memory and Action Selection in Human-Machine Interaction

Memory and Action Selection in Human-Machine Interaction

Author: Munéo Kitajima

Publisher: John Wiley & Sons

Published: 2016-01-05

Total Pages: 163

ISBN-13: 111926863X

DOWNLOAD EBOOK

The first goal of this book is to extend Two Minds originating from behavioral economics to the domain of interaction, where the time dimension has to be dealt with rigorously; in human–machine interaction, it is of crucial importance how synchronization between conscious processes and unconscious processes is established for a sense of smoothness, and how memory processes and action selection processes are coordinated. The first half this book describes the theory in detail. The book begins by outlining the whole view of the theory consisting of action selection processes and memorization processes, and their interactions. Then, a detailed description for action selection processes theorized as a nonlinear dynamic human behavior model with real-time constraints is provided, followed by a description for memorization processes. Also, implications of the theory to human–machine interactions are discussed. The second goal of this book is to provide a methodology to study how Two Minds works in practice when people use interactive systems. The latter half of this book describes theory practices in detail. A new methodology called Cognitive Chrono-Ethnography (CCE) is introduced, which adds the time dimension to Hutchins’ Cognitive Ethnography, in order to practice "know the users" systematically by designing user studies based on a simulation of users’ mental operations controlled by Two Minds. The author then shows how CCE has been applied to understanding the ways in which people navigate in real physical environments by walking and by car, respectively, and explores the possibility of applying CCE to predict people’s future needs. This is not for understanding how people use interfaces at present but to predict how people want to use the interfaces in the future given they are currently using them in a certain way Finally, the book concludes by describing implications of human–machine interactions that are carried out while using modern artefacts for people's cognitive development from birth, on the basis of the theories of action selection and memorization.


Action Selection and Coordination of Autonomous Agents for UAV Surveillance

Action Selection and Coordination of Autonomous Agents for UAV Surveillance

Author: David Ching-Wey Han

Publisher:

Published: 2011

Total Pages: 276

ISBN-13:

DOWNLOAD EBOOK

Agents, by definition, (1) are situated in an environment upon which their actions affect changes and (2) have some level of autonomy from the control of humans or other agents. Being situated requires that the agent have a mechanism for sensing the environment as well as actuators for changing the environment. Autonomy implies that each agent has the freedom to make their own decisions. Rational agents are those agents that decide to execute actions that are in their "best interests" according to their desires, using a model of those desires on which they make those decisions. Action selection is complicated due to uncertainty when operating in a dynamic environment or where other actors (agents) can also influence the environment. This dissertation presents an action selection framework and algorithms that are (1) rational with respect to multiple desires and (2) responsive with respect to changing desires. Agents can use the concept of commitments, and the subsequent communication of those commitments, to coordinate their actions and reduce their uncertainty. Coordination is layered on top of this framework by describing and analyzing how commitments affect the agents' desires in their action selection models. This research uses the domain of UAV surveillance to experimentally explore the balance between under-commitment and over-commitment. Where previous approaches concentrate on the semantics of commitment, this research concentrates on the pragmatics of commitment, describing how to use utility calculations to enable an agent to decide when making a commitment is in its best interests.


Multi-Agent Coordination

Multi-Agent Coordination

Author: Arup Kumar Sadhu

Publisher: John Wiley & Sons

Published: 2020-12-01

Total Pages: 320

ISBN-13: 1119699029

DOWNLOAD EBOOK

Discover the latest developments in multi-robot coordination techniques with this insightful and original resource Multi-Agent Coordination: A Reinforcement Learning Approach delivers a comprehensive, insightful, and unique treatment of the development of multi-robot coordination algorithms with minimal computational burden and reduced storage requirements when compared to traditional algorithms. The accomplished academics, engineers, and authors provide readers with both a high-level introduction to, and overview of, multi-robot coordination, and in-depth analyses of learning-based planning algorithms. You'll learn about how to accelerate the exploration of the team-goal and alternative approaches to speeding up the convergence of TMAQL by identifying the preferred joint action for the team. The authors also propose novel approaches to consensus Q-learning that address the equilibrium selection problem and a new way of evaluating the threshold value for uniting empires without imposing any significant computation overhead. Finally, the book concludes with an examination of the likely direction of future research in this rapidly developing field. Readers will discover cutting-edge techniques for multi-agent coordination, including: An introduction to multi-agent coordination by reinforcement learning and evolutionary algorithms, including topics like the Nash equilibrium and correlated equilibrium Improving convergence speed of multi-agent Q-learning for cooperative task planning Consensus Q-learning for multi-agent cooperative planning The efficient computing of correlated equilibrium for cooperative q-learning based multi-agent planning A modified imperialist competitive algorithm for multi-agent stick-carrying applications Perfect for academics, engineers, and professionals who regularly work with multi-agent learning algorithms, Multi-Agent Coordination: A Reinforcement Learning Approach also belongs on the bookshelves of anyone with an advanced interest in machine learning and artificial intelligence as it applies to the field of cooperative or competitive robotics.


Interpersonal Coordination

Interpersonal Coordination

Author: Nobuyuki Inui

Publisher: Springer

Published: 2018-08-28

Total Pages: 252

ISBN-13: 9811317658

DOWNLOAD EBOOK

This book explores the fascinating area of interpersonal coordination in force production tasks, outlining the author’s extensive research to date and presenting stimulating new perspectives. The purpose is to provide a detailed exposition of current understanding of the science behind interpersonal joint action. Readers will find clear explanation of concepts from social cognition and neuroscience that are key to an understanding of the field, including the social brain hypothesis, the mirror neuron system, and joint action, as well as other relevant background information. The author then proceeds to present an overview of recent original studies on interpersonal movement coordination performed at his laboratory in Japan. These studies provide insights into such issues as complementary and synchronous force production in joint action, bidirectional transfer between joint and solo actions, and motor control hierarchy in joint action involving bimanual force. They also set the direction for integration of knowledge of physical properties and social cognition. The book will be of interest for researchers and graduate students in all areas of the biomedical sciences.


Movement Control

Movement Control

Author: Paul Cordo

Publisher: Cambridge University Press

Published: 1994-05-27

Total Pages: 296

ISBN-13: 9780521456074

DOWNLOAD EBOOK

Movement is arguably the most fundamental and important function of the nervous system. Purposive movement requires the coordination of actions within many areas of the cerebral cortex, cerebellum, basal ganglia, spinal cord, and peripheral nerves and sensory receptors, which together must control a highly complex biomechanical apparatus made up of the skeleton and muscles. Beginning at the level of biomechanics and spinal reflexes and proceeding upward to brain structures in the cerebellum, brainstem and cerebral cortex, the chapters in this book highlight the important issues in movement control. Commentaries provide a balanced treatment of the articles that have been written by experts in a variety of areas concerned with movement, including behaviour, physiology, robotics, and mathematics.


ECAI 2016

ECAI 2016

Author: G.A. Kaminka

Publisher: IOS Press

Published: 2016-08-24

Total Pages: 1860

ISBN-13: 1614996725

DOWNLOAD EBOOK

Artificial Intelligence continues to be one of the most exciting and fast-developing fields of computer science. This book presents the 177 long papers and 123 short papers accepted for ECAI 2016, the latest edition of the biennial European Conference on Artificial Intelligence, Europe’s premier venue for presenting scientific results in AI. The conference was held in The Hague, the Netherlands, from August 29 to September 2, 2016. ECAI 2016 also incorporated the conference on Prestigious Applications of Intelligent Systems (PAIS) 2016, and the Starting AI Researcher Symposium (STAIRS). The papers from PAIS are included in this volume; the papers from STAIRS are published in a separate volume in the Frontiers in Artificial Intelligence and Applications (FAIA) series. Organized by the European Association for Artificial Intelligence (EurAI) and the Benelux Association for Artificial Intelligence (BNVKI), the ECAI conference provides an opportunity for researchers to present and hear about the very best research in contemporary AI. This proceedings will be of interest to all those seeking an overview of the very latest innovations and developments in this field.


Modelling Natural Action Selection

Modelling Natural Action Selection

Author: Anil K. Seth

Publisher: Cambridge University Press

Published: 2011-11-10

Total Pages: 569

ISBN-13: 113950097X

DOWNLOAD EBOOK

Action selection is the task of doing the right thing at the right time. It requires the assessment of available alternatives, executing those most appropriate, and resolving conflicts among competing goals and possibilities. Using advanced computational modelling, this book explores cutting-edge research into action selection in nature from a wide range of disciplines, from neuroscience to behavioural ecology, and even political science. It delivers new insights into both detailed and systems-level attributes of natural intelligence and demonstrates advances in methodological practice. Contributions from leading researchers cover issues including whether biological action selection is optimal, neural substrates for action selection in the vertebrate brain, perceptual selection in decision making, and interactions between group and individual action selection. This first integrated review of action selection in nature contains a balance of review and original research material, consolidating current knowledge into a valuable reference for researchers while illustrating potential paths for future studies.


Handbook of Developmental Cognitive Neuroscience, second edition

Handbook of Developmental Cognitive Neuroscience, second edition

Author: Charles A. Nelson

Publisher: MIT Press

Published: 2008-07-11

Total Pages: 985

ISBN-13: 0262141043

DOWNLOAD EBOOK

The second edition of an essential resource to the evolving field of developmental cognitive neuroscience, completely revised, with expanded emphasis on social neuroscience, clinical disorders, and imaging genomics. The publication of the second edition of this handbook testifies to the rapid evolution of developmental cognitive neuroscience as a distinct field. Brain imaging and recording technologies, along with well-defined behavioral tasks—the essential methodological tools of cognitive neuroscience—are now being used to study development. Technological advances have yielded methods that can be safely used to study structure-function relations and their development in children's brains. These new techniques combined with more refined cognitive models account for the progress and heightened activity in developmental cognitive neuroscience research. The Handbook covers basic aspects of neural development, sensory and sensorimotor systems, language, cognition, emotion, and the implications of lifelong neural plasticity for brain and behavioral development. The second edition reflects the dramatic expansion of the field in the seven years since the publication of the first edition. This new Handbook has grown from forty-one chapters to fifty-four, all original to this edition. It places greater emphasis on affective and social neuroscience—an offshoot of cognitive neuroscience that is now influencing the developmental literature. The second edition also places a greater emphasis on clinical disorders, primarily because such research is inherently translational in nature. Finally, the book's new discussions of recent breakthroughs in imaging genomics include one entire chapter devoted to the subject. The intersection of brain, behavior, and genetics represents an exciting new area of inquiry, and the second edition of this essential reference work will be a valuable resource for researchers interested in the development of brain-behavior relations in the context of both typical and atypical development.