Reinforcement Learning of Bimanual Robot Skills

Reinforcement Learning of Bimanual Robot Skills

Author: Adrià Colomé

Publisher: Springer Nature

Published: 2019-08-27

Total Pages: 192

ISBN-13: 3030263266

DOWNLOAD EBOOK

This book tackles all the stages and mechanisms involved in the learning of manipulation tasks by bimanual robots in unstructured settings, as it can be the task of folding clothes. The first part describes how to build an integrated system, capable of properly handling the kinematics and dynamics of the robot along the learning process. It proposes practical enhancements to closed-loop inverse kinematics for redundant robots, a procedure to position the two arms to maximize workspace manipulability, and a dynamic model together with a disturbance observer to achieve compliant control and safe robot behavior. In the second part, methods for robot motion learning based on movement primitives and direct policy search algorithms are presented. To improve sampling efficiency and accelerate learning without deteriorating solution quality, techniques for dimensionality reduction, for exploiting low-performing samples, and for contextualization and adaptability to changing situations are proposed. In sum, the reader will find in this comprehensive exposition the relevant knowledge in different areas required to build a complete framework for model-free, compliant, coordinated robot motion learning.


Intelligent Robotics and Applications

Intelligent Robotics and Applications

Author: Honghai Liu

Publisher: Springer Nature

Published: 2022-08-03

Total Pages: 801

ISBN-13: 3031138449

DOWNLOAD EBOOK

The 4-volume set LNAI 13455 - 13458 constitutes the proceedings of the 15th International Conference on Intelligent Robotics and Applications, ICIRA 2022, which took place in Harbin China, during August 2022. The 284 papers included in these proceedings were carefully reviewed and selected from 442 submissions. They were organized in topical sections as follows: Robotics, Mechatronics, Applications, Robotic Machining, Medical Engineering, Soft and Hybrid Robots, Human-robot Collaboration, Machine Intelligence, and Human Robot Interaction.


Collaboration in a Data-Rich World

Collaboration in a Data-Rich World

Author: Luis M. Camarinha-Matos

Publisher: Springer

Published: 2017-09-06

Total Pages: 764

ISBN-13: 331965151X

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 18th IFIP WG 5.5 Working Conference on Virtual Enterprises, PRO-VE 2017, held in Vicenza, Italy, in September 2017. The 68 revised full papers were carefully reviewed and selected from 159 submissions. They provide a comprehensive overview of identified challenges and recent advances in various collaborative network (CN) domains and their applications, with a strong focus on the following areas: collaborative models, platforms and systems for data-rich worlds; manufacturing ecosystem and collaboration in Industry 4.0; big data analytics and intelligence; risk, performance, and uncertainty in collaborative data-rich systems; semantic data/service discovery, retrieval, and composition in a collaborative data-rich world; trust and sustainability analysis in collaborative networks; value creation and social impact of collaboration in data-rich worlds; technology development platforms supporting collaborative systems; collective intelligence and collaboration in advanced/emerging applications: collaborative manufacturing and factories of the future, e-health and care, food and agribusiness, and crisis/disaster management.


Tactile Sensing, Skill Learning, and Robotic Dexterous Manipulation

Tactile Sensing, Skill Learning, and Robotic Dexterous Manipulation

Author: Qiang Li

Publisher: Academic Press

Published: 2022-04-02

Total Pages: 374

ISBN-13: 0323904173

DOWNLOAD EBOOK

Tactile Sensing, Skill Learning and Robotic Dexterous Manipulation focuses on cross-disciplinary lines of research and groundbreaking research ideas in three research lines: tactile sensing, skill learning and dexterous control. The book introduces recent work about human dexterous skill representation and learning, along with discussions of tactile sensing and its applications on unknown objects' property recognition and reconstruction. Sections also introduce the adaptive control schema and its learning by imitation and exploration. Other chapters describe the fundamental part of relevant research, paying attention to the connection among different fields and showing the state-of-the-art in related branches. The book summarizes the different approaches and discusses the pros and cons of each. Chapters not only describe the research but also include basic knowledge that can help readers understand the proposed work, making it an excellent resource for researchers and professionals who work in the robotics industry, haptics and in machine learning. - Provides a review of tactile perception and the latest advances in the use of robotic dexterous manipulation - Presents the most detailed work on synthesizing intelligent tactile perception, skill learning and adaptive control - Introduces recent work on human's dexterous skill representation and learning and the adaptive control schema and its learning by imitation and exploration - Reveals and illustrates how robots can improve dexterity by modern tactile sensing, interactive perception, learning and adaptive control approaches


Robot Learning Human Skills and Intelligent Control Design

Robot Learning Human Skills and Intelligent Control Design

Author: Chenguang Yang

Publisher: CRC Press

Published: 2021-06-21

Total Pages: 184

ISBN-13: 1000395170

DOWNLOAD EBOOK

In the last decades robots are expected to be of increasing intelligence to deal with a large range of tasks. Especially, robots are supposed to be able to learn manipulation skills from humans. To this end, a number of learning algorithms and techniques have been developed and successfully implemented for various robotic tasks. Among these methods, learning from demonstrations (LfD) enables robots to effectively and efficiently acquire skills by learning from human demonstrators, such that a robot can be quickly programmed to perform a new task. This book introduces recent results on the development of advanced LfD-based learning and control approaches to improve the robot dexterous manipulation. First, there's an introduction to the simulation tools and robot platforms used in the authors' research. In order to enable a robot learning of human-like adaptive skills, the book explains how to transfer a human user’s arm variable stiffness to the robot, based on the online estimation from the muscle electromyography (EMG). Next, the motion and impedance profiles can be both modelled by dynamical movement primitives such that both of them can be planned and generalized for new tasks. Furthermore, the book introduces how to learn the correlation between signals collected from demonstration, i.e., motion trajectory, stiffness profile estimated from EMG and interaction force, using statistical models such as hidden semi-Markov model and Gaussian Mixture Regression. Several widely used human-robot interaction interfaces (such as motion capture-based teleoperation) are presented, which allow a human user to interact with a robot and transfer movements to it in both simulation and real-word environments. Finally, improved performance of robot manipulation resulted from neural network enhanced control strategies is presented. A large number of examples of simulation and experiments of daily life tasks are included in this book to facilitate better understanding of the readers.


Mapping Human Sensory-Motor Skills for Manipulation onto the Design and Control of Robots

Mapping Human Sensory-Motor Skills for Manipulation onto the Design and Control of Robots

Author: Matteo Bianchi

Publisher: Frontiers Media SA

Published: 2019-03-25

Total Pages: 134

ISBN-13: 2889457958

DOWNLOAD EBOOK

Humans are endowed with extraordinary sensory-motor capabilities that enable a successful interaction with and exploration of the environment, as is the case of human manipulation. Understanding and modeling these capabilities represents an important topic not only for neuroscience but also for robotics in a mutual inspiration, both to inform the design and control of artificial systems and, at the same time, to increase knowledge on the biological side. Within this context, synergies -- i.e., goal-directed actions that constrain multi DOFs of the human body and can be defined at the kinematic, muscular, neural level -- have gained increasing attention as a general simplified approach to shape the development of simple and effective artificial devices. The execution of such purposeful sensory-motor primitives on the biological side leverages on the interplay of the sensory-motor control at central and peripheral level, and the interaction of the human body with the external world. This interaction is particularly important considering the new concept of robotic soft manipulation, i.e. soft, adaptable yet robust robotic hands that can deform with the external environment to multiply their grasping and manipulation capabilities. Under this regard, a preeminent role is reserved to touch, being that skin isour primary organ to shape our knowledge of the external world and, hence, to modify it, in interaction with the efferent parts. This Research Topic reports results on the mutual inspiration between neuroscience and robotics, and on how it is possible to translate neuroscientific findings on human manipulation into engineering guidelines for simplified systems able to take full advantage from the interaction and hence exploitation of environmental constraints for task accomplishment and knowledge acquisition.


Human-in-the-loop Learning and Control for Robot Teleoperation

Human-in-the-loop Learning and Control for Robot Teleoperation

Author: Chenguang Yang

Publisher: Elsevier

Published: 2023-04-06

Total Pages: 268

ISBN-13: 0323958435

DOWNLOAD EBOOK

Human-in-the-loop Learning and Control for Robot Teleoperation presents recent, research progress on teleoperation and robots, including human-robot interaction, learning and control for teleoperation with many extensions on intelligent learning techniques. The book integrates cutting-edge research on learning and control algorithms of robot teleoperation, neural motor learning control, wave variable enhancement, EMG-based teleoperation control, and other key aspects related to robot technology, presenting implementation tactics, adequate application examples and illustrative interpretations. Robots have been used in various industrial processes to reduce labor costs and improve work efficiency. However, most robots are only designed to work on repetitive and fixed tasks, leaving a gap with the human desired manufacturing effect. - Introduces research progress and technical contributions on teleoperation robots, including intelligent human-robot interactions and learning and control algorithms for teleoperation - Presents control strategies and learning algorithms to a teleoperation framework to enhance human-robot shared control, bi-directional perception and intelligence of the teleoperation system - Discusses several control and learning methods, describes the working implementation and shows how these methods can be applied to a specific and practical teleoperation system


Skill Training in Multimodal Virtual Environments

Skill Training in Multimodal Virtual Environments

Author: Massîmo Bergamasco

Publisher: CRC Press

Published: 2012-08-24

Total Pages: 325

ISBN-13: 1439878951

DOWNLOAD EBOOK

The advent of augmented reality technologies used to assist human operators in complex manipulative operations—has brought an urgency to research into the modeling and training of human skills in Virtual Environments. However, modeling a specific act still represents a challenge in cognitive science. The same applies for the control of humanoid robots and the replication of skilled behavior of avatars in Virtual Environments. Skill Training in Multimodal Virtual Environments presents the scientific background, research outcomes, engineering developments, and evaluation studies conducted during the five years (2006-2011) of the project SKILLS–Multimodal Interfaces for Capturing and Transfer of Skill, funded by the European Commission under its 6th Framework Programme for Research and Technological Development. The SKILLS project evaluated how to exploit robotics and virtual environment technologies for the training of specific skills. This book details the novel approach used in the study to cope with skill acquisition, setting aside the mainstream assumptions of common computer-assisted training simulators. It explores how the SKILLS approach generated new training scenarios that allow users to practice new experiences in the performance of the devised task. Using a carefully designed approach that balances science with practicality, the book explores how virtual and augmented reality systems can be designed to address the skill transfer and training in different application contexts. The application of the same roadmap to skills originating from domains such as sports, rehabilitation, industrial environment, and surgery sets this book apart. It demonstrates how technology-oriented training conditions can yield better results than more traditional training conditions.


Artificial Neural Networks and Machine Learning – ICANN 2017

Artificial Neural Networks and Machine Learning – ICANN 2017

Author: Alessandra Lintas

Publisher: Springer

Published: 2017-10-20

Total Pages: 488

ISBN-13: 3319686003

DOWNLOAD EBOOK

The two volume set, LNCS 10613 and 10614, constitutes the proceedings of then 26th International Conference on Artificial Neural Networks, ICANN 2017, held in Alghero, Italy, in September 2017. The 128 full papers included in this volume were carefully reviewed and selected from 270 submissions. They were organized in topical sections named: From Perception to Action; From Neurons to Networks; Brain Imaging; Recurrent Neural Networks; Neuromorphic Hardware; Brain Topology and Dynamics; Neural Networks Meet Natural and Environmental Sciences; Convolutional Neural Networks; Games and Strategy; Representation and Classification; Clustering; Learning from Data Streams and Time Series; Image Processing and Medical Applications; Advances in Machine Learning. There are 63 short paper abstracts that are included in the back matter of the volume.