Deep Learning of Neuromuscular and Sensorimotor Control with Biomimetic Perception for Realistic Biomechanical Human Animation

Deep Learning of Neuromuscular and Sensorimotor Control with Biomimetic Perception for Realistic Biomechanical Human Animation

Author: Masaki Nakada

Publisher:

Published: 2017

Total Pages: 118

ISBN-13:

DOWNLOAD EBOOK

We introduce a biomimetic simulation framework for investigating human perception and sensorimotor control. Our framework is unique in that it features a biomechanically simulated musculoskeletal human model actuated by 823 muscles. The anthropomorphic model has two human-like eyes whose retinas contain spatially nonuniform arrangements of photoreceptors. The sensorimotor control system of our human model comprises a set of 15 automatically-trained, fully-connected deep neural networks. Two networks control the saccadic eye movement functionality of its binocular, foveated perception system. The remaining networks achieve neuromuscular control of the skeletal muscles. One network controls the 216 neck muscles that actuate the neck-head biomechanical complex, producing controlled head movements. In our prototype model, 3 networks control each limb; in particular, the 29 muscles in each of the two arms and the 39 muscles in each of the two legs. Thus, the virtual human demonstrates eective sensorimotor control of its eyes, head, and four limbs driven exclusively by visual perception to achieve a nontrivial motor task. We also demonstrate that its foveated perceptual system is capable of appearance-based recognition.


Core Training: Learning Deep Neuromuscular Control of the Torso for Anthropomimetic Animation

Core Training: Learning Deep Neuromuscular Control of the Torso for Anthropomimetic Animation

Author: tao zhou

Publisher:

Published: 2019

Total Pages: 100

ISBN-13:

DOWNLOAD EBOOK

Despite its importance, the core of the human body has to date received inadequate attention in the computer graphics literature. We tackle the challenge of biomechanically simulating and controlling the torso, including of course the spine, in its full musculoskeletal complexity, thus providing a whole-body biomechanical human model with a full set of articular degrees of freedom actuated by many hundreds of muscles embedded in a finite-element soft tissue simulation. Performing skillful (non-locomotive) motor tasks while bipedally balancing upright in gravity has never before been attempted with a musculoskeletal model of such realism and complexity. Our approach to tackling the challenge is machine learning, specifically deep learning. The neuromuscular motor control system of our virtual human comprises 12 trained deep neural networks (DNNs), including a core voluntary/reflex DNN pair devoted to innervating the 443 muscles of the torso. By synthesizing its own training data offline, our virtual human automatically learns efficient, online, active control of the core musculoskeletal complex as well as its proper coordination with the five extremities---the cervicocephalic, arm, and leg musculoskeletal complexes---in order to perform nontrivial motor tasks such as sitting and standing, doing calisthenics, stepping, and golf putting. Moreover, we equip our virtual human with a full sensorimotor control system, thus making it autonomous. Afforded suitable NN-based machine perception, our model can also visually analyze drawings and manually sketch similar drawings as it balances in an upright stance before a large touchscreen display.


Advances in Visual Computing

Advances in Visual Computing

Author: George Bebis

Publisher: Springer

Published: 2018-11-09

Total Pages: 771

ISBN-13: 3030038017

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 13th International Symposium on Visual Computing, ISVC 2018, held in Las Vegas, NV, USA in November 2018. The total of 66 papers presented in this volume was carefully reviewed and selected from 91 submissions. The papers are organized in topical sections named: ST: computational bioimaging; computer graphics; visual surveillance; pattern recognition; vitrual reality; deep learning; motion and tracking; visualization; object detection and recognition; applications; segmentation; and ST: intelligent transportation systems.


Realistic Ray Tracing, Second Edition

Realistic Ray Tracing, Second Edition

Author: Peter Shirley

Publisher: A K Peters, Ltd.

Published: 2008-12-19

Total Pages: 242

ISBN-13: 1568814615

DOWNLOAD EBOOK

Concentrating on the "nuts and bolts" of writing ray tracing programs, this new and revised edition emphasizes practical and implementation issues and takes the reader through all the details needed to write a modern rendering system. Most importantly, the book adds many C++ code segments, and adds new details to provide the reader with a better intuitive understanding of ray tracing algorithms.


Neural Engineering

Neural Engineering

Author: Bin He

Publisher: Springer Science & Business Media

Published: 2013-01-09

Total Pages: 801

ISBN-13: 1461452279

DOWNLOAD EBOOK

Neural Engineering, 2nd Edition, contains reviews and discussions of contemporary and relevant topics by leading investigators in the field. It is intended to serve as a textbook at the graduate and advanced undergraduate level in a bioengineering curriculum. This principles and applications approach to neural engineering is essential reading for all academics, biomedical engineers, neuroscientists, neurophysiologists, and industry professionals wishing to take advantage of the latest and greatest in this emerging field.


The Human Hand as an Inspiration for Robot Hand Development

The Human Hand as an Inspiration for Robot Hand Development

Author: Ravi Balasubramanian

Publisher: Springer

Published: 2014-01-03

Total Pages: 573

ISBN-13: 3319030175

DOWNLOAD EBOOK

“The Human Hand as an Inspiration for Robot Hand Development” presents an edited collection of authoritative contributions in the area of robot hands. The results described in the volume are expected to lead to more robust, dependable, and inexpensive distributed systems such as those endowed with complex and advanced sensing, actuation, computation, and communication capabilities. The twenty-four chapters discuss the field of robotic grasping and manipulation viewed in light of the human hand’s capabilities and push the state-of-the-art in robot hand design and control. Topics discussed include human hand biomechanics, neural control, sensory feedback and perception, and robotic grasp and manipulation. This book will be useful for researchers from diverse areas such as robotics, biomechanics, neuroscience, and anthropologists.


Biomimetics

Biomimetics

Author: Yoseph Bar-Cohen

Publisher: CRC Press

Published: 2005-11-02

Total Pages: 552

ISBN-13: 9780849331633

DOWNLOAD EBOOK

Nature is the world's foremost designer. With billions of years of experience and boasting the most extensive laboratory available, it conducts research in every branch of engineering and science. Nature's designs and capabilities have always inspired technology, from the use of tongs and tweezers to genetic algorithms and autonomous legged robots. Taking a systems perspective rather than focusing narrowly on materials or chemistry aspects, Biomimetics: Biologically Inspired Technologies examines the field from every angle. The book contains pioneering approaches to biomimetics including a new perspective on the mechanization of cognition and intelligence, as well as defense and attack strategies in nature, their applications, and potential. It surveys the field from modeling to applications and from nano- to macro-scales, beginning with an introduction to principles of using biology to inspire designs as well as biological mechanisms as models for technology. This innovative guide discusses evolutionary robotics; genetic algorithms; molecular machines; multifunctional, biological-, and nano- materials; nastic structures inspired by plants; and functional surfaces in biology. Looking inward at biological systems, the book covers the topics of biomimetic materials, structures, control, cognition, artificial muscles, biosensors that mimic senses, artificial organs, and interfaces between engineered and biological systems. The final chapter contemplates the future of the field and outlines the challenges ahead. Featuring extensive illustrations, including a 32-page full-color insert, Biomimetics: Biologically Inspired Technologies provides unmatched breadth of scope as well as lucid illumination of this promising field.


ROMANSY 21 - Robot Design, Dynamics and Control

ROMANSY 21 - Robot Design, Dynamics and Control

Author: Vincenzo Parenti-Castelli

Publisher: Springer

Published: 2016-06-29

Total Pages: 436

ISBN-13: 3319337149

DOWNLOAD EBOOK

This proceedings volume contains papers that have been selected after review for oral presentation at ROMANSY 2016, the 21th CISM-IFToMM Symposium on Theory and Practice of Robots and Manipulators. These papers cover advances on several aspects of the wide field of Robotics as concerning Theory and Practice of Robots and Manipulators. ROMANSY 2016 is the 21st event in a series that started in 1973 as one of the first conference activities in the world on Robotics. The first event was held at CISM (International Centre for Mechanical Science) in Udine, Italy on 5-8 September 1973. It was also the first topic conference of IFToMM (International Federation for the Promotion of Mechanism and Machine Science) and it was directed not only to the IFToMM community.


Prosthetic Designs for Restoring Human Limb Function

Prosthetic Designs for Restoring Human Limb Function

Author: William Craelius

Publisher: Springer Nature

Published: 2021-07-30

Total Pages: 231

ISBN-13: 3030310779

DOWNLOAD EBOOK

This textbook provides a thorough introduction and overview of the design and engineering of state-of-the-art prosthetics and assistive technologies. Innovations in prosthetics are increasingly made by cross-disciplinary thinking, and the author introduces the application of biomedical, mechanical, electrical, computer, and materials engineering principles to the design of artificial limbs. Coverage includes the fundamentals of biomechanics, biomechanical modeling and measurements, the basics of anatomy and physiology of limb defects, and the historical development of prosthetic design. This book stimulates the innovative thinking necessary for advancing limb restoration, and will be essential reading for students, as well as researchers, professional engineers, and prosthetists involved in the design and manufacture of artificial limbs. Learning enhanced by the exercises, including physical modeling with MATLAB and Simulink; Includes appendices with relevant equations and parameters for reference; Introduction to the design and engineering of prosthetics and assistive technologies.


Human Modeling for Bio-Inspired Robotics

Human Modeling for Bio-Inspired Robotics

Author: Jun Ueda

Publisher: Academic Press

Published: 2016-09-02

Total Pages: 360

ISBN-13: 0128031522

DOWNLOAD EBOOK

Human Modelling for Bio-inspired Robotics: Mechanical Engineering in Assistive Technologies presents the most cutting-edge research outcomes in the area of mechanical and control aspects of human functions for macro-scale (human size) applications. Intended to provide researchers both in academia and industry with key content on which to base their developments, this book is organized and written by senior experts in their fields. Human Modeling for Bio-Inspired Robotics: Mechanical Engineering in Assistive Technologies offers a system-level investigation into human mechanisms that inspire the development of assistive technologies and humanoid robotics, including topics in modelling of anatomical, musculoskeletal, neural and cognitive systems, as well as motor skills, adaptation and integration. Each chapter is written by a subject expert and discusses its background, research challenges, key outcomes, application, and future trends. This book will be especially useful for academic and industry researchers in this exciting field, as well as graduate-level students to bring them up to speed with the latest technology in mechanical design and control aspects of the area. Previous knowledge of the fundamentals of kinematics, dynamics, control, and signal processing is assumed. Presents the most recent research outcomes in the area of mechanical and control aspects of human functions for macro-scale (human size) applications Covers background information and fundamental concepts of human modelling Includes modelling of anatomical, musculoskeletal, neural and cognitive systems, as well as motor skills, adaptation, integration, and safety issues Assumes previous knowledge of the fundamentals of kinematics, dynamics, control, and signal processing