Search and Classification Using Multiple Autonomous Vehicles

Search and Classification Using Multiple Autonomous Vehicles

Author: Yue Wang

Publisher: Springer Science & Business Media

Published: 2012-04-02

Total Pages: 167

ISBN-13: 1447129563

DOWNLOAD EBOOK

Search and Classification Using Multiple Autonomous Vehicles provides a comprehensive study of decision-making strategies for domain search and object classification using multiple autonomous vehicles (MAV) under both deterministic and probabilistic frameworks. It serves as a first discussion of the problem of effective resource allocation using MAV with sensing limitations, i.e., for search and classification missions over large-scale domains, or when there are far more objects to be found and classified than there are autonomous vehicles available. Under such scenarios, search and classification compete for limited sensing resources. This is because search requires vehicle mobility while classification restricts the vehicles to the vicinity of any objects found. The authors develop decision-making strategies to choose between these competing tasks and vehicle-motion-control laws to achieve the proposed management scheme. Deterministic Lyapunov-based, probabilistic Bayesian-based, and risk-based decision-making strategies and sensor-management schemes are created in sequence. Modeling and analysis include rigorous mathematical proofs of the proposed theorems and the practical consideration of limited sensing resources and observation costs. A survey of the well-developed coverage control problem is also provided as a foundation of search algorithms within the overall decision-making strategies. Applications in both underwater sampling and space-situational awareness are investigated in detail. The control strategies proposed in each chapter are followed by illustrative simulation results and analysis. Academic researchers and graduate students from aerospace, robotics, mechanical or electrical engineering backgrounds interested in multi-agent coordination and control, in detection and estimation or in Bayes filtration will find this text of interest.


Decision-Making for Search and Classification Using Multiple Autonomous Vehicles Over Large-Scale Domains

Decision-Making for Search and Classification Using Multiple Autonomous Vehicles Over Large-Scale Domains

Author: Yue Wang

Publisher:

Published: 2011

Total Pages: 454

ISBN-13:

DOWNLOAD EBOOK

Abstract: This dissertation focuses on real-time decision-making for large-scale domain search and object classification using Multiple Autonomous Vehicles (MAV). In recent years, MAV systems have attracted considerable attention and have been widely utilized. Of particular interest is their application to search and classification under limited sensory capabilities. Since search requires sensor mobility and classification requires a sensor to stay within the vicinity of an object, search and classification are two competing tasks. Therefore, there is a need to develop real-time sensor allocation decision-making strategies to guarantee task accomplishment. These decisions are especially crucial when the domain is much larger than the field-of-view of a sensor, or when the number of objects to be found and classified is much larger than that of available sensors. In this work, the search problem is formulated as a coverage control problem, which aims at collecting enough data at every point within the domain to construct an awareness map. The object classification problem seeks to satisfactorily categorize the property of each found object of interest. The decision-making strategies include both sensor allocation decisions and vehicle motion control. The awareness-, Bayesian-, and risk-based decision-making strategies are developed in sequence. The awareness-based approach is developed under a deterministic framework, while the latter two are developed under a probabilistic framework where uncertainty in sensor measurement is taken into account. The risk-based decision-making strategy also analyzes the effect of measurement cost. It is further extended to an integrated detection and estimation problem with applications in optimal sensor management. Simulation-based studies are performed to confirm the effectiveness of the proposed algorithms.


Autonomous Intelligent Vehicles

Autonomous Intelligent Vehicles

Author: Hong Cheng

Publisher: Springer Science & Business Media

Published: 2011-11-15

Total Pages: 151

ISBN-13: 1447122801

DOWNLOAD EBOOK

This important text/reference presents state-of-the-art research on intelligent vehicles, covering not only topics of object/obstacle detection and recognition, but also aspects of vehicle motion control. With an emphasis on both high-level concepts, and practical detail, the text links theory, algorithms, and issues of hardware and software implementation in intelligent vehicle research. Topics and features: presents a thorough introduction to the development and latest progress in intelligent vehicle research, and proposes a basic framework; provides detection and tracking algorithms for structured and unstructured roads, as well as on-road vehicle detection and tracking algorithms using boosted Gabor features; discusses an approach for multiple sensor-based multiple-object tracking, in addition to an integrated DGPS/IMU positioning approach; examines a vehicle navigation approach using global views; introduces algorithms for lateral and longitudinal vehicle motion control.


Person Re-Identification

Person Re-Identification

Author: Shaogang Gong

Publisher: Springer Science & Business Media

Published: 2014-01-03

Total Pages: 446

ISBN-13: 144716296X

DOWNLOAD EBOOK

The first book of its kind dedicated to the challenge of person re-identification, this text provides an in-depth, multidisciplinary discussion of recent developments and state-of-the-art methods. Features: introduces examples of robust feature representations, reviews salient feature weighting and selection mechanisms and examines the benefits of semantic attributes; describes how to segregate meaningful body parts from background clutter; examines the use of 3D depth images and contextual constraints derived from the visual appearance of a group; reviews approaches to feature transfer function and distance metric learning and discusses potential solutions to issues of data scalability and identity inference; investigates the limitations of existing benchmark datasets, presents strategies for camera topology inference and describes techniques for improving post-rank search efficiency; explores the design rationale and implementation considerations of building a practical re-identification system.


Handbook of Research on Thrust Technologies’ Effect on Image Processing

Handbook of Research on Thrust Technologies’ Effect on Image Processing

Author: Pandey, Binay Kumar

Publisher: IGI Global

Published: 2023-08-04

Total Pages: 594

ISBN-13: 1668486202

DOWNLOAD EBOOK

Image processing integrates and extracts data from photos for a variety of uses. Applications for image processing are useful in many different disciplines. A few examples include remote sensing, space applications, industrial applications, medical imaging, and military applications. Imaging systems come in many different varieties, including those used for chemical, optical, thermal, medicinal, and molecular imaging. To extract the accurate picture values, scanning methods and statistical analysis must be used for image analysis. Thrust Technologies’ Effect on Image Processing provides insights into image processing and the technologies that can be used to enhance additional information within an image. The book is also a useful resource for researchers to grow their interest and understanding in the burgeoning fields of image processing. Covering key topics such as image augmentation, artificial intelligence, and cloud computing, this premier reference source is ideal for computer scientists, industry professionals, researchers, academicians, scholars, practitioners, instructors, and students.


Monte Carlo Planning and Reinforcement Learning for Large Scale Sequential Decision Problems

Monte Carlo Planning and Reinforcement Learning for Large Scale Sequential Decision Problems

Author: John Michael Mern

Publisher:

Published: 2021

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

Autonomous agents have the potential to do tasks that would otherwise be too repetitive, difficult, or dangerous for humans. Solving many of these problems requires reasoning over sequences of decisions in order to reach a goal. Autonomous driving, inventory management, and medical diagnosis and treatment are all examples of important real-world sequential decision problems. Approximate solution methods such as reinforcement learning and Monte Carlo planning have achieved superhuman performance in some domains. In these methods, agents learn good actions to take in response to inputs. Problems with many widely varying inputs or possible actions remain challenging to efficiently solve without extensive problem-specific engineering. One of the key challenges in solving sequential decision problems is efficiently exploring the many different paths an agent may take. For most problems, it is infeasible to test every possible path. Many existing approaches explore paths using simple random sampling. Problems in which many different actions may be taken at each step often require more efficient exploration to be solved. Large, unstructured input spaces can also challenge conventional learning approaches. Agents must learn to recognize inputs that are functionally similar while simultaneously learning an effective decision strategy. As a result of these challenges, learning agents are often limited to solving tasks in virtual domains where very large amounts of trials can be conducted relatively safely and cheaply. When problems are solved using black-box models such as neural networks, the resulting decision making policy is impossible for a human to meaningfully interpret. This can also limit the use of learning agents to low-regret tasks such as image classification or video game playing. The work in this thesis addresses the challenges of learning in large-space sequential decision problems. The thesis first considers methods to improve scaling of deep reinforcement learning and Monte Carlo tree search methods. We present neural network architectures for the common case of exchangeable object inputs in deep reinforcement learning. The presented architecture accelerates learning by efficiently sharing learned representations among objects of the same type. The thesis then addresses methods to efficiently explore large action spaces in Monte Carlo tree search. We present two algorithms, PA-POMCPOW and BOMCP, that improve search by guiding exploration to actions with good expected performance or information gain. We then propose methods to improve the use of offline learned policies within online Monte Carlo planning through importance sampling and experience generalization. Finally, we study methods to interpret learned policies and expected search performance. Here, we present a method to represent high-dimensional policies with interpretable local surrogate trees. We also propose bounds on the error rates for Monte Carlo estimation that can be numerically calculated using empirical quantities.


Towards Human-Like Prediction and Decision-Making for Automated Vehicles in Highway Scenarios

Towards Human-Like Prediction and Decision-Making for Automated Vehicles in Highway Scenarios

Author: David Sierra Gonzalez

Publisher:

Published: 2019

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

During the past few decades automakers have consistently introduced technological innovations aimed to make road vehicles safer. The level of sophistication of these advanced driver assistance systems has increased parallel to developments in sensor technology and embedded computing power. More recently, a lot of the research made both by industry and institutions has concentrated on achieving fully automated driving. The potential societal benefits of this technology are numerous, including safer roads, improved traffic flows, increased mobility for the elderly and the disabled, and optimized human productivity. However, before autonomous vehicles can be commercialized they should be able to safely share the road with human drivers. In other words, they should be capable of inferring the state and intentions of surrounding traffic from the raw data provided by a variety of onboard sensors, and to use this information to make safe navigation decisions. Moreover, in order to truly navigate safely they should also consider potential obstacles not observed by the sensors (such as occluded vehicles or pedestrians). Despite the apparent complexity of the task, humans are extremely good at predicting the development of traffic situations. After all, the actions of any traffic participant are constrained by the road network, by the traffic rules, and by a risk-aversive common sense. The lack of this ability to naturally understand a traffic scene constitutes perhaps the major challenge holding back the large-scale deployment of truly autonomous vehicles in the roads.In this thesis, we address the full pipeline from driver behavior modeling and inference to decision-making for navigation. In the first place, we model the behavior of a generic driver automatically from demonstrated driving data, avoiding thus the traditional hand-tuning of the model parameters. This model encodes the preferences of a driver with respect to the road network (e.g. preferred lane or speed) and also with respect to other road users (e.g. preferred distance to the leading vehicle). Secondly, we describe a method that exploits the learned model to predict the future sequence of actions of any driver in a traffic scene up to the distant future. This model-based prediction method assumes that all traffic participants behave in a risk-aware manner and can therefore fail to predict dangerous maneuvers or accidents. To be able to handle such cases, we propose a more sophisticated probabilistic model that estimates the state and intentions of surrounding traffic by combining the model-based prediction with the dynamic evidence provided by the sensors. In a way, the proposed model mimics the reasoning process of human drivers: we know what a given vehicle is likely to do given the situation (this is given by the model), but we closely monitor its dynamics to detect deviations from the expected behavior. In practice, combining both sources of information results in an increased robustness of the intention estimates in comparison with approaches relying only on dynamic evidence. Finally, the learned driver behavioral model and the prediction model are integrated within a probabilistic decision-making framework. The proposed methods are validated with real-world data collected with an instrumented vehicle. Although focused on highway environments, this work could be easily adapted to handle alternative traffic scenarios.


Nonlinear Model Predictive Control

Nonlinear Model Predictive Control

Author: Frank Allgöwer

Publisher: Birkhäuser

Published: 2012-12-06

Total Pages: 463

ISBN-13: 3034884079

DOWNLOAD EBOOK

During the past decade model predictive control (MPC), also referred to as receding horizon control or moving horizon control, has become the preferred control strategy for quite a number of industrial processes. There have been many significant advances in this area over the past years, one of the most important ones being its extension to nonlinear systems. This book gives an up-to-date assessment of the current state of the art in the new field of nonlinear model predictive control (NMPC). The main topic areas that appear to be of central importance for NMPC are covered, namely receding horizon control theory, modeling for NMPC, computational aspects of on-line optimization and application issues. The book consists of selected papers presented at the International Symposium on Nonlinear Model Predictive Control – Assessment and Future Directions, which took place from June 3 to 5, 1998, in Ascona, Switzerland. The book is geared towards researchers and practitioners in the area of control engineering and control theory. It is also suited for postgraduate students as the book contains several overview articles that give a tutorial introduction into the various aspects of nonlinear model predictive control, including systems theory, computations, modeling and applications.


Deep Multi Agent Reinforcement Learning for Autonomous Driving

Deep Multi Agent Reinforcement Learning for Autonomous Driving

Author: Sushrut Bhalla

Publisher:

Published: 2020

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

Deep Learning and back-propagation have been successfully used to perform centralized training with communication protocols among multiple agents in a cooperative Multi-Agent Deep Reinforcement Learning (MARL) environment. In this work, I present techniques for centralized training of MARL agents in large scale environments and compare my work against current state of the art techniques. This work uses model-free Deep Q-Network (DQN) as the baseline model and allows inter agent communication for cooperative policy learning. I present two novel, scalable and centralized MARL training techniques (MA-MeSN, MA-BoN), which are developed under the principle that the behavior policy and message/communication policies have different optimization criteria. Thus, this work presents models which separate the message learning module from the behavior policy learning module. As shown in the experiments, the separation of these modules helps in faster convergence in complex domains like autonomous driving simulators and achieves better results than the current techniques in literature. Subsequently, this work presents two novel techniques for achieving decentralized execution for the communication based cooperative policy. The first technique uses behavior cloning as a method of cloning an expert cooperative policy to a decentralized agent without message sharing. In the second method, the behavior policy is coupled with a memory module which is local to each model. This memory model is used by the independent agents to mimic the communication policies of other agents and thus generate an independent behavior policy. This decentralized approach has minimal effect on degradation of the overall cumulative reward achieved by the centralized policy. Using a fully decentralized approach allows us to address the challenges of noise and communication bottlenecks in real-time communication channels. In this work, I theoretically and empirically compare the centralized and decentralized training algorithms to current research in the field of MARL. As part of this thesis, I also developed a large scale multi-agent testing environment. It is a new OpenAI-Gym environment which can be used for large scale multi-agent research as it simulates multiple autonomous cars driving cooperatively on a highway in the presence of a bad actor. I compare the performance of the centralized algorithms to existing state-of-the-art algorithms, for ex, DIAL and IMS which are based on cumulative reward achieved per episode and other metrics. MA-MeSN and MA-BoN achieve a cumulative reward of at-least 263% higher than the reward achieved by the DIAL and IMS. I also present an ablation study of the scalability of MA-BoN and show that MA-MeSN and MA-BoN algorithms only exhibit a linear increase in inference time and number of trainable parameters compared to quadratic increase for DIAL.


Autonomous Driving

Autonomous Driving

Author: Markus Maurer

Publisher: Springer

Published: 2016-05-21

Total Pages: 698

ISBN-13: 3662488477

DOWNLOAD EBOOK

This book takes a look at fully automated, autonomous vehicles and discusses many open questions: How can autonomous vehicles be integrated into the current transportation system with diverse users and human drivers? Where do automated vehicles fall under current legal frameworks? What risks are associated with automation and how will society respond to these risks? How will the marketplace react to automated vehicles and what changes may be necessary for companies? Experts from Germany and the United States define key societal, engineering, and mobility issues related to the automation of vehicles. They discuss the decisions programmers of automated vehicles must make to enable vehicles to perceive their environment, interact with other road users, and choose actions that may have ethical consequences. The authors further identify expectations and concerns that will form the basis for individual and societal acceptance of autonomous driving. While the safety benefits of such vehicles are tremendous, the authors demonstrate that these benefits will only be achieved if vehicles have an appropriate safety concept at the heart of their design. Realizing the potential of automated vehicles to reorganize traffic and transform mobility of people and goods requires similar care in the design of vehicles and networks. By covering all of these topics, the book aims to provide a current, comprehensive, and scientifically sound treatment of the emerging field of “autonomous driving".