Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles
Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Author: Teng Liu

Publisher: Morgan & Claypool Publishers

Published: 2019-09-03

Total Pages: 99

ISBN-13: 1681736195

DOWNLOAD EBOOK

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles
Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Author: Teng Liu

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 90

ISBN-13: 3031015037

DOWNLOAD EBOOK

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles
Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Author: Teng Liu

Publisher: Synthesis Lectures on Advances

Published: 2019-09-03

Total Pages: 99

ISBN-13: 9781681736204

DOWNLOAD EBOOK

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles
Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles

Author: Yeuching Li

Publisher: Morgan & Claypool Publishers

Published: 2022-02-14

Total Pages: 135

ISBN-13: 1636393020

DOWNLOAD EBOOK

The urgent need for vehicle electrification and improvement in fuel efficiency has gained increasing attention worldwide. Regarding this concern, the solution of hybrid vehicle systems has proven its value from academic research and industry applications, where energy management plays a key role in taking full advantage of hybrid electric vehicles (HEVs). There are many well-established energy management approaches, ranging from rules-based strategies to optimization-based methods, that can provide diverse options to achieve higher fuel economy performance. However, the research scope for energy management is still expanding with the development of intelligent transportation systems and the improvement in onboard sensing and computing resources. Owing to the boom in machine learning, especially deep learning and deep reinforcement learning (DRL), research on learning-based energy management strategies (EMSs) is gradually gaining more momentum. They have shown great promise in not only being capable of dealing with big data, but also in generalizing previously learned rules to new scenarios without complex manually tunning. Focusing on learning-based energy management with DRL as the core, this book begins with an introduction to the background of DRL in HEV energy management. The strengths and limitations of typical DRL-based EMSs are identified according to the types of state space and action space in energy management. Accordingly, value-based, policy gradient-based, and hybrid action space-oriented energy management methods via DRL are discussed, respectively. Finally, a general online integration scheme for DRL-based EMS is described to bridge the gap between strategy learning in the simulator and strategy deployment on the vehicle controller.

Hybrid Electric Vehicles
Hybrid Electric Vehicles

Author: Simona Onori

Publisher: Springer

Published: 2015-12-16

Total Pages: 121

ISBN-13: 1447167813

DOWNLOAD EBOOK

This SpringerBrief deals with the control and optimization problem in hybrid electric vehicles. Given that there are two (or more) energy sources (i.e., battery and fuel) in hybrid vehicles, it shows the reader how to implement an energy-management strategy that decides how much of the vehicle’s power is provided by each source instant by instant. Hybrid Electric Vehicles: •introduces methods for modeling energy flow in hybrid electric vehicles; •presents a standard mathematical formulation of the optimal control problem; •discusses different optimization and control strategies for energy management, integrating the most recent research results; and •carries out an overall comparison of the different control strategies presented. Chapter by chapter, a case study is thoroughly developed, providing illustrative numerical examples that show the basic principles applied to real-world situations. The brief is intended as a straightforward tool for learning quickly about state-of-the-art energy-management strategies. It is particularly well-suited to the needs of graduate students and engineers already familiar with the basics of hybrid vehicles but who wish to learn more about their control strategies.

Intelligent Control for Modern Transportation Systems
Intelligent Control for Modern Transportation Systems

Author: Arunesh Kumar Singh

Publisher: CRC Press

Published: 2023-10-16

Total Pages: 203

ISBN-13: 1000963462

DOWNLOAD EBOOK

The book comprehensively discusses concepts of artificial intelligence in green transportation systems. It further covers intelligent techniques for precise modeling of complex transportation infrastructure, forecasting and predicting traffic congestion, and intelligent control techniques for maximizing performance and safety. It further provides MATLAB® programs for artificial intelligence techniques. It discusses artificial intelligence-based approaches and technologies in controlling and operating solar photovoltaic systems to generate power for electric vehicles. Highlights how different technological advancements have revolutionized the transportation system. Presents core concepts and principles of soft computing techniques in the control and management of modern transportation systems. Discusses important topics such as speed control, fuel control challenges, transport infrastructure modeling, and safety analysis. Showcases MATLAB® programs for artificial intelligence techniques. Discusses roles, implementation, and approaches of different intelligent techniques in the field of transportation systems. It will serve as an ideal text for professionals, graduate students, and academicians in the fields of electrical engineering, electronics and communication engineering, civil engineering, and computer engineering.

Principles and Applications in Speed Sensing and Energy Harvesting for Smart Roads
Principles and Applications in Speed Sensing and Energy Harvesting for Smart Roads

Author: Taha, Luay

Publisher: IGI Global

Published: 2024-06-24

Total Pages: 326

ISBN-13: 1668492164

DOWNLOAD EBOOK

In the industry of transportation, the demand for sustainable energy solutions and intelligent traffic management has reached a critical juncture. One of the key challenges faced is the efficient utilization of roadways to generate power and support the infrastructure of smart highways. Road piezoelectric energy harvesting (RPEH) is a concept that has sparked widespread interest in both industry and academia. The book, titled Principles and Applications in Speed Sensing and Energy Harvesting for Smart Roads, unravels the intricacies of RPEH and presents a visionary solution to power traffic ancillary facilities and wireless sensor devices on highways. Within its pages lies a transformative proposal – harnessing energy from piezoelectric stacks to not only address the power needs of these critical components but also to enable intelligent vehicle speed sensing. This book is for academic scholars and practitioners alike, navigating the intricate landscape of smart highways. Focused on the latest energy harvesting technologies and vehicle speed sensing, it extends an invitation to delve into communication with smart road displays. Tailored for diverse engineering disciplines—electrical, computer, mechanical, and civil—the book contains cutting-edge research in the domain. Aspiring to be a one-stop source for up-to-date information, it guides researchers, students, and industry professionals through state-of-the-art technologies, fostering a deeper understanding of smart highway systems.

Modeling for Hybrid and Electric Vehicles Using Simscape
Modeling for Hybrid and Electric Vehicles Using Simscape

Author: Shuvra Das

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 208

ISBN-13: 3031015088

DOWNLOAD EBOOK

Automobiles have played an important role in the shaping of the human civilization for over a century and continue to play a crucial role today. The design, construction, and performance of automobiles have evolved over the years. For many years, there has been a strong shift toward electrification of automobiles. It started with the by-wire systems where more efficient electro-mechanical subsystems started replacing purely mechanical devices, e.g., anti-lock brakes, drive-by-wire, and cruise control. Over the last decade, driven by a strong push for fuel efficiency, pollution reduction, and environmental stewardship, electric and hybrid electric vehicles have become quite popular. In fact, almost all the automobile manufacturers have adopted strategies and launched vehicle models that are electric and/or hybrid. With this shift in technology, employers have growing needs for new talent in areas such as energy storage and battery technology, power electronics, electric motor drives, embedded control systems, and integration of multi-disciplinary systems. To support these needs, universities are adjusting their programs to train students in these new areas of expertise. For electric and hybrid technology to deliver superior performance and efficiency, all sub-systems have to work seamlessly and in unison every time and all the time. To ensure this level of precision and reliability, modeling and simulation play crucial roles during the design and development cycle of electric and hybrid vehicles. Simscape, a Matlab/Simulink toolbox for modeling physical systems, is an ideally suited platform for developing and deploying models for systems and sub-systems that are critical for hybrid and electric vehicles. This text will focus on guiding the reader in the development of models for all critical areas of hybrid and electric vehicles. There are numerous texts on electric and hybrid vehicles in the market right now. A majority of these texts focus on the relevant technology and the physics and engineering of their operation. In contrast, this text focuses on the application of some of the theories in developing models of physical systems that are at the core of hybrid and electric vehicles. Simscape is the tool of choice for the development of these models. Relevant background and appropriate theory are referenced and summarized in the context of model development with significantly more emphasis on the model development procedure and obtaining usable and accurate results.

Decision Making, Planning, and Control Strategies for Intelligent Vehicles
Decision Making, Planning, and Control Strategies for Intelligent Vehicles

Author: Haotian Cao

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 128

ISBN-13: 3031015061

DOWNLOAD EBOOK

The intelligent vehicle will play a crucial and essential role in the development of the future intelligent transportation system, which is developing toward the connected driving environment, ultimate driving safety, and comforts, as well as green efficiency. While the decision making, planning, and control are extremely vital components of the intelligent vehicle, these modules act as a bridge, connecting the subsystem of the environmental perception and the bottom-level control execution of the vehicle as well. This short book covers various strategies of designing the decision making, trajectory planning, and tracking control, as well as share driving, of the human-automation to adapt to different levels of the automated driving system. More specifically, we introduce an end-to-end decision-making module based on the deep Q-learning, and improved path-planning methods based on artificial potentials and elastic bands which are designed for obstacle avoidance. Then, the optimal method based on the convex optimization and the natural cubic spline is presented. As for the speed planning, planning methods based on the multi-object optimization and high-order polynomials, and a method with convex optimization and natural cubic splines, are proposed for the non-vehicle-following scenario (e.g., free driving, lane change, obstacle avoidance), while the planning method based on vehicle-following kinematics and the model predictive control (MPC) is adopted for the car-following scenario. We introduce two robust tracking methods for the trajectory following. The first one, based on nonlinear vehicle longitudinal or path-preview dynamic systems, utilizes the adaptive sliding mode control (SMC) law which can compensate for uncertainties to follow the speed or path profiles. The second one is based on the five-degrees-of-freedom nonlinear vehicle dynamical system that utilizes the linearized time-varying MPC to track the speed and path profile simultaneously. Toward human-automation cooperative driving systems, we introduce two control strategies to address the control authority and conflict management problems between the human driver and the automated driving systems. Driving safety field and game theory are utilized to propose a game-based strategy, which is used to deal with path conflicts during obstacle avoidance. Driver's driving intention, situation assessment, and performance index are employed for the development of the fuzzy-based strategy. Multiple case studies and demos are included in each chapter to show the effectiveness of the proposed approach. We sincerely hope the contents of this short book provide certain theoretical guidance and technical supports for the development of intelligent vehicle technology.

Behavior Analysis and Modeling of Traffic Participants
Behavior Analysis and Modeling of Traffic Participants

Author: Xiaolin Song

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 160

ISBN-13: 3031015096

DOWNLOAD EBOOK

A road traffic participant is a person who directly participates in road traffic, such as vehicle drivers, passengers, pedestrians, or cyclists, however, traffic accidents cause numerous property losses, bodily injuries, and even deaths to them. To bring down the rate of traffic fatalities, the development of the intelligent vehicle is a much-valued technology nowadays. It is of great significance to the decision making and planning of a vehicle if the pedestrians' intentions and future trajectories, as well as those of surrounding vehicles, could be predicted, all in an effort to increase driving safety. Based on the image sequence collected by onboard monocular cameras, we use the Long Short-Term Memory (LSTM) based network with an enhanced attention mechanism to realize the intention and trajectory prediction of pedestrians and surrounding vehicles. However, although the fully automatic driving era still seems far away, human drivers are still a crucial part of the road‒driver‒vehicle system under current circumstances, even dealing with low levels of automatic driving vehicles. Considering that more than 90 percent of fatal traffic accidents were caused by human errors, thus it is meaningful to recognize the secondary task while driving, as well as the driving style recognition, to develop a more personalized advanced driver assistance system (ADAS) or intelligent vehicle. We use the graph convolutional networks for spatial feature reasoning and the LSTM networks with the attention mechanism for temporal motion feature learning within the image sequence to realize the driving secondary-task recognition. Moreover, aggressive drivers are more likely to be involved in traffic accidents, and the driving risk level of drivers could be affected by many potential factors, such as demographics and personality traits. Thus, we will focus on the driving style classification for the longitudinal car-following scenario. Also, based on the Structural Equation Model (SEM) and Strategic Highway Research Program 2 (SHRP 2) naturalistic driving database, the relationships among drivers' demographic characteristics, sensation seeking, risk perception, and risky driving behaviors are fully discussed. Results and conclusions from this short book are expected to offer potential guidance and benefits for promoting the development of intelligent vehicle technology and driving safety.