Data-Driven Science and Engineering

Data-Driven Science and Engineering

Author: Steven L. Brunton

Publisher: Cambridge University Press

Published: 2022-05-05

Total Pages: 615

ISBN-13: 1009098489

DOWNLOAD EBOOK

A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.


Data Driven Learning of Dynamical Systems Using Neural Networks

Data Driven Learning of Dynamical Systems Using Neural Networks

Author: Thomas Frederick Mussmann

Publisher:

Published: 2021

Total Pages: 44

ISBN-13:

DOWNLOAD EBOOK

We review general numerical approaches for discovering governing equations through data driven equation recovery. That is when the equations governing a dynamical system is unknown and depends on some hidden subset of variables. We review the structure of Neural Networks, Residual Neural Networks, and Recurrent Neural Networks. We also discuss the Mori Zwanzig formulation using history to substitute for hidden variables. We explore two examples, first is modeling Neuron Bursting with hidden variables using a Neural Network. Second, we examine particle traffic models and select one, which we dimensionally reduce and then attempt to predict future state from this dimensional reduction.


Data-driven Learning of Dynamical Systems Via Deep Neural Networks

Data-driven Learning of Dynamical Systems Via Deep Neural Networks

Author: Xiaohan Fu (Ph. D. in statistics)

Publisher:

Published: 2022

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

There has been a growing interest in learning governing equations for unknown dynamical systems with observational data. Instead of recovering the equation explicitly, methods have been put forward to learn the underlying mapping using deep neural networks (DNNs). In this dissertation, we discuss the topic of data-driven learning of dynamical systems in various scenarios using neural networks with memory. Flow map based learning seeks to model the flow map between two system states. Once this flow map is constructed, it can be used as an evolution operator to make predictions for the future states. When systems are autonomous and complete data is available, this learning method is straightforward, and memory- less Residual Networks (ResNets) can be readily applied. But in more complicated situations, history of the systems is valuable and has to be relied on. This dissertation considers the following situations: missing variables, hidden parameters, and corrupted data. When only data on a subset of the state variables is available, the effective dynamic of the reduced system is no longer Markovian even if the full system is autonomous. According to Mori-Zwanzig formalism, memory of the observed variables play an important role. We therefore propose a method to learn the evolution equations for the observables by incorporating memory terms into the neural network. We then extend this work to the situation where parameters are hidden in the data set to learn the underlying dynamics of state variables, as well as their moments. In these work, we design a recurrent-forward neural network structure that is capable of producing robust and accurate results. This memory built-in property also allows the neural network to learn the under- lying evolution from corrupted data. In this case, the history of the system provides a source from which useful information can be distilled. The neural network can learn directly from the corrupted data without the need to de-noise first. While this is still an ongoing work, current experiments show promising results.


Data-Driven Science and Engineering

Data-Driven Science and Engineering

Author: Steven L. Brunton

Publisher: Cambridge University Press

Published: 2022-05-05

Total Pages: 616

ISBN-13: 1009115634

DOWNLOAD EBOOK

Data-driven discovery is revolutionizing how we model, predict, and control complex systems. Now with Python and MATLAB®, this textbook trains mathematical scientists and engineers for the next generation of scientific discovery by offering a broad overview of the growing intersection of data-driven methods, machine learning, applied optimization, and classical fields of engineering mathematics and mathematical physics. With a focus on integrating dynamical systems modeling and control with modern methods in applied machine learning, this text includes methods that were chosen for their relevance, simplicity, and generality. Topics range from introductory to research-level material, making it accessible to advanced undergraduate and beginning graduate students from the engineering and physical sciences. The second edition features new chapters on reinforcement learning and physics-informed machine learning, significant new sections throughout, and chapter exercises. Online supplementary material – including lecture videos per section, homeworks, data, and code in MATLAB®, Python, Julia, and R – available on databookuw.com.


Data-driven Learning of Unknown Dynamical Systems with Missing Information

Data-driven Learning of Unknown Dynamical Systems with Missing Information

Author: Weize Mao

Publisher:

Published: 2021

Total Pages: 118

ISBN-13:

DOWNLOAD EBOOK

In this dissertation, we discuss several topics in data-driven learning of unknown dynamical systems with missing information. Depending on different scenarios of the underlying governing equations and data collection, we need different learning techniques, in order to effectively learn the underlying dynamics. The dissertation consists of five chapters. In the first two chapters, we review basic techniques regarding regression, neural networks, and data-driven learning of dynamical systems. In each of the last three chapters, we introduce data-driven learning method in different scenarios of underlying dynamical systems and data. First, we assume the underlying dynamical system is autonomous and contains unknown parameters, and we only have access to statistical moments (e.g. mean) of the measurements on the state variables. When a variable is Markovian (i.e. memoryless), deep learning methods such as \cite{qin2018data} can be readily applied to learn the time evolution of the variable. In our case, even though the underlying dynamical system is autonomous, the resulting moments are not Markovian, hence new methods need to be developed to corporate the memory effect. The flow map governing the moments time evolution with memory is derived based on Mori-Zwanzig formalism and is approximated by our proposed residual network. Second, in some cases, we have measurement data for individual trajectories of the state variables. When we have access to parameter information, data-driven methods such as \cite{QinCJX_IJUQ20} are effective at recovering the underlying parameterized system. But when information about the parameters is missing, new methods need to be developed. By treating the parameters as missing state variables with zero derivatives, the observed variables are essentially a reduced system, which has memory. We then develop a new method that incorporates the memory effect for learning the reduced system. Lastly, we are interested in recovering the dynamics of species populations in chemical reactions, using observational data. The evolution of species populations is a stochastic process whose probability distribution is governed by \textit{chemical master equation} (CME), which is a set of ordinary differential equations (ODEs). The CME consists of a large number of variables, and is intractable to be solved directly. The moments equations are derived based on CME, and we develop a data-driven method to learn the time evolution of the moments.


Dynamic Neural Networks for Robot Systems: Data-Driven and Model-Based Applications

Dynamic Neural Networks for Robot Systems: Data-Driven and Model-Based Applications

Author: Long Jin

Publisher: Frontiers Media SA

Published: 2024-07-24

Total Pages: 301

ISBN-13: 2832552013

DOWNLOAD EBOOK

Neural network control has been a research hotspot in academic fields due to the strong ability of computation. One of its wildly applied fields is robotics. In recent years, plenty of researchers have devised different types of dynamic neural network (DNN) to address complex control issues in robotics fields in reality. Redundant manipulators are no doubt indispensable devices in industrial production. There are various works on the redundancy resolution of redundant manipulators in performing a given task with the manipulator model information known. However, it becomes knotty for researchers to precisely control redundant manipulators with unknown model to complete a cyclic-motion generation CMG task, to some extent. It is worthwhile to investigate the data-driven scheme and the corresponding novel dynamic neural network (DNN), which exploits learning and control simultaneously. Therefore, it is of great significance to further research the special control features and solve challenging issues to improve control performance from several perspectives, such as accuracy, robustness, and solving speed.


Dynamic Mode Decomposition

Dynamic Mode Decomposition

Author: J. Nathan Kutz

Publisher: SIAM

Published: 2016-11-23

Total Pages: 241

ISBN-13: 1611974496

DOWNLOAD EBOOK

Data-driven dynamical systems is a burgeoning field?it connects how measurements of nonlinear dynamical systems and/or complex systems can be used with well-established methods in dynamical systems theory. This is a critically important new direction because the governing equations of many problems under consideration by practitioners in various scientific fields are not typically known. Thus, using data alone to help derive, in an optimal sense, the best dynamical system representation of a given application allows for important new insights. The recently developed dynamic mode decomposition (DMD) is an innovative tool for integrating data with dynamical systems theory. The DMD has deep connections with traditional dynamical systems theory and many recent innovations in compressed sensing and machine learning. Dynamic Mode Decomposition: Data-Driven Modeling of Complex Systems, the first book to address the DMD algorithm, presents a pedagogical and comprehensive approach to all aspects of DMD currently developed or under development; blends theoretical development, example codes, and applications to showcase the theory and its many innovations and uses; highlights the numerous innovations around the DMD algorithm and demonstrates its efficacy using example problems from engineering and the physical and biological sciences; and provides extensive MATLAB code, data for intuitive examples of key methods, and graphical presentations.


Machine Learning Control – Taming Nonlinear Dynamics and Turbulence

Machine Learning Control – Taming Nonlinear Dynamics and Turbulence

Author: Thomas Duriez

Publisher: Springer

Published: 2016-11-02

Total Pages: 229

ISBN-13: 3319406248

DOWNLOAD EBOOK

This is the first textbook on a generally applicable control strategy for turbulence and other complex nonlinear systems. The approach of the book employs powerful methods of machine learning for optimal nonlinear control laws. This machine learning control (MLC) is motivated and detailed in Chapters 1 and 2. In Chapter 3, methods of linear control theory are reviewed. In Chapter 4, MLC is shown to reproduce known optimal control laws for linear dynamics (LQR, LQG). In Chapter 5, MLC detects and exploits a strongly nonlinear actuation mechanism of a low-dimensional dynamical system when linear control methods are shown to fail. Experimental control demonstrations from a laminar shear-layer to turbulent boundary-layers are reviewed in Chapter 6, followed by general good practices for experiments in Chapter 7. The book concludes with an outlook on the vast future applications of MLC in Chapter 8. Matlab codes are provided for easy reproducibility of the presented results. The book includes interviews with leading researchers in turbulence control (S. Bagheri, B. Batten, M. Glauser, D. Williams) and machine learning (M. Schoenauer) for a broader perspective. All chapters have exercises and supplemental videos will be available through YouTube.


Reinforcement Learning for Optimal Feedback Control

Reinforcement Learning for Optimal Feedback Control

Author: Rushikesh Kamalapurkar

Publisher: Springer

Published: 2018-05-10

Total Pages: 305

ISBN-13: 331978384X

DOWNLOAD EBOOK

Reinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution. To yield an approximate optimal controller, the authors focus on theories and methods that fall under the umbrella of actor–critic methods for machine learning. They concentrate on establishing stability during the learning phase and the execution phase, and adaptive model-based and data-driven reinforcement learning, to assist readers in the learning process, which typically relies on instantaneous input-output measurements. This monograph provides academic researchers with backgrounds in diverse disciplines from aerospace engineering to computer science, who are interested in optimal reinforcement learning functional analysis and functional approximation theory, with a good introduction to the use of model-based methods. The thorough treatment of an advanced treatment to control will also interest practitioners working in the chemical-process and power-supply industry.