A Deep Learning Approach to State Estimation and Bad Data Detection

A Deep Learning Approach to State Estimation and Bad Data Detection

Author: Kursat Rasim Mestav

Publisher:

Published: 2021

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

A deep neural network is a deep learning algorithm that uses artificial neural networks with multiple layers. The goal of a deep neural network is to learn a function from observation samples. In many real-world problems, this function is unknown and there is a need to learn it from the input-output samples. This idea may apply to various interesting problems that require a deep learning approach. I studied three learning problems motivated by the applications in power systems, The first problem considered is the problem of state estimation for unobservable distribution systems. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning for stochastic power injection, a Monte Carlo technique for the training of a deep neural network for state estimation, and a Bayesian bad data detection and filtering algorithm. Simulations illustrate the accuracy of Bayesian state estimation for unobservable systems and demonstrate the benefit of employing a deep neural network. Comparing with pseudo-measurement techniques, direct Bayesian state estimation via deep learning neural network outperforms existing benchmarks. The second problem considered is to detect anomalies under unknown probability distributions. Whereas the probability distribution of the anomaly-free data is unknown, anomaly-free training samples are assumed to be available. For anomaly data, neither the underlying probability distribution is known nor anomaly data samples are available. A deep learning approach coupled with a statistical test based on coincidence is proposed where an inverse generative adversary network is trained to transform data to the classical uniform vs. nonuniform hypothesis testing problem. The proposed approach is particularly effective to detect persistent anomalies whose distributions have an overlapping domain with that of the anomaly-free distribution. The third problem considered is the detection of bad-data sequences in power system. The bad-data model is nonparametric that includes arbitrary natural and adversarial data anomalies. No historical samples of data anomaly are assumed. The probability distribution of data in anomaly-free system operations is also non-parametric, unknown, but with historical training samples. A uniformity test is proposed based on a generative adversarial network (GAN) that extracts independent components of the measurement sequence via independent component analysis (ICA). Referred to as ICA-GAN, the developed approach to bad-data sequence detection can be applied at the individual sensor level or jointly at the system level. Numerical results demonstrate significant improvement over the state-of-the-art solutions for a variety of bad-data cases using PMU measurements from the EPFL smart grid testbed and that from the synthetic North Texas grid.


A Deep Learning Approach for Spatiotemporal-data-driven Traffic State Estimation

A Deep Learning Approach for Spatiotemporal-data-driven Traffic State Estimation

Author: Amr Abdelraouf

Publisher:

Published: 2022

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

The past decade witnessed rapid developments in traffic data sensing technologies in the form of roadside detector hardware, vehicle on-board units, and pedestrian wearable devices. The growing magnitude and complexity of the available traffic data has fueled the demand for data-driven models that can handle large scale inputs. In the recent past, deep-learning-powered algorithms have become the state-of-the-art for various data-driven applications. In this research, three applications of deep learning algorithms for traffic state estimation were investigated. Firstly, network-wide traffic parameters estimation was explored. An attention-based multi-encoder-decoder (Att-MED) neural network architecture was proposed and trained to predict freeway traffic speed up to 60 minutes ahead. Att-MED was designed to encode multiple traffic input sequences: short-term, daily, and weekly cyclic behavior. The proposed network produced an average prediction accuracy of 97.5%, which was superior to the compared baseline models. In addition to improving the output performance, the model’s attention weights enhanced the model interpretability. This research additionally explored the utility of low-penetration connected probe-vehicle data for network-wide traffic parameters estimation and prediction on freeways. A novel sequence-to-sequence recurrent graph networks (Seq2Se2 GCN-LSTM) was designed. It was then trained to estimate and predict traffic volume and speed for a 60-minute future time horizon. The proposed methodology generated volume and speed predictions with an average accuracy of 90.5% and 96.6%, respectively, outperforming the investigated baseline models. The proposed method demonstrated robustness against perturbations caused by the probe vehicle fleet’s low penetration rate. Secondly, the application of deep learning for road weather detection using roadside CCTVs were investigated. A Vision Transformer (ViT) was trained for simultaneous rain and road surface condition classification. Next, a Spatial Self-Attention (SSA) network was designed to consume the individual detection results, interpret the spatial context, and modify the collective detection output accordingly. The sequential module improved the accuracy of the stand-alone Vision Transformer as measured by the F1-score, raising the total accuracy for both tasks to 96.71% and 98.07%, respectively. Thirdly, a real-time video-based traffic incident detection algorithm was developed to enhance the utilization of the existing roadside CCTV network. The methodology automatically identified the main road regions in video scenes and investigated static vehicles around those areas. The developed algorithm was evaluated using a dataset of roadside videos. The incidents were detected with 85.71% sensitivity and 11.10% false alarm rate with an average delay of 27.53 seconds. In general, the research proposed in this dissertation maximizes the utility of pre-existing traffic infrastructure and emerging probe traffic data. It additionally demonstrated deep learning algorithms’ capability of modeling complex spatiotemporal traffic data. This research illustrates that advances in the deep learning field continue to have a high applicability potential in the traffic state estimation domain.


Power System State Estimation

Power System State Estimation

Author: Ali Abur

Publisher: CRC Press

Published: 2004-03-24

Total Pages: 350

ISBN-13: 9780203913673

DOWNLOAD EBOOK

Offering an up-to-date account of the strategies utilized in state estimation of electric power systems, this text provides a broad overview of power system operation and the role of state estimation in overall energy management. It uses an abundance of examples, models, tables, and guidelines to clearly examine new aspects of state estimation, the testing of network observability, and methods to assure computational efficiency. Includes numerous tutorial examples that fully analyze problems posed by the inclusion of current measurements in existing state estimators and illustrate practical solutions to these challenges. Written by two expert researchers in the field, Power System State Estimation extensively details topics never before covered in depth in any other text, including novel robust state estimation methods, estimation of parameter and topology errors, and the use of ampere measurements for state estimation. It introduces various methods and computational issues involved in the formulation and implementation of the weighted least squares (WLS) approach, presents statistical tests for the detection and identification of bad data in system measurements, and reveals alternative topological and numerical formulations for the network observability problem.


Security of Cyber-Physical Systems: State Estimation and Control

Security of Cyber-Physical Systems: State Estimation and Control

Author: Chengwei Wu

Publisher: Springer Nature

Published: 2021-10-19

Total Pages: 293

ISBN-13: 3030883507

DOWNLOAD EBOOK

This book analyzes the secure problems of cyber-physical systems from both the adversary and defender sides. Targeting the challenging security problems of cyber-physical systems under malicious attacks, this book presents some recent novel secure state estimation and control algorithms, in which moving target defense scheme, zero-sum game-theoretical approach, reinforcement learning, neural networks, and intelligent control are adopted. Readers will find not only the valuable secure state estimation and control schemes combined with the approaches aforementioned, but also some vital conclusions for securing cyber-physical systems, for example, the critical value of allowed attack probability, the maximum number of sensors to be attacked, etc. The book also provides practical applications, example of which are unmanned aerial vehicles, interruptible power system, and robot arm to validate the proposed secure algorithms. Given its scope, it offers a valuable resource for undergraduate and graduate students, academics, scientists, and engineers who are working in this field.


Future Electricity System Based on Energy Internet: Energy storage system design, Optimal Scheduling, Security, Attack Model and Countermeasures

Future Electricity System Based on Energy Internet: Energy storage system design, Optimal Scheduling, Security, Attack Model and Countermeasures

Author: Dou An

Publisher: Frontiers Media SA

Published: 2023-11-09

Total Pages: 172

ISBN-13: 2832529844

DOWNLOAD EBOOK

Energy Internet, a futuristic evolution of electricity system, is conceptualized as an energy sharing network. The energy internet integrates advanced sensors, efficient measurement technologies, advanced control methods, and efficient energy utilization/conversion/storage system to achieve economical, efficient, and environmentally friendly operation of the power grid system. The energy internet also contains a large amount of heterogeneous information, which requires the support of information technology more than traditional power system design. Moreover, due to the open network environment of the energy internet, any anomaly or malicious attack in the system can bring unpredictable and significant losses to the overall grid operation.


Cyber-Physical Power Systems State Estimation

Cyber-Physical Power Systems State Estimation

Author: Arturo Bretas

Publisher: Elsevier

Published: 2021-05-14

Total Pages: 294

ISBN-13: 0323903223

DOWNLOAD EBOOK

Cyber-Physical Power System State Estimation updates classic state estimation tools to enable real-time operations and optimize reliability in modern electric power systems. The work introduces and contextualizes the core concepts and classic approaches to state estimation modeling. It builds on these classic approaches with a suite of data-driven models and non-synchronized measurement tools to reflect current measurement trends required by increasingly more sophisticated grids. Chapters outline core definitions, concepts and the network analysis procedures involved in the real-time operation of EPS. Specific sections introduce power flow problem in EPS, highlighting network component modeling and power flow equations for state estimation before addressing quasi static state estimation in electrical power systems using Weighted Least Squares (WLS) classical and alternatives formulations. Particularities of the state estimation process in distribution systems are also considered. Finally, the work goes on to address observability analysis, measurement redundancy and the processing of gross errors through the analysis of WLS static state estimator residuals. - Develops advanced approaches to smart grid real-time monitoring through quasi-static model state estimation and non-synchronized measurements system models - Presents a novel, extended optimization, physics-based model which identifies and corrects for measurement error presently egregiously discounted in classic models - Demonstrates how to embed cyber-physical security into smart grids for real-time monitoring - Introduces new approaches to calculate power flow in distribution systems and for estimating distribution system states - Incorporates machine-learning based approaches to complement the state estimation process, including pattern recognition-based solutions, principal component analysis and support vector machines


AI-Enabled Threat Detection and Security Analysis for Industrial IoT

AI-Enabled Threat Detection and Security Analysis for Industrial IoT

Author: Hadis Karimipour

Publisher: Springer Nature

Published: 2021-08-03

Total Pages: 250

ISBN-13: 3030766136

DOWNLOAD EBOOK

This contributed volume provides the state-of-the-art development on security and privacy for cyber-physical systems (CPS) and industrial Internet of Things (IIoT). More specifically, this book discusses the security challenges in CPS and IIoT systems as well as how Artificial Intelligence (AI) and Machine Learning (ML) can be used to address these challenges. Furthermore, this book proposes various defence strategies, including intelligent cyber-attack and anomaly detection algorithms for different IIoT applications. Each chapter corresponds to an important snapshot including an overview of the opportunities and challenges of realizing the AI in IIoT environments, issues related to data security, privacy and application of blockchain technology in the IIoT environment. This book also examines more advanced and specific topics in AI-based solutions developed for efficient anomaly detection in IIoT environments. Different AI/ML techniques including deep representation learning, Snapshot Ensemble Deep Neural Network (SEDNN), federated learning and multi-stage learning are discussed and analysed as well. Researchers and professionals working in computer security with an emphasis on the scientific foundations and engineering techniques for securing IIoT systems and their underlying computing and communicating systems will find this book useful as a reference. The content of this book will be particularly useful for advanced-level students studying computer science, computer technology, cyber security, and information systems. It also applies to advanced-level students studying electrical engineering and system engineering, who would benefit from the case studies.


IoT and Analytics in Renewable Energy Systems (Volume 1)

IoT and Analytics in Renewable Energy Systems (Volume 1)

Author: O.V. Gnana Swathika

Publisher: CRC Press

Published: 2023-08-11

Total Pages: 471

ISBN-13: 1000909794

DOWNLOAD EBOOK

Smart grid technologies include sensing and measurement technologies, advanced components aided with communications and control methods along with improved interfaces and decision support systems. Smart grid techniques support the extensive inclusion of clean renewable generation in power systems. Smart grid use also promotes energy saving in power systems. Cyber security objectives for the smart grid are availability, integrity and confidentiality. Five salient features of this book are as follows: AI and IoT in improving resilience of smart energy infrastructure IoT, smart grids and renewable energy: an economic approach AI and ML towards sustainable solar energy Electrical vehicles and smart grid Intelligent condition monitoring for solar and wind energy systems