Anomaly Detection in Smart Distribution Grids with Deep Neural Network

Anomaly Detection in Smart Distribution Grids with Deep Neural Network

Author: Ming Zhou (Computer scientist)

Publisher:

Published: 2022

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

With the rapid development of smart grids, the detection of anomalies is essential to improve the quality and security protection of the grid. The identification of anomalies not only saves valuable time but also reduces maintenance costs. Due to the increasing deployment of distributed energy resources, traditional methods of protecting the grid that rely on simple linear models and manual inspections are no longer sufficient. Meanwhile, the massive amount of data generated by smart meters and phasor measurement units provide opportunities to better monitor and control power grids in real-time. Due to this advantage of data availability, various machine learning and deep learning methods have been proposed and are currently demonstrating successful results in anomaly detection in power systems. While previously proposed artificial intelligence techniques can successfully de- tect anomalies, most of them tend to require large amounts of simulated data of all different types of anomalies for training their framework. However, anomalous data may be rare in power distribution systems. In addition, their static training model makes them vulnerable to new data from different distributions entering the system. To address these drawbacks, we propose data-driven frameworks based on deep learning network models to directly detect anomalies in power distribution systems. Anomalies are generally defined as observations that deviate from the standard, normal or expected values. Specifically, this work is divided into two phases. In the first phase, we consider anomalies as events caused by changes in the distribution system load, such as customer disconnection from the grid. A long short-term memory network is proposed to predict the next time step of the voltage magnitude of all buses in the distribution system. A threshold function based on Euclidean distance is then used to detect voltage anomalies by utilizing only normal data. The results corresponding to this proposed framework have been successfully tested using a real distribution network. In the second phase, we aim to classify faults and locate faulted lines in partially observable distribution systems using convolutional neural networks. To improve the robustness of the classification and localization performance, we extract feature vectors with measurements in the observable buses as inputs to the proposed classifier. In addition, we incorporate an online continuous learning algorithm to accommodate variations in the level of integration of distributed energy resources and changes in the load of the distribution system over time. Unlike previous data-driven approaches, the proposed method also deals with imbalanced learning tasks, as fault data are often rare. The performance of the method has been tested and validated by simulating ten faults on a real distribution feeder model.


Network Anomaly Detection

Network Anomaly Detection

Author: Dhruba Kumar Bhattacharyya

Publisher: CRC Press

Published: 2013-06-18

Total Pages: 364

ISBN-13: 146658209X

DOWNLOAD EBOOK

With the rapid rise in the ubiquity and sophistication of Internet technology and the accompanying growth in the number of network attacks, network intrusion detection has become increasingly important. Anomaly-based network intrusion detection refers to finding exceptional or nonconforming patterns in network traffic data compared to normal behavi


Anomaly Detection in Power Distribution System Measurements Using Machine Learning

Anomaly Detection in Power Distribution System Measurements Using Machine Learning

Author: Arun Abhishek Imayakumar

Publisher:

Published: 2019

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

Sensor measurements of distribution system are uncertain due to sensor malfunctions, communication failure and cyber attacks. This thesis aims to perform anomaly detection on measurements utilizing data-driven approaches. The measurements considered are individual smart meter real power measurements and network-wide primary voltage magnitudes. Anomaly detection in individual smart meter measurements using gaussian probabilistic thresholds is explored. It flags non-anomalous data as verified by the comparison of smart meter real power and individual appliance consumption. To perform a real-time comparison for detection, Non-Intrusive Load Monitoring (NILM) is needed, which is difficult due to the associated consumer privacy issues. Alternatively, forecasting can be used for anomaly detection. So, single layer neural network models such as Multi-Layer Perceptron (MLP), and Long Short Term Memory (LSTM) with different features are tried. Even in training data, a poor performance is seen in these models, due to the smart meter profile variability. Hence, aggregated smart meter forecasting using neural networks can be used to detect anomaly in such aggregated measurements with a reasonable accuracy. Network-wide primary voltage measurements are correlated for a phase of feeder for different buses at a given time-step; this is extensively validated empirically. To leverage this, Principal Component Analysis (PCA) is used to reduce the dimensionality of this input data. Further, residual and subspace based methods are explored for network-level anomaly detection and identification. The results for the residual approach on missing and bad data cases are detailed for IEEE 13 bus and IEEE 8500 node test feeders. It is validated through simulations that residual-based approach on subspace projection matrix for the measurement data successfully performs anomaly detection and identification for primary network voltage measurements for the selected test cases. Further research is needed to validate the applicability and accuracy of the proposed framework during changes in the system operating conditions (topology changes, capacitor bank switching, etc.), and on real-world measurements form sensors deployed in the field.


Applied Cloud Deep Semantic Recognition

Applied Cloud Deep Semantic Recognition

Author: Mehdi Roopaei

Publisher: CRC Press

Published: 2018-04-09

Total Pages: 188

ISBN-13: 135111901X

DOWNLOAD EBOOK

This book provides a comprehensive overview of the research on anomaly detection with respect to context and situational awareness that aim to get a better understanding of how context information influences anomaly detection. In each chapter, it identifies advanced anomaly detection and key assumptions, which are used by the model to differentiate between normal and anomalous behavior. When applying a given model to a particular application, the assumptions can be used as guidelines to assess the effectiveness of the model in that domain. Each chapter provides an advanced deep content understanding and anomaly detection algorithm, and then shows how the proposed approach is deviating of the basic techniques. Further, for each chapter, it describes the advantages and disadvantages of the algorithm. The final chapters provide a discussion on the computational complexity of the models and graph computational frameworks such as Google Tensorflow and H2O because it is an important issue in real application domains. This book provides a better understanding of the different directions in which research has been done on deep semantic analysis and situational assessment using deep learning for anomalous detection, and how methods developed in one area can be applied in applications in other domains. This book seeks to provide both cyber analytics practitioners and researchers an up-to-date and advanced knowledge in cloud based frameworks for deep semantic analysis and advanced anomaly detection using cognitive and artificial intelligence (AI) models.


Microgrids

Microgrids

Author: Amjad Anvari-Moghaddam

Publisher: MDPI

Published: 2021-05-21

Total Pages: 280

ISBN-13: 3036506624

DOWNLOAD EBOOK

Microgrids are a growing segment of the energy industry, representing a paradigm shift from centralized structures toward more localized, autonomous, dynamic, and bi-directional energy networks, especially in cities and communities. The ability to isolate from the larger grid makes microgrids resilient, while their capability of forming scalable energy clusters permits the delivery of services that make the grid more sustainable and competitive. Through an optimal design and management process, microgrids could also provide efficient, low-cost, clean energy and help to improve the operation and stability of regional energy systems. This book covers these promising and dynamic areas of research and development and gathers contributions on different aspects of microgrids in an aim to impart higher degrees of sustainability and resilience to energy systems.


Handbook of Big Data Privacy

Handbook of Big Data Privacy

Author: Kim-Kwang Raymond Choo

Publisher: Springer Nature

Published: 2020-03-18

Total Pages: 397

ISBN-13: 3030385574

DOWNLOAD EBOOK

This handbook provides comprehensive knowledge and includes an overview of the current state-of-the-art of Big Data Privacy, with chapters written by international world leaders from academia and industry working in this field. The first part of this book offers a review of security challenges in critical infrastructure and offers methods that utilize acritical intelligence (AI) techniques to overcome those issues. It then focuses on big data security and privacy issues in relation to developments in the Industry 4.0. Internet of Things (IoT) devices are becoming a major source of security and privacy concern in big data platforms. Multiple solutions that leverage machine learning for addressing security and privacy issues in IoT environments are also discussed this handbook. The second part of this handbook is focused on privacy and security issues in different layers of big data systems. It discusses about methods for evaluating security and privacy of big data systems on network, application and physical layers. This handbook elaborates on existing methods to use data analytic and AI techniques at different layers of big data platforms to identify privacy and security attacks. The final part of this handbook is focused on analyzing cyber threats applicable to the big data environments. It offers an in-depth review of attacks applicable to big data platforms in smart grids, smart farming, FinTech, and health sectors. Multiple solutions are presented to detect, prevent and analyze cyber-attacks and assess the impact of malicious payloads to those environments. This handbook provides information for security and privacy experts in most areas of big data including; FinTech, Industry 4.0, Internet of Things, Smart Grids, Smart Farming and more. Experts working in big data, privacy, security, forensics, malware analysis, machine learning and data analysts will find this handbook useful as a reference. Researchers and advanced-level computer science students focused on computer systems, Internet of Things, Smart Grid, Smart Farming, Industry 4.0 and network analysts will also find this handbook useful as a reference.


Smart Grid Sensors

Smart Grid Sensors

Author: Hamed Mohsenian-Rad

Publisher:

Published: 2022-04-06

Total Pages: 350

ISBN-13: 1108880835

DOWNLOAD EBOOK

Discover the ever-growing field of smart grid sensors, covering traditional and state-of-the-art sensor technologies, as well as data-driven and intelligent methods for using sensor measurements in support of innovative smart grid applications. Covers recent and emerging topics, such as smart meters, synchronized phasor measurements, and synchronized waveform measurements. Additional advanced topics and future trends are also discussed, such as situational awareness, probing, and working with off-domain measurements. Including real-world examples, exercise questions, and sample data sets, this is an essential text for students, researchers, and scientists, as well as field engineers and practitioners in the areas of smart grid and power systems.


A Deep Learning Approach to State Estimation and Bad Data Detection

A Deep Learning Approach to State Estimation and Bad Data Detection

Author: Kursat Rasim Mestav

Publisher:

Published: 2021

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

A deep neural network is a deep learning algorithm that uses artificial neural networks with multiple layers. The goal of a deep neural network is to learn a function from observation samples. In many real-world problems, this function is unknown and there is a need to learn it from the input-output samples. This idea may apply to various interesting problems that require a deep learning approach. I studied three learning problems motivated by the applications in power systems, The first problem considered is the problem of state estimation for unobservable distribution systems. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning for stochastic power injection, a Monte Carlo technique for the training of a deep neural network for state estimation, and a Bayesian bad data detection and filtering algorithm. Simulations illustrate the accuracy of Bayesian state estimation for unobservable systems and demonstrate the benefit of employing a deep neural network. Comparing with pseudo-measurement techniques, direct Bayesian state estimation via deep learning neural network outperforms existing benchmarks. The second problem considered is to detect anomalies under unknown probability distributions. Whereas the probability distribution of the anomaly-free data is unknown, anomaly-free training samples are assumed to be available. For anomaly data, neither the underlying probability distribution is known nor anomaly data samples are available. A deep learning approach coupled with a statistical test based on coincidence is proposed where an inverse generative adversary network is trained to transform data to the classical uniform vs. nonuniform hypothesis testing problem. The proposed approach is particularly effective to detect persistent anomalies whose distributions have an overlapping domain with that of the anomaly-free distribution. The third problem considered is the detection of bad-data sequences in power system. The bad-data model is nonparametric that includes arbitrary natural and adversarial data anomalies. No historical samples of data anomaly are assumed. The probability distribution of data in anomaly-free system operations is also non-parametric, unknown, but with historical training samples. A uniformity test is proposed based on a generative adversarial network (GAN) that extracts independent components of the measurement sequence via independent component analysis (ICA). Referred to as ICA-GAN, the developed approach to bad-data sequence detection can be applied at the individual sensor level or jointly at the system level. Numerical results demonstrate significant improvement over the state-of-the-art solutions for a variety of bad-data cases using PMU measurements from the EPFL smart grid testbed and that from the synthetic North Texas grid.


Research Anthology on Smart Grid and Microgrid Development

Research Anthology on Smart Grid and Microgrid Development

Author: Information Resources Management Association

Publisher: Engineering Science Reference

Published: 2021-09-24

Total Pages:

ISBN-13: 9781668436660

DOWNLOAD EBOOK

"This reference book covers the latest innovations and trends within smart grid and microgrid development, detailing benefits, challenges, and opportunities, that will help readers to fully understand the current opportunities that smart grids and microgrids present around the world"--


Data Analytics for Smart Grids Applications—A Key to Smart City Development

Data Analytics for Smart Grids Applications—A Key to Smart City Development

Author: Devendra Kumar Sharma

Publisher: Springer Nature

Published: 2024-01-03

Total Pages: 466

ISBN-13: 3031460928

DOWNLOAD EBOOK

This book introduces big data analytics and corresponding applications in smart grids. The characterizations of big data, smart grids as well as a huge amount of data collection are first discussed as a prelude to illustrating the motivation and potential advantages of implementing advanced data analytics in smart grids. Basic concepts and the procedures of typical data analytics for general problems are also discussed. The advanced applications of different data analytics in smart grids are addressed as the main part of this book. By dealing with a huge amount of data from electricity networks, meteorological information system, geographical information system, etc., many benefits can be brought to the existing power system and improve customer service as well as social welfare in the era of big data. However, to advance the applications of big data analytics in real smart grids, many issues such as techniques, awareness, and synergies have to be overcome. This book provides deployment of semantic technologies in data analysis along with the latest applications across the field such as smart grids.