Automatic Performance Prediction of Parallel Programs

Automatic Performance Prediction of Parallel Programs

Author: Thomas Fahringer

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 279

ISBN-13: 1461313716

DOWNLOAD EBOOK

Automatic Performance Prediction of Parallel Programs presents a unified approach to the problem of automatically estimating the performance of parallel computer programs. The author focuses primarily on distributed memory multiprocessor systems, although large portions of the analysis can be applied to shared memory architectures as well. The author introduces a novel and very practical approach for predicting some of the most important performance parameters of parallel programs, including work distribution, number of transfers, amount of data transferred, network contention, transfer time, computation time and number of cache misses. This approach is based on advanced compiler analysis that carefully examines loop iteration spaces, procedure calls, array subscript expressions, communication patterns, data distributions and optimizing code transformations at the program level; and the most important machine specific parameters including cache characteristics, communication network indices, and benchmark data for computational operations at the machine level. The material has been fully implemented as part of P3T, which is an integrated automatic performance estimator of the Vienna Fortran Compilation System (VFCS), a state-of-the-art parallelizing compiler for Fortran77, Vienna Fortran and a subset of High Performance Fortran (HPF) programs. A large number of experiments using realistic HPF and Vienna Fortran code examples demonstrate highly accurate performance estimates, and the ability of the described performance prediction approach to successfully guide both programmer and compiler in parallelizing and optimizing parallel programs. A graphical user interface is described and displayed that visualizes each program source line together with the corresponding parameter values. P3T uses color-coded performance visualization to immediately identify hot spots in the parallel program. Performance data can be filtered and displayed at various levels of detail. Colors displayed by the graphical user interface are visualized in greyscale. Automatic Performance Prediction of Parallel Programs also includes coverage of fundamental problems of automatic parallelization for distributed memory multicomputers, a description of the basic parallelization strategy and a large variety of optimizing code transformations as included under VFCS.


Performance Evaluation, Prediction and Visualization of Parallel Systems

Performance Evaluation, Prediction and Visualization of Parallel Systems

Author: Xingfu Wu

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 336

ISBN-13: 1461551471

DOWNLOAD EBOOK

Performance Evaluation, Prediction and Visualization in Parallel Systems presents a comprehensive and systematic discussion of theoretics, methods, techniques and tools for performance evaluation, prediction and visualization of parallel systems. Chapter 1 gives a short overview of performance degradation of parallel systems, and presents a general discussion on the importance of performance evaluation, prediction and visualization of parallel systems. Chapter 2 analyzes and defines several kinds of serial and parallel runtime, points out some of the weaknesses of parallel speedup metrics, and discusses how to improve and generalize them. Chapter 3 describes formal definitions of scalability, addresses the basic metrics affecting the scalability of parallel systems, discusses scalability of parallel systems from three aspects: parallel architecture, parallel algorithm and parallel algorithm-architecture combinations, and analyzes the relations of scalability and speedup. Chapter 4 discusses the methodology of performance measurement, describes the benchmark- oriented performance test and analysis and how to measure speedup and scalability in practice. Chapter 5 analyzes the difficulties in performance prediction, discusses application-oriented and architecture-oriented performance prediction and how to predict speedup and scalability in practice. Chapter 6 discusses performance visualization techniques and tools for parallel systems from three stages: performance data collection, performance data filtering and performance data visualization, and classifies the existing performance visualization tools. Chapter 7 describes parallel compiling-based, search-based and knowledge-based performance debugging, which assists programmers to optimize the strategy or algorithm in their parallel programs, and presents visual programming-based performance debugging to help programmers identify the location and cause of the performance problem. It also provides concrete suggestions on how to modify their parallel program to improve the performance. Chapter 8 gives an overview of current interconnection networks for parallel systems, analyzes the scalability of interconnection networks, and discusses how to measure and improve network performances. Performance Evaluation, Prediction and Visualization in Parallel Systems serves as an excellent reference for researchers, and may be used as a text for advanced courses on the topic.


Author:

Publisher: IOS Press

Published:

Total Pages: 4947

ISBN-13:

DOWNLOAD EBOOK


Parallel Programming and Applications

Parallel Programming and Applications

Author: Peter Fritzson

Publisher: IOS Press

Published: 1995

Total Pages: 450

ISBN-13: 9789051992298

DOWNLOAD EBOOK

ZEUS (Centres of European Supercomputing) is a network for information exchange and co-operation between European Supercomputer Centres. During the fall of 1994 the idea was put forward to start an annual workshop to stimulate the exchange of ideas and experience in parallel programming and computing between researchers and users from industry and academia. The first workshop in this series, the ZEUS '95 Workshop on Parallel Programming and Computation, is organized at Linkoping University, where the Swedish ZEUS centre, NSC (National Supercomputer Centre) is located. This is open for all researchers and users in the field of parallel computing.


Performance Analysis of Parallel Applications for HPC

Performance Analysis of Parallel Applications for HPC

Author: Jidong Zhai

Publisher: Springer Nature

Published: 2023-09-09

Total Pages: 259

ISBN-13: 9819943663

DOWNLOAD EBOOK

This book presents a hybrid static-dynamic approach for efficient performance analysis of parallel applications on HPC systems. Performance analysis is essential to finding performance bottlenecks and understanding the performance behaviors of parallel applications on HPC systems. However, current performance analysis techniques usually incur significant overhead. Our book introduces a series of approaches for lightweight performance analysis. We combine static and dynamic analysis to reduce the overhead of performance analysis. Based on this hybrid static-dynamic approach, we then propose several innovative techniques for various performance analysis scenarios, including communication analysis, memory analysis, noise analysis, computation analysis, and scalability analysis. Through these specific performance analysis techniques, we convey to readers the idea of using static analysis to support dynamic analysis. To gain the most from the book, readers should have a basic grasp of parallel computing, computer architecture, and compilation techniques.


Advances in Parallel Computing Technologies and Applications

Advances in Parallel Computing Technologies and Applications

Author: D.J. Hemanth

Publisher: IOS Press

Published: 2021-11-25

Total Pages: 450

ISBN-13: 1643682199

DOWNLOAD EBOOK

Recent developments in parallel computing mean that the use of machine learning techniques and intelligence to handle the huge volume of available data have brought the faster solutions offered by advanced technologies to various fields of application. This book presents the proceedings of the Virtual International Conference on Advances in Parallel Computing Technologies and Applications (ICAPTA 2021), hosted in Justice Basheer Ahmed Sayeed College for women (formerly "S.I.E.T Women's College"), Chennai, India, and held online as a virtual event on 15 and 16 April 2021. The aim of the conference was to provide a forum for sharing knowledge in various aspects of parallel computing in communications systems and networking, including cloud and virtualization solutions, management technologies, and vertical application areas. It also provided a platform for scientists, researchers, practitioners and academicians to present and discuss the most recent innovations and trends, as well as the concerns and practical challenges encountered in this field. Included here are 52 full length papers, selected from over 100 submissions based on the reviews and comments of subject experts. Topics covered include parallel computing in communication, machine learning intelligence for parallel computing and parallel computing for software services in theoretical and practical aspects. Providing an overview of the latest developments in the field, the book will be of interest to all those whose work involves the use of parallel computing technologies.


Massively Parallel Processing Applications and Development

Massively Parallel Processing Applications and Development

Author: L. Dekker

Publisher: Elsevier

Published: 2013-10-22

Total Pages: 996

ISBN-13: 1483290433

DOWNLOAD EBOOK

The contributions of a diverse selection of international hardware and software specialists are assimilated in this book's exploration of the development of massively parallel processing (MPP). The emphasis is placed on industrial applications and collaboration with users and suppliers from within the industrial community consolidates the scope of the publication. From a practical point of view, massively parallel data processing is a vital step to further innovation in all areas where large amounts of data must be processed in parallel or in a distributed manner, e.g. fluid dynamics, meteorology, seismics, molecular engineering, image processing, parallel data base processing. MPP technology can make the speed of computation higher and substantially reduce the computational costs. However, to achieve these features, the MPP software has to be developed further to create user-friendly programming systems and to become transparent for present-day computer software. Application of novel electro-optic components and devices is continuing and will be a key for much more general and powerful architectures. Vanishing of communication hardware limitations will result in the elimination of programming bottlenecks in parallel data processing. Standardization of the functional characteristics of a programming model of massively parallel computers will become established. Then efficient programming environments can be developed. The result will be a widespread use of massively parallel processing systems in many areas of application.


Parallel Programming, Models and Applications in Grid and P2P Systems

Parallel Programming, Models and Applications in Grid and P2P Systems

Author: Fatos Xhafa

Publisher: IOS Press

Published: 2009

Total Pages: 364

ISBN-13: 1607500043

DOWNLOAD EBOOK

Presents advances for grid and P2P paradigms, middleware, programming models, communication libraries, as well as their application to the resolution of real-life problems. This book is suitable for academics, scientists, software developers and engineers interested in the grid and P2P paradigms.


Advanced Parallel Processing Technologies

Advanced Parallel Processing Technologies

Author: Yong Dou

Publisher: Springer Science & Business Media

Published: 2009-08-06

Total Pages: 489

ISBN-13: 3642036430

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 8th International Workshop on Advanced Parallel Processing Technologies, APPT 2009, held in Rapperswil, Switzerland, in August 2009. The 36 revised full papers presented were carefully reviewed and selected from 76 submissions. All current aspects in parallel and distributed computing are addressed ranging from hardware and software issues to algorithmic aspects and advanced applications. The papers are organized in topical sections on architecture, graphical processing unit, grid, grid scheduling, mobile application, parallel application, parallel libraries and performance.