Automatic Performance Prediction of Parallel Programs

Automatic Performance Prediction of Parallel Programs

Author: Thomas Fahringer

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 279

ISBN-13: 1461313716

DOWNLOAD EBOOK

Automatic Performance Prediction of Parallel Programs presents a unified approach to the problem of automatically estimating the performance of parallel computer programs. The author focuses primarily on distributed memory multiprocessor systems, although large portions of the analysis can be applied to shared memory architectures as well. The author introduces a novel and very practical approach for predicting some of the most important performance parameters of parallel programs, including work distribution, number of transfers, amount of data transferred, network contention, transfer time, computation time and number of cache misses. This approach is based on advanced compiler analysis that carefully examines loop iteration spaces, procedure calls, array subscript expressions, communication patterns, data distributions and optimizing code transformations at the program level; and the most important machine specific parameters including cache characteristics, communication network indices, and benchmark data for computational operations at the machine level. The material has been fully implemented as part of P3T, which is an integrated automatic performance estimator of the Vienna Fortran Compilation System (VFCS), a state-of-the-art parallelizing compiler for Fortran77, Vienna Fortran and a subset of High Performance Fortran (HPF) programs. A large number of experiments using realistic HPF and Vienna Fortran code examples demonstrate highly accurate performance estimates, and the ability of the described performance prediction approach to successfully guide both programmer and compiler in parallelizing and optimizing parallel programs. A graphical user interface is described and displayed that visualizes each program source line together with the corresponding parameter values. P3T uses color-coded performance visualization to immediately identify hot spots in the parallel program. Performance data can be filtered and displayed at various levels of detail. Colors displayed by the graphical user interface are visualized in greyscale. Automatic Performance Prediction of Parallel Programs also includes coverage of fundamental problems of automatic parallelization for distributed memory multicomputers, a description of the basic parallelization strategy and a large variety of optimizing code transformations as included under VFCS.


Performance Evaluation, Prediction and Visualization of Parallel Systems

Performance Evaluation, Prediction and Visualization of Parallel Systems

Author: Xingfu Wu

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 336

ISBN-13: 1461551471

DOWNLOAD EBOOK

Performance Evaluation, Prediction and Visualization in Parallel Systems presents a comprehensive and systematic discussion of theoretics, methods, techniques and tools for performance evaluation, prediction and visualization of parallel systems. Chapter 1 gives a short overview of performance degradation of parallel systems, and presents a general discussion on the importance of performance evaluation, prediction and visualization of parallel systems. Chapter 2 analyzes and defines several kinds of serial and parallel runtime, points out some of the weaknesses of parallel speedup metrics, and discusses how to improve and generalize them. Chapter 3 describes formal definitions of scalability, addresses the basic metrics affecting the scalability of parallel systems, discusses scalability of parallel systems from three aspects: parallel architecture, parallel algorithm and parallel algorithm-architecture combinations, and analyzes the relations of scalability and speedup. Chapter 4 discusses the methodology of performance measurement, describes the benchmark- oriented performance test and analysis and how to measure speedup and scalability in practice. Chapter 5 analyzes the difficulties in performance prediction, discusses application-oriented and architecture-oriented performance prediction and how to predict speedup and scalability in practice. Chapter 6 discusses performance visualization techniques and tools for parallel systems from three stages: performance data collection, performance data filtering and performance data visualization, and classifies the existing performance visualization tools. Chapter 7 describes parallel compiling-based, search-based and knowledge-based performance debugging, which assists programmers to optimize the strategy or algorithm in their parallel programs, and presents visual programming-based performance debugging to help programmers identify the location and cause of the performance problem. It also provides concrete suggestions on how to modify their parallel program to improve the performance. Chapter 8 gives an overview of current interconnection networks for parallel systems, analyzes the scalability of interconnection networks, and discusses how to measure and improve network performances. Performance Evaluation, Prediction and Visualization in Parallel Systems serves as an excellent reference for researchers, and may be used as a text for advanced courses on the topic.


Quantitative Evaluation of Computing and Communication Systems

Quantitative Evaluation of Computing and Communication Systems

Author: Heinz Beilner

Publisher: Springer Science & Business Media

Published: 1995-09-13

Total Pages: 434

ISBN-13: 9783540603009

DOWNLOAD EBOOK

This book constitutes the proceedings of the 8th International Conference on Modelling Techniques and Tools for Computer Performance Evaluation (Performance Tools '95) and of the 8th GI/ITG Conference on Measuring, Modelling and Evaluating Computing and Communication Systems, MMB '95, held jointly in Heidelberg, Germany in September 1995. The volume presents 26 full refereed papers selected from a total of 86 submissions, together with two invited contributions. The scope of the papers includes measurement- and model-based approaches for quantitative systems assessment, reports on theoretical and methodological progress, and novel and improved assessment techniques and their tool implementations and applications.


Euro-Par 2005 Parallel Processing

Euro-Par 2005 Parallel Processing

Author: José C. Cunha

Publisher: Springer

Published: 2005-08-25

Total Pages: 1311

ISBN-13: 3540319255

DOWNLOAD EBOOK

Euro-Par 2005 was the eleventh conference in the Euro-Par series. It was organized by the Centre for Informatics and Information Technology (CITI) and the Department of Informatics of the Faculty of Science and Technology of Universidade Nova de Lisboa, at the Campus of Monte de Caparica.


Supercomputing Research Advances

Supercomputing Research Advances

Author: Yongge Huáng

Publisher: Nova Publishers

Published: 2008

Total Pages: 448

ISBN-13: 9781604561869

DOWNLOAD EBOOK

Supercomputers are used for highly calculation-intensive tasks such as problems involving quantum mechanical physics, weather forecasting, climate research (including research into global warming), molecular modelling (computing the structures and properties of chemical compounds, biological macromolecules, polymers, and crystals), physical simulations (such as simulation of aeroplanes in wind tunnels, simulation of the detonation of nuclear weapons, and research into nuclear fusion), cryptanalysis, and the like. Major universities, military agencies and scientific research laboratories are heavy users. This book presents the latest research in the field from around the world.


Parallel Program Development for Cluster Computing

Parallel Program Development for Cluster Computing

Author: José Cardoso Cunha

Publisher: Nova Publishers

Published: 2001

Total Pages: 402

ISBN-13: 9781560728658

DOWNLOAD EBOOK

The book is divided into two parts, the first one covering the concepts and methodologies, and the second describing the tools and integrated environments that were developed in those projects. In this way, we hope that the reader will find the book useful not only concerning an identification of current trends in parallel program development, but also concerning their practical illustration through concrete tools and environments.


Programming Environments for Massively Parallel Distributed Systems

Programming Environments for Massively Parallel Distributed Systems

Author: Karsten M. Decker

Publisher: Birkhäuser

Published: 2013-04-17

Total Pages: 417

ISBN-13: 3034885342

DOWNLOAD EBOOK

Massively Parallel Systems (MPSs) with their scalable computation and storage space promises are becoming increasingly important for high-performance computing. The growing acceptance of MPSs in academia is clearly apparent. However, in industrial companies, their usage remains low. The programming of MPSs is still the big obstacle, and solving this software problem is sometimes referred to as one of the most challenging tasks of the 1990's. The 1994 working conference on "Programming Environments for Massively Parallel Systems" was the latest event of the working group WG 10.3 of the International Federation for Information Processing (IFIP) in this field. It succeeded the 1992 conference in Edinburgh on "Programming Environments for Parallel Computing". The research and development work discussed at the conference addresses the entire spectrum of software problems including virtual machines which are less cumbersome to program; more convenient programming models; advanced programming languages, and especially more sophisticated programming tools; but also algorithms and applications.


Recent Advances in Parallel Virtual Machine and Message Passing Interface

Recent Advances in Parallel Virtual Machine and Message Passing Interface

Author: Dieter Kranzlmüller

Publisher: Springer Science & Business Media

Published: 2004-09-10

Total Pages: 464

ISBN-13: 3540231633

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 11th European PVM/MPI users' Group Meeting held in Budapest, Hungary, in September 2004. The 50 revised papers presented together with abstracts of 10 invited contributions were carefully reviewed and selected from numerous submissions. The papers are organized in topical sections on MPI/PVM extensions and improvements, algorithms, applications, tools and environments, cluster and grid computing, performance, and parallel numerical simulation.


Euro-Par 2015: Parallel Processing

Euro-Par 2015: Parallel Processing

Author: Jesper Larsson Träff

Publisher: Springer

Published: 2015-07-24

Total Pages: 717

ISBN-13: 3662480964

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 21st International Conference on Parallel and Distributed Computing, Euro-Par 2015, held in Vienna, Austria, in August 2015. The 51 revised full papers presented together with 2 invited papers were carefully reviewed and selected from 190 submissions. The papers are organized in the following topical sections: support tools and environments; performance modeling, prediction and evaluation; scheduling and load balancing; architecture and compilers; parallel and distributed data management; grid, cluster and cloud computing; distributed systems and algorithms; parallel and distributed programming, interfaces and languages; multi- and many-core programming; theory and algorithms for parallel computation; numerical methods and applications; and accelerator computing.