Implementing an IBM High-Performance Computing Solution on IBM Power System S822LC

Implementing an IBM High-Performance Computing Solution on IBM Power System S822LC

Author: Dino Quintero

Publisher: IBM Redbooks

Published: 2016-07-25

Total Pages: 340

ISBN-13: 0738441872

DOWNLOAD EBOOK

This IBM® Redbooks® publication demonstrates and documents that IBM Power SystemsTM high-performance computing and technical computing solutions deliver faster time to value with powerful solutions. Configurable into highly scalable Linux clusters, Power Systems offer extreme performance for demanding workloads such as genomics, finance, computational chemistry, oil and gas exploration, and high-performance data analytics. This book delivers a high-performance computing solution implemented on the IBM Power System S822LC. The solution delivers high application performance and throughput based on its built-for-big-data architecture that incorporates IBM POWER8® processors, tightly coupled Field Programmable Gate Arrays (FPGAs) and accelerators, and faster I/O by using Coherent Accelerator Processor Interface (CAPI). This solution is ideal for clients that need more processing power while simultaneously increasing workload density and reducing datacenter floor space requirements. The Power S822LC offers a modular design to scale from a single rack to hundreds, simplicity of ordering, and a strong innovation roadmap for graphics processing units (GPUs). This publication is targeted toward technical professionals (consultants, technical support staff, IT Architects, and IT Specialists) responsible for delivering cost effective high-performance computing (HPC) solutions that help uncover insights from their data so they can optimize business results, product development, and scientific discoveries


POWER8 High-performance Computing Guide IBM Power System S822LC (8335-GTB) Edition

POWER8 High-performance Computing Guide IBM Power System S822LC (8335-GTB) Edition

Author: Dino Quintero

Publisher: IBM Redbooks

Published: 2017-08-04

Total Pages: 400

ISBN-13: 0738442550

DOWNLOAD EBOOK

This IBM® Redbooks® publication documents and addresses topics to provide step-by-step customizable application and programming solutions to tune application and workloads to use IBM Power SystemsTM hardware architecture. This publication explores, tests, and documents the solution to use the architectural technologies and the software solutions that are available from IBM to help solve challenging technical and business problems. This publication also demonstrates and documents that the combination of IBM high-performance computing (HPC) solutions (hardware and software) delivers significant value to technical computing clients who are in need of cost-effective, highly scalable, and robust solutions. First, the book provides a high-level overview of the HPC solution, including all of the components that makes the HPC cluster: IBM Power System S822LC (8335-GTB), software components, interconnect switches, and the IBM SpectrumTM Scale parallel file system. Then, the publication is divided in three parts: Part 1 focuses on the developers, Part 2 focuses on the administrators, and Part 3 focuses on the evaluators and planners of the solution. The IBM Redbooks publication is targeted toward technical professionals (consultants, technical support staff, IT Architects, and IT Specialists) who are responsible for delivering cost-effective HPC solutions that help uncover insights from vast amounts of client's data so they can optimize business results, product development, and scientific discoveries.


IBM PowerVP: Introduction and Technical Overview

IBM PowerVP: Introduction and Technical Overview

Author: Scott Vetter

Publisher: IBM Redbooks

Published: 2015-08-14

Total Pages: 122

ISBN-13: 0738454362

DOWNLOAD EBOOK

This IBM® RedpaperTM publication is a comprehensive guide that covers IBM Power Virtualization Performance (PowerVPTM) for IBM Power SystemsTM Version 1.1.3. The objective of this paper is to introduce the features and benefits of PowerVP: Real-time monitoring Intuitive and customizable GUI Background data collection Multiple dynamic views Recording and replay Data stores Thresholds and alarms This publication is for professionals who are involved in performance and capacity planning, support, design, and deployment of IBM PowerVM® on IBM Power Systems. The intended audience includes the following roles: Clients Capacity planning managers Sales and marketing professionals IT Architects Technical support professionals IBM Business Partners independent software vendors This paper explains the current set of IBM PowerVP features and documents the installation and configuration. It includes real-life examples of use of PowerVM. It is intended to help you take advantage of the capabilities of IBM Power Systems and optimize the use of system resources.


IBM Power Systems SR-IOV: Technical Overview and Introduction

IBM Power Systems SR-IOV: Technical Overview and Introduction

Author: Scott Vetter

Publisher: IBM Redbooks

Published: 2017-01-12

Total Pages: 86

ISBN-13: 073845379X

DOWNLOAD EBOOK

This IBM® RedpaperTM publication describes the adapter-based virtualization capabilities that are being deployed in high-end IBM POWER7+TM processor-based servers. Peripheral Component Interconnect Express (PCIe) single root I/O virtualization (SR-IOV) is a virtualization technology on IBM Power Systems servers. SR-IOV allows multiple logical partitions (LPARs) to share a PCIe adapter with little or no run time involvement of a hypervisor or other virtualization intermediary. SR-IOV does not replace the existing virtualization capabilities that are offered as part of the IBM PowerVM® offerings. Rather, SR-IOV compliments them with additional capabilities. This paper describes many aspects of the SR-IOV technology, including: A comparison of SR-IOV with standard virtualization technology Overall benefits of SR-IOV Architectural overview of SR-IOV Planning requirements SR-IOV deployment models that use standard I/O virtualization Configuring the adapter for dedicated or shared modes Tips for maintaining and troubleshooting your system Scenarios for configuring your system This paper is directed to clients, IBM Business Partners, and system administrators who are involved with planning, deploying, configuring, and maintaining key virtualization technologies.


IBM PowerAI: Deep Learning Unleashed on IBM Power Systems Servers

IBM PowerAI: Deep Learning Unleashed on IBM Power Systems Servers

Author: Dino Quintero

Publisher: IBM Redbooks

Published: 2019-06-05

Total Pages: 278

ISBN-13: 0738442941

DOWNLOAD EBOOK

This IBM® Redbooks® publication is a guide about the IBM PowerAI Deep Learning solution. This book provides an introduction to artificial intelligence (AI) and deep learning (DL), IBM PowerAI, and components of IBM PowerAI, deploying IBM PowerAI, guidelines for working with data and creating models, an introduction to IBM SpectrumTM Conductor Deep Learning Impact (DLI), and case scenarios. IBM PowerAI started as a package of software distributions of many of the major DL software frameworks for model training, such as TensorFlow, Caffe, Torch, Theano, and the associated libraries, such as CUDA Deep Neural Network (cuDNN). The IBM PowerAI software is optimized for performance by using the IBM Power SystemsTM servers that are integrated with NVLink. The AI stack foundation starts with servers with accelerators. graphical processing unit (GPU) accelerators are well-suited for the compute-intensive nature of DL training, and servers with the highest CPU to GPU bandwidth, such as IBM Power Systems servers, enable the high-performance data transfer that is required for larger and more complex DL models. This publication targets technical readers, including developers, IT specialists, systems architects, brand specialist, sales team, and anyone looking for a guide about how to understand the IBM PowerAI Deep Learning architecture, framework configuration, application and workload configuration, and user infrastructure.


IBM High-Performance Computing Insights with IBM Power System AC922 Clustered Solution

IBM High-Performance Computing Insights with IBM Power System AC922 Clustered Solution

Author: Dino Quintero

Publisher: IBM Redbooks

Published: 2019-05-02

Total Pages: 352

ISBN-13: 0738457450

DOWNLOAD EBOOK

This IBM® Redbooks® publication documents and addresses topics to set up a complete infrastructure environment and tune the applications to use an IBM POWER9TM hardware architecture with the technical computing software stack. This publication is driven by a CORAL project solution. It explores, tests, and documents how to implement an IBM High-Performance Computing (HPC) solution on a POWER9 processor-based system by using IBM technical innovations to help solve challenging scientific, technical, and business problems. This book documents the HPC clustering solution with InfiniBand on IBM Power SystemsTM AC922 8335-GTH and 8335-GTX servers with NVIDIA Tesla V100 SXM2 graphics processing units (GPUs) with NVLink, software components, and the IBM SpectrumTM Scale parallel file system. This solution includes recommendations about the components that are used to provide a cohesive clustering environment that includes job scheduling, parallel application tools, scalable file systems, administration tools, and a high-speed interconnect. This book is divided into three parts: Part 1 focuses on the planners of the solution, Part 2 focuses on the administrators, and Part 3 focuses on the developers. This book targets technical professionals (consultants, technical support staff, IT architects, and IT specialists) who are responsible for delivering cost-effective HPC solutions that help uncover insights among clients' data so that they can act to optimize business results, product development, and scientific discoveries.


IBM Power System S822LC for High Performance Computing Introduction and Technical Overview

IBM Power System S822LC for High Performance Computing Introduction and Technical Overview

Author: Scott Vetter

Publisher: IBM Redbooks

Published: 2017-09-28

Total Pages: 82

ISBN-13: 073845561X

DOWNLOAD EBOOK

This IBM® RedpaperTM publication is a comprehensive guide that covers the IBM Power SystemTM S822LC for High Performance Computing (HPC) server (8335-GTB model). The S822LC for HPC server is designed for high-performance computing applications that support the Linux operating system and high-performance data analytics, the enterprise data center, and accelerated cloud deployments. This paper introduces the major innovative S822LC for HPC server features and their relevant functions: Powerful IBM POWER8® processors that offer 16 cores at 3.259 GHz with 3.857 GHz turbo performance or 20 cores at 2.860 GHz with 3.492 GHz turbo A 19-inch rack-mount 2U configuration NVIDIA NVLink technology for exceptional processor-to-accelerator intercommunication Four dedicated connectors for the NVIDIA Tesla P100 GPU This publication is for professionals who want to acquire a better understanding of IBM Power Systems products and is intended for the following audience: Clients Sales and marketing professionals Technical support professionals IBM Business Partners Independent software vendors This paper expands the set of IBM Power Systems documentation by providing a desktop reference that offers a detailed technical description of the S822LC for HPC server. This paper does not replace the latest marketing materials and configuration tools. It is intended as an additional source of information that, together with existing sources, can be used to enhance your knowledge of IBM server solutions.


AI and Big Data on IBM Power Systems Servers

AI and Big Data on IBM Power Systems Servers

Author: Scott Vetter

Publisher: IBM Redbooks

Published: 2019-04-10

Total Pages: 162

ISBN-13: 0738457515

DOWNLOAD EBOOK

As big data becomes more ubiquitous, businesses are wondering how they can best leverage it to gain insight into their most important business questions. Using machine learning (ML) and deep learning (DL) in big data environments can identify historical patterns and build artificial intelligence (AI) models that can help businesses to improve customer experience, add services and offerings, identify new revenue streams or lines of business (LOBs), and optimize business or manufacturing operations. The power of AI for predictive analytics is being harnessed across all industries, so it is important that businesses familiarize themselves with all of the tools and techniques that are available for integration with their data lake environments. In this IBM® Redbooks® publication, we cover the best practices for deploying and integrating some of the best AI solutions on the market, including: IBM Watson Machine Learning Accelerator (see note for product naming) IBM Watson Studio Local IBM Power SystemsTM IBM SpectrumTM Scale IBM Data Science Experience (IBM DSX) IBM Elastic StorageTM Server Hortonworks Data Platform (HDP) Hortonworks DataFlow (HDF) H2O Driverless AI We map out all the integrations that are possible with our different AI solutions and how they can integrate with your existing or new data lake. We also walk you through some of our client use cases and show you how some of the industry leaders are using Hortonworks, IBM PowerAI, and IBM Watson Studio Local to drive decision making. We also advise you on your deployment options, when to use a GPU, and why you should use the IBM Elastic Storage Server (IBM ESS) to improve storage management. Lastly, we describe how to integrate IBM Watson Machine Learning Accelerator and Hortonworks with or without IBM Watson Studio Local, how to access real-time data, and security. Note: IBM Watson Machine Learning Accelerator is the new product name for IBM PowerAI Enterprise. Note: Hortonworks merged with Cloudera in January 2019. The new company is called Cloudera. References to Hortonworks as a business entity in this publication are now referring to the merged company. Product names beginning with Hortonworks continue to be marketed and sold under their original names.


Networking Design for HPC and AI on IBM Power Systems

Networking Design for HPC and AI on IBM Power Systems

Author: Scott Vetter

Publisher: IBM Redbooks

Published: 2018-04-26

Total Pages: 62

ISBN-13: 0738456837

DOWNLOAD EBOOK

This publication provides information about networking design for IBM® High Performance Computing (HPC) and AI for Power SystemsTM. This paper will help you understand the basic requirements when designing a solution, the components in an infrastructure for HPC and AI Systems, the designing of interconnect and data networks with use cases based in real life scenarios, the administration and the Out-Of-Band management networks. We cover all the necessary requirements, provide a good understanding of the technology and include examples for small, medium and large cluster environments. This paper is intended for IT architects, system designers, data center planners, and system administrators who must design or provide a solution for the infrastructure of a HPC cluster.


IBM Power System E950: Technical Overview and Introduction

IBM Power System E950: Technical Overview and Introduction

Author: Scott Vetter

Publisher: IBM Redbooks

Published: 2019-12-09

Total Pages: 180

ISBN-13: 0738457094

DOWNLOAD EBOOK

This IBM® RedpaperTM publication gives a broad understanding of a new architecture of the IBM Power System E950 (9040-MR9) server that supports IBM AIX®, and Linux operating systems. The objective of this paper is to introduce the major innovative Power E950 offerings and relevant functions: The IBM POWER9TM processor, which is available at frequencies of 2.8 - 3.4 GHz. Significantly strengthened cores and larger caches. Supports up to 16 TB of memory, which is four times more than the IBM POWER8® processor-based IBM Power System E850 server. Integrated I/O subsystem and hot-pluggable Peripheral Component Interconnect Express (PCIe) Gen4 slots, which have double the bandwidth of Gen3 I/O slots. Supports EXP12SX and ESP24SX external disk drawers, which have 12 Gb Serial Attached SCSI (SAS) interfaces and support Active Optical Cables (AOCs) for greater distances and less cable bulk. New IBM EnergyScaleTM technology offers new variable processor frequency modes that provide a significant performance boost beyond the static nominal frequency. This publication is for professionals who want to acquire a better understanding of IBM Power SystemsTM products. The intended audience includes the following roles: Clients Sales and marketing professionals Technical support professionals IBM Business Partners Independent software vendors (ISVs) This paper expands the current set of Power Systems documentation by providing a desktop reference that offers a detailed technical description of the Power E950 server. This paper does not replace the current marketing materials and configuration tools. It is intended as an extra source of information that, together with existing sources, can be used to enhance your knowledge of IBM server solutions.