InfoSphere DataStage Parallel Framework Standard Practices
InfoSphere DataStage Parallel Framework Standard Practices

Author: Julius Lerm

Publisher: IBM Redbooks

Published: 2013-02-12

Total Pages: 458

ISBN-13: 0738434477

DOWNLOAD EBOOK

In this IBM® Redbooks® publication, we present guidelines for the development of highly efficient and scalable information integration applications with InfoSphereTM DataStage® (DS) parallel jobs. InfoSphere DataStage is at the core of IBM Information Server, providing components that yield a high degree of freedom. For any particular problem there might be multiple solutions, which tend to be influenced by personal preferences, background, and previous experience. All too often, those solutions yield less than optimal, and non-scalable, implementations. This book includes a comprehensive detailed description of the components available, and descriptions on how to use them to obtain scalable and efficient solutions, for both batch and real-time scenarios. The advice provided in this document is the result of the combined proven experience from a number of expert practitioners in the field of high performance information integration, evolved over several years. This book is intended for IT architects, Information Management specialists, and Information Integration specialists responsible for delivering cost-effective IBM InfoSphere DataStage performance on all platforms.

InfoSphere DataStage for Enterprise XML Data Integration
InfoSphere DataStage for Enterprise XML Data Integration

Author: Chuck Ballard

Publisher: IBM Redbooks

Published: 2012-05-23

Total Pages: 404

ISBN-13: 0738436720

DOWNLOAD EBOOK

XML is one of the most common standards for the exchange of information. However, organizations find challenges in how to address the complexities of dealing with hierarchical data types, particularly as they scale to gigabytes and beyond. In this IBM® Redbooks® publication, we discuss and describe the new capabilities in IBM InfoSphere® DataStage® 8.5. These capabilities enable developers to more easily manage the design and processing requirements presented by the most challenging XML sources. Developers can use these capabilities to create powerful hierarchical transformations and to parse and compose XML data with high performance and scalability. Spanning both batch and real-time run times, these capabilities can be used to solve a broad range of business requirements. As part of the IBM InfoSphere Information Server 8.5 release, InfoSphere DataStage was enhanced with new hierarchical transformation capabilities called . XML Stage provides native XML schema support and powerful XML transformation functionality. These capabilities are based on a unique state-of-the-art technology that allows you to parse and compose any complex XML structure from and to a relational form, as well as to a separate hierarchical form. This book is targeted at an audience of systems designers and developers who focus on implementing XML integration support in their environments.

Metadata Management with IBM InfoSphere Information Server
Metadata Management with IBM InfoSphere Information Server

Author: Wei-Dong Zhu

Publisher: IBM Redbooks

Published: 2011-10-18

Total Pages: 458

ISBN-13: 0738435996

DOWNLOAD EBOOK

What do you know about your data? And how do you know what you know about your data? Information governance initiatives address corporate concerns about the quality and reliability of information in planning and decision-making processes. Metadata management refers to the tools, processes, and environment that are provided so that organizations can reliably and easily share, locate, and retrieve information from these systems. Enterprise-wide information integration projects integrate data from these systems to one location to generate required reports and analysis. During this type of implementation process, metadata management must be provided along each step to ensure that the final reports and analysis are from the right data sources, are complete, and have quality. This IBM® Redbooks® publication introduces the information governance initiative and highlights the immediate needs for metadata management. It explains how IBM InfoSphereTM Information Server provides a single unified platform and a collection of product modules and components so that organizations can understand, cleanse, transform, and deliver trustworthy and context-rich information. It describes a typical implementation process. It explains how InfoSphere Information Server provides the functions that are required to implement such a solution and, more importantly, to achieve metadata management. This book is for business leaders and IT architects with an overview of metadata management in information integration solution space. It also provides key technical details that IT professionals can use in a solution planning, design, and implementation process.

Smarter Business: Dynamic Information with IBM InfoSphere Data Replication CDC
Smarter Business: Dynamic Information with IBM InfoSphere Data Replication CDC

Author: Chuck Ballard

Publisher: IBM Redbooks

Published: 2012-03-12

Total Pages: 484

ISBN-13: 0738436372

DOWNLOAD EBOOK

To make better informed business decisions, better serve clients, and increase operational efficiencies, you must be aware of changes to key data as they occur. In addition, you must enable the immediate delivery of this information to the people and processes that need to act upon it. This ability to sense and respond to data changes is fundamental to dynamic warehousing, master data management, and many other key initiatives. A major challenge in providing this type of environment is determining how to tie all the independent systems together and process the immense data flow requirements. IBM® InfoSphere® Change Data Capture (InfoSphere CDC) can respond to that challenge, providing programming-free data integration, and eliminating redundant data transfer, to minimize the impact on production systems. In this IBM Redbooks® publication, we show you examples of how InfoSphere CDC can be used to implement integrated systems, to keep those systems updated immediately as changes occur, and to use your existing infrastructure and scale up as your workload grows. InfoSphere CDC can also enhance your investment in other software, such as IBM DataStage® and IBM QualityStage®, IBM InfoSphere Warehouse, and IBM InfoSphere Master Data Management Server, enabling real-time and event-driven processes. Enable the integration of your critical data and make it immediately available as your business needs it.

IBM InfoSphere Information Server Deployment Architectures
IBM InfoSphere Information Server Deployment Architectures

Author: Chuck Ballard

Publisher: IBM Redbooks

Published: 2013-01-17

Total Pages: 254

ISBN-13: 073843728X

DOWNLOAD EBOOK

Typical deployment architectures introduce challenges to fully using the shared metadata platform across products, environments, and servers. Data privacy and information security requirements add even more levels of complexity. IBM® InfoSphere® Information Server provides a comprehensive, metadata-driven platform for delivering trusted information across heterogeneous systems. This IBM Redbooks® publication presents guidelines and criteria for the successful deployment of InfoSphere Information Server components in typical logical infrastructure topologies that use shared metadata capabilities of the platform, and support development lifecycle, data privacy, information security, high availability, and performance requirements. This book can help you evaluate information requirements to determine an appropriate deployment architecture, based on guidelines that are presented here, and that can fulfill specific use cases. It can also help you effectively use the functionality of your Information Server product modules and components to successfully achieve your business goals. This book is for IT architects, information management and integration specialists, and system administrators who are responsible for delivering the full suite of information integration capabilities of InfoSphere Information Server.

IBM InfoSphere Streams: Accelerating Deployments with Analytic Accelerators
IBM InfoSphere Streams: Accelerating Deployments with Analytic Accelerators

Author: Chuck Ballard

Publisher: IBM Redbooks

Published: 2014-02-07

Total Pages: 556

ISBN-13: 0738439193

DOWNLOAD EBOOK

This IBM® Redbooks® publication describes visual development, visualization, adapters, analytics, and accelerators for IBM InfoSphere® Streams (V3), a key component of the IBM Big Data platform. Streams was designed to analyze data in motion, and can perform analysis on incredibly high volumes with high velocity, using a wide variety of analytic functions and data types. The Visual Development environment extends Streams Studio with drag-and-drop development, provides round tripping with existing text editors, and is ideal for rapid prototyping. Adapters facilitate getting data in and out of Streams, and V3 supports WebSphere MQ, Apache Hadoop Distributed File System, and IBM InfoSphere DataStage. Significant analytics include the native Streams Processing Language, SPSS Modeler analytics, Complex Event Processing, TimeSeries Toolkit for machine learning and predictive analytics, Geospatial Toolkit for location-based applications, and Annotation Query Language for natural language processing applications. Accelerators for Social Media Analysis and Telecommunications Event Data Analysis sample programs can be modified to build production level applications. Want to learn how to analyze high volumes of streaming data or implement systems requiring high performance across nodes in a cluster? Then this book is for you.

Addressing Data Volume, Velocity, and Variety with IBM InfoSphere Streams V3.0
Addressing Data Volume, Velocity, and Variety with IBM InfoSphere Streams V3.0

Author: Mike Ebbers

Publisher: IBM Redbooks

Published: 2013-03-12

Total Pages: 326

ISBN-13: 0738437808

DOWNLOAD EBOOK

There are multiple uses for big data in every industry—from analyzing larger volumes of data than was previously possible to driving more precise answers, to analyzing data at rest and data in motion to capture opportunities that were previously lost. A big data platform will enable your organization to tackle complex problems that previously could not be solved using traditional infrastructure. As the amount of data available to enterprises and other organizations dramatically increases, more and more companies are looking to turn this data into actionable information and intelligence in real time. Addressing these requirements requires applications that are able to analyze potentially enormous volumes and varieties of continuous data streams to provide decision makers with critical information almost instantaneously. IBM® InfoSphere® Streams provides a development platform and runtime environment where you can develop applications that ingest, filter, analyze, and correlate potentially massive volumes of continuous data streams based on defined, proven, and analytical rules that alert you to take appropriate action, all within an appropriate time frame for your organization. This IBM Redbooks® publication is written for decision-makers, consultants, IT architects, and IT professionals who will be implementing a solution with IBM InfoSphere Streams.

IBM Information Server: Integration and Governance for Emerging Data Warehouse Demands
IBM Information Server: Integration and Governance for Emerging Data Warehouse Demands

Author: Chuck Ballard

Publisher: IBM Redbooks

Published: 2013-07-10

Total Pages: 194

ISBN-13: 0738438499

DOWNLOAD EBOOK

This IBM® Redbooks® publication is intended for business leaders and IT architects who are responsible for building and extending their data warehouse and Business Intelligence infrastructure. It provides an overview of powerful new capabilities of Information Server in the areas of big data, statistical models, data governance and data quality. The book also provides key technical details that IT professionals can use in solution planning, design, and implementation.

Batch Modernization on z/OS
Batch Modernization on z/OS

Author: Mike Ebbers

Publisher: IBM Redbooks

Published: 2012-07-26

Total Pages: 488

ISBN-13: 0738436968

DOWNLOAD EBOOK

Mainframe computers play a central role in the daily operations of many of the world's largest corporations, and batch processing is a fundamental part of the workloads that run on the mainframe. A large portion of the workload on IBM® z/OS® systems is processed in batch mode. Although several IBM Redbooks® publications discuss application modernization on the IBM z/OS platform, this book specifically addresses batch processing in detail. Many different technologies are available in a batch environment on z/OS systems. This book demonstrates these technologies and shows how the z/OS system offers a sophisticated environment for batch. In this practical book, we discuss a variety of themes that are of importance for batch workloads on z/OS systems and offer examples that you can try on your own system. The audience for this book includes IT architects and application developers, with a focus on batch processing on the z/OS platform.

Hybrid Analytics Solution using IBM DB2 Analytics Accelerator for z/OS V3.1
Hybrid Analytics Solution using IBM DB2 Analytics Accelerator for z/OS V3.1

Author: Paolo Bruni

Publisher: IBM Redbooks

Published: 2013-09-27

Total Pages: 382

ISBN-13: 0738438790

DOWNLOAD EBOOK

The IBM® DB2® Analytics Accelerator Version 3.1 for IBM z/OS® (simply called Accelerator in this book) is a union of the IBM System z® quality of service and IBM Netezza® technology to accelerate complex queries in a DB2 for z/OS highly secure and available environment. Superior performance and scalability with rapid appliance deployment provide an ideal solution for complex analysis. In this IBM Redbooks® publication, we provide technical decision-makers with a broad understanding of the benefits of Version 3.1 of the Accelerator's major new functions. We describe their installation and the advantages to existing analytical processes as measured in our test environment. We also describe the IBM zEnterprise® Analytics System 9700, a hybrid System z solution offering that is surrounded by a complete set of optional packs to enable customers to custom tailor the system to their unique needs..