IBM Software

Data management tools

for the era of big data
Manage your IBM DB2 for Linux, UNIX and
Windows database and applicationsdelivering
valuable intelligence to make informed decisions, fast

Data management tools for the era of big data

1
Introduction

Accelerate
development

Optimize
performance

Increase
availability

Give your
business a
competitive
edge

Data management tools for the era of big data

Introduction
In todays competitive global environment,
businesses must become more nimble,
adapting and responding to changes in
market conditions or customer preferences
at a moments notice. Access to timely,
accurate information is critical for enterprises
that are striving to better serve their
customers, compete successfully and
foster innovation. But delivering the key
information required to make informed
decisions, given explosive growth in the
amount of data collected and consumed
daily, is a tall order.
For IT managers, managing and delivering
data is more challenging than ever. You
must bring new applications online quickly
to improve the performance of databases,
applications and work teams. At the

How can you balance information-driven

demands with the need for a robust,
dependable, flexible data infrastructure
to meet daily business challenges?
same time, you must prevent runaway
infrastructure spending, meet demanding
service-level agreements (SLAs), mitigate
compliance risks and support ever-morecomplex, heterogeneous IT environments.
This e-book explores how data management
tools for IBM DB2 for Linux, UNIX and
Windows help you increase productivity
and maximize the efficiency of your
database resources. It illustrates how the
tools are tightly integrated with DB2 with
BLU Acceleration to deliver a scalable,
high-performance platform and a unified

environment that enables you to costeffectively manage data throughout its

lifecycle. And it describes how data
management tools can help you accelerate
development, optimize performance,
increase availability and simplify access to
enterprise datawhile enabling powerful
analytics capabilities for business users at
all levels to enhance efficiency and
effectiveness across the enterprise.
3

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Accelerate development
Improving your competitive position in
an evolving market requires both speed
and agility. You must deliver enterpriseready, data-centric applications rapidly,
yet be able to adapt to changing customer
demands and market fluctuations. The
need for greater collaboration between
business, application and data groups
makes this challenge even more difficult;
your organization must work across roles,
geographies and business units while
remaining flexible and responsive. At the
same time, you must adopt emerging
programming methodologies, observe
regulatory compliance standards and
automate data discovery and design tasks.

Database administration, development

and testing tools from IBM enhance your
DB2 foundation and amplify its strengths.

Develop

They help accelerate development, expedite

deployment, simplify database administration
and support cross-team collaboration for
higher productivity.

Collaborate

Test

Empower developers to
write high-quality code
more rapidly using
optimized frameworks.

Reduce the risk, costs

and time associated with
database testing processes
to meet SLAs.

Reduce time-to-market
and enhance compliance
by modeling data assets
and automating database
design processes.

Add realistic test rigor by

capturing and replaying
production workloads to
test upgrades, migrations
and tuning changes.

Manage

Improve cross-team
collaboration with a development
process that spans database,
application and data access
requirements.
Increase data quality and
consistency with shared
policies, models and methods.
Enhance productivity
with a common solution
across roles.

Centralize database health

monitoring and job
management.
Use change management
capabilities to alter objects,
permissions and dependencies.
Tune queries for best
performance.
Support DB2 migration
projects with automation.

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Simplify administration and

reduce common errors to increase
productivity
Manual or fragmented processes are
prone to inefficiency and error. The
answer is to cost-effectively automate
repetitive, error-prone processes. IBM
tools provide out-of-the box database
development, management and health
monitoring capabilities that help you
save time, improve productivity and
reduce common administration errors
from repetitive or error-prone tasks.
They also help increase data efficiency
and reduce the time and cost needed
to meet data governance requirements,
including regulatory mandates.

We think that Data Studio

is a comprehensive, reliable,
stable and complete solution
for designing, administering
and monitoring databases as
well as tuning SQL queries
for performance.
Metin Deniz and Onur Basturk,
Computer Research and Application
Center Experts, Anadolu University,
Turkey

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Recognize enterprise change issues

sooner with realistic testing
To stay competitive, organizations must
constantly enhance products and services
to meet and exceed competitive offerings.
But changes can be disruptive and
expensive. For instance, application
changes may impact database performance
and execution accuracy, or migrating to
a new version of the database management
system (DBMS) may cause production
delays and the need to roll back the update.
Unfortunately, data teams arent always
equipped with the right testing software
to mirror the production environment.

Even if the team spends weeks or months

preparing test scripts to simulate production
workloads, they are still left with internally
fabricated use cases or approximations that
may not reflect real-world situations.
IBM tools for administration, development
and testing can help you save time, cut
costs and meet SLAs by capturing
production workloads and replaying them
realistically to test upgrades, perform
migrations or complement new application
testing. Captured production workloads
include all the information needed for reallife simulation, such as threads, user

sessions, the original application timing,

order of execution, transaction boundaries,
isolation levels, and other SQL and
application characteristics. You can test
changes to database environments and
tune them without compromising the
production database performance, easily
develop accurate and streamlined tests, or
plan for growth and capacity. Furthermore,
you can significantly reduce test effort
by as much as 75 percent or more per
database.1 IBM development and testing
tools help you perform the operational
transformations your organization needs
to compete with confidence.

Data management tools for the era of big data

Improve collaboration to use

common resources more efficiently
Cross-lifecycle, cross-role and crossorganization collaboration is critical to
aligning processes and reducing overall
operating costs. Fragmented development
and administrative processes hamper
collaboration, and waste time and money.
IBM tools for database administration,
development and testing provide a
collaborative data design solution,
facilitating development processes that
span database, application and data
access needs. These tools can be used to
discover, model, relate and standardize
diverse and distributed data. They enable
organizations to standardize business
terms, data naming, data values, data

To achieve a more efficient data

environment, we implemented
InfoSphere Data Architect. We have
used IDA to help foster collaboration
and drive efficiencies among IT
professionals and have lowered our
administrative costs. We are now better
able to manage our data and support
our business growth objectives.
Ferran Rodenas Barcelo,
Lead Architect, La Caixa

access privileges and data privacy,

providing the basis for greater automation
and governance of design, development,
test and deployment processes.
7

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Optimize performance
In the rush to create applications that
support the business in a quickly changing
market, performance and efficiency are
not always top priorities. As data volumes
and usage grow, these applications cant
keep up; they may become sluggish and
unresponsive, forcing organizations to add
hardware and staffincluding overtime
and short-notice workersjust to maintain
performance. Poor application performance
also leads to customer churn, missed SLAs
and revenue lossnone of which have a
positive effect on a companys reputation.
Organizations need a comprehensive solution
to proactively manage performance across
the data environment. IBM tools for managing
and optimizing performance help you
implement a best-practice methodology

to identify, diagnose, solve and prevent

performance bottlenecks. Through a guided,
proactive problem-solving approach, the

Diagnose

Identify
Receive early notifications
of problems before they
impact production.
Quickly isolate problems
across database, network
and application layers.
Get visibility into problems
by workload to prioritize
response.

Follow guided workflows to

diagnose issues.
Get complete views of data,
from real time to any time.
Dig into the root causes of
problems with detailed
drill-down capabilities.
Use built-in integration to
leverage data from other
IBM solutions.

tools enable you to manage the overall health

of your application environment and rapidly
deploy applications for immediate value.

Solve

Prevent

Receive easy-to-understand,
actionable recommendations
for problem resolution.
Tune entire workloads to
balance costs across query
and insert actions.
Minimize slowdowns that
impact user productivity
and revenue.

Spot changes that may be

related to performance
slowdowns.

Capture and analyze

real-time and historical data
for capacity planning and
growth.
Proactively optimize the
performance of query
workloads, database and
applications.
Configure DB2 Workload
Manager to allocate
resources according to
business priority.
Foster cross-team
collaboration to improve
security, performance and
manageability.

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Empower your team for true end-toend performance management

The performance management and
optimization solution for DB2 covers the
entire chain of events, from detection
of a performance issue through its analysis
and resolution:
Monitoring and diagnosis: Using
performance management tools,
organizations can proactively monitor
database environments, receive
notification if a problem arises and then
pinpoint the source of the problem.

Optimization: Once a performance

issue is identified, the tools provide
actionable recommendations to optimize
database and application performance.
You can even get expert advice on what
tables to convert to column orientation
based on workload analysis and
estimated benefits.

Optim Performance Manager is a

comprehensive tool for troubleshooting
and performance tuning. With this
tool, we can answer many more
questions related to what is happening
in the databases. That deepens and
extends our understanding of them.

Performance and security:

Organizations can use the tools to
enhance the performance and security
of an application without changing the
existing legacy application code. The tools
also help reduce the time needed to go
live with newly developed applications.

Victor Dong,
Database Systems Manager,
TransUnion

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

InfoSphere Optim Query Workload Tuner makes it easy to determine which tables can
benefit from DB2 BLU Acceleration for big performance improvement gains in BI
and analytics.
Jean-Marc Blaise, IT Solutions Architect and DB2 for Linux, UNIX and Windows expert, Delta DB

IBM InfoSphere Optim Configuration Manager is a great tool for exploiting both the
Adaptive Compression and Multi-Temperature Data Management features in DB2.
I would definitely make use of InfoSphere Optim Configuration Managers features to
find contiguous space on disks for better I/O performance and allocate the most efficient
storage devices for the most demanded data.
Juvenal Garcia Cuevas, Consulting Manager, SBRT Computing

10

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Increase availability
Customers and partners expect
uninterrupted access to your systems and
services at all times. Unplanned database
outages place customer satisfaction and
goodwill at risk, causing potential revenue
loss and brand damage, as well as driving
up operational costs.

The recover phase

only took about
17 minutes to recover
the table that took
about 3 hours
40 minutes before.

And yet many companies dont have an

effective backup and recovery strategy,
even when they clearly understand the
value of creating one and the dangers of
going without. Others have a strategy, but
the processes involved are complex and
time-consuming, lengthening the time to
recover beyond what the businessand
marketfinds acceptable.

Senior DBA,
Large Insurance
Company in USA

11

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

To meet the ever-increasing expectations

of partners and customers, IBM provides
the comprehensive DB2 Advanced
Recovery feature, which enables you to
safeguard data, speed recovery, maximize
application uptime and minimize the cost
of downtime.

and accelerate recovery. The benefit of

having a comprehensive recovery feature
is clear: you gain the capabilities to build
and carry out an efficient, effective data
availability strategy that will help keep your

The DB2 Advanced Recovery feature helps

ensure your environment is available in
the face of exploding data volumes and
potential disasters, giving you the tools to
deal with day-to-day human error as well
as environmental catastrophes. It helps
you continue to meet SLAs when demand
increases, and in the case of an outage,
quickly recover to the point of failure.
The DB2 Advanced Recovery Feature also
provides options for incrementally backing
up databases to minimize backup times

1 Introduction

2 Accelerate development

Backup
Back up databases efficiently.
Maintain a current full backup.
Minimize production impact
and accelerate recovery.

customers and partners up and running.

At the same time, it helps you safeguard
data integrity, and minimize the costs of
downtime and data administrationso you
can get on with business.

Recover

Unload

Recover with precise granularity

as well as flexibility.

Meet SLAs with pure unload

performance.

Minimize impact on production

with remote log analysis.

Migrate full data and systems.

Reduce recovery time and

resources by automating the
process of rebuilding database
assets to a correct point-in-time.

Minimize production impact

and reduce storage cost.
Increase data protection
and regulatory compliance.

12

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Enhancing availability with the IBM DB2 Advanced Recovery Feature

A Wall Street bank uses DB2 Merge
Backup to provide high-speed, logical
recovery capability for large data
warehouses up to 200 TB. The solution
can combine incremental and delta
backups with an older full backup to
quickly create a new full backup without
affecting application processing.

A large retail company based in

Germany significantly reduced the time
required to export large tables after
adopting IBM InfoSphere Optim
High Performance Unload. The process
used to take 15 to 25 hours, but according
to a DBA at the company, The unload/
load of our biggest table (about 35

billion rows and compressed 2 TB

data) was finished after 40 minutes.
Thats quite fast. The solution
helped the retail company improve data
availability, mitigate risk and accelerate
the delivery of customer database
migration without impacting the database
production server and the end user.

I am very excited about DB2 Merge

Backup because we are building large
data warehouses and we will never have
to take a full backup again (except for
new releases), says an executive IT
specialist at the bank. Warehouses are
getting so big that software backups are
starting to not be viable...Merge Backup
is a powerful tool to provide a logical
recovery capability for large warehouses.

13

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Give your business a competitive edge

Todays organizations need new ways to
differentiate their products and services from
those of their competitors. At the same time,
they must enhance operational efficiencies.
To heighten both competitive differentiation
and operational agility, organizations must
maximize the use of information collected
within and beyond the enterprise. This
information holds the key to improving
customer service and generating highly
targeted product offerings, while also
supporting fraud detection and enhancing
the accuracy of financial risk analysis.
In an increasingly dynamic environment,
organizations must collect information in
various forms and from various sources to
gain the insight and efficiency they need
to create fresh business opportunities,

contain costs and satisfy client needs.

Information that is structured and
unstructured, operational and transactional,
as well as real-time and historical may be
scattered throughout the enterprise and

Develop
Empower developers to build and

maintain the lifecycle of warehouse

activities with an integrated
development environment.

Reduce time-to-value with

modeling and validation of

structures required for data mining,
as well as multidimensional and
embedded analytics.

Simplify intra-warehouse data

movement and transformation by

building efficient, flexible and
reusable data flows.

delivered by various outside sources that are

beyond the direct influence of the enterprise.
Information may reside in databases, data
marts and data warehouses; emails and
transaction logs; customer call logs; shopper

Administer

Analyze

Manage and monitor BI

Discover and understand the

Create data sources and enable

Get in-database insights directly, in real

time, to prevent customer churn or
detect fraud.

Exchange cubing and mining

Integrate easily with other reporting

tools such as IBM Cognos, with its
rich BI capabilities and zero upfront
cost, to gain rapid business value and
insight from data.

applications, warehouse building

operations (ETL) and status.
databases for analysis (OLAP
and mining).

models across different

applicationsnamely, in-database
mining with SAS and advanced
analytics with IBM SPSS.

relationships in your data using

a multidimensional view.

14

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

behavior data; and repair orders. It may

even live in XML data locked inside
transactional systems that cannot be used
or analyzed in the enterprise database.
To turn this information into insight, it must
first be discovered, collected and verified
for quality. Then it is analyzed to find the
hidden relationships, patterns and trends
that help generate actionable insights
to achieve improved efficiencies and
competitive benefits.
DB2 provides a comprehensive, multipurpose
environment that allows organizations to
access, analyze and act on operational and
historical information, whether structured

or unstructured. Its advanced design,

administration and analytic capabilities help
simplify data warehouse and analytics
development and deployment. Moreover,
DB2 data warehouse tools present
transformed data in the most informative
possible way, and allow business users to
interrogate this information to accelerate
the delivery of business intelligence (BI)
that drives successful results.
To that end, DB2 helps simplify timeconsuming data movement and
transformation during the extract, transform
and load (ETL) process for intra-warehouse
data movement tasks. Unlike tools
that require users to extract data from the

warehouse, independently analyze it and

then send the results back to the warehouse,
DB2 provides embedded data mining,
modeling and scoring capabilities.
Embedded analytics enable business
users to work with current data and deliver
analytics in real time to quickly discover
revenue opportunities. Cubing Services
for online analytical processing (OLAP)
enable multidimensional data analysis
without extracting data from the warehouse.
In addition, Cubing Services cubes are
first-class data providers to the Cognos
Business Intelligence platform for
incorporating predictive and analytic insights
into Cognos reports.

15

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Make better decisions, faster

Deliver trusted information throughout your
information supply chain. Quickly analyze
your data to identify breakdowns and avoid
future problems. Gain insights to help your
organization make better decisions and
optimize business processes. No matter
what your data challenges are, you can
look to IBM for the tools you need.

DB2 for Linux, UNIX and Windows and

data management tools for DB2 provide
an ideal foundation for your data. The
tools are tightly integrated with DB2 with
BLU Acceleration to deliver a scalable,
high-performance platform and a unified
environment that enable you to costeffectively manage data throughout
its lifecycle.

Businesses are awash with ever-growing

amounts of data of all types, easily
amassing terabyteseven petabytes
of information. Data availability is therefore
essential; IBM can help you keep your data
systems up and running, extract maximum
value from your information and give your
business a competitive edge.

16

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

Data management tools for the era of big data

Additional resources
To learn more about IBM DB2 and data
management tools for DB2, check out
the following resources.

DB2 for Linux, UNIX and

Windows
DB2 Advanced Enterprise
Server Edition
DB2 Advanced Recovery
Features

DB2 Advanced Workgroup

Server Edition
InfoSphere Optim Query Capture
and Replay
Data management tools for DB2
for Linux, UNIX and Windows

17

1 Introduction

2 Accelerate development

3 Optimize performance

4 Increase availability

5 Gain a competitive edge

 Copyright IBM Corporation 2013

IBM Corporation
Software Group
Route 100
Somers, NY 10589
Produced in the United States of America
November 2013
IBM, the IBM logo, ibm.com, Cognos, DB2, InfoSphere, Optim, and SPSS
are trademarks of International Business Machines Corp., registered in
many jurisdictions worldwide. Other product and service names might be
trademarks of IBM or other companies. A current list of IBM trademarks is
available on the web at Copyright and trademark information at ibm.com/
legal/copytrade.shtml
Linux is a registered trademark of Linus Torvalds in the United States, other
countries or both.
Microsoft, Windows, Windows NT and the Windows logo are trademarks
of Microsoft Corporation in the United States, other countries or both.
UNIX is a registered trademark of The Open Group in the United States and
other countries.
This document is current as of the initial date of publication and may be
changed by IBM at any time. Not all offerings are available in every country
in which IBM operates.
The performance data and client examples cited are presented for illustrative
purposes only. Actual performance results may vary depending on specific
configurations and operating conditions. THE INFORMATION
IN THIS DOCUMENT IS PROVIDED AS IS WITHOUT ANY
WARRANTY, EXPRESS OR IMPLIED, INCLUDING WITHOUT
ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A
PARTICULAR PURPOSE AND ANY WARRANTY OR CONDITION
OF NONINFRINGEMENT. IBM products are warranted according to the
terms and conditions of the agreements under which they are provided.
The client is responsible for ensuring compliance with laws and regulations
applicable to it. IBM does not provide legal advice or represent or warrant
that its services or products will ensure that the client is in compliance with
any law or regulation. Statements regarding IBMs future direction and intent
are subject to change or withdrawal without notice, and represent goals and
objectives only. Actual available storage capacity may be reported for both
uncompressed and compressed data and will vary and may be less than stated.
1

 ased on reported beta clients testing. Individual results will vary depending
B
on individual configurations and conditions, including table size and content.

Please Recycle

NIM03003-USEN-05