Vous êtes sur la page 1sur 55

PowerCenter 8.

6 new features

Vincent Loosli
Senior Sales Consultant
Informatica Software (Schweiz) GmbH

1
What’s new in PowerCenter 8.6?

• Improve operational data integration capabilities and


Charter the collaboration between business and IT
professionals

Release Benefits • Maximize Data Value


• Optimize IT Efficiency
• Expedite Time to Value

Release • PowerCenter Real Time Edition


Announcements • PowerCenter Data Masking option
Include • PowerCenter and Data Quality integration improvements
• PowerExchange CDC improvements & connectivity
enhancements
• Role-based Tools such as Mapping Analyst for Excel
• Metadata Manager business glossary enhancements

2
PowerCenter Real-Time Edition

3
Real-Time Enterprise Information Latency
Deliver Analytic and Operational Data Exactly When Needed

• Improving Customer Service


• Business Modernization and M&A
• Increasing Operational Efficiency

4
PowerCenter Real-time Edition
Single Platform, Single Package – For Supporting All Data Latencies

PowerCenter
Real-time Edition Benefits Product Functionality
Orchestration Universal Data Structured, unstructured and Legacy
Access Federated Access
Relational CDC
Right-time Data Continuous Change Data Capture
PowerExchange for Guaranteed Message Delivery
EAI systems
Real Time Data Zero latency, parallel data processing
PowerExchange for Processing Once and only once and in order processing
Web Services
SOA Reentrant data services
Partitioning
Standards support (BPEL, WS*)

Enterprise Resilience and Recoverability


Real-time Option
Scalability
Partitioning

PowerCenter Process Business process modeling (BPMN)


Standard Edition Orchestration &
Workflow BPEL orchestration and human workflow

5
PowerCenter Real-Time Edition
Changed Data Capture (CDC)

6
PowerCenter Real-time Edition
Streaming Change Data Capture With Reliable
Message Delivery
Capabilities Source Target
PowerCenter
PowerExchange
• Continuous capture of event Real Time
CDC
streams Edtion

• Transactional integrity with


resilience and recovery Benefits
• Support for all major relational and
legacy sources • Speed operations with continuous real-
time data
• Guaranteed, exactly once, in-order
data delivery for relational • Improve business performance by
databases and message queues enabling more timely decision-making
• No data duplication or data loss • Reduces risk through improved
even in unplanned system failure transactional recovery
scenarios
• Lower cost by handling only incremental
• Transactional integrity with full changes as they occur, not large sets of
rollover and resilience data repeatedly

7
PowerCenter Real-Time Edition
Orchestration

8
PowerCenter Real-time Edition
Orchestrating Data Integration and Quality

Orchestration

Control Flows 2 5
1 Real-time Option4
(BPEL) 3
6

Data Integration
b
Data Flows
Real-time
a Option c e
(PowerCenter Mappings)
d

Data Quality

Data Quality
Real-time Optionx y z
Plans

9
PowerCenter Real-time Edition
Uses for Orchestration

• Sequencing
• Start a process after the completion of another process or after a specific time has
been reached

• Synchronization of master data


• Synchronize master data between multiple independent data sources

• Conditional Logic
• Take differentiated action depending on the outcome of another process activity
• Different handlers for System and Business exceptions

• Human Workflow
• Complex decisions requiring human intervention

• Looping
• Iteratively execute a process activity based on standard looping criteria (for, while,
repeat-until)

10
PowerCenter Real Time Edition
BPEL Orchestration and Human Workflow
Capabilities Benefits
• Analyst-friendly BPMN Modeling • Improve operational efficiency with
support for long-running processes and
• BPEL-based process execution engine human interaction
for Data service orchestration
• Eliminate costly hand-coding to
• Support for stateful, long running coordinate business process flows
processes
• Allow process-oriented data integration
• Human activity tasks through to support advanced data integration
BPEL4People and XForms requirements

11
Operational Data Integration Projects

Data Integration Capabilities


Event Driven
Latency: Low High Data Integration
Real Time DWH
(Linkshare)
(Deutsche Börse) Volume: Low High

Quality: Basic Advanced

Structure: Simple Complex


Transformation: Basic Advanced
Real-time
Data Replication Orchestration: Basic Advanced Data Quality
(BNSF) (State Auto, KPN)

Front Office
Data Synchronization Data Automation
(RBS) (GfK)

Operational Payment Processing


Data Hub (Wells Fargo, BofA, Natixis)
(ING, Virgin Media)

12
PowerCenter Data Masking Option

13
Data Masking
Business Process Use-Cases

• Development and Testing John Smith


654-65-8945
4563-3456-9876-6342
100 Cardinal way
• Training Redwood city

• Support
Glen Carter
900-45-2643
• Data Analysis 4563-XXXX-XXXX-6342
342 54th Street
New York
• Outsourcing and Offshoring

14
Data Masking
Definition

• Transformation of sensitive information into


de-identified, realistic-looking data
while retaining original data properties

• Data remains relevant and meaningful


• Preserves the shape and form of individual fields
• Preserves intra-record relationships
• Preserves join / foreign key relationships

John Smith Glen Carter


654-65-8945 654-45-2643
4739-1146-8075-5716 4739-1102-3517-8842
100 Cardinal way 342 54th Street
Redwood City New York

15
Data Masking
Capabilities and Benefits
Capabilities Benefits
• Multiple techniques and algorithms • Reduce risk of data security breach
• Random masking
• Improve compliance with data privacy
• Blurring laws and regulations
• Preserve referential integrity by
repeatable masking • Enable outsourcing and offshoring in
conformance with your company’s
• Substitution security policies
• Specialized, built-in rules and content
• Name and Address content
• Special fields like SSN, Credit Card,
Phone Number, etc
• Pre-packaged sample mappings
• Component of data integration platform
• Universal data access
• Rich transformation capabilities
• Auditing and Reporting

16
• Data Masking Option Demo

17
Informatica Data Quality
Integration with PowerCenter

18
Optimize IT Efficiency
Enhanced Data Quality integration with PowerCenter
Capabilities
• Provides consistent UI across Informatica
Data Quality and PowerCenter
• Supports import / export of Data Quality
plans as PowerCenter mapplets
• Enables the native execution of Data
Quality mapplets within PowerCenter.
Informatica Data Quality

Benefits
• Improved efficiency of projects by
simplifying the integration of data quality
and PowerCenter
• Increased flexibility based on additional
control and security of data quality
processes within the Informatica platform.

Informatica PowerCenter

19
PowerCenter
Mapping Analyst for Excel

20
Role-specific Tools
Automating the Data Integration Project Life-cycle

Mapping Analyst Mapping


for Excel Architect for Visio

Analysts
Architects
Developers
Operators

21
Mapping Analyst for Excel
Current Approach

Business Analyst Data Analyst


1. Gathers requirements 1. Create source to target mapping Mapping
from the business specifications with transformation Specification
2. Documents business rules Pseudo Code on a
information and business spreadsheet
rules

DI Developer
1. Translate mapping specifications into
PowerCenter Mappings

22
Mapping Analyst for Excel
The Informatica Solution

Business Analyst Data Analyst


1. Gathers requirements 1. Create source to target mapping
from the business specifications with transformation
2. Documents business rules Mapping Specification
information and business 2. Auto-generate PowerCenter English/Pseudo Code on a
rules Mapping spreadsheet

DI Developer
1. Augment & Tune Generated
PowerCenter Mappings
2. Re-use mappings for other projects

23
Mapping Analyst for Excel
Keep Specifications Updated

•Specify associated sources, target • Jumpstart mappings from specification


• Define transformation rules
• Modify and optimize mappings
Analyst • Standardize Excel format Developer • Synchronize mappings w/ spec.

Auto-generate PowerCenter mappings

Mapping Analyst for Excel PowerCenter

Auto-generate specification from modified mappings


Benefit: Improve documentation and
auditability

24
Mapping Analyst for Excel
Key Capabilities & Benefits

Key Capabilities Benefits


• Leverages existing mapping • Tightens the collaboration between IT and
specifications in the organization business with standardized specifications
• Easily define a standard Excel
format for mapping specification
• Automatic generation of • Shorten project delivery time by
PowerCenter mappings from jumpstarting mapping development
specification
• Supports translation of major
transformation logic
• Automatically synchronize • Keep specifications up to date
mapping modifications to the • Improve documentation & auditability of
Excel specification business logic

25
PowerCenter
Mapping Architect for Visio

26
Role-specific Tools
Mapping Architect for Visio: What’s new in 8.6

• Workflow and Session Generation


• Support for more reusable objects
• Source and Target shortcuts
• Mapplets
• Reusable transformation
• Support for more transformations
• Stored Procedure
• Create multiple pipelines in a mapping

27
Reference Table Manager (RTM)

28
Role-specific Tools
Reference Table Manager (RTM)

• Current Approach
• Reference data used in migration from old to new systems are
entered manually
• Business subject matter experts (SMEs) document reference
data in spreadsheets

• Challenges
• Costly, labor-intensive to capture, maintain reference data
• Inconsistencies and errors due to manual, decentralized process

• Goal: Bridge the gap between business subject matter


experts and IT

29
Role-specific Tools
RTM: Facilitate Collaboration w/ Business Analyst or SME
• An easy-to-use interface for business analysts/SMEs to:
• Create, edit and delete reference tables
• Enter reference data, such as valid values, default values, and cross-
reference information
• Import and export reference tables as .csv or .xls
• Maintain audit trail documenting the changes to the reference tables

Source Data Target


Continued re-analysis and redesign
Specifi-
cations
Sales System

Analysis Build Test SAP

Customer
Database
Bus.
App
Legacy ERP

Business Analyst or SME

30
Reference Table Manager
Examples

Data Migration Gender code Description


M Male
• Valid values
The set of acceptable values for a data F Female
element
• Default values System Table Column Default Value
The default value that should be loaded
into a target field if the data doesn’t exist SAP KNA1 REGIO NN
at the source SAP DOMAIN BUKRS ACH
SAP DOMAIN CLIENT2 800
• Cross references
(e.g. how the accounting codes from a SAP DOMAIN DISTRCHAN I
legacy financial system map to the SAP ADR6 DATE_FROM 12/1/2006
codes in the new finance application)
Source Source Target Target
Data Warehousing/Other Data Column Value Column Value
Integration COUNTRY Arab Emirates LAND2 AE
COUNTRY New Zealand LAND2 NZ
• Manage lookups for data warehousing
operations COUNTRY Hong Kong LAND2 HK
COUNTRY France LAND2 FR
COUNTRY Netherlands LAND2 NL

6
31
Reference Table Manager
Key Capabilities & Benefits

Key Capabilities Benefits


• Centralized maintenance of key • Lowers risk of errors, inconsistencies,
reference data and compliance breaches
• Empowers business subject matter
experts to directly manage reference data
while preserving IT’s integrity control
• Web-based interface for business • Facilitates collaboration between IT and
SME to enter reference data business
• Eliminates decentralized spreadsheet-
based capture of reference data
• Easy deployment
• Central administration of service • Reduces administration overhead
and security from the • Ensures enterprise-grade security
PowerCenter administration
console

32
• Reference Table Manager Demo

33
Workflow Generation Wizard in Designer

34
Workflow Generation Wizard in Designer

35
Workflow Generation Wizard in Designer

36
Workflow Generation Wizard in Designer

37
Real-time sessions with EAI

38
Real-time sessions with EAI

• Improved Recovery Mechanism


• The Integration Service writes real-time session recovery
information to a queue. The queue helps maintain data
integrity during recovery so no data is lost or duplicated.
(src : JMS/WebSphere MQ – tgt JMS/WebSphere MQ)

• Partitioning.
• You can add partitions to a real-time session that includes a
JMS or WebSphere MQ source and is enabled for recovery.

• Resilience.
• Resilience is available if you have the real-time option.

39
Performance features

40
Dynamic Partitioning
based on number of CPUs

41
View thread worktime details in the session log

42
PowerCenter Transformations

43
PowerCenter Transformations

• HTTP Transformation
• You can let the Integration Service determine the authentication
type of the HTTP server when the HTTP server does not return an
authentication type to the Integration Service. Or, you can specify
the authentication type for the Integration Service to use.

• Unstructured Data Transformation


• You can define additional ports and pass output rows to relational
targets from the Unstructured Data transformation. You can create
ports by populating the transformation from a Data Transformation
service. You can pass a dynamic service name to the Unstructured
Data transformation with source data.

44
PowerExchange enhancements

45
PowerExchange Enhancements
Real-time

• CDC Option • Message Queuing (all)


• Continuous Extraction • Exactly-once delivery
(8.5) semantics
• Oracle, SQL Server, DB2 • Message order is
LUW
preserved
• Extraction process runs
continuously instead of • Process messages in
shutting down parallel with multi-
• Faster startup, higher
throughput
partitioned sessions
• Performance • SAP
• CPU offload • Support for IDoc
• Multithreaded CDC interpreter

46
PowerExchange Enhancements
Applications, Technology Standards

• JDE World • Siebel


• UNICODE support • Invoke business
• Multiple library support services
• Read/write business
• JDE EnterpriseOne objects
• Source filter
parameterization • LDAP
• Multiple source filter • Support for SSL/TLS
conditions • Email Server
• SAP NetWeaver • MAPI support in the
• Table type support for client
BAPI • Certifications
• Lotus Notes • Oracle EBS 11.5, 12
• UNICODE support • SAP BW-OHS

47
PowerExchange Enhancements
Data Warehouses

• Teradata • New source/target:


HP Neoview
• Support Teradata
Monitoring tool • HP Transporter Java
• Support Teradata interface
Parallel Transporter • Netezza Performance Server
• Recovery/restart for • Support for update as
stream mode
insert
• Drop error tables
• Support multiple TPT • Support for NPS 4.0
versions
• Rejected row logging
• Certifications
• HP Neoview ODBC
driver
48
PowerExchange Enhancements
Databases

• Hyperion Essbase • Relational targets


• Outline Metadata Extractor • Exactly-once delivery
• Allow multiple selection of semantics
measure dimension’s • Order of records is
member preserved
• BSO: modify outline • SQL Server
• ASO: full support for • Globally Unique Identifier
extract, modify outline, load (GUID) data type
• Re-order mapped columns • Certifications
• Informix • IMS version 10
• Byte data type • Adabas version 8
• Adabas • DB2 v9 for z/OS
• WIDECHAR data type • Oracle 11g

49
Other PowerCenter Enhancements

50
Other PowerCenter Enhancements

PowerCenter, PowerExchange and Complex Data


Exchange support same code pages

51
PowerCenter Advanced Edition
Metadata Manager

52
What’s New in Metadata Manager 8.6?
• Business names
• Attribute of any metadata asset
• Option to show business names in lineage diagram
• Business glossary model
• Bundled custom meta-model template for business terms and nested categories
• Includes business rules, definition, steward, owner, valid values
• Object relationships wizard
• Excel-based import/export of metadata extensions
• New Metadata Exchange for Advanced Edition
• DB2 on z/OS
• Netezza
• New version certifications for Metadata Exchange AE
• Oracle 11g
• Sybase 15.0.2
• DB2 9.1.2
• Erwin 7.2

53
Role-specific Tools
Business Metadata
PowerCenter AE Metadata Manager 8.6
• Business names
• Attribute of any
metadata asset
Use Business Names
• Option to display
business names in
lineage
• Sample custom meta-
model template (devnet)
•Custom meta-model
template for business
terms and categories
•Includes business
rules, definition,
steward, owner, valid
values

54
55