Académique Documents
Professionnel Documents
Culture Documents
Oren Shatil
Sushil Tiwari
[ Agenda
Key Learning Points
Session Overview
Learn how to manage data exceptions during the migration process caused
by transformation of legacy data and reject records in the target system
Staging Area
Flat Files/
Excel
Pre-Built load
routines for SAP
Data Services Platform
Objects
LSMW
Files
Validate
Databases Cleanse Transform
& Load
Name Parsing Business
Transform IDocs
Extract & Address Parsing
& Correction
Data into SAP
Validation Rules
Automatic SAP
SAP
Profile structure
Material/Product Config
Parsing Validation
Applications Matching
SAP
Reconciliation Configuration
Extraction
XML
Transparency,
Communication and
Governance,
Source: © SAP 2008
RealAMERICAS | EUROPE
Experience. Real | MIDDLE EAST | ASIA PACIFIC | INDIA
Advantage. 7
[ Leverage Data Mapping Templates
Based on SAP ® Business Objects™ Data Services, SAP’s Best Practices for
Data Migration Pre-built mapping templates help accelerate the field and
data mappings, involving the business users early in the project
Source: © SAP 2008
Real Experience. Real Advantage. 8
[ Leverage Pre-configured AIO Workflows
Realization
Key Challenges
in
Data Migration project
Traditional
Steps:
Extract &
Transformation Upload
provision data
Analysts Why?
“More than 80% of data migration projects run over time Data migration projects are poorly scoped and
and/or over budget. Cost overruns average 30%. Time estimated. How often are they done?!
overruns average 41%.” Staffs lack expertise to plan a seasoned approach
Bloor, 2007 to data migration
Business users are not rigorously interviewed for
“80% of organizations… will underestimate the costs business rules and validation logic
related to the data acquisition tasks by an average of 50 Latent data quality problems hold hidden surprises
percent” Go Lives are planned as a “one big upload”
Gartner Cross-object dependencies are not discovered
until late in the process
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA 11
[ Key Challenges - Data Issues are Identified Too Late in the Project
Significant Data
Management 33
Issues
93% 20
11 10
23
4
Post-live
support
Source: ASUG Best Practices and Benchmarking: Aggregate Findings Report, June 2007
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA 12
[
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA
Step-1b : Profile data
[
Data is profiled to help identify existing data quality issues in the source legacy,
especially in terms of different patterns of phone number formats, inconsistent usage of data standards, duplicates in field values, etc.
RealAMERICAS | EUROPE
Experience. Real | MIDDLEofEAST
Profiling
Advantage. data| ASIA
helpsPACIFIC | INDIA
gauge the potential cleansing effort required downstream 17
[
Address related data fields like Street, City, State, Zip can be cleansed
against USPS or similar standard postal regulatory repositories
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA
Step – 2b: Cleanse data (continued...)
[
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA 20
Step – 2c: Consolidate data (Identify duplicates and rationalize records)
[
21
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA
Step – 2d: Cleanse data (continued…)
[
Source data is mapped
to corresponding target SAP ECC table structures,
based on Data Mapping Templates.
Transformed data is finally created in LSMW upload ready format.
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA 22
[ Iterative Data Cleansing and Transformation
Realization Review Cycle Results and prepare for
go/no go decision
What Errors
Remain?
Evaluate Data
Final
Preparation
Assess Results Collect Rules
Attained Target Quality Level:
Zero Defects
Cleanse
Matching and consolidation of
Build Data customer & vendor data is one
Flows example of iterative cleansing
J Edward
J Edwards Jr.
Plan and adjust for next cycle John Edwards
Johnathon Edwards
Johnathon Thomas Edwards
• Extract reference data, configuration parameters, and linkage rules from the
target and source systems.
• Use the configuration data to test and validate each ETL job run and TDC
operation, BEFORE you load the data.
AMERICAS | EUROPE | MIDDLE EAST | ASIA PACIFIC | INDIA
Real Experience. Real Advantage.
[
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA 27
[
RealAMERICAS | EUROPE
Experience. Real | MIDDLE
Advantage. EAST | ASIA PACIFIC | INDIA
[ Beyond Data Migration – What Next?
Conduct periodic profiling of data and institute data quality
monitoring process
SESSION CODE:
4103
Please remember to complete and return your
evaluation form following this session.
For ongoing education in this area of focus, visit www.asug.com. ]
Real Experience. Real Advantage.