DW Concepts

Data Warehouse
Concepts
&
Architecture
Principle Partners, Inc.
Info@PrinciplePartners.Com
Page 1
PP I
Data Warehouse Concepts

Topics To Be Discussed:
Why Do We Need A Data Warehouse ?
The Goal Of A Data Warehouse ?
What Exactly Is A Data Warehouse ?
Comparison Of A Data Warehouse And

An Operational Data Store.
Data Warehouse Trends.

Page 2
PP I

We Can Only
See - What We
Can See !
Page 3
PP I

BETTER !
FASTER !
CHEAPER !
FUNCTIONALLY COMPLETE !
Page 4
PP I

Data Warehouse Development Perspective
Vs.
Data Driven
Function Driven
A/P
O/P
Data
Order
Processing
EIS
Data
DSS
Page 5
PP I

What Do We Need To Do ?
Use Operational Legacy Systems Data:
To Build Operational Data Store,
That Integrate Into Corporate Data Warehouse,
That Spin-off Data Marts.
Some May Tell You To Develop These In Reverse!
Page 6
PP I

Our Goal for A Data Warehouse ?
Collect Data-Scrub, Integrate & Make It Accessible

Provide Information - For Our Businesses
Start Managing Knowledge
So Our Business Partners Will Gain Wisdom !
Page 7
PP I

Data Warehouse Definition
A Data Warehouse Is A Structured Repository
of Historic Data.
It Is Developed in an Evolutionary Process
By Integrating Data From Non-integrated
Legacy Systems.
It Is Usually:
Subject Oriented
Integrated
Time Variant
Non-volatile
Page 8
PP I

Subject Oriented
Data is Integrated and Loaded by Subject
Cust
Prod
1996
1996
D/W
Data
1997
O/P
1998
A/R
Page 9
PP I

Time Variant
Operational System
Data Warehouse
View of The Business

Today
Designated Time Frame

(3 - 10 Years)
Operational Time Frame
One Snapshot Per Cycle
Key Need Not Have Date
Key Includes Date
Page 10
PP I

Integrated
Operational Systems
Order Processing
Order ID = 10
Accounts Receivable Order ID = 12
D/W
Order ID = 16
Product Management Order ID = 8
HR System
Sex = M/F
Payroll
Sex = 1/2
D/W
Sex = M/F
Product Management Sex = 0/1

Page 11
PP I

Non-Volatile
Operational System
Data Warehouse
CRUD Actions
No Data Update
Insert
Load
Create
Update
Read
Replace
Read
Read
Read
Delete
Read
Page 12
PP I

Data Warehouse Environment Architecture
Contains Integrated Data From Multiple Legacy Applications
Update
A/P
Insert
O/P
Pay
Mktg
HR
A/R
Best System of
Record Data
Data
Mart
Load
Integration
Criteria
ODS
All Or Part
Of System of
Record Data
e
us
o
reh
a
W
ta
a
D
Read
Page 13
Read
Replace
Delete
ria
e
t
i
Cr
d
a
Lo
D/W Load
Data
Mart
Data
Mart
Loads
D/W
PP I

Meta Data - Map of Integration
The Data That Provides the Card Catalogue Of
References For All Data Within The Data Warehouse
System of Record
Data Source
D/W Structure
Source Data Structure
Definition
Allowable
Domains
Aliases
Data Relationships
Page 14
PP I

ODS Vs. Data Warehouse
Operational Data Store
Characteristics:
Age Of The Data:

Primary Use:
Frequency Of Load:
Data Warehouse
Data Focused Integration

Subject Oriented
From Transaction Processing Integrated
Focused Systems
Non-Volatile
Time Variant
Current, Near Term
Historic
(Today, Last Weeks)
(Last Month, Qtrly, Five
Years)
Day-To-Day Decisions
Long-Term Decisions
Tactical Reporting
Strategic Reporting
Current Operational Results Trend Detection
Twice Daily , Daily, Weekly Weekly, Monthly, Quarterly
Page 15
PP I

Building The Data Warehouse
Tasks
Deliverables
Define Project Scope

Define Business Reqmts
Define System of Record
Data
Define Operational Data
Store Reqmts
Map SOR to ODS
Acquire / Develop
Extract Tools
Extract Data & Load
ODS
Scope Definition
Logical Data Model
Physical Database Data
Model
Operational Data Store
Model
ODS Map
Extract Tools and
Software
Populated ODS
Page 16
PP I

Building The Data Warehouse
(Continued)
Tasks
Deliverables
Define D/W Data Reqmts

Map ODS to D/W
Document Missing Data
Develop D/W DB Design
Extract and Integrate D/W
Data
Load Data Warehouse
Maintain Data Warehouse
Transition Data Model

D/W Data Integration Map
To Do Project List
D/W Database Design
Integrated D/W Data
Extracts
Initial Data Load
On-going Data Access
and Subsequent Loads
Page 17
PP I

Relationship Among Data Warehouse Data Models
Business
Partner
Business Requirements
Knowledge
& Wisdom
Data
Warehouse
Validation
of Current
Data
Strategic
Business
Requirements
Physical
Model
Business
Requirements
Logical
Model
Structured
Requirements
Operational
Data Store
Data
Load
Current
Database
Physical
Model
Current Structure
Physical
Model
Tactical Business
Reqmts & Structures
Data Whse
Requirements
Transition
Model
Page 18
PP I

Sources of Data Warehouse Data
Archives
(Historic Data)
Current Systems
of Record
(Recent History)
Enterprise
Data Warehouse
Operational
Transactions
(Future Data Source)
Page 19
PP I

Appropriate Uses of Data Warehouse Data
Produce Reports For Long Term Trend Analysis
Produce Reports Aggregating Enterprise Data
Produce Reports of Multiple Dimensions

(Earned revenue by month by product by branch)
Page 20
PP I
Inappropriate Uses of Data Warehouse Data
Replace Operational Systems
Replace Operational Systems Reports
Analyze Current Operational Results
Page 21
PP I

Levels of Granularity of Data Warehouse Data
Atomic (Transaction)
Lightly Summarized
Highly Summarized
Page 22
PP I

Options for Viewing Data
Text
90
80
70
60
50
40
30
20
10
0
1s t
Qtr
2 nd
Qtr
3rd
Qtr
4th
Qtr
Page 23
PP I

Next Steps In Data Warehouse Evolution
Use It - Analyze Data Warehouse Data
Determine Additional Data Requirements
Define Sources For Additional Data
Add New Data (Subject Areas) to
Data Warehouse
Page 24
PP I

Future Trends In Data Warehouse
Increased Data Mining
Exploration
Prove Hypothesis
Increase Competitive Advantage
(i.e., Identify Cross-selling Opportunities)
Integration into Supply Chain & e-Business
Page 25
PP I

Summary
A Data Warehouse Is A Structured Repository
of Historic Data.
It Is:
It Contains:
Subject Oriented
Integrated
Time Variant
Non-volatile
Business Specified Data,
To Answer Business Questions
Page 26
PP I
Questions and Answers
Page 27
PP I

DW Concepts

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

DW Concepts

Transféré par

Droits d'auteur :

Formats disponibles

Data Warehouse

Principle Partners, Inc.

Data Warehouse Concepts

Why Do We Need A Data Warehouse ?

The Goal Of A Data Warehouse ?

What Exactly Is A Data Warehouse ?

Comparison Of A Data Warehouse And

Data Warehouse Trends.

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Some May Tell You To Develop These In Reverse!

Principle Partners, Inc.

Data Warehouse Concepts

Collect Data-Scrub, Integrate & Make It Accessible

Principle Partners, Inc.

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

View of The Business

Designated Time Frame

Operational Time Frame

One Snapshot Per Cycle

Key Need Not Have Date

Key Includes Date

Principle Partners, Inc.

Data Warehouse Concepts

Accounts Receivable Order ID = 12

Product Management Order ID = 8

Product Management Sex = 0/1

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Data Warehouse Concepts

Source Data Structure

Principle Partners, Inc.

Data Warehouse Concepts

Age Of The Data:

Principle Partners, Inc.

Data Focused Integration

Data Warehouse Concepts

Define Project Scope

Data Warehouse Concepts

Define D/W Data Reqmts

Principle Partners, Inc.

Transition Data Model

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Principle Partners, Inc.

Data Warehouse Concepts

Produce Reports For Long Term Trend Analysis

Produce Reports Aggregating Enterprise Data

Produce Reports of Multiple Dimensions

Principle Partners, Inc.

Data Warehouse Concepts

Inappropriate Uses of Data Warehouse Data