Data Warehouse &

Business Intelligence
Data Warehouse & BI 2
What Does A Company Want?

As a company

We want to react to changes

Economic and market conditions

Competitors pricing / features / products

We also want to cause change

Change customer uy haits /eha!ior

Disrupt market with new pricing" features etc

#/$2/$%
Data Warehouse & BI &
What Does A Company Want?

'etting the right information into the right

people(s hands in a format that allows them to
understand data )uickly

Its aout helping management understand

where to make the right changes

Its aout helping management understand

which changes are ha!ing the est / most /
least impact
#/$2/$%
Data Warehouse & BI %
Data Warehouse

A data warehouse stores central" current and

historical data of potential interest that has
een e*tracted from the !arious operational"
e*ternal" and other dataases of an
organi+ation,

It is data that is cleaned" transformed and

catalogued

Consolidates and standardi+es information

Can e used for data mining" -.A/ and decision

support purposes
#/$2/$%
Data Warehouse & BI 0
Data Marts

Data Mart is Decentrali+ed" smaller"

summari+ed" highly focused data put in a
separate dataase" susets of data warehouse

1ypically focuses on single su2ect or line of

usiness

Constructed rapidly

.ower cost
#/$2/$%
DW & BI
#/$2/$% Data Warehouse & BI 3
Characteristics Of A Data
Warehouse
#/$2/$% Data Warehouse & BI 4
Data Warehouse
c
c
Organizational
Consistent
Time Variant
Non volatile
Relational
Client/server
Web-based
Integration
Trouble With The
Terrorist Watch ist
Database
Terrorist Watch ist
#/$2/$% Data Warehouse & BI 5
16C(s
1error Watch
.ist
N
a
t
i
o
n
a
l

C
o
u
n
t
e
r
t
e
r
r
o
r
i
s
m

C
e
n
t
e
r
(
N
C
T
C
)
F
B
I
FBI CI
National !e"urit#
gen"#(N!)
Trans$ortation !e"urit#
dmin(T!)
%! &e$tt o' (omeland
!e"urit#
!tate &e$tt
%! Customs )
Border *rote"tion
%! +ars,alls !ervi"e
W,ite (ouse
!e"ret !ervi"e
irlines
Wea!nesses With Terrorist Watch
ist

Data integration not complete

Data 7uality

/olicy adherence

E8cacy of policies for nomination and

remo!al

/ri!acy concerns

9acial pro:ling
#/$2/$% Data Warehouse & BI $;
Business Intelligence

Business Intelligence < enales data

consolidation" and analysis to identify new
patterns" relationships" insights

BI 1ools include<

-nline analytical processing=-.A/>

Data mining< Disco!ery dri!en

1e*t mining and we mining

Dataase )uery and reporting tools

#/$2/$% Data Warehouse & BI $$
Business Intelligence

BI 1ools<

Online analytical processing"OA#$%

?ulti@dimensional data analysis

Data mining< Disco!ery dri!en

1e*t mining and we mining

Dataase )uery and reporting tools

Data !isuali+ation" dashoards

#/$2/$% Data Warehouse & BI $2
Data Mining

Data mining is the process of using

mathematical techni)ues to look for hidden
patterns in groups of data" therey
disco!ering pre!iously unknown relationships
among the many pieces of information stored
in a dataase
#/$2/$% Data Warehouse & BI $&
Data Analysis An& Business
Intelligence

Data mining% Disco'ery &ri'en

Aind hidden patterns and relationships in

large dataases

Infer rules to predict future

Can get Associations" 6e)uences"

Classi:cations" Clustering" Aorecasting

/redicti!e analysis < uses data mining and

assumptions aout future conditions to
predict outcomes of e!ents
#/$2/$% Data Warehouse & BI $%
Business Intelligence%
Mathematical Techni(ues
#/$2/$% Data Warehouse & BI $0
)uggestions To Impro'e Terrorist
Watch ist

Data integration and consolidation

6tandardi+ation of data

Bse data mining techni)ues and predicti!e

analysis
#/$2/$% Data Warehouse & BI $3
Data Analysis An& Business
Intelligence

BI 1ools <

-nline analytical processing=-.A/><

?ulti@dimensional data analysis

Data mining< Disco!ery dri!en

Te*t mining an& web mining

Dataase )uery and reporting tools

Cisuali+ation" Dashoards
#/$2/$% Data Warehouse & BI $4
Data Analysis An& Business
Intelligence

Te*t mining

Aor unstructured data like e@mails" call@center

transcripts etc

1ools to e*tract key elements" disco!er patterns and

summari+e information

Web mining

?ining we for insights into customer eha!ior

.ooks for patterns in data through

We Content mining

We 6tructure mining

We usage mining
#/$2/$% Data Warehouse & BI $#
Business Intelligence

BI 1ools<

-nline analytical processing=-.A/><

?ulti@dimensional data analysis

Data mining< Disco!ery dri!en

1e*t mining and we mining

Database (uery an& reporting tools

Data !isuali+ation" dashoards

#/$2/$% Data Warehouse & BI $5
Dashboar&s
#/$2/$% Data Warehouse & BI 2;
Data Warehouse & BI 2$
)ample DW +,I+BI Tools
#/$2/$%
-.e"ution !#stems
/ CR+
/ -R*
/ 0ega"#
/ e Commer"e
-.ternal &ata
/ *ur",ased
mar1et data
/ !$read s,eets
!am$le Te",nologies
!*
*eo$le!o't
!iebel
Ora"le $$li"ations
Custom !#stems
!our"e !#stems -T0 0a#er
-.tra"t2 Trans'orm2
0oad la#er
/ Cleanse data
/ Filter data
/ !tandardize
values
/ &e"ode values
/ $$l# business
rules
-T0 Tools
/ In'ormati"a
/ In'ormation !erver (IB+)
/ Ora"le Ware,ouse builder
/ *enta,o (O$ensour"e)
/ !!I! (+i"roso't)
/ +*R-&%C- / (&OO*
(3oogle / 4a,oo)
Enterpris
e DW
?etadata
9epositor
y
Data
?art
Data
?art
Data
?art
Data
?art
&ata ) +etadata
Re$ositor# 0a#er
&atabase
Ora"le
&B5
!60 !erver
Teradata
Verti"a
*resentation
0a#er
Re$orting Tools
O0* Tools
d (o" 6uer#
Tools
&ata +ining
Tools
In'ormation
&eliver#
Cognos
Business Ob7e"ts
Ora"le &is"overer
Brio2 *enta,o
Managing Data -esources

Estalishing an information policy

Data Administration
/ De!eloping information policies
/ /lanning for data
/ -!erseeing logical dataase design
/ Data dictionary de!elopment
/ ?onitoring the usage of data y techies and non@techies
/
Data 'o!ernance
/
/ri!acy and security of data
/ 7uality of data
/ Compliance
/
Ensuring data )uality< accuracy" accessiility"
rele!ance" timeliness and completeness
#/$2/$% 22 Data Warehouse & BI
7 & A
Data Warehouse & BI 2%
Online Analytical #rocessing

?ultidimensional data analysis

Ciewing the same data using multiple

dimensions

6ales may e seen in the dimension of product

model" time" geography or any other applicale
dimensions

-nline answers for adhoc )ueries which

needs multi@dimensional !iew of data from
large dataases
#/$2/$%
Data Warehouse & BI 20
Multi.Dimensional Data Mo&el
#/$2/$%