03/28/11

GoogleInc

03/28/11

GoogleInc

Gmail, Calendar, Picasa, Docs, Google Apps,...
App Engine

03/28/11

GoogleInc

Tera

Gega

TeraPeta

Peta

03/28/11

GoogleInc

 vs

03/28/11

GoogleInc

 vs

03/28/11

GoogleInc

 vs

03/28/11

GoogleInc

 vs

03/28/11

GoogleInc

03/28/11

GoogleInc



16GBDRAM;160GBSSD;5x1TBdisk

(Rack)
40
48portGigabitEthernetswitch

(Warehouse)
10,000 (250racks)
2KportGigabitEthernetswitch
03/28/11

GoogleInc

03/28/11

GoogleInc

03/28/11

GoogleInc

03/28/11

GoogleInc



, ,
, ,

Flash(SSD);GPU
03/28/11

GoogleInc

30
03/28/11

GoogleInc

( )

2000 2005
6 8
03/28/11

GoogleInc

03/28/11

GoogleInc


= 2.0

IT
03/28/11

Google = 1.16

GoogleInc



, ,
, ,

Flash(SSD);GPU
03/28/11

GoogleInc


99.9% =9 /
10,000
0.25
3
1,000
1,000s
etc.,etc.,etc.

03/28/11

GoogleInc

03/28/11

GoogleInc



, ,
, ,

Flash(SSD);GPU
03/28/11

GoogleInc

03/28/11

GoogleInc

 (GFS)
GFS Master
Master

Client

sa
ci
lp
e
R

GFS Master

C0

C1

C3

C4

03/28/11

Client
C1

C3

C0

C5

C3
C4

GoogleInc

MapReduce
Data Block 1

Data
Data

datadatada
datadatada
tadatadata
tadatadata
datadatada
datadatada
tadatadata
tadatadata

Data Block 2

map
Reduce

map

Data Block 3

Results
Results
datadata
datadata
datadata
datadata
datadata
datadata

Data Block 5

map

map
map
Data Block 4

GFS Mapreduce 2004 , Hadoop

, Facebook Hadoop
03/28/11

GoogleInc

 (BigTable)

:
:
:
03/28/11

GoogleInc

03/28/11

GoogleInc

03/28/11

GoogleInc

03/28/11

GoogleInc

03/28/11

GoogleInc



PeterNorvig
StuartFeldman
EdwardChang
XuemeiGu
HaiFang

03/28/11

GoogleInc

03/28/11

GoogleInc

 20111020~22
www.qconhangzhou.com6

QCon
www.qconbeijing.com