Utility-Oriented Cloud & Grid Computing: A Vision, Hype, and Reality

Utility-Oriented Cloud & Grid Computing:
A Vision, Hype, and Reality

Dr. Rajkumar Buyya
Grid Computing and Distributed Systems (GRIDS) Lab
Dept. of Computer Science and Software Engineering
The University of Melbourne, Australia
www.gridbus.org
www.buyya.com
www.manjrasoft.com
Gridbus Sponsors
The GRIDS Lab @ Melbourne

R&D
Youngest and one of the rapidly

growing research labs in our
School/University:
Founded in 2002
Houses 20+ researchers consisting of:
Widely in academic and industrial users.
Publication:
Academics
Industries
Software:
Faculties of Science, Engineering, and

Medicine
Many national and international

collaborations.
National and International organizations

Australian Research Council & DEST
Many industries (Sun, StorageTek, Microsoft,
IBM, Microsoft)
University-wide collaboration:
Research Fellows/PostDocs
Software Engineers
PhD candidates
Honours/Masters students
Funding
Education
My research team produces over 20% of our

Depts research output.
+ Community Services: e.g., IEEE TC for Scalable
Agenda
Introduction
Global Grids and Challenges
Architecture, Design and Implementation
Performance Evaluation: Experiments in Creation

and Deployment of Applications on Global Grids
Market-based Management, GMD, Grid Bank, Aneka
Grid Service Broker
Security, resource management, pricing models,
Service-Oriented Grid Architecture and Gridbus

Solutions
Utility Networks and Grid Computing

Application Drivers and Various Types of Grid Services
A Case Study in High Energy Physics
Summary and Conclusion
Computer Utilities Vision:

Implications of the Internet
1969 Leonard Kleinrock, ARPANET project
As of now, computer networks are still in their infancy,

but as they grow up and become sophisticated, we will
probably see the spread of computer utilities, which,
like present electric and telephone utilities, will service
individual homes and offices across the country
Computers Redefined
1984 John Gage, Sun Microsystems
2008 David Patterson, U. C. Berkeley
The network is the computer

The data center is the computer. There are dramatic differences between of
developing software for millions to use as a service versus distributing
software for millions to run their PCs
2008 Cloud is the computer Buyya!
Computing Paradigms and

Attributes: Realizing the Computer
Utilities Vision
Paradigms
} ?
Web
Data Centres
Utility Computing
Service Computing
Grid Computing
P2P Computing
Market-Oriented
Computing
Cloud Computing
-Ubiquitous
access
-Reliability
-Scalability
-Autonomic
-Dynamic
discovery
- Composability
-QoS
-SLA
-
-Trillion $ business
- Who will own it?
Attributes/Capabilities
* Since Grids have been around for

sometime (early 2000), do we have a
unified vision of what Grids can do?
* And did we make sufficient advances to
turn vision of computer utilities into a
reality?
- Let us take a look at views of

-industrial practitioners & academics
-
Industrial vision of Grid computing
IBM
Microsoft
Elastic Compute Cloud Services
Manjrasoft
Adaptive Enterprise
Amazon
N1 Sun Grid Engine
HP
10g
Sun
.NET
Oracle
On Demand Computing
Aneka for building enterprise Grids and Clouds.
Most academics view:

Cyberinfrastructure for conducting
collaborative (e-)Science
E-Scientist
Peers sharing ideas and collaborative
interpretation of data/results
Cyberinfrastructure
Distributed data
Remote
Visualization
2100
2100
2100
2100
Distributed computation
2100
2100
2100
2100
8
Data & Compute Service
Distributed instruments
How do Grids look like?

A Bird Eye View of a Global Grid
Grid Information Service
Grid Resource Broker
R2
R3
R5
database
Application
R4
RN

R6
R1
Resource Broker
How do Grids look like?

A Bird Eye View of a Global Grid
R2
R3
R5
database
Application
R4
RN

R6
10
R1
Resource Broker
How Are Grids Used?

Utility computing
High-performance computing
Collaborative design
Financial modeling
Collaborative data-sharing
High-energy physics
E-Business
Drug discovery
Data center automation
Natural language
processing
11
Life sciences
E-Science
Business Intelligence
(Data Mining)
Agenda
Introduction
12

Grid Service Broker

Solutions

Grid Challenges
Security
Computational Economy
Uniform Access
Resource Discovery
System Management
Data locality
Resource Allocation
& Scheduling
Application Construction
13
Network Management
Some Grid Initiatives

USA
Worldwide
Australia
120million 5 yrs
450million 5 yrs
486million 5 yrs
OurGrid, EasyGrid
LNCC-Grid + many others
ChinaGrid Education
CNGrid - application
UK eScience
EU Grids..
and many more...
Garuda
NAREGI
Korea...
1 billion 5 yrs
N*Grid
Singapore
NGP
IBM On Demand Computing

2? billion
HP Adaptive Computing
Sun N1
Microsoft - .NET
Oracle 10g
Amzon Elastic Compute Cloud
Infosys Enterprise Grid
Satyam Business Grid
Manjrasoft enterprise Clouds
and Grids
and many more
Public Forums
Open Grid Forum

Conferences:
14
1.3 billion 3 yrs
Industry Initiatives
India
1.3 billion (Rs)

Japan
Europe
China
Brazil
Nimrod-G
Gridbus
DISCWorld
27 million
GrangeNet.
APACGrid
ARC eResearch
Globus
TeraGrid
Cyberinfrasture
AutoMate
and many more...
CCGrid
Grid
HPDC
E-Science
http://www.gridcomputing.com
Open-Source Grid Middleware

Projects
15
Slide by Hiro
Driving Theme:
Community vs. Utility Grids
Type Community Grids
Feature
16
Utility Grids (Now

Clouds)
User QoS
Best effort
Contract/SLA
Service
Pricing
Not considered /
free access
Usage, QoS level,

Market supply and
demand
Example
Middleware
Globus, Condor,
OMII, Unicore
Nimrod-G, Gridbus, &

many inspired efforts
(IBM Business Grid,
Sun Grid Market)
.. Amazon EC2..
The Gridbus Project @ Melbourne:
Enable Leasing of ICT Services on Demand
WWG
Gridbus
Pushes Grid computing into

mainstream computing
17
18
Agenda
Introduction
19

Grid Service Broker

Solutions

What do Grid players want &

require?
20
Grid Service Consumers (GSCs): - minimize expenses, meet QoS
How do I express QoS requirements ?
How do I trade between timeframe & cost ?
How do I discover services and map jobs to meet my QoS needs?
How do I manage Grid dynamics and get my work done?
Grid Service Providers (GSPs): maximise ROI
How do I decide service pricing models ?
How do I specify them ?
How do I translate them into resource allocations ?
How do I enforce them ?
How do I advertise & attract consumers ?
How do I do accounting and handle payments?
They need mechanisms, tools and technologies that help them

in value expression, value translation, and value enforcement.
Service-Oriented Grid
Architecture
Data Catalogue
Grid Bank
Job
Control
Agent
Grid Node1
Pricing
Algorithms
Trading
Deployment Agent
21
QoS
Trade Server
Trade Manager
Grid Service Consumer
Grid Node N
Secure
Schedule Advisor
JobExec
Storage
Core Middleware
Services
Health
Monitor
Grid Explorer
Info ?
Information
Service
Programming
Environments
Applications
Sign-on
Grid Market
Services
Accounting
Resource
Reservation
Misc. services
Resource Allocation
R1
R2
Rm
Grid Service Providers
Market-Oriented Grid Software:

A union of Gridbus and other
technologies
User-Level
Middleware
Core Grid
Middleware
Grid
Fabric
Software
Grid
Fabric
Hardware
22
Science
Commerce
APIs/Tools:
MPI
Engineering
ExcellGrid
Globus
NorduGrid
Workflow APIs
Grid Workflow Engine
Grid Scheduling:
Aneka
Cloud
(WSbased
access
+ SLA
Collaboratories
Grid Portals
Task, Parametric, and

Components Programming
Gridbus Resource Broker
Unicore
XGrid
JVM
Grid
Storage
Economy
Condor
Grid
Exchange &
Federation
Grid
Bank
PBS
SGE
Libra
Grid
Market
Directory
Tomcat
.NET
Windows
Solaris
Linux
AIX
IRIX
Mac
OSF1
CDB
PDB
Worldwide
Grid
Grid Economy
Grid
Applications
On Demand Assembly of Services in

Market-Oriented Grid Environments
Application Code
Explore
data
1
Visual Application Composer
10
ts+
l
u
s
o
Re t Inf
s
Co
Data Catalogue 5
6
Grid
Resource Broker
23
GSP
(e.g., IBM)
ts
12
Grid Market Directory
Res
ul
Jo b
CPU
or
PE
Grid Info Service
ASP Catalogue
Grid Service
(GS)
(Globus)
Aneka
Bill
EC2
Resource Allocation
PE
GSP
(e.g., Microsoft)
PE
GTS
11
Gridbus
GridBank
GSP
GSP
(Accounting Service)
(e.g., Amazon)

24
Cloud Services
Infrastructure as a Services (IaaS)
Platform as a Services (PaaS)
CPU, Storage: Amazon.com et. al

Google App Engine, Microsoft Azure, and
Manjrasoft Aneka
Software as a Service (SaaS)
SalesForce.Com
Enterprise/Private
Clouds
Clouds
Public/Internet Clouds
25
Layered view of services

within a Cloud stack
Software as a Service (SaaS)
e.g., ..SalesForce.com
Platform as a Service (PaaS)
e.g., ..Aneka
Infrastructure as a Service (IaaS)
26
e.g., Amazon, Nirvanix
Aneka
A Software Platform for Building and

Managing Enterprise Grids and
Clouds
Aneka: A 3rd Gen enterprise Grid

Technology Cloud model
Generation
First
(-2001)
Properties
Application-specific
platforms
Second
Single programming
(2002-2006) model, rigid
architecture, no QoS
Third
(20072012?)
28
Technologies
distributed.net,
SETI@Home
UD, XtremeWeb,
Alchemi,
Digipede,
DataSynapse,
BOINC
SOA, extensible
Aneka
architecture, multiple
programming models,
multi-tenancy,
enterprise QoS, SLAs,
market-based resource
ANEKA Product Overview (Alpha)
.NET based service-oriented

platform for grid / cloud
computing
Development and Run Time
Environment
Includes Development and
Management Tools
Suitable for
29
Development of Enterprise
Grid / Cloud Applications
Grid / Cloud enabling legacy
applications
Ideal for Corporate

Developers, Software, SaaS,
Hosting Vendors and
Application / System
Integrators
ANEKA Product Architecture
Aneka Deployment Models
Enterprise/Private
Enterprise/Private
Clouds
Aneka
Public
Public Clouds
30
Harness LAN connected

resources
Application Development,
Testing, Execution
Teaching and Learning
Sensitive applications
Hosted by a 3rd party service

provider owning a large Data
Center (1000s of servers)
Offers subscription-based
services to their shared
infrastructure on pay-as go
model.to many users from
different organisations.
Amazon.com, Microsoft Azure
Aneka SDK + Execution Manger
Aneka: components
public DumbTask: ITask
{
public void Execute()

{
i=0; i<n; i++)
for(int
{ }
}
DumbTask task = new DumbTask();
app.SubmitExecution(task);
}
Aneka enterprise Cloud
Executor
work units
Executor
Client
Agent
Executor
internet
work units
Scheduler
internet
Aneka Worker
Service
Aneka Manager
Executor
Client
Agent
Programming / Deployment Model
Aneka Users
31
How does it solve the problem?
Divide the problem in to multiple small tasks and distribute

them run in parallel on multiple computers within a Cloud.
An Illustratioin
Executor
Application
Manager
Manager / Executor
GThreads/Tasks
32
User scenario: GoFront
(unit of China Southern Railway

Group)
Application: Locomotive design CAD rendering
Aneka Maya Renderer
GoFront Private Aneka

Cloud
Use private
Aneka Cloud
LAN network
(Running Maya Batch Mode on
demand)
Case 2: Aneka
Enterprise Cloud
Time
(in hrs)
Case 1: Single Server

Raw Locomotive Design Files
(Using AutoDesk Maya)
Using Maya
Graphical Mode
Directly
Single
Server
4 cores
server
33
Aneka
Cloud
Aneka utilizes idle desktops

(30) to decrease task time
from days to hours
Aneka: How can get it?
Available to Download:
Teaching material
= Fee you charge to 1 student (each year) and all

students/teachers in entire college/university can use it!
Applications
34
parallel and distributed computing and programming,

List of possible assignments for students
Possible Projects for Final year students..
Price highly affordable
Software: www.manjrasoft.com
Manual: Setting up Cloud using your LAN-network computers
Other Departments (Physics, Chemistry, Biology, Finance,

Engineering) can use it for their applications.

35
Agenda
Introduction
36

Grid Service Broker

Solutions

Grid Service Broker (GSB)
A resource broker for scheduling task farming data Grid

applications with static or dynamic parameter sweeps
on global Grids.
It uses computational economy paradigm for optimal
selection of computational and data services depending
on their quality, cost, and availability, and users QoS
requirements (deadline, budget, & T/C optimisation)
Key Features
37
A single window to manage & control experiment

Programmable Task Farming Engine
Resource Discovery and Resource Trading
Optimal Data Source Discovery
Scheduling & Predications
Generic Dispatcher & Grid Agents
Transportation of data & sharing of results
Accounting
workload
Gridbus User Console/Portal/Application Interface
App, T, $, Optimization
Preference
Gridbus Broker
Gridbus Farming Engine
Schedule Advisor
Trading Manager
Record
Keeper
Grid Dispatcher
Core Middleware
Grid Explorer
TM
TS
GE
GIS, NWS
Grid Info Server

RM & TS
Globus
enabled
38 node.
L
Amazon EC2/S3 Cloud.
Data
Node
Data
Catalog
Gridbus Broker: Separating applications

from different remote service access
enablers and schedulers
Application Development Interface

Scheduling
Interfaces
Home Node/Portal
Alogorithm1
AlogorithmN
Gridbus
Broker
Single-sign on security
batch()
fork()
-PBS
-Condor
-SGE
-Aneka
-XGrid
Data Catalog
Plugin Actuators
Aneka
Globus
Data Store
Job manager
Amazon EC2
Access Technology
fork()
batch()
-PBS
-Condor
-SGE
39
Gridbus
agent
Grid FTP
SRB
AMI
SSH
fork()
batch()
-PBS
-Condor
-SGE
-XGrid
Gridbus
agent
Gridbus Services for eScience

applications
Application Development Environment:
Resource Allocation and Scheduling
Dynamic discovery of optional computational and data nodes that

meet user QoS requirements.
Hide Low-Level Grid Middleware interfaces
40
XML-based language for composition of task farming (legacy)

applications as parameter sweep applications.
Task Farming APIs for new applications.
Web APIs (e.g., Portlets) for Grid portal development.
Threads-based Programming Interface
Workflow interface and Gridbus-enabled workflow engine.
Grid Superscalar in cooperation with BSC/UPC
Globus (v2, v4), SRB, Aneka, Unicore, and ssh-based access to

local/remote resources managed by XGrid, PBS, Condor, SGE.
Click Here for Demo
Drug Design
Made Easy!
41
42
Agenda
Introduction
43

Grid Service Broker

Solutions

Case Study:
High Energy Physics and Data Grid
The Belle Experiment
44
KEK B-Factory, Japan

Investigating fundamental violation of
symmetry in nature (Charge Parity)
which may help explain why do we
have more antimatter in the universe
OR imbalance of matter and
antimatter in the universe?.
Collaboration 1000 people, 50
institutes
100s TB data currently
Case Study: Event Simulation and

Analysis
B0->D*+D*-Ks
Simulation and Analysis Package - Belle Analysis Software Framework
(BASF)
Experiment in 2 parts Generation of Simulated Data and Analysis of
the distributed data
Analyzed 100 data files (30MB each) that were distributed among
the five nodes within Australian Belle DataGrid platform.
45
Australian Belle Data Grid Testbed

Certificate
Authority
Analysis Request
Analysis Results
Virtual
Organization
Replica
Catalog
NWS
NameServer
Grid
Service
Broker
Globus
Gatekeeper
GRIS
Globus
Gatekeeper
GRIS
NWS
Sensor
NWS
Sensor
GridFTP
Dual Intel Xeon 2.8 Ghz,

2 GB RAM
GridFTP
Dept. of Physics,
University of Sydney

2 GB RAM
AARNET
GRIDS Lab,
University of Melbourne
Globus
Gatekeeper
GRIS
Globus
Gatekeeper
GRIS
NWS
Sensor
GridFTP
Globus
Gatekeeper
GRIS
NWS
Sensor
GridFTP
NWS
Sensor
GridFTP

2 GB RAM
ANU, Canberra
VPAC
Melbourne
46
Intel Pentium 2.0 Ghz,

512 MB RAM
Dept. of Physics,

2 GB RAM
Dept. of Computer Science,

University of Adelaide
Belle Data Grid (GSP CPU Service Price: G$/sec)

Certificate
Authority
Analysis Request
Analysis Results
Virtual
Organization
Replica
Catalog
NWS
NameServer
Grid
Service
Broker
Globus
Gatekeeper
GRIS
Globus
Gatekeeper
GRIS
NWS
Sensor
NWS
Sensor
GridFTP
GridFTP
Dept. of Physics,
NA
2 GB RAM
Globus
Gatekeeper
AARNET
GRIDS Lab,
GRIS
Globus
Gatekeeper
GRIS
NWS
Sensor
Globus
Gatekeeper
GridFTP
GRIS
NWS
Sensor
GridFTP
NWS
Sensor
2 GB RAM
GridFTP
ANU, Canberra
VPAC
Melbourne
47
G$4

2 GB RAM
G$6

512 MB RAM
Dept. of Physics,
G$2

2 GB RAM
Data
node

G$4
Belle Data Grid (Bandwidth Price: G$/MB)

Certificate
Authority
Analysis Request
Analysis Results
Virtual
Organization
NWS
NameServer
Replica
Catalog
Grid
Service
Broker
Globus
Gatekeeper
32
Globus
Gatekeeper
GRIS
GRIS
33
36
NWS
Sensor
31
GridFTP
NA
30

2 GB RAM
Dept. of Physics,
NWS
Sensor
Globus
Gatekeeper
GridFTP
GRIS
GRIS
NWS
Sensor
GridFTP
NWS
Sensor
2 GB RAM
GridFTP
ANU, Canberra
VPAC
Melbourne
48
G$6

512 MB RAM
Dept. of Physics,
G$4

2 GB RAM
Globus
Gatekeeper
31
GRIDS Lab,
GRIS
GridFTP
34
38
AARNET
Globus
Gatekeeper
NWS
Sensor
G$2

2 GB RAM
Data
node

G$4
Deploying Application Scenario
A data grid scenario with 100 jobs and

each accessing remote data of ~30MB
Deadline: 3hrs.
Budget: G$ 60K
Scheduling Optimisation Scenario:
49
Minimise Time
Minimise Cost
Results:
Time Minimization in Data Grids

fleagle.ph.unimelb.edu.au
belle.anu.edu.au
belle.physics.usyd.edu.au
brecca-2.vpac.org
80
70
Number of jobs completed
60
50
40
30
20
10
0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42
Time (in mins.)
50
Results : Cost Minimization in Data

Grids
fleagle.ph.unimelb.edu.au belle.anu.edu.au belle.physics.usyd.edu.au brecca-2.vpac.org
100
90
80
Number of jobs completed
70
60
50
40
30
20
10
0
1
51
9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63
Time(in mins.)
Observation
Organization
52
Node details
Cost (in G$/CPU-sec)
Total Jobs
Executed
Time
Cost
CS,UniMelb
belle.cs.mu.oz.au
4 CPU, 2GB RAM, 40 GB HD, Linux
N.A. (Not used as a

compute resource)
--
--
Physics, UniMelb
fleagle.ph.unimelb.edu.au
1 CPU, 512 MB RAM, 40 GB HD,
Linux
94
CS, University of
Adelaide
belle.cs.adelaide.edu.au
4 CPU (only 1 available) , 2GB RAM,
40 GB HD, Linux
N.A. (Not used as a

compute resource)
--
--
ANU, Canberra
belle.anu.edu.au
4 CPU, 2GB RAM, 40 GB HD, Linux
Dept of Physics,
USyd
belle.physics.usyd.edu.au
4 CPU (only 1 available), 2GB RAM,
40 GB HD, Linux
72
VPAC, Melbourne
brecca-2.vpac.org
180 node cluster (only head node
used), Linux
23
Agenda
Introduction
53

Grid Service Broker

Solutions

Grids exploit synergies that result from cooperation of

autonomous entities:
Grids have emerged as enabler for

Cyberinfrastructure that powers e-Science and eBusiness applications.
SOA + Market-based Grid Management = Utility Grids
Grids allow users to dynamically lease Grid services at
runtime based on their quality, cost, availability, and
users QoS requirements.
Delivering ICT services as computing utilities.
Clouds are rapidly emerging, but more work is

required
54
Resource sharing, dynamic provisioning, and aggregation at global

level Great Science and Great Business!
Federation of Clouds, Cloud Exchange, and Application Scaling
Convergence of Competing
Paradigms/Communities Needed
Paradigms
55
} ?
Web
Data Centres
Utility Computing
Service Computing
Grid Computing
P2P Computing
Cloud Computing
Market-Oriented
Computing
Ubiquitous
access
Reliability
Scalability
Autonomic
Dynamic
discovery
Composability
QoS
SLA
-Trillion $ business
- Who will own it?
Attributes/Capabilities
Thanks for your attention!
Are there any
Questions?
Comments/ Suggestions
We Welcome Cooperation in R&D and Business! http:/

www.gridbus.org | www.Manjrasoft.com
rbuyya@unimelb.edu.au | raj@manjrasoft.com
56

Utility-Oriented Cloud & Grid Computing: A Vision, Hype, and Reality

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Utility-Oriented Cloud & Grid Computing: A Vision, Hype, and Reality

Transféré par

Droits d'auteur :

Formats disponibles

Utility-Oriented Cloud & Grid Computing:

A Vision, Hype, and Reality

The GRIDS Lab @ Melbourne

Youngest and one of the rapidly

Widely in academic and industrial users.

Faculties of Science, Engineering, and

Many national and international

National and International organizations

My research team produces over 20% of our

+ Community Services: e.g., IEEE TC for Scalable

Global Grids and Challenges

Architecture, Design and Implementation

Performance Evaluation: Experiments in Creation

Market-based Management, GMD, Grid Bank, Aneka

Grid Service Broker

Security, resource management, pricing models,

Service-Oriented Grid Architecture and Gridbus

Utility Networks and Grid Computing

A Case Study in High Energy Physics

Summary and Conclusion

Computer Utilities Vision:

1969 Leonard Kleinrock, ARPANET project

As of now, computer networks are still in their infancy,

1984 John Gage, Sun Microsystems

2008 David Patterson, U. C. Berkeley

The network is the computer

2008 Cloud is the computer Buyya!

Computing Paradigms and

* Since Grids have been around for

- Let us take a look at views of

Industrial vision of Grid computing

Elastic Compute Cloud Services

N1 Sun Grid Engine

Aneka for building enterprise Grids and Clouds.

Most academics view:

Data & Compute Service

How do Grids look like?

Grid Resource Broker

Grid Resource Broker

Grid Information Service

How do Grids look like?

Grid Resource Broker

Grid Resource Broker

Grid Information Service

How Are Grids Used?

Global Grids and Challenges

Architecture, Design and Implementation

Performance Evaluation: Experiments in Creation

Market-based Management, GMD, Grid Bank, Aneka

Grid Service Broker

Security, resource management, pricing models,

Service-Oriented Grid Architecture and Gridbus

Utility Networks and Grid Computing

A Case Study in High Energy Physics

Summary and Conclusion

Some Grid Initiatives

IBM On Demand Computing

Open Grid Forum

1.3 billion 3 yrs

1.3 billion (Rs)

Open-Source Grid Middleware

Utility Grids (Now

Usage, QoS level,