Académique Documents
Professionnel Documents
Culture Documents
Computer Utilities
Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms
Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture
SLA-oriented Resource Allocation
Global Cloud Exchange
Emerging Cloud Platforms
Cloudbus: Melbourne Cloud Computing Project
Summary and Thoughts for Future
3
Computer Utilities Vision:
Implications of the Internet
1969 Leonard Kleinrock, ARPANET project
As of now, computer networks are still in their infancy,
but as they grow up and become sophisticated, we will
probably see the spread of computer utilities, which,
like present electric and telephone utilities, will service
individual homes and offices across the country
Computers Redefined
1984 John Gage, Sun Microsystems
The network is the computer
2008 David Patterson, U. C. Berkeley
The data center is the computer. There are dramatic differences between
of developing software for millions to use as a service versus distributing
software for millions to run their PCs
2008 The Cloud is the computer Buyya!
4
Computing Paradigms and
Attributes: Realizing the Computer
Utilities Vision
} ?
Web
Data Centres
Utility Computing
Service Computing
Grid Computing +
P2P Computing
Market-Oriented
Computing -Ubiquitous
Cloud Computing -Reliable -Trillion $ business
-Scalable
-Autonomic
Paradigms -Dynamic
discovery
- Composable
-QoS
-SLA
-
5
Attributes/Capabilities
Outline
Computer Utilities
Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms
Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture
SLA-oriented Resource Allocation
Global Cloud Exchange
Emerging Cloud Platforms
Cloudbus: Melbourne Cloud Computing Project
Summary and Thoughts for Future
6
Gold rush: Too many people are
7
2009 Gartner IT Hype Cycle
of Emerging Technologies
8
Defining Clouds: There are many
views for what is cloud computing?
Over 20 definitions:
http://cloudcomputing.sys-con.com/read/612375_p.htm
Buyyas definition
"A Cloud is a type of parallel and distributed system consisting
of a collection of inter-connected and virtualised computers
that are dynamically provisioned and presented as one or
more unified computing resources based on service-level
agreements established through negotiation between the
service provider and consumers.
Keywords: Virtualisation (VMs), Dynamic Provisioning
(negotiation and SLAs), and Web 2.0 access interface
9
Cloud Services
Infrastructure as a Service
(IaaS)
Software as a Service (SaaS)
CPU, Storage: Amazon.com,
Nirvanix, GoGrid.
Platform as a Service (PaaS)
Platform as a Service (PaaS)
Google App Engine, Microsoft
Azure, Manjrasoft Aneka..
Software as a Service (SaaS)
Infrastructure as a Service (IaaS)
SalesForce.Com
10
Clouds based on Ownership and
Exposure
11
(Promised) Benefits of (Public)
Clouds
12
Cloud opportunity in short term
13
When will Cloud spending become
50% of IT spending or reach to a
several trillion $ business/year?
600?
120?
15%
Software Eng.
Complexity
15
Outline
Computer Utilities
Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms
Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture
SLA-oriented Resource Allocation
Global Cloud Exchange
Emerging Cloud Platforms
Cloudbus: Melbourne Cloud Computing Project
Summary and Thoughts for Future
16
Realizing the Computer Utilities
Vision: What Consumers and
Providers Want?
Consumers minimize expenses, meet QoS
How do I express QoS requirements to meet my goals?
How do I assign valuation to my applications?
How do I discover services and map applications to meet QoS needs?
How do I manage multiple providers and get my work done?
How do I outperform other competing consumers?
Providers maximise Return On Investment (ROI)
How do I decide service pricing models?
How do I specify prices?
How do I translate prices into resource allocations?
How do I assign and enforce resource allocations?
How do I advertise and attract consumers?
How do I perform accounting and handle payments?
Mechanisms, tools, and technologies
value expression, translation, and enforcement
17
Market-based Systems = Self-
managed and self-regulated
systems.
Manage 1
Complexity
Supply and
Demand
Enhance Utility
2
3
penalty
18
Market-oriented Cloud
Architecture: QoS negotiation and SLA-
based Resource Allocation
19
A (Layered) Cloud Architecture
Cloud applications
User level
Social computing, Enterprise, ISV, Scientific, CDNs, ...
Adaptive Management
Middleware
Programming, Workflows, Libraries, Scripting
Apps Hosting Platforms
QoS Negotiation, Admission Control, Pricing, SLA Management,
Core Monitoring, Execution Management, Metering, Accounting, Billing
Middleware
Cloud resources
System level
20
Outline
21
Some Commercial-Oriented Cloud
platforms/technologies
System Amazon Google Microsoft Manjrasoft
Property EC2 & S3 App Engine Azure Aneka
s o
ix os Am
van M nS
3 azo
ver Ni r azo
n E C2
enSer Am
ix X
C i tr
Hy
pe I aaS
r vi V
so
rs p er-
Hy
Pub n
lic
ine
Clou
d Xe
En g
A pp are
gle W Complex decisions
Goo VM to make?
Private Clo
ud
lo ud
r id C
H yb
23
InterCloud: Global Cloud Exchange
and Market Maker
Compute Cloud
Storage Cloud
Broker 1
Directory
.
. Bank
. Auctioneer
Enterprise .
Resource
Manager
(Proxy) Broker N
Global Cloud Compute
Cloud
Exchange
Enterprise IT Consumer
Storage Cloud
24
Outline
Computer Utilities
Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms
Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture
SLA-oriented Resource Allocation
Global Cloud Exchange
Emerging Cloud Platforms
Cloudbus: Melbourne Cloud Computing Project
Summary and Thoughts for Future
25
Cloudbus@CLOUDS Lab:
Melbourne Cloud Computing Initiative
Market-Oriented Clouds
SLA-based Resource Management
Global Cloud Exchange Elements: Brokers
Aneka .NET-based Cloud Computing
PaaS for Enterprise and Public Clouds
Scaling Across Clouds (Meta Brokering) Harnessing Compute
resources
Federation of clouds for application scaling across distributed resources
3rd Party Cloud Services (e.g., MetaCDN) Harnessing Storage
resources
Building Content Delivery Networks using different vendors Storage
Clouds
Green Clouds / Data Centers
Energy Efficiency and QoS Oriented Resource Allocation
CloudSim: Toolkit for Simulation of Clouds
Design and evaluation for resource management policies & algorithms
26
Aneka: .NET-based Cloud
Computing
27
QoS Negotiation in Aneka
Meta Negotiation
Registry 3. Matching
DB
DB
DB Registries
MN Middelware
MN Middelware
Gridbus Broker 4. Session Establishment Aneka
Amadeus Meta- Meta-
Negotiation Handshaking Handshaking
Workflow Negotiation
6. Service Invocation
28
Aneka: components
Client
Agent Executor
internet
work units
Scheduler
Aneka Worker
internet
Aneka Manager Service
Executor
Client
Agent
Programming / Deployment Model
Aneka User Agent
29
Aneka & Virtual Resource Pools
Integration
XenServer Pool
Allows resource provisioning over private Cloud
infrastructure managed by Xen Server
VMWare Pool
Allows resource provisioning over private Cloud
infrastructure managed by VMWare
Amazon EC2 Pool
Allows resource provisioning over public Cloud
provider : Amazon EC2
30
Aneka Cloud
Aneka
Amazon Clouds
Enterprise Desktops/Servers Cloud
31
Aneka+Xen Suspend VM (10)
Start VM (10)
Request (20
(5 resources,
Completed
resources,$0)
$0) Xen Server
- Capacity : 10 VMs
Provision (14)
Aneka
Suspend
Start VM
VM(4)(4)
Join Network(14)
Release (14)
Amazon Clouds
Enterprise Desktops/Servers Cloud
32
Aneka+Xen+EC2 Start VM (10)
Suspend VM (10)
Request (30
(5 ($3.2)
Completed resources,
resources,$0)
$5) Xen Server
- Capacity : 10 VMs
Provision (24)
Aneka
Suspend
Start VM
VM(5)(5)
Join Network(24)
Release (24)
Release
Start VMVM
(9)(9)
Amazon Clouds
- Cost : 20 cents per instance
Use private
Aneka Cloud
LAN network
(Running Maya Batch Mode on
demand)
Case 2: Aneka
Enterprise Cloud Time
(in hrs)
Centralized
log parsing
Single scheduler
controlling the
execution of all the logs
Single matches.
GameController Game Servers
36
DNA MicroArray Data Analysis for
BRCA (Brain Cancer gene profiles)
Aneka on
Public Cloud
Amazon EC2
37
Gene Expression Profiling
Classification on Public Clouds
Cloud CoXCS
Development and execution
Aneka distribution engine: Offspring environment of composable
dispatches CoXCS tasks workflows that are run on
in the Aneka Cloud. top of distributed middleware
via plug-in based engines.
c1.medium
39
Building 3rd Party Cloud Services
Harnessing Storage Clouds
41
Commercial Storage Clouds &
Pricing
42
MetaCDN: Harnessing Storage
Clouds for Content Delivery
(Broberg, Buyya, Tari, JNCA 2009)
43
Meta Brokering Harnessing Compute
Clouds for Application Scaling
Cloud computing
Building a Grid of Clouds
Global Utility Computing
R2 Application
database
R3 R4
R5 RN
Grid Resource Broker
R6
R1
Resource Broker
45
Gridbus Service Broker (GSB)
46
workload
TM TS
Core Middleware $ GE GIS, NWS
RM & TS G
$ Data
Data
C Catalog
$ G
U Node
Globus L
enabled A
47 node. Amazon EC2/S3 Cloud.
Gridbus Broker: Separating applications
from different remote service access
enablers and schedulers
Data Catalog
Plugin Actuators
Aneka Globus
Job manager
Data Store Amazon EC2 SSH
Access Technology fork()
AMI
fork() batch() batch()
SRB
-PBS
-PBS
Gridbus Grid FTP -Condor
Gridbus
-Condor agent
agent -SGE
-SGE
-XGrid
48
s
49
Market-Oriented Scheduling
Experiments
Experiment Setup: DBC Scheduling
with Optimize for (1) Time & (2)
Cost
Workload:
A parameter sweep synthetic application (100 jobs), each job
is modeled to execute ~5 minute with variation of (+/-20 sec.).
QoS Constraints: Deadline: 40 min. and Budget: $6
Resources:
US
R*
Europe R2 Information
Service
Australia R1
R4,5
Resource Broker
51
Resources & Price (multiplier for clarity)
TotalJobs
Rate
Organization Resource Details (Cents per
second*1000 ) Time-Opt Cost-Opt
53
Results of Execution on Cloud and other
Distributed Resources
TotalJobs
Rate
Organization Resource Details (Cents per
second*1000 ) Time-Opt Cost-Opt
55
Resource Scheduling for DBC
Time Optimization
56
Resources Consumed by
Cost and Time Opt. Strategies
Cost-Opt Time-Opt
UniMelb: .006
EC2-m : .06
UCi: .002
EC2-s : .03
EU: .003
EC2-s: .03
Georgia: .09
(most
expensive)
Time Cost
Budget Consumed 5.04$ 3.71$
Computer Utilities
Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms
Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture
SLA-oriented Resource Allocation
Global Cloud Exchange
Emerging Cloud Platforms
Cloudbus: Melbourne Cloud Computing Project
Summary and Thoughts for Future
60
Summary
61
Dozens of Open Research Issues
62
Convergence of Competing
Paradigms/Communities Needed
} ?
Web
Data Centres
Utility Computing
Service Computing
Grid Computing +
P2P Computing
Cloud Computing
Market-Oriented Ubiquitous
Computing access -Trillion $ business
Reliability - Who will own it?
Scalability
Paradigms Autonomic
Dynamic
discovery
Composability
QoS
SLA
63
Attributes/Capabilities
References
Blueprint Paper!
R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, I. Brandic, Cloud Computing and
Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as
the 5th Utility, Future Generation Computer Systems (FGCS) Journal, June 2009.
Aneka Documents:
http://www.manjrasoft.com/
The Grid Economy Paper:
R. Buyya, D. Abramson, S. Venugopal, The Grid Economy, Proceedings of the
IEEE, No. 3, Volume 93, IEEE Press, 2005.
MetaCDN Paper:
James Broberg, Rajkumar Buyya, and Zahir Tari, MetaCDN: Harnessing 'Storage
Clouds' for High Performance Content Delivery, Journal of Network and
Computer Applications, ISSN: 1084-8045, Elsevier, Amsterdam, The Netherlands,
2009.
Cloudbus Keynote Paper:
R. Buyya, S. Pandey, and C. Vecchiola, Cloudbus Toolkit for Market-
Oriented Cloud Computing, Proceeding of the 1st International
Conference on Cloud Computing (CloudCom 2009, Springer, Germany),
Beijing, China, December 1-4, 2009.
64
Thanks for your attention!
65
Solutions for Cloud Computing
66