CS8005 VI Semester - Elective Course

CLOUD COMPUTING AND SERVICES

S.Thamarai Selvi
Professor
Department of Computer Technology
Madras Institute of Technology
Anna University Chennai
Chennai 600 044.

E Mail: stselvi @ annauniv.edu

thamaraiselvis@gmail.com

Acknowledgment

Resources from Internet

Books on cloud computing
Journal Papers
Conference proceedings

Unit I INTRODUCTION
Cloud-definition, benefits, usage
scenarios, History of Cloud Computing Cloud Architecture - Types of Clouds Business models around Clouds Major
Players in Cloud Computing - issues in
Clouds - Eucalyptus - Nimbus - Open
Nebula, Cloud Sim

UNIT II CLOUD
SERVICES
Types of Cloud services: Software as a
Service - Platform as a Service
Infrastructure as a Service - Database as
a Service - Monitoring as a Service
Communication as services. Service
providers- Google, Amazon, Microsoft
Azure, IBM, Sales force.

UNIT III COLLABORATING

USING CLOUD SERVICES
Email Communication over the Cloud CRM Management - Project ManagementEvent Management - Task Management
Calendar - Schedules - Word Processing
Presentation Spreadsheet - Databases
Desktop - Social Networks and
Groupware.

UNIT IV VIRTUALIZATION FOR

CLOUD
Need for Virtualization Pros and cons of
Virtualization Types of Virtualization
System Vm, Process VM, Virtual Machine
monitor Virtual machine properties Interpretation and binary translation, HLL
VM - Hypervisors Xen, KVM , VMWare,
Virtual Box, Hyper- V.
6

UNIT V SECURITY, STANDARDS

AND APPLICATIONS
Security in Clouds: Cloud security
challenges Software as a Service
Security, Common Standards: The Open
Cloud Consortium The Distributed
management Task Force Standards for
application Developers Standards for
Messaging Standards for Security, End
user access to cloud computing, Mobile
Internet devices and the cloud.

10

A Golden Era in Computing

Powerful
multi-core
processors
Explosion of
domain
applications

Proliferation
of devices

Wider bandwidth
for
communication

General
purpose
graphic
processors
Superior
software
methodologies
Virtualization
leveraging
the powerful
hardware
11

Evolution of Sharing on the Internet

Resource Sharing

Cloud Computing
Everything as a service over the Web:
SaaS, utility computing, IT services,
Ubiquitous, always available, scalable,

Grid Computing

The Grid

Services Sharing

Standards and software for sharing of

remote resources and collaboration
Mainly used for highly scalable HPC jobs

Information Sharing The World Wide Web

HTML page format, HTTP protocol, and

Mosaic browser for document exchange
Initially in universities; worldwide adoption

Network Sharing Inter-Networking and the Internet

Inter-Networking of regional networks with TCP/IP
Began to replace regional alternatives
Worldwide adoption file transfer

Networking

Networks
Multiple regional networks linking computers
Initially at universities and national labs
12

1970: DARPAs TCP/IP

1999: Grid Computing

1984: IEEE 802.3

Ethernet & LAN
1966: Flynns Taxonomy
SISD, SIMD, MISD, MIMD

1997: IEEE
802.11 (Wi-Fi)

1989: TCP/IP
IETF RFC 1122

2010: Microsoft
Azure
2008: Google
AppEngine

2007: Manjrasoft Aneka

1969: ARPANET
1984: DECs
VMScluster

1951: UNIVAC I,
First Mainframe

Clouds
1960: Crays
First
Supercomputer

Grids

1975: Xerox
PARC
Invented
Ethernet

2005: Amazon
AWS (EC2, S3)
2004: Web 2.0

1990: Lee-Calliau
WWW, HTTP, HTML

Clusters
Mainframes

1950

1960

1970

1980

1990

2000

2010

Components of distributed systems

Frameworks for
distributed
programming

IPC primitives
for control and
data.

Applications

Middleware

Operating
System
Networking and
Parallel
Hardware

Hardware

Applications

Distributed System
Stack

User interface for presentation

Middleware
Support for heterogeneous resource sharing, communication,
and programming environments for application development
Operative System
Execution platform including network connectivity services
Hardware
Computer and network hardware

MPI Programming,
JMS, MSMQ, MQS

Message
Based
Communicatio
n

Paradigms /
Architectural
Models

History of Cloud systems

1970: DARPAs TCP/IP

1999: Grid Computing

1984: IEEE 802.3

Ethernet & LAN
1966: Flynns Taxonomy
SISD, SIMD, MISD, MIMD

1997: IEEE
802.11 (Wi-Fi)

1989: TCP/IP
IETF RFC 1122

2010: Microsoft
Azure
2008: Google
AppEngine

2007: Manjrasoft Aneka

1969: ARPANET
1984: DECs
VMScluster

1951: UNIVAC I,
First Mainframe

Clouds
1960: Crays
First
Supercomputer

Grids

1975: Xerox
PARC
Invented
Ethernet

2005: Amazon
AWS (EC2, S3)
2004: Web 2.0

1990: Lee-Calliau
WWW, HTTP, HTML

Clusters
Mainframes

1950

1960

1970

1980

1990

2000

2010

Models of IPC
Message Based Communication
Message passing
RPC
Distributed Objects
Distributed Agents and Active Objects
Web Services

Models for message based

communication
Point to point
Publish-Subscribe
Reply Request

18

Technologies for DC
RPC
Distributed Object Framework

19

RPC
Node B

Node A

Procedure
Registry

Main Procedure

Procedure
A

Procedure C:Node
B

Procedure
B

RPC Library

Procedure C

RPC Service
Program C (RPC
Server)

Program A (RPC
Client)
Parameters Marshaling
and Procedure Name

Return Value
Unmarshaling

Parameters
Unmarshaling and
Procedure Name

Return Value
Marshaling

Network

DOF interaction
Node B

Node A
Application B
21
10

Instance

16

Remote
Instance

15

1: Ask for
Reference

Object Skeleton

Object Proxy
9

11 20

Remote Reference Module

17 14

5: Object
Activation

Remote Reference Module

Application A

8
2

12

13
19

18

Network

Service Oriented Architectures

(SOA)
Service
Registry

find

Service
Requestor

Publish

Bind

Service
provider

22

Service Oriented Architecture model implemented by XML Web Services

XML Web Services Foundation

Simple, Open, Broad Industry Support

Publish, Find, Use Services:

UDDI

Service Descriptions

WSDL

Service Interactions:

Universal Data Format:

Ubiquitous Communications:

SOAP

XML
Internet
(HTTP)

Container

Container
Service Provider Code

Servlet/EJB Client Code

Invocation

Receipt

Response

WSEngine

Marshal

Operation Invoke

WSEngine

Unmarshal

Marshal

Transport

Unmarshal

Transport
HTTP
Response

SOAP Response

SOAP Response

SOAP Request

SOAP Request
HTTP Request

Client Side

Service Provider

Web Service Request via SOAP/HTTP

WS Components
1. A standard way for communication (SOAP)
2. A uniform data representation and exchange
mechanism (XML)
3. A standard meta language to describe the
services offered (WSDL)
4. A mechanism to register and locate WS
based applications (UDDI)

What is SOAP?
Lightweight protocol used for exchange of
messages in a decentralized, distributed
environment
Platform-independent
Used for Remote Procedure Calls
W3C note defines the use of SOAP with XML as
payload and HTTP as transport

SOAP Elements
Envelope (mandatory)
Top element of the XML document representing the message

Header (optional)
Determines how a recipient of a SOAP message should process the
message
Adds features to the SOAP message such as authentication,
transaction management, payment, message routes, etc

Body (mandatory)
Exchanges information intended for the recipient of the message
Typical use is for RPC calls and error reporting

SOAP Elements
SOAP Encoding
Envelope package
Header/Body pattern
Similar to how HTTP works
Header

Body

Simple Example
<Envelope>
<Header>
<transId>345</transId>
</Header>

<Body>
<Add>
<n1>3</n1>
<n2>4</n2>

</Add>
</Body>
</Envelope>

c = Add(n1, n2)

SOAP Request
<SOAP-ENV:Envelope

xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/>
<SOAP-ENV:Header>
<t:transId xmlns:t=http://a.com/trans>345</t:transId>

</SOAP-ENV:Header>
<SOAP-ENV:Body>
<m:Add xmlns:m=http://a.com/Calculator>
<n1>3</n1>
<n2>4</n2>
</m:Add>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>

SOAP Request
<SOAP-ENV:Envelope

xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/>
<SOAP-ENV:Header>

Scopes the message to the SOAP

namespace describing the SOAP
envelope

<t:transId xmlns:t=http://a.com/trans>345</t:transId>

</SOAP-ENV:Header>
<SOAP-ENV:Body>

<m:Add xmlns:m=http://a.com/Calculator>
Establishes the type
<n1>3</n1>
<n2>4</n2>
</m:Add>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>

of encoding
that is used within the message
(different data types supported)

SOAP Request
<SOAP-ENV:Envelope

xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/>
<SOAP-ENV:Header>

Qualifies transaction Id

<t:transId xmlns:t=http://a.com/trans>345</t:transId>

</SOAP-ENV:Header>
<SOAP-ENV:Body>

Defines the method

<m:Add xmlns:m=http://a.com/Calculator>
<n1>3</n1>
<n2>4</n2>
</m:Add>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>

SOAP Response
<SOAP-ENV:Envelope

xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/

SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding
<SOAP-ENV:Header>
<t:transId xmlns:t=http://a.com/trans>345</t:transId>

</SOAP-ENV:Header>
<SOAP-ENV:Body>
<m:AddResponse xmlns:m=http://a.com/Calculator>
<result>7</result>
</m:AddResponse>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>

Response typically uses method

name with Response appended

XML-RPC vs SOAP
XML-RPC: lower common denominator form
of communication
Simple, easy to understand (only 7 pages
specification)

SOAP: can transfer more sophisticated

information (could define virtually any data
structure)
Flexible, but complex
Supported by industry

WSDL
Web Services Description Language is an XML
document
Describes WS functionality
How WS communicate & where it is accessible
(What, Where & How)

UDDI
Universal Description Definition Interface
A standard discovery mechanism for WS

Users can query a UDDI registry (company

name, service type, Industry category or
other criteria)
Provides pointers to WSDL document
UDDI is also based on XML

Static UDDI

Service Discovery

Direct UDDI

Service Publication

WSDL

Service Description

SOAP
HTTP, FTP,e-mail, MQ, IIOP, .

XML-based
Messaging
Network

Quality of Service

Web Service Flow

Management

WSFL

Security

WS technology Stack

Web Service Interaction reference

Scenario
Web
Server

WSDL(s
)

UDDI Registry

WS Client

Web Service

Web
Server

Application

Web Service
WSDL
WS Client
Application
Application

WSDL

Architectural styles for

Distributed Computing

Components and connectors

Software Architectural Styles
Data Oriented architecture
Data Flow architecture
Call and return architecture
Architectural styles based on Independent
components
40

History of Distributed
Computing
System Architectural Styles

Client/Server Computing
Peer-to-peer Computing
Grid Computing
Collaborative Computing
Cloud Computing

41

Trends in computing
Cluster Computing

Peer to peer
Computing

Grid
Computing

Computing
Collaborative
Computing
Cloud Computing

42
42

Client/Server Computing
Centralized Apps & Storage

43

Client-server
request

Two Tier
(Classic Model)
clien
t

serve
r

respons
e

Three Tier

clien
t

Server/client

serve
r

N Tier
serve
r
clien
t

Server/clie
nt

Server/clien
t

serve
r

Peer-to-Peer Computing
Sharing Resources

45

P2P
peer
peer

peer

peer

peer
peer

peer

Grid Computing
Providing More Computing Power

47

Grid Computing
Distributed parallel processing across a network
Key concept: the ability to negotiate resourcesharing arrangements
Characteristics of grid computing

Coordinates independent resources

Uses open standards and interfaces
Quality of service
Allows for heterogeneity of computers
Distribution across large geographical boundaries
Loose coupling of computers
48
48

Grid Context
Users
Job submission
Portal / CLI

Resource Broker

Maps to Physical resources

Grid Enabled Resources

C1

C2

C3

C4

Physical Resources

PBS cluster

LSFcluster

Research Activities @
CARE

SGE cluster

Torque cluster

49

Collaborative Computing
Working as a Group

50

Cloud Computing

51

Social Networks,
Scientific Computing,
Enterprise
Applications

Applications
(SaaS)
Frameworks for
Cloud Application
Development

Virtual hardware,
networking, OS
images, and storage.

Middleware (PaaS)

Hardware and OS
(IaaS)

Enabling Technologies
Cloud applications: data-intensive,
compute-intensive, storage-intensive
Bandwidth
WS

Services interface

Web-services, SOA, WS standards

VM0

Storage
Models: S3,
BigTable,
BlobStore,

...

VM1

VMn

Virtualization: bare metal, hypervisor.

Multi-core architectures
64-bit
processor

54

Status of Grid

Mostly used by scientific community

No viable commercial grid computing
providers emerged
Not successful in commercial aspect
Grid adoption in Enterprises is not much
available.

Commercial Grids - Not successful & Cloud Computing - Evolved

60

Evolution of communication

Telephone
Radio
TV
Mobile
Web

61

Evolutionary Development of
the Web
Web 1.0

Read Mainly - Graphical UI

Web 2.0
Read/Write/Participatory Social UI
Web 3.0
3D/Video (iTV, AR,) Metaverse UI ( AR-Augmented Reality)
Web 4.0
Semantic - Conversational UI
Web 5.0
Intelligent - Cognitive UI
62

Phase Transitions: Web,

Semantic Web, Social Software,
Metaweb

63

Defining Clouds: There are many

views for what is cloud computing?
Over 20 definitions:

http://cloudcomputing.sys-con.com/read/612375_p.htm
Renting remote storage backup
Renting remote server hosting Web server
Renting remote more servers to manage large workload

Buyyas Scientific definition of Cloud Computing

Cloud is a market-oriented distributed computing system
consisting of a collection of inter-connected and virtualised
computers that are dynamically provisioned and presented as
one or more unified computing resources based on service-level
agreements (SLA) established through negotiation between the
service provider and consumers.
SLA = {negotiated and agreed QoS parameters + rewards +
penalties for violation of agreement....}

64

Definition
National Institute of Standards and Technology

Cloud computing is a model for enabling convenient,

on-demand network access to a shared pool of
configurable computing resources (e.g., networks,
servers, storage, applications, and services) that can
be rapidly provisioned and released with minimal
management effort or service provider interaction.
(NIST Definition)

This cloud model promotes availability and is composed of

five essential characteristics, three service models, and four
deployment models.

November 18, 2009

65
65

66

What is a Cloud?

SLAs
Web Services

Virtualization

67

Traditional Computing vs. Cloud

Computing
Traditional Computing
PC-centric
Own copies of software
on own hardware
No access outside the
network
If PC crashes, you loose
everything

Cloud Computing
Document-centric
Rented copies of
software on rented
hardware
Accessible anywhere
(Got to have internet
connectivity though!)
If PC crashes, you dont
loose anything
68

What Cloud Computing Isnt

Isnt network computing
Network Computing

Cloud Computing

Applications/documents are
hosted on a single companys
server and accessed
over the companys network.
Access is over the companys
network only.

Encompasses multiple
companies, multiple servers,
and multiple networks.
Cloud services and storage
are accessible from
anywhere in the world over
an internet connection.
69

What Cloud Computing Isnt

Isnt traditional outsourcing
Outsourcing
A company farms out its
computing service to an
outside firm, which hosts the
companys data or
applications that can be
accessed only by the
employees via companys
network.

Cloud Computing
Access data or applications
anywhere via internet.

70

What is cloud computing?

It is document centric, but not PC centric
It is a large group of inter-conncted
The cloud of computers extends beyond a
single company or enterprise
Accessed via internet
Cross enterprise and cross paltform
Technology and infrastructure are invisible
71

What is NOT cloud computing?

NOT network computing
NOT outsourcing
Both the above cases, data or applications
are accessible only to the companys
employees via companys network, not the
entire world via internet

72

Properties of Cloud Computing

Googles Perspective

User centric
Task centric
Powerful
Accessible
Intelligent
programmable
73

Characteristics of Cloud Computing

Scalability
Elasticity
Self service provisioning
On demand resource provisioning
APIs
Billing and metering services
Supporting business agility
Reducing capital expenditure
74

Pros and cons

Lower cost computers

Improved Performance
Lower IT infrastructure cost
Free Maintenance Issues
Lower software cost
Instant Software updates
Increased computing power
Unlimited storage capacity
75

Pros and cons

Increased data safety

Improved compatibility between OS
Improved document compatibility
Easier group collaboration
Universal Access to documents
Latest version Availability
Not reliant a single computer
76

But there are issues

Constant internet facility

Low bandwidth
Economic impact (e.g. employment)
Competition
Standards
Discrepancies in legal regimes
Environmental impact
77

But there are issues

Can be slow
Features may be limited
Stored data might not be seen
Failure or Loss of data

78

Challenges
Alignment with the needs of the business / user
/ non-computer specialists / community and
society
Need to address the scalability issue: large
scale data, high performance computing,
automation, response time, rapid prototyping,
and rapid time to production
Need to effectively address (i) ever shortening
cycle of obsolescence, (ii) heterogeneity and
(iii) rapid changes in requirements
Transform data from diverse sources into
intelligence and deliver intelligence to right
people/user/systems
What about providing all this in a costeffective manner?

Security Services

1. Authentication
2. Authorization
3. Availability
4. Confidentiality
5. Integrity
6. Accountability
7. Privacy

80

Who benefits from Cloud

Computing?

Collaborators
Road warriors
Cost-conscious users
Cost-conscious IT departments
Users with increasing needs

81

Who shouldnt be using Cloud

Computing?

Internet-impaired
Offline workers
Security conscious
Anyone married to existing applications

82

3 Cloud Service Models

Cloud Software as a Service (SaaS)
Use providers applications over a network

Cloud Platform as a Service (PaaS)

Deploy customer-created applications to a cloud

Cloud Infrastructure as a Service (IaaS)

Rent processing, storage, network capacity, and other
fundamental computing resources

To be considered cloud they must be deployed

on top of cloud infrastructure that has the key
characteristics
83
83

84

85

Cloud Architecture
Application

Platform

Unified Resource

Fabric

Cloud computing is defined as a large-scale distributed computing

paradigm that is driven by economies of scale, in which a pool of
abstracted, virtualized, dynamically scalable, managed computing
power, storage, platforms and services are delivered on demand to
external customers over the internet.
Source:Ian Foster et al.,Cloud Computing and Grid Computing 360-Degree Compared 86

Architecture
interactions
across
collections of
resources,
directory services

collectionresources
of specialized
that
tools, middleware
have been
and
services on
abstracted/encap
top of the
discovery, negotiation,
unified resources
sulated to
monitoring, accounting and
provide a
payment of
communication
development
and/or
sharing operations on
and
deployment
platform
individual resources
authentication
protocols
87

Cloud Reference Model

88

89

90

SaaS

Pure
PaaS

Pure
SaaS

PaaS
IaaS (M)

User
Applications

User-level
Middleware

Cloud Applications
Social Computing, Enterprise ISV, Scientific Computing,
CDNs
Cloud Programming Environment and
Tools
Web 2.0, Mashups, Concurrent and Distributed
Programming, Workflows , Libraries, Scripting

Cloud Hosting Platforms

QoS Negotiation, Admission Control, Pricing, SLA
Management, Monitoring, Execution Management,
Metering, Accounting
Core
Middleware

Virtual Machine (VM), VM Management and Deployment

Cloud Resources

System
Infrastructure

Autonomic Cloud
Economy
Adaptive Management

IaaS

Cloud Architecture

IaaS Architecture
Web based Management
Interface
Web Services, Portals, REST API

Infrastructure Management Software

Pricing /
Billing

QoS SLA
Management

Scheduling
Provisioning

Monitoring

Reservation

VM Image Repository

VM Pool
Management

Physical Infrastructure

Datacenter

Cluster

Desktop /
Heterogeneous
Resources

Third Party IaaS

Cloud

PaaS Architecture
Web based Interface
Web Services, Portals, REST API

Programming API / Libraries

PaaS Core Middleware

User
Management

Elasticity &
Scaling
Runtime

Resources Management

Physical Infrastructure

Application
Management
QoS / SLA Management &
Billing

IaaS Providers

4 Cloud Deployment Models

Private cloud
enterprise owned or leased

Community cloud
shared infrastructure for specific community

Public cloud
Sold to the public, mega-scale infrastructure

Hybrid cloud
composition of two or more clouds
94
94

Public, Private and Hybrid clouds

95

IaaS (M)

IaaS

PaaS

Private cloud Stack

Platform as a Service Solutions
DataSynapse, Zimory Pools,
Elastra CloudServer, Aneka, .
Infrastructure Management Software
Eucalyptus, OpenNebula, VMWare
vCloud, OpenPEX, InterGrid,
Virtual Machine Technology
KVM, Xen, VMWare,

Datacenters, Clusters, Desktop Grids

Physical Infrastructure

Hybrid / Heterogeneous
Cloud

Public Cloud

Private Cloud

Paas
IaaS (M)

Dynamic
Provisionin
g

Public Cloud
Datacenter

Cluster

Desktop Grids /
NOWs

Community Cloud

Application
Services

3rd Party
Cloud

Public Cloud
Developmen
t
Platforms

Public Cloud

Private Cloud

Private Cloud
Federal and
Government
Bodies

Private
Users
Public Services

Industries
Enterprises

Private VS Public Cloud

99

5 Essential Cloud Characteristics

On-demand self-service
Broad network access
Resource pooling
Location independence

Rapid elasticity
Measured service

100
10

The NIST Cloud Definition Framework

Hybrid Clouds

Deployment
Models
Service
Models

Community
Cloud

Private
Cloud
Software as a
Service (SaaS)

Public Cloud

Platform as a
Service (PaaS)

Infrastructure as a
Service (IaaS)

On Demand Self-Service
Essential
Characteristics

Common
Characteristics

Broad Network Access

Rapid Elasticity

Resource Pooling

Measured Service

Massive Scale

Resilient Computing

Homogeneity

Geographic Distribution

Virtualization

Service Orientation

Low Cost Software

Advanced Security

101
10

102

Access a Cloud Service?

UI

Internet

SaaS

Application

PaaS

Platform

IaaS

Infrastructure

Cloud Providers

103

Infrastructure Trends
12.3

Four quickly emerging infrastructure

trends:

Service-oriented architecture
Virtualization
Grid Computing
Cloud computing

BYOD
Bring your own device is gaining
popularity
Infusions of new technology
Employee buy-in to new infrastructure
Often more affordable for business

Convergence everywhere

105

Convergence in EVERYWHER
Convergence of
technology
Convergence of
business and
ecosystem
Convergence of
people, application,
things, data, devices,
etc.
Source: IDC

Convergence of IoT, big data and

cloud
For IoT, number of billions of connected devices is
an indicator of IoT. The connectivity is just an
enabler but the real value of IoT is on data
(business insight/data-driven economy)
For Big Data, data collection is one of the main
concern, and IoT can play an important roles for
data collection and data sharing
For Big Data, data is nothing without real business
value insight
Cloud offers Everything as a Service business
model for IOT and big data.
IoT is a King, Big data is a Queen and Cloud is
a Palace

Cloud-based IoT Big Data

applications
Prescriptive and
descriptive

Massive
monitoring
Real-time
actionable insight

Proactive and
predictive

Observation
Performance and
optimization

Key requirements of IoT-Big data

platform
Security and
privacy

Scalable

Intelligent and
dynamic

Real-time

Distributed and
decentralized

iKaaS-EU-Japan IoT big data platform

intelligent Knowledge as as a Service
App.

App.
Query
KaaS

Storage

Global Cloud
Data

Knowledge

Security
GW

Data
Knowledge

Security
GW
Query

Query
Local Cloud
Storage

Local Cloud
Storage

Data
Sensors
/IoT Devices

Data
Sensors
/IoT Devices

The goal of this project is to combine ubiquitous and heterogeneous sensing,

smart objects, semantic, big data and cloud computing technologies in a
platform enabling the Internet of Things process consisting of continuous iterations
on data ingestion, data storage, analytics, knowledge generation and knowledge

Smart city opportunities and

challenges

Smart City is a concentration of

people and devices
Currently 72% of the EU population
lives in urban areas, using 70% of our
energy.
Most of the data is generated by
people/citizen and
process/machine
IoT/ big data can offer value to energy
systems, mobility, climate change,
and water and air quality, crime,
autonomic car.

Madrid City-Environmental Health

Environmental health use case focusing on pollutants, pollen, airborne

contaminants, precise detection to offer improve accuracy of information to
citizen
Install number of environment city sensors on-board public transportation,
to correlated with historical environment health data

Sendai Smart Village in Japan

Tago-Nishi is build as a smart city, including town management and health

services
Offering personalize and context aware services, considering the data
from energy-consumption of each of the house, weather, wearable, etc.

 Lower entry level for SMEs and

application developers
Improve living and working
condition of African rural
community
Technology
Long-distance remote monitoring,
control and users notification
Prediction, forecasting, optimization
and big data analytic applications

Openness and applica on development of third par es

OPEN INNOVATION
PLATFORM FOR IOTBIG DATA IN SUBSAHARA AFRICA
Smart Applica ons

Users management

(Monitoring, control, predic ve

of systems, no fica on of users)

(Users authen ca on, privacy,

log-in, persona;ize users )

Interoperable Service and Dynamic Workflow

(Service deployment, APIs, dynamic composi on)

Processing and Analy c Engine

(Stream and batch processing and Big data analy c capabili es)

IoT Broker and Management

(connec vity, device registra on and management, data
management

Connec vity
Network communica on (long-range/short range
single hop, MAC)

Device
Embedded So ware (Signal processing)
Hardware (embedded sensors, connec vity)

WAZIUP application domains

Irrigation

Storage and logistic

Livestock farming

Fish farming

Mobile health

Fresh water

Sense of connection!
Nothing ever exists entirely alone; everything is in
relation to everything else- Buddha

One more from Advaita Philosophy; its also called

non-duality
It says
"the sense that all things are interconnected and
not separate, while at the same time all things
retain their individuality".

Convergence everywhere
Convergence is everywhere, it is just
starting
Think on the how your business will
convergence and scale-up
Need for more large-scale IoT and big data
testing and experimentation
In developed counties majority people are
living in City whereas in developing countries
still living rural area
IoT, Big data and Cloud are the future of the
world

CLOUD APPLICATIONS

118

1. Smart Farming

119

Cloud for agriculture

Cloud based monitoring and maintenance
WSN and cloud will enable so many
applications for cultivation
Vertical / horizontal farming may be used

120

2. Smart Dresses
Dresses will be embedded with chips to
monitor the health conditions
Protection from pollution
Providing comfortable environment
Provided with communication and other
facilities

121

3. Smart Home

122

CLOUD for smart home

Child Monitoring
Auto lighting/ switch on/off a device
Supporting aged parents
Alerts for unauthorized entries

123

4 Smart Learning

124

U Learning and Smart Classroom

125

Cloud for U Learning

Cloud services enable personalized
learning
Access to context based resources
Allows experts to be contacted
Collaborative learning becomes easier
Interactive learning is feasible
Active learning may be effectively
implemented
126
Evaluation may be done in a standard way

5. Smart Health Care Systems

Smart monitoring of healthcare

Tele-operations
Collaborative Surgery operations
Intelligent Diagnosis
Bio-pharmacy
Natural Treatment

127

6. Space tourism will be common, and

40,000 humans will be working in orbit.

128

Cloud computing for Space

tourism
Communication across planets
Protocol to be developed
Once internet is reached, cloud takes care
of the communication within the planet
Information sharing across planets Research

129

7. Automated flying drones will

transport humans.

130

8. Smart Car :
Driverless cars will be in common place

131

Cloud with Smart Car

Possible to extend GPS services using
cloud for easier guidance and monitoring
Surveillance cameras to be connected to
cloud for smart routing during heavy traffic
Cloud services may be extended for the
benefit of drivers as well as passengers

132

9 Mobile

How Does It Affect You?

Mobile is becoming a major design

point for more applications

Tablet use will explode

Mobile apps are a critical enabler
of B2C interactions

Context Aware Computing enters

your planning through location
based services

Learning a second Application delivery, management

language will no
and support complexity increases
longer be
The rise of the App Store
133
necessary.

Cloud and Mobile

Mobile services are easily integrated with
cloud services
Language translators for the people
Smart phones with cloud services enable
many domestic applications to users
Complex applications are possible with the
help of back end computing using cloud
134

10 Humanoids

A large number
of people will
have robot
lovers.
135

Robot and CLOUD

Cloud enables disaster management using
Robot
Controlling robots using cloud for defense
applications
Domestic applications for cleaning,
cooking and any other repetitive works

136

Major Players in Cloud

Amazon
IBM
HP
Google
Microsoft
Workday
Oracle
Cisco Webex
Salesforce.com etc.,

137

 Elastic Utility Computing Architecture Linking Your Programs

To Useful Systems
Web services based implementation of elastic/utility/cloud
computing infrastructure
Linux image hosting ala Amazon

Interface compatible with EC2

Works with command-line tools from Amazon w/o modification
Enables leverage of emerging EC2 value-added service venues
(e.g. Rightscale)

Functions as a software overlay

Existing installation should not be violated (too much)

One-button install using Rocks

System Administrators are people too.

138

Eucalyptus Architecture: WS-Cloud

Amazon EC2 Interface

Client-side API
Translator

Cloud Controller
Cluster Controller

Node Controller

139

Components of Eucalyptus
Node Controller
Cluster Controller

Walrus
Storage Controller
Cloud Controller
140

Components of EUCALYPTUS

141

Node Controller (NC)

Node Controller runs on each node and controls
the life cycle of instances running on the node.
It interacts with the OS and the hypervisor running
on the node and the Cluster Controller (CC).
Functions
Collection of data related to the resource availability
and utilization on the node and reporting the data to
CC
Instance life cycle management.
142

Cluster Controller (CC)

CC manages one or more Node Controllers and
deploys/manages instances on them
CC also manages the networking for the instances
running on the Nodes under certain types of
networking modes of Eucalyptus
Functions
To receive requests from Cloud controller to deploy
instances
To decide which NCs to use for deploying the instances on
To control the virtual network available to the instances
To collect information about the NCs registered with it and
report it to the Cloud controller

143

Walrus
Walrus provides a persistent simple
storage service using REST and SOAP
APIs compatible with S3 APIs.
Functions
Storing the machine images
Storing snapshots
Storing and serving files using S3 API
144

Storage Controller (SC)

SC provides persistent block storage for use
by the instances.
SC is similar to the Elastic Block Storage
(EBS) service from AWS.
Functions
Creation of persistent EBS devices
Providing the block storage over AoE or iSCSI
protocol to the instances
Allowing creation of snapshots of volumes
145

Cloud Controller (CLC)

Cloud Controller (CLC) is the front end to the entire cloud
infrastructure.
CLC provides an EC2/S3 compliant web services interface to
the client tools.
CLC interacts with all the components of the Eucalyptus in
managing the cloud infrastructure.
Functions
Monitor the availability of resources on various components of
the cloud infrastructure, including hypervisor nodes that are used
to actually provision the instances and the cluster controllers that
manage the hypervisor nodes
Deciding which clusters will be used for provisioning the
instances
Monitoring the running instances.
146

OpenNebula

Open Nebula

148

Services rendered

149

Architecture

150

Open nebula Standrds

151

OpenNebula
OpenNebula is the open-source industry
standard for data center virtualization,
offering the most feature-rich, flexible
solution for the comprehensive
management of virtualized data centers to
enable on-premise Infrastructure as a
Service Clouds.

152

Key Features

Interfaces for Cloud Consumers

Service Management and Catalog
Interfaces for Administrators and Advanced users
Appliance Marketplace
Chargeback
Capacity and Performance Management
High Availability and Business Continuity
Virtual Infrastructure management and Orchestration
External Cloud Connector
Platform
Security
Integration with Third-party Tools
Licensing
Upgrade Process
Quality Assurance
Product Support
153

Interfaces Provided
Cloud Consumers: Cloud interfaces like the OCCI
and EC2 Query and EBS interfaces, and a simple
Sunstone cloud user view that can be used as a
self-service portal.
Cloud Advanced Users and Operators:
Administration interfaces like a Unix-like command
line interface and the powerful Sunstone GUI.
Cloud Integrators: Extensible low-level APIs in
Ruby, JAVA and XMLRPC API
Appliance Builders: A Marketplace with a catalog
of virtual appliances ready to run in OpenNebula
environments
154

Interfaces Provided

155

Open Nebula Interfaces

156

Nimbus

157

OpenStack
Open Source

Apache 2.0 licensed

No enterprise version

Open Design

Open design summit

Anyone is able to define core architecture

Open
Development

GitHub
Launchpad

Open
Community

OpenStack foundation in 2012

Now 190+ companies, 3000+ developers, 11000+
members
158

Block Storage
Provider

Cinder
Account mgmt
system

CERN Network
Database

Network
Compute
Scheduler

Keystone

Nova

Microsoft Active
Directory

Horizon

Glance

CERN DB
on Demand
159

Cloud Storage

160

Cloud Storage Providers

161

References

162

163

Cloud Computing: Implementation, Management,

and Security by John W.Rittinghouse and James
F.Ransome : CRC Press 2010

164

Cloud Computing: Web-Based Applications That Change

the Way You Work and Collaborate Online by Michael
Miller : Que Publishing 2009

165

Cloud Computing Best Practices for Managing and

Measuring Processes for On-demand Computing,
Applications and Data Centers in the Cloud with
SLAs by Haley Beard: Emereo Pty Limited, July
2008.

166

Cloud Application Architectures: Building

Applications and Infrastructure in the Cloud:
Transactional Systems for EC2 and Beyond
(Theory in Practice (O'Reilly))
by George Reese: O'Reilly

167

Cloud Computing, A Practical Approach by Toby

Velte, Anthony Velte, Robert Elsenpeter: TMH,
2009

168

Kai Hwang, Geoffrey

C. Fox, Jack J.
Dongarra,
Distributed and cloud
computing, MK
Publishers

RESTful Web Services Web services for the real world

by Leonard Richardson, Sam Ruby : O'REILLY

170

Professional Web 2.0 Programming

(Wrox Professional Guides)
by Eric Van der list, Danny Ayers, Erik Bruchez, Joe
Fawcett, Alessandro Vernet : Wrox

171