Directions in Virtualization:

From the Hypervisor to the

Virtual Datacentre Operating System

Liam Farrell
Senior Systems Engineer
liam@vmware.com

VMware: Who We Are

Worlds leading provider

of virtualization solutions
Founded 1998, IPO August 2007
100,000+ customers worldwideAll sizes and industries;
100% of Fortune 100
Vision: Transform computing through virtualization
Products: reliable, award-winning, most-deployed
Headquarters in Palo Alto, CA, with 40+ offices worldwide
2

The VMware Effect: Customer

Breakthroughs
60% Reduction
in Cost

23x Gain in
Productivity

$14,235

100250

$5,694
3075

Before VMware

After VMware

Before VMware

After VMware

Workloads per Admin

Infrastructure Cost per App

3
*Source: IDC and VMware TAM program

The Driving Forces in our market

Internal
Cloud

Outside the Firewall

People &
Info-centric

On-premise
Datacenter

Federation
With the Cloud

Desktop
Dilemma

Scale

The Driving Forces in our market

Virtual
Datacentre
OS

vCloud
Initiative

vClient
Initiative

Virtual Datacenter
OS

Virtual
Datacentre
OS

vCloud
Initiative

vClient
Initiative

Win
App

Linux
App

Other
App

Apps are tightly

bound to platform
and H/W

Windows

Linux

Other

Can be hard to
secure or change
Complex

Infrastructure
Challenges

Application
Challenges

Challenges with Traditional x86 Operating Systems

Silo-ed
Inefficient

Key Industry Trends

Increasing cores and memory in servers

Apache
IIS

Web
sphere

MySQL

.Net

Oracle

Innovation with new architectures

Abundant cloud capacity on demand

More x86 in datacenters

Hard to ensure
consistent service levels

Complex porting ,
complex access

What We Believe Customers Want

Availability

App

Security
Scalability

Availability
Security
Scalability

Infrastructure

Lowest TCO
9

On Premise
Data Centre

What Customers Have Been Waiting For

Cloud
Provider

App

On Premise
Availability
Data Center

Security

Scalability

Infrastructure

Lowest TCO
10

On Premise
Data Center

What Customers Have Been Waiting For

Windows

App

Linux

Other?

On Premise
Data Center

11

App

Cloud
Provider

New Software Platform

Required

Existing
App Loads

Future
App Loads

Virtual Datacentre
Operating System

A flexible, Self-managing,
Self-healing SW Platform

Hardware Pool

12

The virtual datacentre OS from VMware

.Net

Windows

Linux

Application Availability
vServices

vCenter

J2EE

Security

Grid

Scalability

Web 2.0

SaaS

VMware Infrastructure -> virtual datacenter OS

Infrastructure vCompute
vServices

vStorage

vNetwork

Cloud
vServices

On-premise Infrastructure
vCloud

VDC-OS is to the datacenter what Windows and Linux are to a single server

The virtual datacenter OS from VMware

.Net

Windows

Linux

Application Availability
vServices
vCenter

J2EE

Security

Grid

Scalability

Web 2.0

SaaS

VMware Infrastructure -> virtual datacenter OS

Infrastructure vCompute
vServices

vStorage

vNetwork

Cloud
vServices

On-premise Infrastructure
Off-premise
Cloud

NEW

New Application vServices for the best place to run all applications

VMware Fault
Tolerance

VMware VMsafe
IBM, McAfee, Checkpoint,
Radware announce VMsafe
products

CURRENT

vCenter Data
Recovery
HA, VMotion,
Storage VMotion,
NIC/HBA teaming
provide resiliency to
downtime

ESXi 32 MB of code,
locked down interfaces,
no general purpose OS
dependence

Application Availability
vServices

Security

Scalability

Hot add of virtual

CPU, memory and
devices
Very large virtual
machines with 8virtual CPUs and
256 GB of RAM
DRS shares and
reservations allow
apps to shrink and
grow based on priority

VMware Infrastructure -> virtual datacenter OS

Availability

VMware Solutions Maximize

Uptime
Performance
Planned Downtime

Unplanned Downtime

Virtual Machines
App

App

App

App

App

OS

OS

OS

OS

OS

VM Failure Monitoring

ESX Server

Site Recovery Manager

Server

VMotion

HA

Storage

Storage VMotion

VCB

Network Redundancy

NIC & HBA Teaming

Interconnect

16

Availability

New Solutions for Reduced

Downtime
App

App

App

OS

OS

OS

ESX Server
Fault Tolerance

Zero downtime, zero data

loss continuous availability

Data Recovery

Integrated backup and

recovery appliance

Server

Storage

17

Availability

VMware Fault Tolerance

2009

Single identical VMs running in lockstep

on separate hosts
Works with any Application
Integrated with VMware HA/DRS

XX
App

App

HA
HA
OS
OS

App
OS

VMware ESX

FT

App

App

App

App

OS

OS

OS

OS

VMware ESX

Zero downtime, zero data loss

No complex clustering or specialized
hardware required
Single common mechanism for all
applications and OS-es

X
18

Hardware Failure Tolerance

Transforming Availability Service Levels

CONTINUOUS

VMware FT

AUTOMATED
RESTART

with VMware HA
UNPROTECTED
0%

100%

10%

Application Coverage

19

Availability

vCenter Data Recovery

2009

1. Backup
Agent-less, disk-based backup
and recovery of your VMs

VirtualCenter
VirtualCenter

VM or file level restore

1. Schedule backups via VC

2. Snapshots taken
3. Data de-duped and stored

Incremental backups and data

de-dupe to save disk space
De-duplicated
Storage

2. Restore
VirtualCenter
VirtualCenter
1. VM goes down
2. Select VM images/files
to recover
3. RestoreVM running
in seconds

Centralized Management through

VirtualCenter
Cost Effective Storage
Management

X
20

Copyright 2005 VMware, Inc. All rights reserved.

Quick, simple and complete data

protection for your VMs

Security

The Hypervisor is the Foundation

ESXi is the next generation of the market-leading ESX hypervisor
Virtual Machines
App

App

App

App

OS

OS

OS

OS

VMware ESXi

Partitions a server into virtual machines

Reduces hardware, power, and cooling
with the performance and features of ESX
Plug-and-Play
Minimal configuration. Run VMs in minutes
Integrated in server hardware
OS-Independent, thin, 32MB architecture
Unparalleled security and reliability

21

Security

VMware VMsafe
API that enables protection of VMs
by inspection of virtual components
in conjunction with hypervisor
Isolation of protection engine from
malware

Application

Broad ranging coverage of virtual

machine CPU, memory, storage and
network

Operating System

Protection
Engine

VMware Infrastructure
22

Security

Ecosystem Enablement with VMware

VMsafe

2009

A
pp
OS

App

App

App

App

OS

OS

OS

OS

Agent-less deployment of partner

security services

Security
VM

Security
VM

Multi-function Security Appliance

A
pp
OS

Single security VM for multiple

security services AV, Firewall, IPS

vNetwork Distributed Switch

VMware ESX

Security policy and state moves

with virtual machine

VMware ESX

Integrated, more effective security

solutions within the virtual
infrastructure

23

Scalability

Scale Out Applications for Assured QoS

App
App

Scalable virtual machines

Hot add of
CPU
Memory
PCIe devices

256
GB
64 GB

Zero downtime scale out of

virtual machines

OS

OS

84CPUs
CPUs

24

2009

NEW

New Application vServices for the best place to run all applications

VMware Fault
Tolerance

VMware VMsafe
IBM, McAfee, Checkpoint,
Radware announce VMsafe
products

CURRENT

vCenter Data
Recovery
HA, VMotion,
Storage VMotion,
NIC/HBA teaming
provide resiliency to
downtime

ESXi 32 MB of code,
locked down interfaces,
no general purpose OS
dependence

Application Availability
vServices

Security

Scalability

Hot add of virtual

CPU, memory and
devices
Very large virtual
machines with 8virtual CPUs and
256 GB of RAM
DRS shares and
reservations allow
apps to shrink and
grow based on priority

VMware Infrastructure -> virtual datacenter OS

25

The virtual datacenter OS from VMware

.Net

Windows

Linux

Application Availability
vServices
vCenter

J2EE

Security

Grid

Scalability

Web 2.0

SaaS

VMware Infrastructure -> virtual datacenter OS

Infrastructure vCompute
vServices

vStorage

vNetwork

Cloud
vServices

On-premise Infrastructure
Off-premise
Cloud

Infrastructure vServices and Cloud vServices

VMware Infrastructure -> virtual datacenter OS

CURRENT

NEW

Infrastructure vCompute
vServices

VMDirectPath
Paravirt SCSI
CPU/Memory
optimization
DRS

vStorage

vStorage
Thin
Provisioning
and Linked
clones
vStorage
VMFS

vNetwork

Cloud
vServices

vNetwork
Distributed
Switch
Third party
virtual
switches
vNetwork
Offload
technologies

Lowest TCO through maximum efficiency

VMware vCloud
Network
VMotion
VMotion
Storage
VMotion

vCompute

Highest Single Server Resource Efficiency

Virtual Machines

2009

Virtual hardware
Virtual
hardware scale out
scale out

8-way vSMP and 256 GB

of RAM per VM

Hardware Scale Out

128 cores and 512 GB of

physical RAM

HW Assist
Purpose Built Scheduler

Lowest CPU overhead

Memory

HW Assist
Page Sharing
Ballooning

Maximum memory
efficiency

Networking

VMDirectPath
Offload

Wirespeed (9Gb today)

network access

VMDirectPath
Para-virtualized SCSI

Greater than 200k iops

per second
Lower than 2ms latency

App

App

App

App

App

OS

OS

OS

OS

OS

ESX Server
CPU

Storage

28

vCompute

% of Applications

Very Large VMs, Powerful Performance

95% of
applications

CURRENT

FUTURE

CPU

1 to 2 CPUs

4 VCPUs

8 VCPUs

Memory

< 4 MB at peak

64 GB per VM

256 GB per VM

Network

< 300 KB/s

9 GB/s

40 GB/s

IOPS

< 100 at peak

100,000

200,000

Applications Performance Requirements

29
1. Source: VMware Capacity Planner assessments

vNetwork

vNetwork Distributed Switch

2009

Aggregated view of virtual networking

App

App

App

App

App

OS

OS

OS

OS

OS

Datacenter level networking

(versus host level)
Historical statistics follow the VM
A unified infrastructure for networking
services (monitoring, filtering, mgmt
via PVLANs)

vSwitch
vNetwork Distributed
vSwitch
Switch
vSwitch

Simplified setup and change;

seamless addition of capacity
Easy troubleshooting, monitoring
and debugging
Enables 3rd party development

30

vNetwork

Ecosystem Enablement

App

App

App

App

App

OS

OS

OS

OS

OS

2009

Enterprise networking vendors can

provide proprietary networking
features in a VMware environment
Enables networking solutions to
monitor, control and manage virtual
networks
Networking/security solutions can
understand/ be aware of mobile,
dynamic virtual infrastructure

Third Party
Virtual
Switch
Nexus
1000V

Simplicity and transparency for

network administrators
Unified management framework for
physical and virtual networks
31

vStorage Technologies and Interfaces

VMware Infrastructure

virtual datacenter OS from VMware

Storage
Partners

Infrastructure
vServices

vCompute

vStorage

Storage
operations
VMFS

Storage
management

Linked Clones
Thin Provisioning

Storage Virtual
Appliances
vStorage APIs

Storage VMotion

32

vNetwork

vCloud

vStorage

vStorage Thin Provisioning

App

App

App

OS

OS

OS

Virtual machine disks consume only

the amount of physical space in use

Virtual machine sees full logical

disk size at all times

ESX

Full reporting and alerting on

allocation and consumption
Virtual
Disks

10GB

20GB
Physical
Storage

10GB
20GB

10GB
40GB

40GB

100GB

Significantly improve storage

utilization
Eliminate need to over-provision
virtual disks

70GB
30GB

Reduce storage costs by up to 50%

33

vStorage

vStorage linked clones

App

App

App

OS

OS

OS

Multiple virtual machines share

common base disk
Each virtual machine has own disk
that stores its writes to disk
Patches applies to base disk are
seen by all linked clones

Base
Disk

Reduce storage costs for

Virtual Desktop Infrastructure
by up to 90%

App
OS

Improve storage utilization

Simplify patch process
34

vStorage

vStorage Virtual Appliances

SVA

App

App

App

App

OS

OS

OS

OS

ESX

Delivers storage capabilities as

virtual appliances

SVA

Validated by VMware Ready Virtual

Appliance certification program

ESX

Simplify deployment and

administration
Data protection
Availability
Storage management

Reduce obstacles to delivering full

virtualization experience
Easy transition to hardware-based
functionality as environment grows

35

vStorage

vStorage APIs

VWware Infrastructure
App

App

App

App

App

OS

OS

OS

OS

OS

Provide storage management

tools with visibility to virtual
machines use of storage
Leverage array capabilities at
per-VM level

APIs for storage multipathing,

backup, deployment, de-dupe, ..

Partner Storage and Management

Simplify storage management for

virtual environment

36

Infrastructure vServices and Cloud

vServices VMware Infrastructure -> virtual datacenter OS

CURRENT

NEW

Infrastructure vCompute
vServices

VMDirectPath
Paravirt SCSI
CPU/Memory
optimization
DRS

vStorage

vStorage
Thin
Provisioning
and Linked
clones
vStorage
VMFS

vNetwork

Cloud
vServices

vNetwork
Distributed
Switch
Third party
virtual
switches
vNetwork
Offload
technologies

Lowest TCO through 37

maximum efficiency

VMware vCloud
Network
VMotion
VMotion
Storage
VMotion

The virtual datacenter OS from VMware

.Net

Windows

Linux

Application Availability
vServices
vCenter

J2EE

Security

Grid

Scalability

Web 2.0

SaaS

VMware Infrastructure -> virtual datacenter OS

Infrastructure vCompute
vServices

vStorage

vNetwork

Cloud
vServices

On-premise Infrastructure
Off-premise
Cloud

39

Virtual DataCentre OS Management Platform: vCenter

Accelerated
Development

Reliable
Deployment

Proactive
Predictable
Performance Management

Application Management

Automated
Provisioning

Simplified

vCenter

Responsive

Infrastructure Management

Resilient

Transparent
Chargeback

Intelligent
Capacity

40

Simplified
Configuration

Unified
Automated
Operations

Managing with multiple VC Servers

Multi-VC Monitor

Federated VirtualCenter

View combined set of hosts and VMs

through filters such as objects with pending
alarms

Inventory and core configuration data

available globally via LDAP backbone
Standard VI Client can access inventory
across entire environment

Summary information for each host, VM,

datacenter, etc.

Hosts can be re-mastered to alternate

nodes with no loss of identity if one VC
Server fails

Launch VI Client in context

Replicated inventory and

configuration data

41

End-to-End Integrated
Management
Enterprise System Management

Non-Virtual
Management
Tools

vCenter
Physical-Only
Environments/
Non-x86/Non-VMware
Non-Virtualized
42

Simple, Proactive Management Whats New

Quality of Service Management for Applications
vCenter AppSpeed: real-time performance monitoring
and remediation guarantee service levels

Proactive Management of Virtual Infrastructure

Applications

vCenter Orchestrator automates repetitive IT

processes with a robust workflow engine
vCenter CapacityIQ provides proactive capacity
planning for VMs, clusters and entire VI environment

vCenter

vCenter Chargeback automates chargeback modeling

for greater visibility and control of IT costs
vCenter ConfigControl automates discovery and
tracking of configuration items for better visibility,
compliance and remediation
Host Profiles simplify setup and ensure standardization

43

Infrastructure

Monitor and Control QoS with vCenter AppSpeed

Policies (SLA)
Monitor application performance
from end-user perspective

99.9% Uptime
Fault Protection

Collect and correlate across tiers

and in VI

Encryption Enabled

55
75

Users

2
4

Servers

Automated SLA management

Database

Enables proactive detection of

end user performance issues

Quality of Service

Integration with VI enables root

cause and remediation

44

VMware Ready
VMware Ready Management Solutions

vCenter foundation for

Application Management
& Infrastructure
Management
vCenter Extensibility
APIs and UI plug-in
architecture to enable 3rd
party integration

vCenter Extensibility
Application Management

VMware Ready
Management Solutions

vCenter
Infrastructure Management

45

virtual datacenter OS from VMware

.Net

Windows

Linux

Application Availability
vServices

vCenter

J2EE

Security

Grid

Scalability

Web 2.0

SaaS

VMware Infrastructure -> virtual datacenter OS

Infrastructure vCompute
vServices

vStorage

vNetwork

Cloud
vServices

On-premise Infrastructure
Off-premise
Cloud

46

vCenter: An Extensible Management Platform

Accelerated
App Dev

Reliable App
Deployment

[xxx} App
Performance

Application Management

vCenter
Infrastructure Management

Automated
Provisioning

Simplified
Config

Unified
Operations

47

Intelligent
Capacity

Assured
Continuity

48

vCloud

Virtual
Datacenter
OS

vCloud
Initiative

49

vClient
Initiative

How Do We Define The Cloud?

Cloud Computing according to VMware
Lightweight entry/exit service acquisition model
Consumption based pricing
Accessible over the internet
Scalable and elastic

Improved economics due to shared

infrastructure and elasticity

Cloud computing comes into focus only when you think about a
way to increase capacity or add capabilities on the fly without
investing in new infrastructure, training new personnel, or licensing
new software. Cloud computing encompasses any subscriptionbased or pay-per-use service that, in real time extends IT's existing
capabilities.
50

vCloud
Initiative
Broad Compatibility
Built on vApps
Application and
Infrastructure VMs

100+ Service
Provider Partners

Federation

Cloud vServices
App

App

App

App

App

OS

OS

OS

OS

OS

Firewall

Tomcat

IIS

Load
Balance

Oracle

51