Académique Documents
Professionnel Documents
Culture Documents
Agenda
• Cloud Computing Overview
• Clanavi
• Demo
• Business Value
• Q&A
DOCOMO USA Labs Confidential © 2010 All Rights Reserved 3
Cloud Clanavi Demo Biz Value
Cloud Computing
Overview
Cloud Clanavi Demo Biz Value
Develop
Services
Services
Provide
Developers
Service
Users AuthN Community
Providers
Operations
Database
Networks
Application
Develop
Services
Services
Provide
Developers
Service
Users AuthN Community
Providers
Operations
Database
Networks
Application
Server
Broadband Virtualization
Low Price
Network-centric
PCs
Services
Develop
Services
Services
Provide
Users
Cloud Service
Providers
Server
Broadband Virtualization
Low Price
Network-centric
PCs
Services
• On-Demand Resources
• Cost Reduction by
Pay-as-you-go Billing /
Server Consolidation
• Easy Provisioning
• Auto-scaling
• Higher Productivity
Cloud Computing
Architecture
Cloud Application : Software as a Service
Virtual
Search Photo Mail Backup
Desktop SaaS
Maps Movie Chat Log Analysis …
Clanavi
Cloud Clanavi Demo Biz Value
Private Cloud
Requirements
• Browser-based UI
• Unified Access for Multiple
Cloud
Private Cloud
Requirements
• Browser-based UI
• Unified Access for Multiple
Cloud
• Management
• Linux & Windows
• Virtual Machine Image
• Server Template
• Network
• Audit Log and Reports
• Backup
DOCOMO USA Labs Confidential © 2010 All Rights Reserved 15
Cloud Clanavi Demo Biz Value
Private Cloud
Requirements
• Browser-based UI • Security
• Unified Access for Multiple • User Authentication
Cloud
• Permissions
• Management
• Linux & Windows
• Virtual Machine Image
• Server Template
• Network
• Audit Log and Reports
• Backup
DOCOMO USA Labs Confidential © 2010 All Rights Reserved 16
Cloud Clanavi Demo Biz Value
Private Cloud
Requirements
• Browser-based UI • Security
• Unified Access for Multiple • User Authentication
Cloud
• Permissions
• Management • Monitoring
• Linux & Windows • Physical Servers / Cloud
• Virtual Machine Image Nodes
• Server Template • Virtual Machines
• Network • Applications
• Audit Log and Reports
• Backup
DOCOMO USA Labs Confidential © 2010 All Rights Reserved 17
Cloud Clanavi Demo Biz Value
Private Cloud
Requirements
• Browser-based UI • Security
• Unified Access for Multiple • User Authentication
Cloud
• Permissions
• Management • Monitoring
• Linux & Windows • Physical Servers / Cloud
• Virtual Machine Image Nodes
• Server Template • Virtual Machines
• Network • Applications
• Audit Log and Reports • Open Source
• Backup
DOCOMO USA Labs Confidential © 2010 All Rights Reserved 18
Cloud Clanavi Demo Biz Value
The Goal of
Clanavi
Users
• Unified Management
Console
• Flexible Resource
Management
Multiple Public Cloud
- Amazon C1 C2
- Google
C3 C4
- Windows
FW Azure
Multiple Private Cloud - etc.
C5 C6
C1 C2 C5 C6 C7 C8
C3 C4 C7 C8
The Goal of
Clanavi
Users
• Unified Management
Console
• Flexible Resource
Management
Multiple Public Cloud
• Monitoring
• Security Hybrid
• Backup C1 C2
• Failover, etc.
Cloud Portal - Amazon
- Google
C3 C4
- Windows
FW Azure
Multiple Private Cloud - etc.
C5 C6
C1 C2 C5 C6 C7 C8
C3 C4 C7 C8
Architecture Overview
Home Data Location
Healthcare Control
Life Logs
Analysis
…
Service
Why Drupal?
Why Drupal?
Drupal + Custom Enomaly oVirt OpenXen
Modules (Until Feb. 2010) (As of Mar. 2010) Manager
Developer - Enomaly Red Hat Citrix
License GPL2 AGPL3 GPL2 GPL2
Browser-based Yes Yes Yes Yes (Recently)
Programming Ruby on Rails
PHP Python Python
Language Python
Database MySQL MySQL PostgreSQL N/A
Hypervisor KVM / Xen / etc KVM / Xen /etc
(Any) Xen Only
Support (thru libvirt) (thru libvirt)
Install & Setup Easy Difficult Difficult Easy
Functionality (Yes) Yes w/ Limitations (Yes) Yes
REST
API Drupal / REST REST XAPI / XML-RPC
(Not Exposed)
Perspective Users (and Admin) Admin (and Users) Admin and Users Admin
Sometimes Implementation Sometimes
Stability D6 Core Stable
Database Corrupt Immature Hang-up
Why Drupal?
Drupal + Custom Enomaly oVirt OpenXen
Modules (Until Feb. 2010) (As of Mar. 2010) Manager
Developer - Enomaly Red Hat Citrix
License GPL2 AGPL3 GPL2 GPL2
Browser-based Yes Yes Yes Yes (Recently)
Programming Ruby on Rails
PHP Python Python
Language Python
Database MySQL MySQL PostgreSQL N/A
Hypervisor KVM / Xen / etc KVM / Xen /etc
(Any) Xen Only
Support (thru libvirt) (thru libvirt)
Install & Setup Easy Difficult Difficult Easy
Functionality (Yes) Yes w/ Limitations (Yes) Yes
REST
API Drupal / REST REST XAPI / XML-RPC
(Not Exposed)
Perspective Users (and Admin) Admin (and Users) Admin and Users Admin
Sometimes Implementation Sometimes
Stability D6 Core Stable
Database Corrupt Immature Hang-up
Why Drupal?
Drupal + Custom Enomaly oVirt OpenXen
Modules (Until Feb. 2010) (As of Mar. 2010) Manager
Developer - Enomaly Red Hat Citrix
License GPL2 AGPL3 GPL2 GPL2
Browser-based Yes Yes Yes Yes (Recently)
Programming Ruby on Rails
PHP Python Python
Language Python
Database MySQL MySQL PostgreSQL N/A
Hypervisor KVM / Xen / etc KVM / Xen /etc
(Any) Xen Only
Support (thru libvirt) (thru libvirt)
Install & Setup Easy Difficult Difficult Easy
Functionality (Yes) Yes w/ Limitations (Yes) Yes
REST
API Drupal / REST REST XAPI / XML-RPC
(Not Exposed)
Perspective Users (and Admin) Admin (and Users) Admin and Users Admin
Sometimes Implementation Sometimes
Stability D6 Core Stable
Database Corrupt Immature Hang-up
Why Drupal?
• Web Application Framework
• Highly-Modularized Architecture
• User Authentication & Management
• Permissions
• Key-value Pair Programming Style (Array)
• Queuing System Support (D7)
• NoSQL Support (D7)
Why Drupal?
• Web Application Framework
• Highly-Modularized Architecture
• User Authentication & Management
• Permissions
• Key-value Pair Programming Style (Array)
• Queuing System Support (D7)
• NoSQL Support (D7)
Why Drupal?
• Web Application Framework
• Highly-Modularized Architecture
• User Authentication & Management
• Permissions
• Key-value Pair Programming Style (Array)
• Queuing System Support (D7)
• NoSQL Support (D7)
Architecture Overview
Home Data Location
Healthcare Control
Life Logs
Analysis
…
Service
Architecture Overview
Home Data Location
Healthcare Control
Life Logs
Analysis
…
Service
Clanavi
• Works with Multiple Cloud
• Amazon EC2
• XCP (Xen Cloud Platform)
• OpenStack (Needs to Test)
Architecture
• Drupal Core as Web Application Framework
Public
Hybrid Cloud Portal IaaS
Drupal Core Drupal Modules Amazon EC2
Private
UI Module
IaaS
Drupal
OpenStack
Private
IaaS
XCP
Clanavi
Existing Development
Component Module 32
DOCOMO USA Labs Confidential © 2010 All Rights Reserved
Cloud Clanavi Demo Biz Value
Architecture
• Drupal Core as Web Application Framework
• Drupal Custom Modules for Each Cloud, Templates, etc.
Public
Hybrid Cloud Portal IaaS
Drupal Core Drupal Modules Amazon EC2
AWS
OpenStack Private
XCP IaaS
Drupal UI Module
OpenStack
Private
IaaS
XCP
Clanavi
Existing Development
Component Module 33
DOCOMO USA Labs Confidential © 2010 All Rights Reserved
Cloud Clanavi Demo Biz Value
Architecture
• Drupal Core as Web Application Framework
• Drupal Custom Modules for Each Cloud, Templates, etc.
• Failover by Monitoring Virtual Machines
Public
Hybrid Cloud Portal IaaS
Drupal Core Drupal Modules Amazon EC2
AWS
OpenStack Private
XCP IaaS
Drupal UI Module
OpenStack
Backup
Failover
Private
IaaS
Monitoring
XCP
Clanavi
Existing Development
Component Module 34
DOCOMO USA Labs Confidential © 2010 All Rights Reserved
Cloud Clanavi Demo Biz Value
Deployment
Private Cloud
XCP Cloud
Active Pool Master
Directory VM VM VM
VM VM VM VM
Storage
LDAP
Slave VM VM VM
XML-RPC VM
Slave
VM VM VM
VM VM
VM VM Image
HTTPS VM VM VM VM
Clanavi
Physical
• User AuthN Eucalyptus Cloud
Server
• Permissions REST Maintenance
Cloud Controller + Cluster Controller
• User Activity Logs System
• VM Image Management
Node Controller VM VM VM VM • Provisioning
• Provisioning
Node Controller VM VM VM VM • Monitoring
• Server Template
• Alert
• Snapshot / Backup
• Monitoring
Systems Requirements
Modules
Category Module Name Description
Common • System Common Library
Cloud Amazon • Manage Amazon EC2
Management OpenStack • Manage OpenStack Cloud
XCP • Manage XCP Cloud
Modules
Category Module Name Description
Common • System Common Library
Cloud Amazon • Manage Amazon EC2
Management OpenStack • Manage OpenStack Cloud
XCP • Manage XCP Cloud
Registration • Manage Virtual Server Images
Server Templates • Manage Server Templates
Provisioning Cluster • Manage Server Template Collection
Scripting • Manage Scripts for Automation
Input Parameters • Input Parameters for Running Virtual Server
Modules
Category Module Name Description
Common • System Common Library
Cloud Amazon • Manage Amazon EC2
Management OpenStack • Manage OpenStack Cloud
XCP • Manage XCP Cloud
Registration • Manage Virtual Server Images
Server Templates • Manage Server Templates
Provisioning Cluster • Manage Server Template Collection
Scripting • Manage Scripts for Automation
Input Parameters • Input Parameters for Running Virtual Server
Audit • User Activity Log
Reporting Usage Report • Cost Estimation Depending on Hours of Usage
Alerts • Provides Alert Functionality
Modules
Category Module Name Description
Common • System Common Library
Cloud Amazon • Manage Amazon EC2
Management OpenStack • Manage OpenStack Cloud
XCP • Manage XCP Cloud
Registration • Manage Virtual Server Images
Server Templates • Manage Server Templates
Provisioning Cluster • Manage Server Template Collection
Scripting • Manage Scripts for Automation
Input Parameters • Input Parameters for Running Virtual Server
Audit • User Activity Log
Reporting Usage Report • Cost Estimation Depending on Hours of Usage
Alerts • Provides Alert Functionality
Reliability
Failover • Provide Failover Functionality
Backup • Provide Backup Functionality
Clanavi Status
• Total 25K Steps
• Continuing Refactoring
• 11/09/2010: Uploaded to drupal.org
• http://drupal.org/node/919966
Problem in-the-Cloud
Problem in-the-Cloud
• Async Operations for VMs on Clanavi
Problem in-the-Cloud
• Async Operations for VMs on Clanavi
• Boot
• Shutdown
• Suspend / Resume
• VM Backup
Clanavi Operation
Browser Clanavi
Drupal Core Boot
XCP Module
XCP Cloud
Master VM VM VM
VM VM VM VM
Slave-1 VM VM VM
VM VM VM VM
Slave-2 VM VM VM
VM VM VM VM
Clanavi Operation
Browser Clanavi
Drupal Core Boot
XCP Module
XCP Cloud
Master VM VM VM
VM VM VM VM
Shutdown Slave-1 VM VM VM
VM VM VM VM
Slave-2 VM VM VM
VM VM VM VM
Clanavi Operation
Browser Clanavi
Drupal Core Boot
XCP Module
XCP Cloud
Master VM VM VM
VM VM VM VM
Shutdown Slave-1 VM VM VM
VM VM VM VM
Slave-2 VM VM VM
Backup VM VM VM VM
Clanavi Operation
Browser Clanavi
Drupal Core Boot
XCP Module Shutdown
XCP Cloud
Master VM VM VM
VM VM VM VM
Shutdown Slave-1 VM VM VM
VM VM VM VM
Slave-2 VM VM VM
Backup VM VM VM VM
Clanavi Operation
Browser Clanavi
Drupal Core Boot
XCP Module Shutdown
XCP Cloud
Master VM VM VM
VM VM VM VMBottleneck
VM VM VM
Shutdown Slave-1 VM
VM VM
VM VM
VM VM
VM VM VM VM
Slave-2 VM VM VM
Backup VM VM VM VM
Clanavi Operation
Using Drupal Queue
Browser Clanavi
Drupal Core
XCP Module
XCP Cloud
Enqueue
Boot Master
Drupal Queue VM VM VM
VM VM VM VM
Shutdown
Slave-1 VM VM VM
Dequeue Suspend VM VM VM VM
Slave-2 VM VM VM
Drupal Queue Boot
Cron VM VM VM VM
Clanavi Operation
Using Drupal Queue
Browser Clanavi
Drupal Core
XCP Module
XCP Cloud
Enqueue
Boot Master
Drupal Queue VM VM VM
VM VM VM VM
Shutdown
Slave-1 VM VM VM
Dequeue Suspend VM VM VM VM
Slave-2 VM VM VM
Drupal Queue Boot
Cron VM VM VM VM
VM Image Backup
Using Drupal Queue
Browser Clanavi
1. Shutdown VM
Drupal Core
2. Bundle Image
XCP Module
3. Upload Image
Enqueue
Drupal Queue W1 Image Repository
Upload Image
Dequeue
Drupal Queue
Cron Persistent Storage
3 – 20 min+ 3 – 10 min+
Wn …Worker Process DOCOMO USA Labs Confidential © 2010 All Rights Reserved 52
Cloud Clanavi Demo Biz Value
VM Image Backup
Using Drupal Queue
Browser Clanavi
1. Shutdown VM
Drupal Core
2. Bundle Image
XCP Module
3. Upload Image
Enqueue
Drupal Queue W1 Image Repository
Upload Image
W2
Dequeue
Drupal Queue
Cron Persistent Storage
3 – 20 min+ 3 – 10 min+
Wn …Worker Process DOCOMO USA Labs Confidential © 2010 All Rights Reserved 53
Cloud Clanavi Demo Biz Value
VM Image Backup
Using Drupal Queue
Browser Clanavi
1. Shutdown VM
Drupal Core
2. Bundle Image
XCP Module
3. Upload Image
Enqueue
Drupal Queue W1 Image Repository
Upload Image
W2
Dequeue
Drupal Queue W3
Cron Persistent Storage
3 – 20 min+ 3 – 10 min+
Wn …Worker Process DOCOMO USA Labs Confidential © 2010 All Rights Reserved 54
Cloud Clanavi Demo Biz Value
Demo
Cloud Clanavi Demo Biz Value
Business Value by
Clanavi
Cloud Clanavi Demo Biz Value
Cost Reduction
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional
Install Windows
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional
Install Windows
Windows Update
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional
Install Windows
Windows Update
Software Installation
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional
Install Windows
Windows Update
Software Installation
Printer Setup
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional
Install Windows
Windows Update
Software Installation
Printer Setup
Network Setup
Cloud Clanavi Demo Biz Value
Cost Reduction
Traditional Clanavi
Install Windows
Printer Setup
Future Direction
Location
Search Mail Maps Docs …
Service
Drupal 7 Core
Custom Modules
Server Server Storage
Portal UI Monitoring Automation
Cloning Image Backup Snapshot
Virtual Infra User Activity Batch Job
Billing Provisioning Failover
Management Auditing Execution
Future Direction
Location
Search Mail Maps Docs …
Service
Drupal 7 Core
Virtual Infra
Management on D7 User Activity
Auditing
Billing Provisioning Failover
Batch Job
Execution
Q&A
• Download : drupal.org/node/919966
• Follow me : @yas
• Hiring : naoi@docomolabs-usa.com
Thank You!
“Coming together is a beginning, keeping
together is a progress; working together
is a success.”
- Henry Ford
Yas Naoi
naoi@docomolabs-usa.com
Backup
Cloud Clanavi Demo Biz Value
Clanavi
Supports Windows and Linux VMs
Instance Monitoring