Académique Documents
Professionnel Documents
Culture Documents
juliandyke.com
Agenda
juliandyke.com
Virtualization
juliandyke.com
Virtualization Overview
Virtualization is the process of abstracting computing resources Multiple operating systems and application images share same physical server Benefits include: Cost of ownership Hardware Licensing Power Cooling Space
juliandyke.com
Virtual Machines
Binary Translation
- Run time translation - Any hardware / OS - Slower
Virtual Partitions
- Online Add / Remove - Near native hardware speed - Shared I/O
Para-Virtualization
- Special O/S Build - Any hardware/ Linux - Faster
Shared Partitions
- Shared CPU - Dynamic CPU cycle allocation
Hardware Virtualization
- Early support (Intel / AMD) - Any O/S - Will be fastest
Solaris
X86 / X86-64
juliandyke.com
Basic Support
Live Migration
DB RAC
Yes Yes Yes Yes Yes Yes Yes Yes Yes No Yes Yes
DB
Yes N/A N/A N/A N/A Test
RAC
Test N/A N/A N/A N/A Test
Oracle
Virtual Machine (PV, HVM) Physical Partition Virtual Partition Virtual Machine Virtual Partition Virtual Partition
HP
IBM
Micro-partitions
VIO4 WPAR zVM
Shared Partition
Shared storage OS Partition Shared Partition
Power
Power Power zSeries
AIX
N/A AIX Linux
Capped only
N/A No No
Yes
Yes Test Yes
Yes
Yes No No
Test
N/A Test N/A
Test
N/A No N/A
Sparc
Sparc Sparc
Solaris
Solaris Solaris
Yes
No Capped only
Yes
Test Yes
Yes
Test No
N/A
N/A N/A
N/A
N/A N/A
SUN
1 2 3 4
Supported with Oracle Database 11.0.7 Need to disable Numa for dynamic support. Static support only. VIO is an option for dLPAR and micro-partitions.
juliandyke.com
The following virtualized platforms are certified for Oracle Application Server
Operating System Linux x86, x86-64 Windows x86, x86-64 Virtualization / Partitioning Technology Oracle VM Oracle VM
IBM LPAR
IBM LPAR Sun Containers (Solaris 10) Sun Containers (Solaris 10)
HP HP/UX PA RISC
HP HP/UX Itanium HP Linux Itanium HP Windows Itanium
nPar, vPar
nPar, vPar nPar nPar
On Solaris both global and local zones/containers are supported, but LDOMs are not supported See http://www.oracle.com/technology/products/ias/hi_av/oracleas_supported_virtualization.html
juliandyke.com
Limited support for Oracle products on VMware Oracle has not certified any of its products on VMware Oracle will support customers running Oracle products running on VMware for issues known to occur on the native OS for issues that can be demonstrated not to be a result of using VMware See Metalink Note 249212.1 - Support Position for Oracle Products running on VMware virtualized environments for more details
juliandyke.com
Applications
Applications
Guest OS
Guest VM Hypervisor
Guest OS
Guest VM
juliandyke.com
Xen hypervisor Small, lightweight, software virtual machine monitor Supports x86 and x86-64 only Executes multiple virtual machines on one physical system Each virtual machine has its own guest operating system Originally developed at Cambridge University Now open source Included in Oracle Enterprise Linux 5.0 and above Red Hat Enterprise Linux 5.0 and above SUSE Linux Enterprise Server 10 Enhanced version included in Oracle VM Server
juliandyke.com
Oracle VM
11
juliandyke.com
Oracle VM Overview
Server virtualization software Supports both Oracle and non-Oracle applications Claimed to be three times more efficient than other server virtualization products Backed by Oracle support Available for free download edelivery.oracle.com/oracle/vm Guests supported include: Linux Windows Runs on x86 and x86-64 based systems
12
juliandyke.com
Oracle VM Overview
Oracle products certified with Oracle VM include: Oracle Database Oracle Fusion Middleware Oracle Applications Consists of Open Source server software integrated Web browser-based management console
13
juliandyke.com
Oracle VM allows users to create and manage Virtual Machines (VMs) VMs exist on same physical server behave like independent physical servers Each VM has its own virtual CPUs network interfaces storage operating system
14
juliandyke.com
Oracle VM Components
Oracle VM Server Self-contained virtualization environment Provides lightweight, secure, server-based platform forrunning VMs Based on updated version of Xen hypervisor technology Includes Oracle VM Agent Oracle VM Agent Installed with Oracle VM Server Communicates with Oracle VM Manager for management of virtual machines Oracle VM Manager Provides user interface to manage Oracle VM servers and resources Standard Application Development Framework (ADF) web applications
15
juliandyke.com
Oracle VM Architecture
Oracle VM Manager Web Browser-based User Interface Java-based Management Server Oracle VM Manager Repository
Oracle VM Server OracleVM Agent dom0 domU Hypervisor Host Hardware CPU, Network, Memory, Disk domU domU
16
juliandyke.com
Oracle VM requirements 32 bit or 64 bit host i686-class processor all Intel Pentium Pro or newer models Intel Pentium 4 recommended as a minimum all AMD Athlon/Duron processors or newer models AMD Athlon recommended as a minimum For unmodified guest operating systems CPU must provide hardware virtualization support Hardware virtualization optionally provided by the following processors: Intel Pentium D, Core, Core2, Xeon AMD Athlon, Opteron
17
juliandyke.com
Oracle VM supports the following guest operating systems: Oracle Enterprise Linux 4 Oracle Enterprise Linux 5 Red Hat Enterprise Linux 3 Red Hat Enterprise Linux 4 Red Hat Enterprise Linux 5 Microsoft Windows 2003 Microsoft Windows Server 2003 Microsoft Windows HP Note that Microsoft Windows is only supported on hardware virtualization (HV) capable hardware Currently Windows runs significantly slower on Oracle VM than on native hardware Oracle is developing paravirtualized Windows drivers to improve performance of Windows on Oracle VM
18
juliandyke.com
Oracle VM is the only x86 based server virtualization environment on which Oracle products are supported
Oracle products currently certified with Oracle VM (September 2008) include: Oracle Database 10gR2 and11gR1 Oracle RAC 10gR2 (10.2.0.4) Oracle Application Server 10gR2 and 10gR3 Oracle Enterprise Manager 10.2.0.4 Oracle Berkeley DB4.6 Oracle TimesTen 7.0.3.1 Oracle E-Business Suite11.5.10 and12 Oracle PeopleSoft Enterprise 8.4.x and 9.0 PeopleTools 8.49.07and above Oracle Siebel CRM 8.0 Oracle Hyperion 9.3.1
See Metalink Note 464754.1 - Certified Software on Oracle VM
19
juliandyke.com
SOA 10.1.3.1.0 with 10.1.3.3.0 patchset WebCenter 10.1.3.2.0 with 10.1.3.3.0 patchset Oralce Communication and Mobility Server 10.1.3.3.0 (Linux x86 only) Oracle Data Integrator 10.1.3.3.0 Business Intelligence Enterprise Edition 10.1.3.3.0 Identity Management 10.1.4.0.1 and 10.1.4.2.0 Oracle Identify Federation 10.1.4.0.1 and 10.1.4.2.0 Oracle Virtual Directory 10.1.4.2.0 Oracle Access Manager 10.1.4.2.0 Oracle Identity Manager 9.1.0.0 Oracle Universal Content Management 10.1.3.3.1 (Linux x86 only) Oracle Universal Records Management 10.1.3.3.1 (Linux x86 only)
20
juliandyke.com
As of September 2008 Oracle single instance databases are certified with Oracle VM with the following restrictions
x86 and x86-64 platforms Oracle Enterprise Linux 4.x, 5.x, Red Hat Enterprise Linux 4.x, 5.x Oracle 10.2.0.3 or above Oracle VM 2.1 or above Para-virtualized and hardware virtualized modes Use para-virtualized drivers in both modes Windows supported in Oracle 11.1.0.7 and above Live migration supported in Oracle 11.1.0.7 and above
21
juliandyke.com
As of September 2008 RAC is certified with Oracle VM with the following restrictions
X86 32-bit platform only Oracle Enterprise Linux 5.1 or above Oracle 10.2.0.4 only Oracle VM 2.1.2 only Para-virtualized mode only Static mode support only No dynamic resource changes No live migration
Oracle Recommendations Each RAC node should be deployed on a different physical server Use physical block devices for database files Do not over-commit CPUs
22
juliandyke.com
Resource Management Control amount of CPU and memory used by each instance Cloning For development, test and pre-production Migration Move instance from one node to another Hardware must currently be identical Live Migration Not supported with RAC
23
juliandyke.com
$599
$1,797
$1,199
$3,597
Oracle VM Premier Support includes Access to software and updates through the Unbreakable Linux Network 24x7 global support Pricing / licensing for Oracle products used with Oracle VM is unaffected CPU licensing is still based on physical processors
24
juliandyke.com
Oracle VM Server
25
juliandyke.com
26
juliandyke.com
27
juliandyke.com
Oracle VM servers can be Para virtualized Hardware virtualized Para virtualization Requires virtualization aware kernel Available in Enterprise Linux 4 and 5 (Oracle and Red Hat) Currently best performance Hardware virtualization Can run unmodified kernels e.g Enterprise Linux 3, Windows etc Requires virtualization aware CPUs Virtualization must be enabled in BIOS
28
juliandyke.com
Why is para-virtualization currently faster? Intel currently supports hardware virtualization of CPU VT-x on x86 / x86-64 VT-i on Itanium In future processors Intel will support hardware virtualization for: Directed I/O VT-d Memory / Page Tables Extended Page Tables (EPT) Networking Devices VT-c When these are available hardware virtualization will be faster then paravirtualization Note: AMD also provides hardware virtualization
29
juliandyke.com
30
juliandyke.com
Para-virtualization requires a xen-aware kernel Available in Enterprise Linux 4 Update 5 and above For example for paravirtualized kernel /etc/grub.conf contains:
default=0 timeout=5 splashimage=(hd0,0)/grub/splash.xpm.gz hiddenmenu title Enterprise Linux (2.6.18-8.el5xen) root (hd0,0) kernel /vmlinuz-2.6.18-8.el5xen ro root=/dev/VolGroup00/LogVol00 console=xvc0 rhgb quiet initrd /initrd-2.6.18-8.el5xen.img
31
juliandyke.com
Oracle VM server release 2.1.2 Hypervisor running in 64 bit mode with NO Hardware Virtualization support. Network : Management Interface : If : eth0(Up) Mac : 00:17:3F:99:F3:7C IP address : 192.168.2.111 Configured Networks and Bridges : If : eth0 Mac : 00:17:3F:99:F3:7C If : eth1 Mac : 00:17:3F:9A:03:B9 If : xenbr0 Mac : FE:FF:FF:FF:FF:FF If : xenbr1 Mac : FE:FF:FF:FF:FF:FF CPU : cpu family model model name : 6 : 15 : Intel(R) Pentium(R) Dual
CPU
E2160
@ 1.80GHz
32
juliandyke.com
Oracle VM server release 2.1.2 Hypervisor running in 64 bit mode with Hardware Virtualization support. Network : Management Interface : If : eth0(Up) Mac : 00:04:23:DC:1E:78 IP address : Configured Networks and Bridges : If : eth0 Mac : 00:04:23:DC:1E:78 If : eth1 Mac : 00:04:23:DC:1E:79 If : xenbr0 Mac : 00:04:23:DC:1E:78 If : xenbr1 Mac : 00:04:23:DC:1E:79 CPU : cpu family model model name : 6 : 15 : Intel(R) Xeon(R) Dual
CPU
X5355
@ 2.66GHz
33
juliandyke.com
34
juliandyke.com
Should be extended to contain all servers in pool Services installed for OCFS2 include: o2cb ocfs2
35
juliandyke.com
36
juliandyke.com
Multiple Oracle VM Servers must share storage Oracle VM uses OCFS2 by default Shared directory is created by Oracle VM Server installation Called /OVS Created as ocfs2 Must be manually extended to other VM servers in pool Contains various pools including: iso_pool - contains ISO images running_pool - contains run-time images for guests seed_pool publish_pool
37
juliandyke.com
Linux guest installation uses Anaconda Guest operating system MUST be installed from ISO images Cannot directly mount CD/ROM Installation can use NFS - from local or remote server HTTP - from remote web server FTP - from remove FTP server See Metalink Note 466005.1 - Mounting an ISO for Paravirtualized Guest Operating System Installation
38
juliandyke.com
Guest can be installed using virt-install operating system utility VM Manager GUI-based installation Install utilities are not entirely compatible e.g. virt-install creates configuration file in /etc/xen e.g. /etc/xen/guest11 VM Manager creates additional configuration file called vm.cfg e.g. /OVS/running_pool/guest1/vm.cfg Prior to first installation create Oracle VM standard pools in /OVS:
39
juliandyke.com
NFS can be mounted on the local host NFS services must be started:
[root@server11]# service portmap start Starting portmap: [root@server11]# service nfs start Starting NFS services: Starting NFS quotes: Starting NFS daemon: Starting NFS mountd:
[ OK ]
[ [ [ [
OK OK OK OK
] ] ] ]
[root@server11]# service iptables stop Flushing firewall rules: Setting chains to policy ACCEPT: filter Unloading iptables modules:
40
juliandyke.com
If the installation software is delivered in a single (DVD-ROM) image Create a mount point
41
juliandyke.com
42
juliandyke.com
The virt-install can be executed by the root user either interactively or using arguments For example interactively (as root)
[root@server11]# virt-install What is the name of your virtual machine? guest1 How much RAM should be allocated (in megabytes?) 512 What would you like to use as the disk (path)? /OVS/running_pool/guest1 How large would you like the disk (/OVS/running_pool/guest1) to be (in gigabytes)? 5 Would you like to enable graphics support? (yes or no) yes What is the install location? nfs:server11:/el
Using arguments:
[root@server11]# virt-install \ --name guest1 \ --ram=512 \ --file=/OVS/running_pool/guest1 \ --file-size=5 \ --location=nfs:192.168.2.111:/el \ --nographics
43
juliandyke.com
During installation of Enterprise Linux guest you will be prompted for a TCP/IP configuration
Ensure that a Gateway IP address is specified otherwise installation will fail with the following error:
That directory could not be mounted from the server
44
juliandyke.com
This error can be ignored Folllowing restart of new operating system virt-install using text graphics reports the following error
libvir: Xen Daemon error: internal error domain information incomplete, missing kernel Entity: line 25: parser error : Opening and ending tag mismatch: os line 5 and domain </domain> Entity: line 26: parser error : Premature end of data in tag domain line 1
See Metalink Note 466563.1 - Oracle VM: First Boot after Installation of Guest OS Fails with Text Console
45
juliandyke.com
46
juliandyke.com
To start a VM
[root@server11]# xm create -c /etc/xen/guest1
To shutdown a VM
[root@server11]# xm shutdown guest1
47
juliandyke.com
48
juliandyke.com
Similar to top Same as xm top Executed from dom0 Shows current state of all domains including dom0 and guests
For example
xentop - 10:23:58 Xen 3.1.4 3 domains: 1 running, 2 blocked, 0 paused, 0 crashed, 0 dying, 0 shutdown Mem: 1037820k total, 1034928k used, 2892k free CPUs: 2 @ 1800MHz NAME STATE CPU(sec) CPU(%) MEM(k) MEM(%) MAXMEM(k) MAXMEM(%) VCPUS NETS NETTX(k) NETRX(k) VBDS VBD_OO VBD_RD VBD_WR SSID Domain-0 -----r 256 0.3 479232 46.2 no limit n/a 2 8 1358489 9219 0 0 0 0 0 guest1 --b--20 0.1 262144 25.3 262144 25.3 1 1 6 9 1 0 3295 1834 0 guest2 --b--21 0.1 262144 25.3 262144 25.3 1 1 7 0 1 0 3240 1727 0
49
juliandyke.com
Oracle VM Agent
50
juliandyke.com
By default Oracle VM Agent is configured with username admin and the password specified during installation To check current status of Oracle VM Agent
[root@server11 ~]# service ovs-agent status ok! process OVSPolicyServer exists ok! process OVSMonitorServer exists ok! process OVSLogServer exists ok! process OVSAgentServer exists ok! OVSAgentServer is alive
51
juliandyke.com
Oracle VM Manager
52
juliandyke.com
Oracle VM Manager Provides user interface to manage Oracle VM servers Standard Application Development Framework (ADF) web applications Manages VM lifecycle Creates VMs from installation media from VM templates Deletes VMs Power On / Off VMs Uploads VMs High Availability Deployment Live migration Dynamic Resource Management CPU, memory etc Static Resource Management ISO files, VM templates etc
53
juliandyke.com
Run installer
[root@server12 ~]# /mnt/runInstaller.sh
54
juliandyke.com
The Oracle VM Manager application runs within an OC4J container To check the status of Oracle Containers for J2EE:
[root@server12]# service oc4j status
55
juliandyke.com
56
juliandyke.com
Multiple Oracle VM servers can be grouped into Server Pools Each server in a server pool has access to shared storage Can be NFS, SAN or iSCSI VMs can be started on any server in the pool that is available and has resources free
VMs can be live Migrated between any servers in the pool Except for RAC instances
VMs can be auto-restarted across any servers in the pool
57
juliandyke.com
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
Shared Storage
Shared Storage
58
juliandyke.com
Each Oracle VM Server can have up to three roles: Server Pool Master Agent Utility Server Virtual Machine Server Each Server Pool must contain One Server Pool Master Agent One or more Utility Servers One or more Virtual Machine Servers One Oracle VM Server can perform all three roles Alternatively each role can be performed by different servers
59
juliandyke.com
Each Server Pool has one (and only one) Server Pool Master Agent Master agents manage: Load balancing Live migration HA restarts All Management Agents in pool communicate with Master Agent Master Agent communicates with Management Server Server Pool Master Agent can: be dedicated server (recommended for availability) host guest VMs
60
juliandyke.com
Responsible for I/O intensive operations such as copying or moving files Used when creating or removing virtual machines servers server pools There can be one or more utility servers in a Server Pool If there is more than one, Server Pool Master chooses Utility Server with maximum CPU resources to complete task
61
juliandyke.com
After installation Oracle VM Manager will automatically run the Server Pool Wizard
62
juliandyke.com
63
juliandyke.com
64
juliandyke.com
65
juliandyke.com
Oracle supplies some templates which can be used to rapidly create VMs Operating system templates available in September 2008 included:
Kernel 2.6.9-55.0.1.2.100.1.ELsmp 2.6.9-55.0.1.2.100.1.ELsmp 2.6.9-55.0.1.2.100.1.ELsmp 2.6.9-55.0.1.2.100.1.ELsmp 2.6.9-55.0.1.2.9.1.ELxenU 2.6.9-55.0.1.2.9.1.ELxenU 2.6.18-8.1.15.100.1.el5 2.6.18-8.1.15.100.1.el5 2.6.18-53.0.0.100.1.el5 2.6.18-53.0.0.100.1.el5 2.6.18-53.1.4.9.1.el5xen 2.6.18-53.1.4.9.1.el5xen 2.6.9-55.0.12.100.1.ELsmp 2.6.9-55.0.12.9.1.ELxenU VCPUs 2 2 1 1 2 1 2 1 2 1 2 1 1 1 RAM(GB) 2 2 1 1 2 1 2 1 2 1 2 1 1 1 Storage(GB) 10 10 4 4 10 4 10 4 10 4 10 4 4 4
Template OVM_EL4U5_X86-HVM-10GB OVM_EL4U5_X86_64-HVM-10GB OVM_EL4U5_X86-HVM-4GB OVM_EL4U5_X86_64-HVM-4GB OVM_EL4U5_X86-PVM-10GB OVM_EL4U5_X86-PVM-4GB OVM_EL5_X86_64_HVM_10GB OVM_EL5_X86_64_HVM_4GB OVM_EL5U1_X86_64_HVM_10GB OVM_EL5U1_X86_64_HVM_4GB OVM_EL5U1_X86_64_PVM_10GB OVM_EL5U1_X86_64_HVM_4GB OVM_EL4U5_X86_HVM_ORACLE_11G OVM_EL4U5_X86_PVM_ORACLE_11G
66
juliandyke.com
67
juliandyke.com
68
juliandyke.com
69
juliandyke.com
70
juliandyke.com
71
juliandyke.com
72
juliandyke.com
Disk images are also available for: Oracle Enterprise Manager Siebel See Metalink Note 551261.1 - Oracle VM Guest Templates for Oracle Enterprise Linux
73
juliandyke.com
Oracle VM Conclusions
Promising technology Full hardware virtualization should be very impressive Could be really useful for High Availability Still relatively immature technology Few customers using Oracle VM in production Still numerous installation and operational issues Beware of conflicts between Oracle VM Manager and Xen tools Use Oracle VM Manager if possible Documentation is relatively weak Often several ways to achieve same goal Not obvious which is best Start investigating now Worth considering when planning Probably not production-ready yet but not far away
74
juliandyke.com
References
75
juliandyke.com
Acknowledgements
Thanks to the following for their assistance with the development of this presentation:
Steve Shaw - Intel Corporation Martin Bach - eDBA Simon Haslam - Veriton Michael Timpanaro-Perrotta - Oracle Adam Hawley - Oracle
info@juliandyke.com
76
juliandyke.com