Académique Documents
Professionnel Documents
Culture Documents
Contents
What is VMware I/O Analyzer? Deploying I/O Analyzer VM I/O Analyzer Web UI
Workload Generator
Use case 1: Single VM IOmeter Test Use case 2: Single VM Trace Replay Test Use case 3: Multi-VM and Multi-Host IOmeter Test Use case 4: Multi-VM and Multi-Host Trace Replay Test Use case 5: Listening Mode
FAQ
2
I/O Analyzer
Integrated framework for storage performance measurement Includes standard workload generator such as IOmeter and I/O trace replay
Test Scheduler
VMFS
Controller VM
Worker VM
Unzip downloaded I/O Analyzer archive file (.zip file) Login to the host via vSphere client In File menu, select Deploy OVF Template
10
Select .ova file using Browse and click Next Review OVF Template Details and click Next
11
Choose Name and Locations and click Next Choose Storage to deploy a VM and click Next
Note that please do NOT use space or comma for the VM name. Recommended name should contain only letters, numbers, dots, and 12 dashes. (The rule applies to worker VMs only.)
Select Disk Format and click Next : Thick provision Eager Zeroed is recommended
13
Enabling Web UI
You cannot access Web UI without appliance login (Optional) If you need local terminal, click mouse right button and
choose xterm
14
Using Web UI
16
VMFS
Controller VM
Worker VM
17
5. Listening Mode
18
1. Open Web UI
2. Click workload configuration icon
19
2. Wait until VM list to be updated Note that we do support using DNS hostname for ESX host. However, you should make sure DNS service is working properly in the network where you deploy I/O Analyzer VM. Also note that if VM names contain space or comma, they will not be processed correctly when displaying results.
20
1. Select a worker VM
2. Choose IOMeter
21
1. Specify a name
22
Wait until the status text disappears and go to Results page to see test results. Alternately, you may also go to Test Scheduler to watch ongoing test status.
23
24
5. Listening Mode
25
1. Open Web UI
2. Click workload configuration icon
26
2. Wait until VM list to be updated Note that we do support using DNS hostname for ESX host. However, you should make sure DNS service is working properly in the network where you deploy I/O Analyzer VM. Also note that if VM names contain space or comma, they will not be processed correctly when displaying results.
27
1. Specify a name
29
Wait until the status text disappears and go to Results page to see test results. Alternately, you may also go to Test Scheduler to watch ongoing test status.
30
31
5. Listening Mode
32
1. Open Web UI
2. Click workload configuration icon
33
2. Wait until VM list to be updated Repeat this step to add all hosts that you need. Note that we do support using DNS hostname for ESX host. However, you should make sure DNS service is working properly in the network where you deploy I/O Analyzer VM. Also note that if VM names contain space or comma, they will not be processed correctly when displaying results.
34
1. Select a worker VM
2. Choose IOMeter
3. Select a workload 4. Add to list Repeat this step to add all worker VMs you need.
35
1. Specify a name
36
Wait until the status text disappears and go to Results page to see test results. Alternately, you may also go to Test Scheduler to watch ongoing test status.
37
38
5. Listening Mode
39
1. Open Web UI
2. Click workload configuration icon
40
2. Wait until VM list to be updated Repeat this step to add all hosts that you need. Note that we do support using DNS hostname for ESX host. However, you should make sure DNS service is working properly in the network where you deploy I/O Analyzer VM. Also note that if VM names contain space or comma, they will not be processed correctly when displaying results.
41
ignore just ignores requests with offsets outside the disk boundary
42
1. Specify a name
43
Wait until the status text disappears and go to Results page to see test results. Alternately, you may also go to Test Scheduler to watch ongoing test status.
44
45
5. Listening Mode
46
47
1. Open Web UI
2. Click workload configuration icon
48
2. Wait until VM list to be updated Note that we do support using DNS hostname for ESX host. However, you should make sure DNS service is working properly in the network where you deploy I/O Analyzer VM. Repeat this step to add all hosts that you plan to collect performance stats from.
49
1. Specify a name
50
Wait until the status text disappears and go to Results page to see test results. Alternately, you may also go to Test Scheduler to watch ongoing test status.
51
52
53
Test Scheduler
A new component in I/O Analyzer 1.5 Schedule multiple tests to run Scheduler starts scheduled tests sequentially based on their given
time of run
54
To make use of the scheduler, you need pre-defined configurations In Workload Configuration page, give the config a name and click
Save as a New Config when workload composition is done.
55
2. Select a config 3. Specify time of run 4. Specify a duration (recommended at least 120 seconds) 5. Click Schedule Test To schedule a test to run as early as possible, click Get Current Server Time. Repeat this step to schedule as many tests as you plan. If more than one tests are scheduled to run at the same time, the one that is scheduled first will run first.
56
In test manager, you can see the list of running, pending, and complete
tests.
For running test, the real starting time and the test progress will be shown. For pending tests, the scheduled time of run will be shown.
You may cancel a pending test in test manager.
For complete tests, the real starting time will be shown and you may delete
it from the list.
58
Trace Upload
I/O Analyzer comes with some template I/O trace files. You may collect vScsi traces based on your needs. Please refer to
Collecting vScsi Trace section in the HELP page.
Once you collect your own trace, click Upload vScsi Trace to go
to the upload page.
59
60
61
Trace Characteristics
62
Summary
Integrated framework for storage performance measurement in multi-host settings
63
FAQ
1. 2. 3. 4. 5.
Workload Configuration FAQ Test Scheduler FAQ
64
FAQ
Part 1: Workload Configuration
65
66
67
If, for example, the trace is only 300 seconds and you specify a test
duration of 500 seconds, in the last 200 seconds, trace replayer will be completely silent. If you need to run a trace in a loop, please schedule multiple tests with a trace of a proper duration.
68
Yes, if a host is added but no workers are running on top of it, the
backend will simply run listening mode on that particular host.
69
To fix this problem, please delete the host and re-add it. Note that re-adding hosts in general does not require re-adding all
workload entries. The only exception is if some VMs have new IP addresses, then all stale workload entries have to be manually updated.
70
Note that re-adding hosts in general does not require re-adding all
workload entries. The only exception is if some VMs have new IP addresses, then all stale workload entries have to be manually updated.
71
VM IP address is inaccurate?
If your VMs IP address has changed after you added the host, web
UI will not know. If you are aware of the IP address changes, please delete the host and re-add it. You will also have to manually all stale workload entries in all configurations.
Often times, it happens in the way that you are not aware. For
example, if you are scheduling IOmeter or trace replay tests, but do not see any workload generated in the result page, it is likely that worker VMs have had their IP addresses changed after you compose the configuration. Please fix the configuration and rerun tests.
72
FAQ
Part 2: Test Scheduler
73
Please note that by aborting, the scheduler will lose its states and
thus all pending tests will be lost. You might also lose any intermediate stats. Also, the immediate following test might as a result contain some stale stats.
74
Test manager says IOmeter guestSummary timeout. Stats will be omitted for this test. What does it mean?
If you see this status, that means at least one of the worker VMs
that should run IOmeter do not generate an iometer.csv output.
If you have accepted EULA term and IOmeter is running without a valid ICF
spec (i.e., you see an IOmeter window but it is running any spec), please contact io-analyzer-info@vmware.com for a solution.
If these are all NOT the case, please make sure the worker VM is reachable by
the controller. You should try to SSH from the controller to make sure it works.
75
76
FAQ
Part 3: Test Results
77
No workload is generated?
If you are running IOmeter, please note that you have to accept the
Intel EULA the first time you run IOmeter on each worker VM. Without accepting the term, IOmeter will not proceed but the controller does not know. (Note that for trace replay tests, the EULA will not pop up.)
If you have accepted the EULA term but still do not see any
workload generated in the result page, it is likely that worker VMs have had their IP addresses changed after you compose the configuration. Please fix the configuration and rerun tests.
Note that this can happen that you schedule a number of tests and
in between tests, some of your worker VMs are assigned a new IP address via DHCP. In such a case, the controller VM will not be able to communicate with the worker VM.
78
If you have accepted IOmeter EULA and you have checked that
DHCP did NOT reassign your workers new IP addresses, but IOmeter still did not run at workers, this most likely means there are networking issues between the controller and the problematic worker.
Please ping from the controller to the worker and make sure the
response time (RTT) is under1.5 seconds. If RTT is above 1.5 seconds, it can happen that either SCP might timeout
when transferring IOmeter config file or IOmeter starts before the config file transfer finishes. In either case, IOmeter will not run. Since 1.5 seconds is uncommonly long, please fix any potential network problems before using I/O Analyzer.
79
Blank results?
If in the result page, you cannot even see host stats, it is likely that
the backend was unable to connect to any of the hosts. Please login to the appliance and check /var/www/ioa.log to find out the root cause.
Another possibility is if you run I/O Analyzer for more than 2 hours,
JVM might exhaust the entire heap. In our lab environment, we have tested I/O Analyzer for more than 5 hours without running out of memory. However, we recommend keeping tests under 2 hours. To find out whether this is the case, please check /var/log/daemon and look for out of memory exception.
81
82
83
If some VMs are missing, it is likely that during the whole test
period, it was totally powered off.
For other counter groups, it is likely that they are inactive. In order to be determined as active
A disk device or disk adapter must have an average IOPS of at least 0.1.
If these thresholds are too high/low for you, please consult ioanalyzer-info@vmware.com for the mean of configuring these thresholds.
84
85
FAQ
Part 4: Trace Repository
86
The backend trace parsing script accepts only CSV format. Please
make sure you follow the steps specified in the Collecting vScsi Trace section in the HELP page. If the format is not compatible, the scripts might fail generating properly charts.
87
FAQ
Part 5: Advanced Usage
88
89
Note that all worker VMs have to change to the same password so
that backend script at the controller is able to communicate with all workers.
90
All the IOs seem to hit the cache. What should I do?
91
If you have multiple I/O Analyzer VMs and would like to store all
results on the same one, you may simply transfer all folders under /var/www/expts to the I/O Analyzer VM you like.
Note that I/O Analyzer 1.5 recognizes all results generated by I/O
Analyzer 1.1+. However, those counters that are not parsed/stored in previous versions will not show up by importing this way.
Currently, I/O Analyzer does not support importing results that are
not generated by I/O Analyzer.
92
93
Why are there more than one esxtop files for each host?
94
*-throughput
TIMESTAMP\tMBREADS\tMBWRITES\tMBTOTAL
*-latency
For adapter and device TIMESTAMP\tDAVG\tKAVG\tGAVG\tQAVG For VM TIMESTAMP\tLatRd\tLatWr
*-pkps
TIMESTAMP\tPkpsTx\tPkpsRx
*-throughput
TIMESTAMP\tMbpsTx\tMbpsRx
Note that the TIMESTAMP is the relative timestamp, in which zero means the
starting time instant of the test.
95
def IsColZero(self,index): " Return true if all of the data is essentially zero " for value in self.columns[index]: floatValue = 0.0 try: floatValue = float(value) except ValueError: continue if floatValue != 0.0: return False return True
Note that you will have to install Python 2.6+, wxPython, and
numPy in order to run the modified esxplot.py.
Please also note that the esxtop output files generated by I/O
Analyzer 1.5+ do not usually follow the same exporting order as esxtop/resxtop.
96
Also, please be aware that all host credentials are stored in nonencrypted way. Exposing I/O Analyzer appliance to public might cause critical security threats to your enterprise networks.
97