How to Perform a Benchmark

Benchmark

Nov 2011 V0.2

INTERNAL
Agenda
Steps to follow before start a Benchmark campaign:

01 Introduction

01a Data Protocols

Layered Architecture
Protocols
Layer 3 (IP), 4 (UDP, TCP) & Application (FTP, HTTP, WAP 2.0)

01b Wireshark Training

Wireshark Introduction
Capturing & Reading a Trace

2 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

Agenda

02 Diagnostic & Optimization

02a FTP Generic Optimization

FTP E2E diagnostic and optimization

02b HTTP Generic Optimization

HTTP E2E diagnostic and optimization

3 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

Agenda
03 Tests Preparation

03 Measurement & Trace Protocol

Tests to be performed
Traces to be captured
Tools and Scripts to be used

04 Bottlenecks Identification

04.1 FTP
04.2 HTTP
04.3 - TCP

4 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

01 - Introduction

Alcatel-Lucent 2010, d.r., XXXXX

 01 - Introduction
Documents

01a Data Protocols

Data protocols in mobile networks.1.02_ALU.pdf

01b Wireshark Training

Wireshark training.1.03_ALU.pdf

Duration: 4 hours

available at LL under:
https://wcdma-ll.app.alcatel-lucent.com/livelink/livelink.exe?func=ll&objId=65762120&objAction=browse&sort=name

6 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

02 Diagnostic & Optimization

Alcatel-Lucent 2010, d.r., XXXXX

 02 Diagnostic & Optimization
Documents

02a FTP Generic Optimization

FTP_generic_optim.1.04_ALU.pdf

02b HTTP Generic Optimization

HTTP_diagnostic_guidelines.1.04_ALU.pdf

Duration: 4 hours

available at LL under:
https://wcdma-ll.app.alcatel-lucent.com/livelink/livelink.exe?func=ll&objId=65762120&objAction=browse&sort=name

8 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

03 Tests Preparation

Alcatel-Lucent 2010, d.r., XXXXX

03 Tests Preparation
Documents

03 Measurement & Trace Protocol

Protocole et traces 0.8_INTERNAL.ppt

Duration: 4 hours

available at LL under:
https://wcdma-ll.app.alcatel-lucent.com/livelink/livelink.exe?func=ll&objId=65762120&objAction=browse&sort=name

10 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

04 Bottlenecks Identification

Alcatel-Lucent 2010, d.r., XXXXX

04 Bottlenecks Identification
Post-processing tools
XCAP

WIRESHARK

Excel MACROS

12 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

04 Bottlenecks Identification
1. FTP
DL Throughput???

????.

13 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX

 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Cache

Notice that before start the HTTP tests, Cache settings should be disabled on the web browser.

.pcap capture under Windows 7

14 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Simultaneous Connections

With Firefox 3.0, 6 parallel connections were open [SYN]: 4940549410.

.pcap capture under Windows 7

15 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Keep Alive

On HTTP 1.1 keep-alive is enable by default; the idea is use the same TCP connection to send and
receive multiple HTTP. This lead to an improvement of the WEB page download time.

.pcap capture under Windows 7

16 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Multipart

Multipart is a technique applicable to WAP 2.0 which allows to send the full WAP page (i.e. all
objects at once) in a single package. Multipart can tremendously improve the WAP browsing speed.

.pcap capture under Windows 7

17 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
HTTP Compression

HTTP data is compressed before being sent by the server: usual compression method are deflate
or gzip. The overall page download gain is linked with shorter transmission duration.

.pcap capture under Windows 7

18 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Response Time Analysis (1/2)

- Set time reference over DNS request message (CTRL+T).

- Response time between [SYN] and [SYN, ACK] is around 260 ms (typical value for a ping on FACH state) and 800 ms between HTTP GET and the response.

- Check the RRC States with XCAP; mobile was often in CELL_FACH state?

.pcap capture under Windows 7

19 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Xcap
04 Bottlenecks Identification Analysis

2. HTTP
Response Time Analysis (2/2)

- Actually the mobile was systematically in FACH between each WEB page download.
- After correlate the RRC state w/ MAC-HS Throughput, it is possible to estimate the TimerT1 which
is around 3 sec.
- So since TimerT1 is too short, there are more FACH to DCH reconfigurations and consequently the
response time is impacted negatively.

20 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

 Wireshark
04 Bottlenecks Identification Analysis

.pcap capture under Windows 7

21 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Proxy (2/3)

- HTTP download time is reduced because the proxy declares the web page objects under several virtual@IP addresses; consequently the nb of
parallel connections is multiplied (for each IP address, 6 parallel connection are established Firefox 3.0)

.pcap capture under Windows 7

22 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

2. HTTP
Proxy (3/3)

- There is only 1 Copernicus web page request since the other 2 requests are provided by the
Proxy. HTTP performance is optimized.

Protocol: 3 consecutives Copernicus web page requests considering 3 operators

Operators w/o
HTTP Proxy
Operator w/
HTTP Proxy

.pcap capture Server side

23 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
 Wireshark
04 Bottlenecks Identification Analysis

3. Interworking with TCP

Slow Start

- The initial congestion window is equal to 2; this window could be increased to 4 in order to speed
up the slow start (higher values could also be tested).

.pcap capture under Windows 7

24 | SFR Benchmark Bordeaux | Octobre 2010 Alcatel-Lucent 2010, d.r., XXXXX
Annex

Alcatel-Lucent 2010, d.r., XXXXX

ANNEX
Useful docs
How Launch/Stop Traces
TCP Captures
Trace Capture & Analysis

available at LL under:
https://wcdma-ll.app.alcatel-lucent.com/livelink/livelink.exe?func=ll&objId=65762130&objAction=browse&viewType=1

26 | Benchmark | November 2011 Alcatel-Lucent 2010, d.r., XXXXX

 www.alcatel-lucent.com
www.alcatel-lucent.com

27 | SFR TGV UMTS 900 | Septembre 2010 Alcatel-Lucent 2010, d.r., XXXXX