Académique Documents
Professionnel Documents
Culture Documents
Connectivity in India
section provides a brief history of cellular data technology other cellular technologies over multiple hops. Packet Data
evolution and identifies technologies deployed in India. Serving Node (PDSN) is the equivalent of GGSN in CDMA
based data networks. Since GGSN and PDSN play the role
of gateways for cellular clients, they are commonly referred
Table 2: Evolution of Cellular Data Technologies. to as cellular gateways or simply gateways in the rest of the
Group Family 2.5G 2.75G 3G paper.
3GPP GSM GPRS, EDGE WCDMA, HSDPA,
HSCSD HSUPA, HSPA+
3GPP2 CDMA 1xRTT 1xEV-DO (Release 3. RELATED WORK
0, Rev A, Rev B) During the late 1990s and early 2000s when GPRS, 1xRTT,
and WCDMA networks were being deployed, the perfor-
The Third Generation Partnership Program (3GPP) and mance of these networks, particularly, the performance of
Third Generation Partnership Program 2 (3GPP2) were cre- TCP on them received much attention [4, 18, 19, 27]. While
ated by telecom standards development organizations to guide the field measurements reported near theoretical through-
cellular data standards development based on GSM and put values [25, 30], the packet-level evaluations provided
CDMA technologies, respectively. Table 2 shows the stan- several insightful observations [13]. For example, Chakra-
dards introduced under the 3GPP and 3GPP2 umbrella [5]. vorty et al. [6, 7] showed that small initial congestion win-
While GSM networks evolved to GPRS and EDGE, which dow combined with large RTT (> 1000ms) caused ineffec-
further evolved to HSPA networks, the CDMA networks tive use of available bandwidth as it took a long time to
evolved to 1xRTT followed by 1xEV-DO. Typically, data fill the network pipe during slow start and hence impacted
technologies prior to 3G are commonly referred to as 2G small file transfers. They also showed that large buffer sizes
technologies although there are significant differences in data at gateways, a phenomenon nowadays referred to as buffer
rates between technologies within the same generation. bloat [16], cause large delays in interactive applications and
In India, a majority of the operators use GSM technology TCP SYN timeouts during new TCP flow creation. They
and hence have evolved to EDGE, HSDPA, and HSUPA. recommended use of a transparent proxy between a GPRS
Only three out of a total of 13 service providers across In- client and a server, where the proxy uses a large initial win-
dia [23] operate on CDMA and have evolved to 1xRTT and dow to send data to the client while advertising a smaller
1xEV-DO. In this paper, we consider one CDMA-based ser- receive window to the server to reduce impact of queuing.
vice provider and three GSM-based service providers. Subsequently, several recommendations for improving TCP
performance on cellular networks have been evaluated [15,
2]. A majority of these studies are a decade old and the
results may not be applicable today. Parameters like ini-
tial congestion window size (from 1 to 3), receive window
size (from 10KB to 80KB), and TCP Segment Size (from
500B to 1500B) have been increased to accommodate large
Bandwidth-Delay Products common in todays networks.
Additionally, TCP SACK and fast retransmit is used by
Figure 1: IP Tunneling in cellular data networks. default thus reducing the impact of wireless packet loss. Fi-
GGSN/PDSN form the bridge (gateway) between nally, the studies above have been conducted in developed
the cellular client and the IP networks. world setting which is different from ours. In the rural re-
gions of the developing world, cellular data connectivity is
Figure 1 shows a schematic of IP layer communication believed to be sparingly used, which may result in these net-
between a cellular client and the Internet. A GPRS Gate- works being differently provisioned.
way Support Node (GGSN) connects the cellular clients to More recently, several studies have evaluated the perfor-
the Internet in a GSM based data network. GGSN is the mance of 3G networks in the developed world [26, 24, 22,
first IP layer hop visible to the cellular client. IP packets 29]. While these measurements are predominantly on access
between the cellular client and GGSN are tunnelled inside technologies different from those deployed in India, we sum-
marize results relevant to our work. Elmokashfi et al. [11] relationship with PRADAN, a NGO that has presence in
evaluated latencies on two HSPA and one EV-DO networks over 4,000 villages across eight of the poorest states in In-
in Norway and reported that the delay characteristics de- dia. PRADAN provided logistic support for our experiment
pend mainly on network configuration rather than location campaign. They helped in selecting locations and service
or measurement device. Similar to this we find that latency providers for measurements, finding appropriate transport
in EDGE networks of one service provider is significantly to reach the locations, and finding food and accommoda-
lower that the other two providers, which we assume is a tion. In consultation with PRADAN staff, we chose five
result of network configuration. In contrast, measurements rural locations namely Ukwa, Lamta, Paraswada, Amarpur,
by Tan et al. [29] in Hong Kong show significant customiza- and Samnapur, and one semi-urban location Dindori. These
tion in a cell-by-cell manner according to demographics of six sites are all based in the state of Madhya Pradesh in
individual sites. This indicates that cellular network deploy- central India. (Two of our rural sites had no hotels or guest
ments may vary across countries and service providers. Jur- houses, and PRADAN staff provided us food and lodging
vansuu et al. [17] evaluate performance of TCP on WCDMA in their offices.) In addition to these rural and semi-urban
and HSDPA networks and find that HSDPA provides an im- locations, we also conduct measurements in Delhi, which is
provement in TCP throughput over WCDMA, but the im- selected to represent Urban India. For ease of exposition,
provement is modest, particularly for short duration flows. we will use the labels R1 to R5 for rural locations, S1 for
The authors attribute this to large RTTs compared to wired the semi-urban location, and U1 for the urban location.
networks and small initial congestion window size. Our mea- We chose BSNL, Airtel, Idea, and Reliance as four dif-
surements, although conducted on slightly different access ferent service providers for measurements. BSNL, Airtel,
technologies, show a significant difference in throughput be- and Idea provide data connectivity over GSM based tech-
tween 2G and 3G technologies. nologies EDGE and HSDPA, which we refer to as G1 , G2 ,
Performance of home broadband networks has also been and G3 respectively for the rest of the paper. Reliance pro-
of interest to the academic community [14, 9, 28, 21, 1, 20, vides connectivity over CDMA based technologies 1xRTT
10]. Of particular relevance to us were the tools and tech- and 1xEV-DO, and so we refer to it at C1 . At any given
niques developed as a part of these measurements, which location, three best service providers were evaluated, the
we evaluated in our environments before choosing our tools. choice of which was based on knowledge of local PRADAN
Specifically, we use Netalyzr [20] for several one time tests staff about providers connection quality and pilot measure-
as described later in Section 4. Our measurement archi- ments conducted at the location. Overall G1 and G2 were
tecture design also draws upon prior work by Kreibich et evaluated in 6, G3 in 5, and C1 in 3 locations.
al. [20], borrowing the key concept of having a separate con- Table 3 summarizes the access technologies available at
trol server to serve the tests to be conducted by the client. our measurement locations. At some locations the access
technology alternated between EDGE and HSDPA, result-
ing in some measurements using EDGE and others using
4. METHODOLOGY HSDPA.
Our goal is to study basic network performance metrics
such as throughput, latency, DNS lookup times of cellular
service providers in rural India. At a high-level, we are pre- Table 3: Measurement locations/service providers.
sented with two challenges. The first challenge is selection G1 G2 G3 C1
(BSNL) (Airtel) (Idea) (Reliance)
of locations in rural India for conducting measurement cam-
R1 (Ukwa) EDGE EDGE EDGE -
paigns. The second challenge is to design a measurement R2 (Lamta) EDGE EDGE - 1xRTT
architecture, consisting of appropriate hardware and soft- R3 (Paraswada) EDGE EDGE EDGE -
ware, that can be deployed in rural locations, require mini- R4 (Amarpur) EDGE EDGE EDGE -
mal manual intervention, and efficiently cope with the chal- R5 (Samnapur) EDGE - - 1xRTT
lenges of electricity outages, rodents in the building chew- HSDPA HSDPA
S1 (Dindori) EDGE -
ing cables 1 , and minimal technical support. This section or EDGE or EDGE
HSDPA
describes how we addressed these challenges and concludes U1 (Delhi) -
and EDGE
EDGE 1xEV-DO
with a description of our measurement campaign.
5. MEASUREMENT RESULTS
5.1 Availability
We were interested in understanding the type of connec-
tivity available in the rural locations. We configured the
USB modems to connect to the service providers using the
highest generation access technology available, and periodi- Figure 3: Availability of service providers across ru-
cally logged the mode in which the modems were connected. ral and urban locations. Error bars indicate stan-
The logs show that only EDGE/1xRTT connectivity is avail- dard deviation across availability at rural locations.
able in our rural locations. However, the semi-urban loca-
tion (S1 ) is found to transition between EDGE and HSDPA
with the modem spending 20% time in HSDPA. (No tran-
sitions occurred when an iperf TCP flow was in-progress.) Are the achieved throughputs close to their theoret-
Our urban location (U1 ) had continuous HSDPA/1xEV-DO ical maximums?
connectivity for all the evaluated service providers. Figure 4 shows the average 2G throughputs measured
We also evaluated percentage of duration for which Inter- across locations and service providers4 along with the stan-
net connectivity was available. To do so we timestamped dard deviation in the measurements. The horizontal dashed
network connection and disconnection events reported by line shows the theoretical maximum throughput, which is
the USB modems and noted device down times and modem calculated using known MAC layer good-put values from the
physical disconnection durations. Using this we calculate standards and assuming 1500 bytes IP packet size includ-
availability for the (service provider, location) tuple as: ing 40 bytes overhead of TCP/IP headers. The achieved
connected time throughputs are (as may be expected) significantly lower
availability =
(measurement duration down time) than their theoretical maximums. 3G connections (not shown
where connected time is the duration in seconds for which in the figure), however, provide reasonably good broad-
the Internet is connected for the tuple, measurement duration band like performance (> 256 Kbps).
is the time between the first experiment and the last experi- Are throughputs better at night or on weekends?
ment conducted for the tuple, and down time is the duration To evaluate existence of diurnal patterns we compare through-
for which either the measurement node was down or the USB puts of flows conducted between 9am and 6pm with through-
modem was disconnected from the measurement node. put of flows conducted between 10pm and 6am. We find di-
Figure 3 shows availability of service providers across rural urnal patterns in G2 EDGE networks in both the uplink and
and urban locations. Since there was little variation in avail- downlink directions with 25% higher throughput in both
ability between rural and semi-urban locations of a provider the directions at night. G1 EDGE networks have 40%
we present a single bar representing average availability for higher throughput at night in downlink direction. Among
these locations. As shown in the figure, availability is con- 3G connections G2 HSDPA networks have 20% higher
sistently lower in rural locations by about 15% compared to downlink throughputs at night. Figure 5 shows the down-
availability in urban regions across all service providers. One link direction diurnal patterns for 2G networks.
exception is C1 where availability in both rural and urban Analysis for weekday-weekend patterns shows no signifi-
locations is below 50%. cant difference between throughputs achieved on weekdays
In our measurements, rural regions lag behind urban re- and weekends in our rural locations. The weekend through-
gions in type of connectivity and availability.
4
Uplink throughputs show similar characteristics and have
5.2 Throughput been omitted for brevity.
Figure 4: Measured 2G downlink throughputs
across locations and service providers. Error bars
indicate std-dev across experiment runs. Horizon-
tal dashed lines indicate TCP throughput in ideal
conditions. Figure 6: Comparison of signal strength at 2s in-
terval and throughput achieved during that period.
Arbitrary Signal Unit (ASU) is linearly correlated
to dBm with maximum and minimum values of 31
and 0 respectively.
achieved throughput.
We also tracked the base station to which the modems
were associated and observed no handoffs during our mea-
surements. Thus, handoffs are not responsible for the low
throughputs observed by us.
Later in Section 6, we present a detailed analysis of the
cause of low throughputs.
5.3 Latency
We analyze the ping round trip latencies and traceroute
paths from measurement nodes to landmark nodes.
Figure 5: Diurnal patterns in 2G downlink through-
puts.