SmartBenchmarker

Benchmarking tests
made easier

Product Brochure | 01.02

SmartBenchmarker
Benchmarking tests
made easier

In the fast-paced and highly competitive world of mobile network operators and service providers, performing
regular benchmarking tests is an indispensable investment in the future. To make smart decisions about future
expansions and deployments, reliable and reproducible network performance data is essential for ones own
network as well as for that of the competition.

With SmartBenchmarker, mobile network operators and service providers can perform accurate and advanced
benchmarking tests that not only are in line with the latest standards and methodologies but also reduce CAPEX
and OPEX.

SmartBenchmarker is the new software platform from Rohde&Schwarz mobile network testing for bench-
marking tests. It is the technological evolution of the SwissQual Diversity and NQView platforms and allows the
seamless configuration, execution and monitoring of benchmarking test campaigns. SmartBenchmarker is built
on state-of-the-art technology: users can control benchmarking tests either locally or remotely from the office.

With its optional central master module, SmartBenchmarker offers complete fleet management and advanced
alarming and monitoring functions. This approach gives operators and service providers more flexibility when
conducting drive tests. SmartBenchmarkers advanced monitoring functionalities also reduce the risk of expensive
redrives. Only when prompted by the software will users need to be involved in monitoring and troubleshooting
ongoing tests.

SmartBenchmarker is perfectly adaptable to meet user needs. Users only pay for what they need, when they need it.

2
SmartBenchmarker Flexible and customizable web interface that facilitates
configuration, execution and monitoring of bench-
marking test campaigns

At a glance Supports the existing Benchmarker II hardware chassis

and all its modules, including the Vehicle Roof Box (VRB),
the Test Device Containment Module (TCM) and the
Phone Mounting Wall (PMW)
Supports Benchmarker II Go
Offers capabilities to control the system locally or re-
motely from the office via a secure and reliable connecti-
on without affecting ongoing test results
The optional central master module provides advanced
fleet management capabilities and smart alarming and
notifications tailored to specific test scenarios

SmartBenchmarker setup

Benchmarker II Go Benchmarker II Vehicle Roof Box hosting TCMs

Rohde&Schwarz SmartBenchmarker 3
Key use case
Remote controlled
benchmarking
drive test
SmartBenchmarker allows users to remotely control one
or more benchmarking systems. For example, a system
could comprise the Benchmarker II chassis installed in a
vehicle and a number of TCMs hosted inside the VRB on
top of the car. Via a secure and encrypted connection, a
test supervisor can log in to the system and simultane-
ously manage the vehicle and monitor multiple devices
(smartphones and scanners).
Remote unit management of the VRB.
4
5
Advanced alarming and superior control functions
The flexible and adaptable SmartBenchmarker interface
supports the configuration of customized benchmarking
dashboards to keep ongoing tests under control at a
glance. Advanced alarming and notification functionalities
allow SmartBenchmarker users to save time: they can
customize the collection and processing of events and
notifications and only need to actively monitor the tests
when prompted.
Hosted platform fleet management
Service providers often need to factor OPEX into their
projects, ideally using and paying only for what they
actually need and utilize. The SmartBenchmarker central
master module can be hosted on a state-of-the-art, cloud
computing platform, which is available for rent. This kind
of flexibility further reduces operational costs. If fleet ma-
nagement and advanced alarming are not needed, a dedi-
cated hosted platform with secure connection capabilities
is available for accessing a single benchmarking system.
Drive and walk test
campaigns
The building blocks of the SmartBenchmarker include the
measuring devices, smartphones and R&STSMx scan-
ners. Smartphones can be seamlessly ported and used
as standalone QualiPoc solutions. Combined with an RF
scanner and a minimal license fee upgrade, the smart-
phones can also be used in a portable system such as
Freerider. This kind of modularity and flexibility not only
reduces capital expenditures, it also minimizes the number
of testing devices needed.
SmartBenchmarker
Easy and intuitive

Rohde&Schwarz SmartBenchmarker 5
Key product Powerful and
features easy-to-use user
Advanced fleet interface
management and The SmartBenchmarker software allows users to
seamlessly configure one or more systems to complete

remote control
The SmartBenchmarker software platform allows secure
remote connection to each system separately. In a more
advanced setup that includes the central master module,
smart alarming is configurable: users can customize the
collection and processing of events and notifications
and choose how test supervisors are kept informed, via
notifications, email or SMS. The central master also offers
centralized campaign configuration and live monitoring,
potentially of every smartphone in the field.
various advanced testing scenarios, for example the setup
of a voice call test between two independent systems
located in two different vehicles and connected via a se-
cure and encrypted connection. The SmartBenchmarkers
intuitive and modern graphical user interface makes
the configuration of such complex tasks very quick and
efficient. A robust and automated pre-test check offers
an additional efficiency boost as it prevents user and
configuration errors and saves the time and effort involved
in staff training.

More value from

test results
With SmartBenchmarker, tests are executed directly on
the smartphones, using the devices native software.
The test results reflect the true end-user behavior since
SmartBenchmarker probes are based on commercially
available device firmware and standard Android apps.
The SmartBenchmarker also supports and integrates
high-end hardware modules such as the VRB and TCM.
Combined, they comprise the leading solution for end-to-
end assessment.

Powerful alerts help operators focus on key The main dashboard provides aggregated The monitoring & replay overview offers
information. information to control multiple devices in-depth information (down to the bit) for
simultaneously. advanced users.

6
7
System overview Key benefits

Using the SmartBenchmarker offers long-term

The SmartBenchmarker software platform allows secure
remote connection to each system separately. The central
master module offers centralized campaign configuration
and live monitoring, potentially of every smartphone in
the field.
benefits, including:
Lower operational costs thanks to customized and
advanced remote controlling functions and high
system stability, reducing redrives.
Lower training costs thanks to its ease of use and
flexible interface, allowing efficient configuration of
multiple testing scenarios.
Lower capital expenditure costs thanks to its flexibi-
lity and modularity in configuration and the repur-
posing of mobile devices and scanners for other
testing purposes.

Smart architecture example

Web interface

Secure and
encrypted
connection
Drive test system 1 Drive test system 3

Central master module

Walk test system 1 Drive test system 2

Rohde&Schwarz SmartBenchmarker 7
 Overview of
supported hardware
Phone Mounting
Wall

Computer Slide-In Module

(CSM)

Benchmarker II chassis. Benchmarker II Go.

TCM

QualiPoc Android. Vehicle Roof Box (VRB) hosting Test Device Containment Modules (TCM).

R&STSME scanner from the R&STSMx network scanner product family. Freerider III (roadmap).

8

 Technical
specifications
Software specifications
Configuration data storage
SmartBenchmarker stores all configuration and high-level
test result data into a secure communication database.
Technology
Secure communication technology is used to interact with
the systems, including SSH and HTTPS protocol.
User interface
The modern user interface, using Angular Material design,
is easy to operate and fully compatible with any display
size: whether displayed on a large desktop monitor or a
smaller tablet screen, SmartBenchmarker adapts its layout
automatically.
Dashboard
All test result KPIs are presented in powerful dashboards.
At all times, the manager has an accurate overview of the
networks current service quality and receives detailed
status information of all measuring devices.
Campaign management
An intuitive and easy to operate campaign and test
management offers fast and efficient test configurations
in a modular way also for large numbers of measuring
devices.
User management
Multiple roles with different access levels (Admin,
Manager, Test Manager, Viewer) are part of the built-in
user management and allow system administrators to
manage users and assign tailored roles.
Functionalities
Central master
The central master module controls up to 100 systems
connected via HTTPS. The module can be hosted on a
state-of-the-art cloud computing platform.
Local master
The local master supports up to 32 measuring devices
per system. When registering to SmartBenchmarker,
phone configuration and subscriber number are included.
Compatibility
Network probes
SmartBenchmarker supports QualiPoc Android probes,
which are available on a wide range of the latest Android
smartphones, including Samsung, LG, HTC and Sony, and
on Rohde&Schwarz scanners, including R&STSME and
R&STSMW.
Hardware
The SmartBenchmarker software platform is compatible
with the Computer Slide-In Module (CSM) versions 1 and
2, TCM, all versions of the Audio Slide-In Module (ASM),
Benchmarker II Go and the Benchmarker II chassis.
Rohde&Schwarz SmartBenchmarker 9
 About Rohde&Schwarz
Service that adds value The Rohde&Schwarz electronics group offers innovative
Worldwide solutions in the following business fields: test and mea-
Local and personalized surement, broadcast and media, secure communications,
Customized and exible
Uncompromising quality
cybersecurity, monitoring and network testing. Founded
Long-term dependability more than 80 years ago, the independent company which
is headquartered in Munich, Germany, has an extensive
sales and service network with locations in more than
70countries.

Mobile network testing

The companys broad and diverse product portfolio for
mobile network testing addresses every test scenario in
the network lifecycle from base station installation to
network acceptance and network benchmarking, from op-
timization and troubleshooting to interference hunting and
spectrum analysis, from IP application awareness to QoS
and QoE of voice, data, video and app-based services.

Rohde&Schwarz GmbH&Co. KG
www.rohde-schwarz.com
Rohde&Schwarz mobile network testing
www.rohde-schwarz.com/mobile-network-testing
Rohde&Schwarz training
www.training.rohde-schwarz.com

Regional contact
Europe, Africa, Middle East | +4989412912345
customersupport@rohde-schwarz.com
North America | 1888TESTRSA (18888378772)
customer.support@rsa.rohde-schwarz.com
Latin America | +14109107988
customersupport.la@rohde-schwarz.com
Asia Pacific | +6565130488
customersupport.asia@rohde-schwarz.com
China | +868008108228 | +864006505896
customersupport.china@rohde-schwarz.com

R&S is a registered trademark of Rohde&Schwarz GmbH&Co. KG

5215.4246.12 01.02 PDP 1 en

Trade names are trademarks of the owners

PD 5215.4246.12 | Version 01.02 | September 2017 (cl)
SmartBenchmarker Benchmarking tests made easier
Data without tolerance limits is not binding | Subject to change
2017 Rohde&Schwarz GmbH&Co. KG | 81671 Munich, Germany

5215424612