Netmanias.2017.04.24.SDN - Nfv.strategies and Progresses in Network Operators

SDN/NFV:
Strategies and Progresses

in Network Operators
Harrison J. Son
CEO at Netmanias.com
son@netmanias.com
www.netmanias.com
About NMC Consulting Group/Netmanias was founded in year 2002, and is an advanced, professional network consulting company which is specialized for
IP Network areas (e.g., FTTH, Metro Ethernet, IP/MPLS and SDN/NFV), service areas (e.g. eMBMS, IPTV, IMS and CDN), and lastly, wireless network areas
(e.g. 4G LTE, 5G and Wi-Fi). Copyright © 2002-2017 NMC Consulting Group. All rights reserved.
Table of Contents
1. Top NFV/SDN Use Case in Operators’ Networks: vCPE 03
2. What’s trending in NFV/SDN application to Operator’s Networks 09
3. Case Analysis: Enterprise vCPE 12
3-1: Distributed vCPE 14
3-2: vCPE on Aggregation Switch or PE 24
3-3: Centralized vCPE 29
3-4: Centralized vCPE – Why SDN? 31
3-5: Distributed vCPE vs Centralized vCPE 52
3-6: Hybrid = Best 59
3-7: Discussion 62
Released in December, 2016
SDN/NFV: Strategies and Progresses in Network Operators 2

1. Top NFV/SDN Use Case in Operators’ Networks:
vCPE

NFV/SDN Use Case in Operators’ Networks (1/5)
Telco Network
Function (PNF) IHS/Infonetics, Top NFV and SDN
CO/PoP Core Datacenter
Dedicated appliances Residential Deployment Use Cases, 2016/04
2
RG (DHCP/NAT/…) There are many use cases where
Enterprise service providers are intending to
1 offer commercial services based on
Router/FW/DPI/... Access BNG Metro/Backbone SDN and/or NFV.
4 Our top use cases are virtual CPE
Mobile PE 3
(vCPE)—both consumer and the
Gi-LAN IMS vE-CPE enterprise version.
EPC
BS Telco Network Internet
Function (PNF) (Based on a study of global 22
Dedicated appliances Telco Network network operators )
Function (PNF)
Dedicated appliances
Most Important NFV Use Cases for Operational Efficiencies Most Important NFV Use Cases for Capex Reduction
1. Business vE-CPE 1. Business vE-CPE
2. Residential vCPE 2. Residential vCPE
Service Chaining 3. Mobile Core vEPC
4. IP Edge vPE 4. IP Edge vPE

Telco Network
1
Function (PNF) CO/PoP Core Datacenter
Sdxcentral 2016
Dedicated appliances Residential
Network operators selected vCPE,
RG (DHCP/NAT/…)
vEPC, SGi-LAN Service Chaining,
Enterprise and vRAN as the most effective
solutions in applying SDN/NFV to
Router/FW/DPI/... Access BNG Metro/Backbone the networks
Mobile PE
2 Gi-LAN IMS
4 EPC 3
Function (PNF)
Dedicated appliances Telco Network
Function (PNF)
1. vCPE
2. vEPC
3. Gi-LAN
4. vRAN
https://www.sdxcentral.com/articles/analysis/sgi-
gi-lan-efficiency/2016/06/

Telco Network
1
Function (PNF) Wipro 2015
CO/PoP Core Datacenter
Dedicated appliances Residential
vCPE and vEPC are chosen by
RG (DHCP/NAT/…) Wipro 2015 as the two areas that
Enterprise will have benefits of greatest TCO
saving (by more than 40%) and
3
Router/FW/DPI/... Access BNG Metro/Backbone fastest realization of SDN/NFV.
Mobile PE 2
Gi-LAN
4 IMS
EPC
Function (PNF)
Dedicated appliances Telco Network
Function (PNF)
3
45% vRAN
2
1
vEPC
vCPE

SOURCE: Verizon, Leveraging NFV for Profitable Managed Services: SD-WAN, Security & vCPE 2016.04

* Pricing based on 1,000 customers NFV-O SDNC
Customer 1 Customer 1
...
...
Customer 1,000 Customer 1,000
When using existing dedicated H/W When using NFV/SDN $580,000 $160,000
appliances NFV-O SDNC
X.86 Server $5,000

Customer Premise Customer Premise
Dedicated H/W Appliances

Router VNF (vRouter) $600
$2,400
SBC VNF (vSBC) $898
SBC
$1,200
Firewall VNF (vFW) $900
Firewall
$2,000 Carrier Ethernet VNF (vNID) $420
Mid Rage Router
2.0
$1,000
1G NID X.86 Server

$900
$6,600,000 $3,558,000
SOURCE: ADVA, Total Cost of Ownership Calculator, FSP 150vSE (X.86 server case, 2016

2. What’s trending in NFV/SDN application to Operator’s Networks

Trends
Virtualization & Go up to Cloudification & Go
Telco
Edge down to Edge
Network Edge PoP Core Datacenter
Function
<Function>
Residential
Enterprise
Access Backbone
...
Network Network
Mobile
Cloud
NFV
NVF and SDN: Out of DC and into operators’ networks SDN
<Technology>

Trends Ultimate purposes of technological evolution: i) Save money: less spending in deployment
and operation, ii) Make money: discover new revenue stream (VNFaaS)
n AS IS
Edge PoP Core Datacenter
Residential
NFV-O
RG (DHCP/NAT/…) SDNC
Enterprise
VPC Cloud
. Tenant A NFV Single purpose dedicated network appliance
Router/FW/WOC/... Access Backbone Tenant B SDN
.
. IMS
Mobile
Internet
BBU Services
EPC
(FW/DPI/MVO/SBC/…)
H/W S/W
Virtualization Network Appliance VNF (Virtualized Network Function)
= +
n TO BE [Residential]
Residential Edge PoP NFV-O Core Datacenter L3 CPE (RG) at customer home is virtualized - SW
(DHCP, NAT and Routing) is separated from HW
SDNC
VNF (modem, switch and AP). HW remains, but SW is moved
L2 CPE onto X.86 at edge PoP.
RG (DHCP/NAT/…) VNF
[Enterprise]
Enterprise VNF
vCPE
vCPE Network appliance (router, FW, WOC, IPS, etc.) at
vBBU enterprise is virtualized as VNF.
Router/FW/WOC... VPC Cloud
Access MEC Backbone NFV 1) Centralized vCPE: SW (VNF) is moved onto the cloud
. Tenant A
L2 CPE vEPC of edge PoP, leaving only simple L2 CPE behind at the
Tenant B SDN
VNF . VNF . enterprise premise.
Mobile 5G . 2) Distributed vCPE: VNFs are moved onto X.86 at the
. IMS
. enterprise premise.
BBU 4G Internet
EPC [Mobile]
Service BBUs at cell site are moved onto edge PoP, and
(FW/DPI/MVO/Caching/SBC/…) virtualized on X.86 server
VNF Centralization VNF Distribution Mobile core is also virtualized, moving eEPC down to
edge PoP
Go up to Edge Go down to Edge Services at the top of Gi are also moved down to edge
PoP

3. Case Analysis: Enterprise vCPE

Enterprise vCPE
Physical Network Appliances:
Customer Premise Multiple pieces of equipment
serving a single purpose
ER/PE
DC
WAN acc. MPLS L3 VPN

Router (Cisco) (Riverbed) FW (Juniper) ER/PE
Access HQ/DC
ONT/NID
IP Backbone Public Internet

VNFs
vRouter W
W vWOC Virtual CPE: Multiple appliances
vSwitch
vFW virtualized on X.86 server
X.86 server
Issues: Where in the operators’ network should the virtual CPE go?
Customer Premise
DC
ER/PE
Customer Premise
ER/PE MPLS L3 VPN HQ/DC

Access
ONT/NID aggregation
Branch Office/SMB
Edge PoP IP Backbone Public Internet

3-1: Distributed vCPE
Customer Premise Access Network Edge PoP Core Network
Physical IPS (Radware) FW (Juniper)
Carrier Ethernet
Network PON, DSL
DPI (Sandvine)
Appliances WAN acc. Lease Line, etc.
(PNFs) PNF (Riverbed) Router (Cisco)
DC
ER/PE
L3 VPN
L2 CPE
Router L2 SW
(aggregation) HQ/DC
NFVI on Premise IP Backbone Public Internet

vCPE
VNF
W L2 CPE WAN Acceleration VNF
W X.86 Server
❶ X.86 server Traffic heading to
Branch Office
Switch
VNF Internet traffic

NID
W ❶❸ X.86 only ❷ Server-Switch
Relative Cost $ Low. $$ High.
*For high-capacity 10Gbps server,
❷ Server-Switch comparison should be made with
AT&T, Verizon Server-Switch
NID VNF
Traffic Steering No. Yes
(per application traffic) All traffic passes the server (adding load): Ex.) WAN-accelerated traffic goes
W 2.0 The number of VNFs must be limited, or to X.86 module while general
high-performance CPU is required. Internet traffic goes to the
Internet.
❸ X.86 server Survivability No communication possible if server Communication available
Masergy fails because all traffic by-passes when
server fails
Enterprise Distributed vCPE - What’s available in the market
· All-in-one (NID + X.86 module) distributed vCPE equipment
· Commercially launched by all CPE vendors in 2015 ~ 2016
What’s available in the market
Juniper NFX250
VNF: 4~6
MRV OS-V20
ADVA FSP 150 ProVM
Telco Systems
CloudMetro 10
Ciena 3938vi
RAD ETX-2i VNF: 2~5
1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12
2015 2016
Further Reading
- AT&T's CORD - the ultimate architecture born after decades of innovation in the communications network
http://www.netmanias.com/en/?m=view&id=blog&no=10408

Enterprise Distributed vCPE – Vendors
vCPE at Customer Premise: NID with built-in server, and servers
Vendor vCPE Server CPU Released in NFV MANO Customers
Juniper NFX250 6-core Intel Xeon-D 2015.11 In-house: Contrail Service Orchestration AT&T
(Contrail Systems Acquisition in 2012)
RAD ETX-2i NID Intel® Core™ i7 and 2015.03 In-house: RADview D-NFV Orchestrator Centurylink
Intel® Atom™ processors Partners: HPE, Juniper Contrail, Ciena
BluePlanet
MRV OS-V20 Intel X.86 2016.05 In-house: Pro-Vision
ADVA FSP 150 ProVM Intel high performance 2015.10 In-house: Ensemble Orchestrator
4/8 core processor (Overture Acquisition in 2016)
ADVA FSP 150vSE (X.86 server) Multi-core Intel X.86 2014.06 “ MASERGY
architecture
Ciena 3938vi Intel X.86 2015.06 In-house: Blueplanet (Cyan Acquisition in
2015)
Telco Systems CloudMetro 10/100 Intel X.86 2016.05 In-house: EdgeGenie Orchestrator™ CE 2.0
& SDN/NFV Management System
Alcatel NSG (X.86 server) Intel X.86 In-house: VSD (Virtual Service Directory)
Vendor Supported VNFs
Juniper vRouter(Juniper), vSRX(Juniper), Cisco, Fortinet, Riverbed, Viptela,…
RAD vRouter(HP), Encryption, vFW, vSBC, vWOC
MRV CE2.0 VNF,
ADVA CE2.0 VNF (ADVA), vRouter(Brocade, HP), Encryption(Certes), vFW(Fortinet, Check Point), vWOC(ipanema,
Riverbed), DPI(Qosmos), vSBC(Sonus)
Ciena vRouter(Brocade), Encryption(Certes), vFW(Fortinet), Caching(Qwilt), Versa, etc.
Telco Systems Cisco, Brocade, Juniper, Silver Peak, Riverbed, Fortinet, Check Point, Audio Codes, Palo Alto, Netrounds.
Alcatel vRouter (DHCP, NAT), VPN, FW

ADVA
• Supports both Centralized CPE and Distributed CPE
SP’s OSS/BSS
Selfcare Portal models
• Orchestrator and SDN controller: Supplied by ADVA
Ensemble Service Orchestrator (ESO) • VNF: CE 2.0 EAD/NID VNF are developed by Overture, but
other VNFs are by 3PP
• Distributed vCPE platform
Ensemble Network Controller (ENC) Openstack 1) FSP 150vSE: Server
Netconf, Openflow Nova Neutron 2) FSP 150 ProVM: NID + Server + Storage
1. Centralized vCPE Cloud Network Controller
Openflow
VNF
FSP 150 ProNID

OVS
2. Distributed vCPE Underlay
Underlay
Backbone
2014.06 Carrier CE Switch Openflow Switch PE/ER
VNF Ethernet PoP
X.86 Server
FSP 150 vSE
VNF as a Service
2015.10
VNF
NFVI as a Service
FSP 150 ProVM

FSP 150 ProVM

ADVA deployed at production network, and trials

RAD
• Released ETX-2i NID, a server-switch featuring NID and a built-in X.86 module card in March 2015
• Supported 3PP VNFs: vRouter, FW, SBC, WOC, Encryption, IP PBX, IPS/IDS
• NFV orchestrators, both by RAD (e.g., RADview D-NVF orchestrator) and by partners (e.g., HPE, Juniper and Ciena), are used
ETX-2i NID
X.86 Module (NFV)

Enterprise Distributed vCPE – Operators
Operator vCPE Service VNF Location: vCPE Platform NFV MANO VNFs in use Commercial
Premise/PoP (NFVI) service
available in
AT&T Network Functions Customer Premise Juniper NFX 250 AT&T in-house: vRouter(Juniper, Cisco) 2016.07.18
VPN On Demand (uCPE: (Server-switch) ECOMP vSecurity(Fortinet)
Universal CPE) vWOC(Riverbed)
Verizon Virtual Network Customer Premise Juniper Verizon in-house vSecurity (Cisco, 2016.07.21
VPN Service (uCPE) Cisco Fortinet, Juniper, Palo
Alto)
vWOC (Riverbed, Cisco)
SD-WAN (Viptela, Cisco)
DartPoints Customer Premise ADVA FSP 150vSE NFV Orchestrator: vRouter Feb. 2016.
(USA) (located in multi- (Overture 65vSE) ADVA ensemble vFW Began deploying
tenant facilities) vSwitch: ADVA ADVA solutions
ensemble in its
connector commercial
network
(world’s first
65vSE+ensembl
e). (SMB)
CenturyLink Customer Premise RAD ETX-2i Ciena(Cyan)’s Blue vEncryption 2015.03.12
(USA) Planet NFV vFW (SMB)
Orchestrator.
MASERGY Virtual f(n)™ Customer Premise ADVA FSP 150vSE vCE2.0NID (Overture) June, 2015.
(USA) (Overture 65vSE) vRouter (Brocade) World’s first
VPN 65vSE: x.86 서버 vFW (Fortinet) Pure-Play NFV
vSBC (ACME, Adtran) CPE service
vWOC (Certes (SMB)
Networks)
WOC: WAN Optimization Controller (e.g., WAN Accelerator )

Distributed vCPE: Commercialization case 1 – ADVA
1. Masergy (USA-based carrier Ethernet service provider ) 2. DartPoints (USA-based data center operator)
Customers: SMB (Small and Medium-size Business) 2015.06 2016.02
Connection speed: 100Mbps
Commercialized services: Routing, FW, SBC, WOC Macro
Enterprise Datacenter
LAN Public Internet (Co-location,
3rd Party VNFs Masergy
vRouter (Brocade) Cloud,…)
Orchestrator
vFW (Fortinet)
vSBC (ACME, Adtran) CE2.0 NID VNF
vWOC (Certes Networks) (ADVA)
DartPoints NOC
Multi-Tenant Building
Masergy
LAN Carrier Ethernet ADVA Ensemble
FSP 150 vSE Customer 1 Orchestrator
SMB Enterprise
LAN
FSP 150 vSE
What ADVA offers
3. CE2.0 NID VNF
Enterprise
LAN
3rd Party VNFs Orchestration
NFV FSP 150 vSE
VNFs Customer 2
Router Public Internet
SDN
2. Connector ADVA vSwitch

Micro Datacenter (OTT model)
1. FSP 150 vSE = Hardened X.86 Server VNF service and network service are offered by different service providers

Distributed vCPE: Commercialization case 2 – AT&T network
function on demand (July 18, 2016)
1. Managed Internet Service on Demand 2. Network Function on Demand
VNFs (vRouter) are located at AIC nodes in AT&T’s VNFs are located at customer premises (e.g. X.86 server in NFX25) or at AICs in AT&T’s network
network ECOMP integrator: Amdocs
MANO = ECOMP = AT&T in House Openstack: Mirantis Openstack
SDN Controller: Juniper Contrail
Networking (Overlay, Service-
Chain)
vRouter
NVFs
Juniper NFX250
NVFs
vRouter (Juniper, Cisco)
vFW (Fortinet)
vWOC (Riverbed)
On the Premise In the Network

Released in Sep. 2015 Released on July 18, 2016 To be released in 2017
Virtual Router (vRouter)

Vendors: Cisco, Juniper, Brocade
Features Packet
• Static Routing Forwarding Built-in
NIC
CPU
Engine
• Routing Policy
• RIP, OSPF, IS-IS, and BGP Routing Protocols 10 x 1GbE 2x 2x 1 x 1 GbE copper
copper 1GbE 10GbE Management /
• Dynamic Host Configuration Protocol (DHCP) Relay SFP SFP+ WAN
• Proxy Address Resolution Protocol (ARP)

Juniper NFX250
Number of AIC (AT&T Integrated Cloud) nodes: 74 as of 2016

Distributed vCPE: Commercialization case 3
Verizon Virtual Network Service MANO: In-House
Openstack: Red Hat’s Openstack
Switch Fabric SDN Controller: Big Switch
Switch Fabric (Leaf, Spine) White Box Switch: Dell
White Box Switch Network OS: Big Switch’s Switch Light OS
Distributed vCPE: Juniper, Cisco
Three options:
1. Premises-based universal customer equipment
2. Cloud-based virtual CPE service available later this year
3. Hybrid version that allows for a mix of premises-based
and cloud-based deployments.

3-2: vCPE on Aggregation SW or PE Router
Physical
IPS (Radware) FW (Juniper)
Network
Appliances DPI (Sandvine)
WAN acc.
(PNFs) PNF (Riverbed) Router (Cisco) DC
L3 VPN
HQ/DC
L2 CPE
Router ER/PE IP Backbone Public Internet
• Less unit costs compared to Premise vCPE

• Cost performance:
NFVI on Aggr. Switch or Operating an external, standalone X.86 server
Router saves more compared to having a high-priced
router connected to all PNFs via line cards
• Scalability Problem
❷ X.86 Line Card

on PE router
vCPE vCPE DC
❶ X.86 Line Card
on Aggre. SW W W L3 VPN
HQ/DC
L2 CPE L2 SW
(aggregation) ER/PE IP Backbone Public Internet

vCPE on Aggr. SW or PE – Vendors
Vendor PE Router Server CPU Released in NFV MANO Customers
Juniper MX 960 x.86 Line Card 2012 In-house: Contrail COLT
Service Orchestration
(Contrail Systems
Acquisition in 2012)
Nokia/ALU 7750 SR x.86 Line Card In-house: VSD (Virtual

Service Directory)
Telco System T-Metro x.86 Line Card In-house: EdgeGenie

Orchestrator™ CE 2.0 &
SDN/NFV Management
System
MRV OptiPacket Series x.86 Line Card 2016.05 In-house:Pro-Vision

MRV
· Added Intel X.86 module on CPE
and Aggregation switch
· Operators can implement vE-CPE
service right on the Access
Network equipment without
having to deploy a separate edge
X.86 Line Card (VNF)
PoP NFVI dedicated for the
service.
X.86
Standalone
Server(VNF)
X.86 Module (VNF)

OS-V20
NFV-Optimized 10GbE CPEs
X.86 Module (NFV)
Expansion slot can host an x86 HW

compute module to allow
supporting of virtual applications
such as DPI, Firewall, DPI,
Security, Load balancing, etc.

Telco Systems
Telco Systems' Open Metro Edge (OME) portfolio =
CloudMetro CPE Switch + EdgeGenie Orchestrator + TelcoApps library of pre-configured VNF packages
❷ ❸
VNF 생성/관리 Pre-Integrated VNF: Cisco, Brocade,

Service Chaining Juniper, Silver Peak, Riverbed, Fortinet,
Check Point, Audio Codes, Palo Alto,
Netrounds.
❶ · Added Intel X.86 module on

CPE and Aggregation switch
· Operators can implement
vE-CPE service right on the
Access Network equipment
CloudMetro™ 100 CloudMetro™ 10 without having to deploy a
10GE Carrier Grade SDN & 1GE Carrier Grade vCPE SDN & separate data center
D-NFV Platform Distributed NFV Platform
dedicated for the service.

vCPE on PE Router: Commercialization case
COLT: IP access and IP VPN services
From physical L3 CPE routers to a virtualised IP service (Internet Access & IP/MPLS VPN)
DC/WAN Network As of 2015, 60% of enterprises subscribing to Internet Access service are vCPE subscribers.
SDN Controller
(BluePlanet) Cloud Controller
(Openstack)
2013
Openflow
Overlay
(VXLAN)
Underlay COLT Node (Edge) COLT Datacenter (Gen4)
(Per-Hop)
vRouter 2014
Physical Server
vFW
Overlay Tunnel(VXLAN) VM
PE
L3 Router
VNF VNF
Cyan
Accedian
2012.11
vRouter MPLS L3 VPN OVS
L2 NID Cyan 기업전산
자원
PE
IP/MPLS VM VPC
L2
IP access and IP VPN
SDN GW
Cyan Juniper M960
services PE Overlay Tunnel(VXLAN) vFW
Spine: Arista 7150S

Leaf: Arista 7050Q
Public Internet
Carrier Ethernet
[NFV]
· In Nov. 2012, L3 CPE (router) was removed from a customer premise, and vRouter was added as VNF onto X.86 line
card at PE router (Juniper M960)
· Then later, NFVI was introduced in COLT node, and vRouter and vFW were added onto X.86 server
[SDN]
· L2 NID – Carrier Ethernet – PE Router: At each hop, SDN controller provisions paths with Openflow
· PE – Fabric – vRouter: Overlay Tunnel(VXLAN)s are provisioned by SDN controller with Openflow

3-3: Centralized vCPE
Physical Carrier Ethernet
Network IPS (Radware) FW (Juniper) PON
AppliancesDPI (Sandvine)
Lease Line, etc.
(PNFs) WAN acc.
PNF (Riverbed) Router (Cisco) DC
L3 VPN
HQ/DC
L2 CPE
Router L2 SW
(aggregation)
ER/PE IP Backbone Public Internet
NFVI Edge PoP
vCPE Datacenter
W
X.86
server
Switch
Fabric
DC
L3 VPN
HQ/DC
L2 CPE L2 SW

Centralized vCPE
Carrier Ethernet, PON
Lease Line, L3 Switch, etc.
LAN DC
L3 VPN
HQ/DC
ONT
Router FW
/NID IP Backbone Public Internet
CPEs
NFVI
vCPE
vRouter vFW
LAN
Switch
DC
Fabric
L3 VPN
HQ/DC
ONT/NID
· CPE at customer premises are virtualized (vCPE) and added onto NFVI at edge PoP
· Customer’s LAN is expanded to the operator’s edge PoP

3-4: Centralized vCPE – Why SDN?
A secure tunnel is required between a customer (Branch Office) and VNFs at NFVI in edge PoP of the operator to:
· Identify and reach the customer’s VNF (vRouter) in the edge PoP
· Ensure security as the operator’s access networks, DC GW/ER/PE, Switching Fabric, X.86 servers, etc. are shared by
many customers
⇒Network virtualization through SDN (virtual network creation)
Enterprise A vRouter A vFW A
Branch Office
X.86
server
vRouter B vFW B
ONT/NID
Switch
DC
Fabric
L3 VPN
HQ/DC
Access Network
ONT/NID
Enterprise B
Branch Office

Centralized vCPE - SDN

Underlay vRouter Edge PoP · SDN controller provisions the packet
forwarding table of each node on the
SDN Controller VM
route
vFW · Can maximize the efficiency of the
p1 p2 network usage
Per-Hop provisioning vSwitch
· SDN controller: Complex
(Openflow, Netconf,…)
· Best for new networks
Switch
Customer Premise Fabric
DC
L3 VPN
HQ/DC
ONT/NID L2 SW
(aggregation) ER/PE
Hop-by-Hop forwarding
vRouter
Overlay Edge PoP
· SDN controller provisions only the
SDN Controller VM two end points on the route
vFW · SDN not recognized by sub-network
p1 p2
· SDN controller: Simple
vSwitch
Tunnel provisioning · Can use existing networks as is
(Openflow, MXPP,…)
Switch
Customer Premise Fabric
DC
VXLAN, GRE or IPsec Tunnel
L3 VPN
HQ/DC
ONT/NID L2 SW
(aggregation) ER/PE

Lease Line, L3 Switch, etc. Network Virtualization with
vRouter vFW
SDN: Datacenter (edge PoP)
Network Virtualization with X.86 B ❶ Underlay: Openflow
server
SDN: Access Network SDN ❷ Overlay: Tunnel
❶ Underlay: Openflow
❷ Overlay: Tunnel Switch
DC
Fabric
L3 VPN
A HQ/DC
ONT/NID
L2 SW DC GW/ER/PE IP Backbone Public Internet
SDN (aggre.)
Switch Fabric Switch Fabric Switch Fabric

DC GW vRouter vFW ER/PE
ONT/NID/L2 CPE
Overlay (VXLAN, GRE, IPsec) Overlay (VXLAN, MPLSoGRE) Overlay (VXLAN, MPLSoGRE) Overlay (VXLAN, MPLSoGRE)
Underlay (Per-Hop Openflow/Netconf/
Proprietary/Manual) Underlay (Openflow) Underlay (Openflow) Underlay (Openflow)
B
Overlay (VXLAN, GRE, IPsec) Overlay (VXLAN, MPLSoGRE) Overlay (VXLAN, MPLSoGRE)
Underlay (Per-Hop Openflow/Netconf/Proprietary/Manual) Underlay (Openflow) Underlay (Openflow)

Enterprise Centralized vCPE – Vendors
Vendor Cloud CPE vSwitch DC SDN tunnel Switching NFVO, SDNC Customers
Fabric
Juniper vCPE VR VXLAN, QFX series In-house AT&T
MPLSoGRE
Cisco CSR1Kv VTF VXLAN, In-house Orange
MPLSoGRE
Ericsson vEGW EVS/CSS VXLAN, Router 8000 In-house 2015 Trial@Telstra
MPLSoGRE (Australia)
Nokia/ALU vCPE VRS VXLAN, 7850 In-house
MPLSoGRE

Ericsson: vEGW Solution
Service Orchestration (ECM)
Ericsson SDN Controller Resource Orchestration

(Opendaylight) (Openstack/ECEE) VNF
Edge PoP
Customer Premise Access Network vRouter
Carrier Ethernet, PON VM
vFW
EVS/CSS p1 p2
ASUS RT-N16 vSwitch

B
SDN
Router 8801 (240Gbps)
SSR 8000
Switch
Zyxel NBG 6716 DC
Fabric
L3 VPN
A HQ/DC
L2 SDN CPE
SDN (aggre.)

L2 SDN CPE
B

Ericsson vEGW
Virtual Enterprise GW (vEGW): Ericsson’s vCPE solution for Branch offices and SMBs
Portal
VXLAN Tunnel VM Instances
Ericsson SDN Controller Resource

(Opendaylight) Orchestration
(Openstack/ECEE) Nova/Neutron/Glance
Openflow/OVSDB
Openflow
Internet
Access GW
vFW vNAT
(vRouter)
HQ
OVS OVS OVS
...
VXLAN Tunnel, GRE
L3 VPN
SDN-CPE (L2) OLT/DSLAM/CMTS/ DC GW ER/PE

L2 SW/L3 SW
BO or SMB
Legacy Access Network (Any) PoP/Local Datacenter

Ericsson vEGW
Virtual Enterprise GW (vEGW): Ericsson’s vCPE solution for Branch offices and SMBs
Portal
VXLAN Tunnel VM Instances
Ericsson SDN Controller Resource

(Opendaylight) Orchestration
(Openstack/ECEE) Nova/Neutron/Glance
Openflow/OVSDB
Openflow
Internet
Access GW
vFW vNAT
(vRouter)
=>
VXLAN Tunnel ID: Port1 Port2
VXLAN Tunnel ID Port3 HQ
Port 1
Server IP:1.1.1.1
OVS
VXLAN Tunnel, GRE L3 VPN
SDN-CPE (L2) OLT/DSLAM/CMTS/ L3 SW ER/PE

L2 SW/L3 SW
BO or SMB PoP/Local Datacenter
Legacy Access Network (Any)

Juniper Centralized vCPE
Portal
Contrail Service Orchestration

(NFV Orchestration and VNF Manager)
VNF Manager
VNF
Contrail Cloud Platform:VM,
VIMVN
(Openstack + SDN Controller(Contrail Networking))
Virtual Machine Virtual Network
VM VM
vRouter vSRX 3PP VNF vSRX FW, IPS, Anti-Virus, ...
...
Northstar (SDN controller) XMPP
VR BGP, Netconf
... Internet HQ
Overlay
VXLAN, QFX switch series
MPLSoGRE
L3 VPN
L2 CPE Unified Edge Router
Or MX series
BO or SMB
Underlay/Overlay
Telco CO/PoP
VLAN
L1
Ipsec, GRE tunnel

Juniper Centralized vCPE (1)
Portal

VNF Manager

VIMVN
Northstar (SDN controller)
... Internet HQ
QFX switch series
L3 VPN
Or MX series
BO or SMB
Underlay/Overlay
Telco CO/PoP
VLAN
L1
Ipsec, GRE tunnel

Portal


VIMVN
Northstar (SDN controller)
E2E VPN creation
... Internet HQ
L3 VPN
Or MX series
BO or SMB
Underlay/Overlay
Telco CO/PoP
VLAN
L1
Ipsec, GRE tunnel

Portal


VIMVN
Virtual Machine creation
VM VM
ip1 ip2 ip1 ip2

Northstar (SDN controller) ge1 ge2 ge1 ge2
VR
... Internet HQ
L3 VPN
Or MX series
BO or SMB
Underlay/Overlay
Telco CO/PoP
VLAN
L1
Ipsec, GRE tunnel

Portal


VIMVN
Virtual Network creation
XMPP BGP, Netconf
VM VM

VR
Overlay ... Internet HQ

VXLAN,
MPLSoGRE
L3 VPN
Or MX series
BO or SMB
Underlay/Overlay
Telco CO/PoP
VLAN
L1
Ipsec, GRE tunnel

Portal

VNF Manager
VNF Instance creation
VIMVN
VM VM
vRouter vSRX
VR
Overlay ... Internet HQ

VXLAN,
MPLSoGRE
L3 VPN
Or MX series
BO or SMB
Underlay/Overlay
Telco CO/PoP
VLAN
L1
Ipsec, GRE tunnel

Enterprise Centralized vCPE – Operators
Operator vCPE Service VNF Location: Premise CPE – Cloud NFV MANO VNFs introduced (or to Commercial
Premise/PoP CPE Connectivity be introduced) service launched
or to be
launched
AT&T Network Functions AT&T Node (AIC) AT&T ECOMP vRouter(Juniper, Cisco) Planned in 2017
On Demand vSecurity(Fortinet)
vWOC(Riverbed)
Verizon Virtual Network Cloud CPE Maybe In-House vSecurity (Cisco, 2016.Q3
VPN Service Hybrid Fortinet, Juniper, Palo
Alto)
vWOC (Riverbed, Cisco)
Orange Easy Go Orange PoP NFV Orchestrator: vSRX (Juniper)
Ciena BluePlanet (Versa)
DT (T-Com) DT Overlay (IPsec) vRouter (Cisco, CSR1Kv) Croatia, Hungary,
PoP/Datacenter vFW (Cisco, ) and Slovakia in
Cisco Turn-Key V (Cisco, ) March 2015.
German in
March 2016
COLT (Europe) IP access and IP COLT Node (PoP) Underlay SDN SDNC: BluePlane vRouter, vFW 2012.11 – 2013 -
Internet VPN services Initially X.86 card (Openflow) 2014
MPLS VPN on Juniper
Universal Edge
Router, and then
later on X.86
server and SF
Singtel Singtel NFV Singtel Cloud vRouter, vFW In May 2016
service*
KT Maybe In-House 2017 or 2018
*Offered for free to enterprise customers subscribing to Singtel’s enterprise Internet service

Centralized vCPE: Commercialization case 1 – COLT

Carrier Ethernet
vRouter vFW
X.86
server
SDN
Switch
DC
SDN Fabric
L3 VPN
A HQ/DC
ONT/NID
(aggre.)

ONT/NID/L2 CPE
B

From physical L3 CPE routers to a virtualised IP service (Internet Access & IP/MPLS VPN)
DC/WAN Network As of 2015, 60% of enterprises subscribing to Internet Access service are vCPE subscribers.
SDN Controller
(Openstack)
2013
Openflow
Overlay
(VXLAN)
(Per-Hop)
vRouter 2014
Physical Server
vFW
Overlay Tunnel(VXLAN) VM
PE
L3 Router
VNF VNF
Cyan
Accedian
2012.11
vRouter MPLS L3 VPN OVS
L2 NID Cyan 기업전산
자원
PE
IP/MPLS VM VPC
L2
IP access and IP VPN
SDN GW
Cyan Juniper M960
services PE Overlay Tunnel(VXLAN) vFW
Spine: Arista 7150S

Leaf: Arista 7050Q
Public Internet
Carrier Ethernet
[NFV]
· In Nov. 2012, L3 CPE (router) was removed from a customer premise, and vRouter was added as VNF onto X.86 line
card at PE router (Juniper M960)
· Then later, NFVI was introduced in COLT node, and vRouter and vFW were added onto X.86 server
[SDN]
· L2 NID – Carrier Ethernet – PE Router: At each hop, SDN controller provisions paths with Openflow
· PE – Fabric – vRouter: Overlay Tunnel(VXLAN)s are provisioned by SDN controller with Openflow

COLT: IP access
DC/WAN Network
SDN Controller
(Openstack)
2013년
Openflow
Overlay
(VXLAN)
(Per-Hop)
vRouter 2014년
Physical Server
vFW
VM
PE/ER
L3 Router
VNF VNF
Cyan
Accedian
OVS
L2 NID Cyan IP/MPLS 기업전산
자원
PE/ER VM VPC
L2
SDN GW
Cyan PE/ER vFW
Juniper M960
Spine: Arista 7150S

Leaf: Arista 7050Q
Public Internet
Carrier Ethernet

COLT: IP VPN (MPLS L3 VPN) services
DC/WAN Network Cloud Controller Customer Site
SDN Controller (Openstack)
(BluePlanet)
COLT Node (Edge) COLT Datacenter (Gen4)

2014년
Physical Server
Customer Site vRouter
vRouter
VM
L3 Router
PE VNF
Cyan VNF
Accedian
L2 NID
MPLS L3 VPN OVS
Cyan 기업전산
자원
PE
IP/MPLS VM VPC
L2
SDN GW
Cyan PE vFW
Juniper M960
Spine: Arista 7150S

Leaf: Arista 7050Q
Public Internet
Carrier Ethernet

Centralized vCPE: Commercialization case 2 – AT&T network
function on demand (July 18, 2016)
1. Managed Internet Service on Demand 2. Network Function on Demand
VNFs (vRouter) are located at AIC nodes in AT&T’s VNFs are located at customer premises (e.g. X.86 server in NFX25) or at AICs in AT&T’s network
network ECOMP integrator: Amdocs
MANO = ECOMP = AT&T in House Openstack: Mirantis Openstack
SDN Controller: Juniper Contrail
Networking (Overlay, Service-
Chain)
vRouter
NVFs
Juniper NFX250
NVFs
vRouter (Juniper, Cisco)
vFW (Fortinet)
vWOC (Riverbed)
On the Premise In the Network

Released in Sep. 2015 Released on July 18, 2016 To be released in 2017
Virtual Router (vRouter)

Vendors: Cisco, Juniper, Brocade
Features Packet
• Static Routing Forwarding Built-in
NIC
CPU
Engine
• Routing Policy
• RIP, OSPF, IS-IS, and BGP Routing Protocols 10 x 1GbE 2x 2x 1 x 1 GbE copper
copper 1GbE 10GbE Management /
• Dynamic Host Configuration Protocol (DHCP) Relay SFP SFP+ WAN
• Proxy Address Resolution Protocol (ARP)

Juniper NFX250
Number of AIC (AT&T Integrated Cloud) nodes: 74 as of 2016

Centralized vCPE: Commercialization case 3
Verizon Virtual Network Service MANO: In-House
Openstack: Red Hat’s Openstack
Switch Fabric SDN Controller: Big Switch
Switch Fabric (Leaf, Spine) White Box Switch: Dell
White Box Switch Network OS: Big Switch’s Switch Light OS
Distributed vCPE: Juniper, Cisco
Three options:
1. Premises-based universal customer equipment
2. Cloud-based virtual CPE service available later this year
3. Hybrid version that allows for a mix of premises-based
and cloud-based deployments.

3-5: Distributed vCPE vs Centralized vCPE
Current Telco Network Core Datacenter
many single-purpose, hardware-based devices Function (PNF)
IPS (Radware) FW (Juniper)

Edge PoP NFV-O
DPI (Sandvine) Enterprise SDNC
WAN acc.
PNF (Riverbed) Router (Cisco) Backbone VPC
Access
.. Tenant A
. Tenant B
subscription Too high Install,

can be CAPEX/OPEX configure,
available in update,
days or weeks maintain
1. VNF at Premise (Distributed vCPE) 2. VNF at CO/PoP (Centralized vCPE)

Self-Service Portal Self-Service Portal
NFV-O SDNC NFV-O SDNC
VNF
vRouter
vFW
vWOC
L2 NID
VNF
VNF vRouter
vFW
vRouter Edge PoP vRouter
vWOC
vFW vFW
VNF vWOC vWOC
Access Backbone
Access Backbone L2 NID ...
Server-Switch
Edge PoP

Comparison 1. First Costs
Distributed vCPE (VNF at Premise) Centralized vCPE (VNF at CO/PoP/DC)
VNF NFV-O SDNC NFV-O SDNC
SDN
Access Access
Access Backbone Access Backbone

SDN
SDN
Access Access
· Full-scale datacenter deployment or network re-design is not · High costs in building a new data center at edge PoP and deploying full
necessary NFVI (switch fabric, server and storage)
· No change in network architecture
· Works required only within customer premises as usual
· Fast time-to-market

Comparison 2. NFVI Costs (Per-unit costs and scalability)
NFV-O SDNC NFV-O SDNC
VNF fixed compute power Resources (servers and storage)

1 1
can efficiently be shared among
customers as needed
2 2 2 1 1 2 2 2
3 3 4 4 4
4 5 5 5 5
3 3
Access Backbone Access Backbone
4 4 4 4
1 1 2 2 2 1 1 2 2 2 1 1 2 2 2
3 3 4 4 4 3 3 4 4 4 3 3 4 4 4
5 5 5 5 4 5 5 5 5 4 5 5 5 5 4 5 5 5 5
High scalability
· Computing capacity of the distributed vCPE at each customer · Plentiful resources of many servers at edge PoP can be efficiently
cannot be shared with other customers shared among customers
· Computing nodes with sufficient capacity margins must be
· Low per-unit costs (costs per customer), the greatest benefit
provided as customers can request for more services (i.e.
adding VNFs) later · More servers and storage can be easily added at edge PoP as the
· vCPE HW must be replaced when the customer adds services number of customers and their subscription grow
more than specified

Cost
Costs Almost-linear growth Costs
High first costs, but

moderate increase over
subscription growth
No. of Customers No. of Customers

Comparison 3. Application Performance: WAN accelerator
TCP Sessions
VNF: WAN VNF: WAN
VNF: WAN VNF: WAN
Accelerator Accelerator
Accelerator Accelerator
Access Metro/ Access Access Metro/ Access

Backbone Backbone
BO HQ BO HQ
Edge PoP Edge PoP
Fast
Slow
A few 0~00 msec

usec
TCP session throughputs in
inverse proportion to RTT
Download Download
Multiple TCP sessions between BO and HQ = Fast Single TCP session between HQ and PoP, and PoP and BO
E2E data transmission = less efficient WAN accelerator
· WAN accelerator function works between two points (e.g. · Acceleration effect is caused only between the operator’s edge
between HQ and BO, or between BO and BO), thereby PoPs, and so less E2E efficiency
giving excellent speed enhancement
· Effective only when edge PoPs and customer are located close by

Comparison 4. Application Performance: Data De-duplication
VNF: WAN Data De-duplication
BO HQ Edge PoP Edge PoP

Access Backbone Access Access Backbone Access
100MB 100MB
1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4
100Mbps 100Mbps
1MB 100MB
1 2 3 4 3 1 2 3 4 1 2 3 4 3 1 2 3 4
변경부분
100Mbps
10Mbps
1MB 100MB
1 2 3 4 4 1 2 3 4 1 2 3 4 4 1 2 3 4
변경부분
100Mbps
10Mbps
· Lower cost of WAN cabling · No saving costs of WAN cabling

· (ex, 50Mbps instead of 100Mbps will be sufficient)

Comparison 5. Others
• IP PBX, Router: With distributed vCPE, no communication at a customer
premise is available when access links fail or are blocked
• Security
• Reliability

3-6: Hybrid = Best
VNFs are located at distributed locations in both a customer premise and the edge
PoP (multi-site service chain)
Carrier Ethernet
PON, DSL
Lease Line, etc.
VNF VNF
NFVI
Switch
Fabric
DC
VNF
L3 VPN
W
HQ/DC
L2 CPE L2 SW
VNF VNF
Switch
Fabric
SDN SDN DC
VNF L2 Circuit (VLAN) L3 VPN
W
HQ/DC
SDN
L2 CPE L2 SW

ex) AT&T Network Function On Demand

Netmanias’ Ideal Scenario: First D-vCPE, and then C-vCPE, but ultimately
Hybrid (when specific circumstances of each operator are not considered)
Physical Network Appliances:
Customer Premise Multiple pieces of equipment
serving a single purpose ER/PE
DC
WAN acc. MPLS L3 VPN

Router (Cisco) (Riverbed) FW (Juniper) ER/PE
Access HQ/DC
ONT/NID
vRouter
W
W vWOC Virtual CPE: Multiple appliances
vFW vSwitch virtualized on X.86 server
X.86 server
Edge PoP
W W
vSwitch vSwitch
Customer Premise X.86 server X.86 server
First, Distributed vCPE!

W
vSwitch
And then, Centralized vCPE! X.86 server
Edge PoP ER/PE
W W
vSwitch vSwitch
X.86 server X.86 server

DC
Customer Premise
W
ER/PE MPLS L3 VPN HQ/DC
vSwitch
Access
X.86 server aggregation
Branch Office/SMB
Ultimately Hybrid (VNFs are distributed
onto either D-vCPE or c-vCPE depending
on services)

3-7: Discussion
Edge PoP
vBNG DHCP Pare. W vBBU vEPC MEC
vSwitch vSwitch vSwitch
X.86 server X.86 server X.86 server
Access ER/PE
Edge PoP aggregation
Residential
vBNG DHCP Pare. W vBBU vEPC MEC
vSwitch vSwitch vSwitch
X.86 server X.86 server X.86 server

DC
Enterprise
MPLS L3 VPN
W
vSwitch Access
IP Backbone HQ/DC
X.86 server aggregation ER/PE
Mobile
Public Internet
Discussion

Netmanias.2017.04.24.SDN - Nfv.strategies and Progresses in Network Operators

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Netmanias.2017.04.24.SDN - Nfv.strategies and Progresses in Network Operators

Transféré par

Droits d'auteur :

Formats disponibles

SDN/NFV:

Strategies and Progresses

1. Top NFV/SDN Use Case in Operators’ Networks: vCPE 03

2. What’s trending in NFV/SDN application to Operator’s Networks 09

3. Case Analysis: Enterprise vCPE 12

3-1: Distributed vCPE 14

3-2: vCPE on Aggregation Switch or PE 24

3-3: Centralized vCPE 29

3-4: Centralized vCPE – Why SDN? 31

3-5: Distributed vCPE vs Centralized vCPE 52

3-6: Hybrid = Best 59

Released in December, 2016

SDN/NFV: Strategies and Progresses in Network Operators 2

SDN/NFV: Strategies and Progresses in Network Operators 3

1. Business vE-CPE 1. Business vE-CPE

2. Residential vCPE 2. Residential vCPE

Service Chaining 3. Mobile Core vEPC

4. IP Edge vPE 4. IP Edge vPE

SDN/NFV: Strategies and Progresses in Network Operators 4

SDN/NFV: Strategies and Progresses in Network Operators 5

SDN/NFV: Strategies and Progresses in Network Operators 6

SDN/NFV: Strategies and Progresses in Network Operators 7

X.86 Server $5,000

Dedicated H/W Appliances

1G NID X.86 Server

SDN/NFV: Strategies and Progresses in Network Operators 8

SDN/NFV: Strategies and Progresses in Network Operators 9

SDN/NFV: Strategies and Progresses in Network Operators 10

SDN/NFV: Strategies and Progresses in Network Operators 11

SDN/NFV: Strategies and Progresses in Network Operators 12

WAN acc. MPLS L3 VPN

IP Backbone Public Internet

ER/PE MPLS L3 VPN HQ/DC

SDN/NFV: Strategies and Progresses in Network Operators 13

NFVI on Premise IP Backbone Public Internet

VNF Internet traffic

ADVA FSP 150 ProVM

RAD ETX-2i VNF: 2~5

SDN/NFV: Strategies and Progresses in Network Operators 15

SDN/NFV: Strategies and Progresses in Network Operators 16

FSP 150 ProNID

FSP 150 ProVM

SDN/NFV: Strategies and Progresses in Network Operators 17

SDN/NFV: Strategies and Progresses in Network Operators 18

X.86 Module (NFV)

SDN/NFV: Strategies and Progresses in Network Operators 19

WOC: WAN Optimization Controller (e.g., WAN Accelerator )

SDN/NFV: Strategies and Progresses in Network Operators 20

2. Connector ADVA vSwitch

SDN/NFV: Strategies and Progresses in Network Operators 21

On the Premise In the Network

Virtual Router (vRouter)

• Proxy Address Resolution Protocol (ARP)

SDN/NFV: Strategies and Progresses in Network Operators 22

SDN/NFV: Strategies and Progresses in Network Operators 23

• Less unit costs compared to Premise vCPE

❷ X.86 Line Card

SDN/NFV: Strategies and Progresses in Network Operators 24

Nokia/ALU 7750 SR x.86 Line Card In-house: VSD (Virtual

Telco System T-Metro x.86 Line Card In-house: EdgeGenie

MRV OptiPacket Series x.86 Line Card 2016.05 In-house:Pro-Vision

SDN/NFV: Strategies and Progresses in Network Operators 25

X.86 Module (VNF)