Académique Documents
Professionnel Documents
Culture Documents
Patrick Diamond PhD Director Systems Engineering Advanced Communications and Sensing
What makes a Network Synchronous? A synchronous network is one that provides a common clock. - Voice and Video are isosynchronous types of information - Data is asynchronous - The circuit that carries these info types is synchronous and provides the ingress and egress clocks. Network Service providers implement BITS and SSU machines in their central and serving offices to deliver the network clock to the network equipment. A network is synchronized if all elements operate on the same Epoch. A network is syntonized if all elements operate at the same frequency.
Autonomous - No system reference clock or clock distribution system. Line cards generate local clocks. Depends upon logic buffers and inter-card memory stores for data stability. No protection switching or frequency/phase transient control. Not capable of performing SSM or clock transit node functions. Centralized - Centralized reference clock generation and distribution. Protection switching capability typically limited to frequency matching. Not capable of input to output phase build-out control. Cannot correct for phase disturbances. Line cards have same limitations. Distributed - Reference clock generation and distribution with phase build-out and frequency control on clock card and selected line cards.
Why is Synchronization so Important to Services Delivery? Transport Networks of the last 20 years have always been built using the circuit technology E-1, T1, SDH and Sonet. These transport techniques have a fundamental need for physical layer clock synchronization.
The BIT rate and the Line utilization are always the same value, ie an E1 has 2048 bit periods as well as 2048 clock cycles.
The Network Clock provides the perpetual heartbeat for the services using the network.
The source of the Network Clock is a caesium beam oscillator located in a GPS satellite, a BITS or SASE. This is called the G.811 Clock in ITU standards parlance.
Circuits use a frequency synchronous clock to control the ingress and egress of the information streams to be transported.
Why has Syncronization been so Important to Transport? The Synchronization standards guarantee the performance of today's transport networks. The Currency of Synchronization is TDEV and MTIE. Time Deviation is measured for 10000 seconds and compares a reference clock, G.811 quality to a derived clock. The amount of time drift allowed from the derived clock is tightly regulated. The measurement is presented in the form of a graphic mask target and the actual measured. Maximum Time Interval Error is measured for 100000 seconds and accumulates the time error between the above clocks. This measurement is also presented in graphic form with a target mask and actual measured plot. Synchronization standards define the limits of reference and nodal system clock wander, phase gain, phase jump and jitter.
Why has Syncronization been so Important to Transport? The ITU and ANSI standards organizations have defined the rules for Synchronization. These rules are expressed as a numerical standard. The ITU standards typically start with a G. and the ANSI standards start with a GR-. There are hundreds of standards issued by each organization.
10us
G.823 Traffic
1us
}
SDH
E3
100ns
E1
G.823 (Traffic) G.823 (Sync)
PLL
CDR
Framer
SelectA n x T1 p x T2 1 x T3
Squelch
SelectC
T4
SelectB
SETG
Squelch
T0
OSC
T1 T2 T3 T0 T4
- Clocks recovered from SONET/SDH line - Clocks supplied from PDH tributary input - Clock supplied from HSC - Clocks supplied to SONET/SDH equipment - BITS clocks supplied back to HSC source
Backplane SECs
BITS SEC Clock PDH SEC Clock Line Input Framed Data Mb/s Line Input Framed Data Mb/s Line Input Framed Data Mb/s
Line Interface 1 SETS Clock Generator Master
Line Output
SEC MFrSync
Line Output
Line Output
High component count means: high component cost board space consumption layout problems
Extremely difficult to get manufacturing repeatability and achieve standard compliant performance.
PDH BITS
MUX
Phase Detector
DAC
TCVCX O
Temp. Sensor
Ref Clk
Restricted choice gives Temp. compensation inadequate flexibility must be calibrated and back-up - ignores differential aging coefficients
Parameter
Unit
ETSI 300-462-5
Free run accuracy Freq offset (total) Holdover stability (total) Temp Drift (24 Hrs) Initial Offset
Aging (20 years) Pull-in/Hold-in range Filter bandwidth Jitter (generation) RMS
ppm ppm Hz UI
The difference between initial offset and drift is that drift directly relates to the performance of the external XO. The initial offset is directly tied to the performance of the timing control when switching from a locked state to holdover.
Semtech Patrick Diamond PhD - Director Systems Engineering
XO
Clock
High Rate Line Clock A XO Holdover Card With Sync Clock A A (Optional) High Rate Line ACS89xx XO Holdover Clock B Sync A (Optional) Card Line Clock A ACS89xxHigh Rate With Sync B (Optional) Clock Clock B XO Holdover Sync A (Optional) Distribution Card With Sync B (Optional) ACS89xx Clock Clock A XO Clock B Holdover Recovered Clock Distribution Sync A (Optional) B (Optional) Sync Clock A ACS89xx Clock XO Recovered Clock Clock B Distribution Sync A (Optional) Framer Dat ACS89xx A Sync B (Optional) Clock SERDES Recovered Clock Clock B a
Sync B (Optional)
ACS85x x ACS85xx High Rate Line LC/P LC/P Card With ACS85xx High Rate Line Holdover LC/P Card With ACS85xx Holdover LC/P Distribution Framer ACS85xx
Recovered Clock
Sync B (Optional)
LC/P
ACS89xx
Framer Framer
Distribution
Data
Recovered Clock
SERDES
Sync Card A
Sec Clock (to each Line Card) A Optional Sync Clock (to each Line Card) A Sec Clock (to each Line Card) Optional Sync Clock (to each Line Card) Recovered Clocks From Line Cards
Data
SERDES
Sync Card B
Clock Distribution
Clock
Framer
Data
SERDES
BB AB C K P L A N E
Clock Distribution
Clock Sync
Sync
Clock BI TS
LIU
To/From Network
XO
BITS
LIU
Data
Control, Data Clock & SSM Processing Control, Data & SSM Processing
The T0 path is used to generate the clock for the egress ports ITU Sync Trail PRC SECs T0 Path SECsline timed SEC & colocated SSU T0 Path SSU may well provide time from GPS or other source. But can simply clean up the line recovered clock Sync Trail Sync Trail
T0 Path
SSU
Programmable pulse width and polarity 2 kHz and 8 kHz Frame Sync Pulses 1.544 MHz or 2.048 MHz (E1 or DS1) Output Configurations N x E1 or N x DS1, N = 1 to 16 19.44 MHz 44.736 MHz or 34.368 MHz (E3 or DS3) 6.48, 25.52 MHz 38.88 MHz, 51.84 MHz, 77.76 MHz 155.52 MHz
10
10
1.544 MHz or 2.048 MHz (E1 or DS1) 6.48, 19.44, 25.52, 38.88, 51.84, 77.76 MHz 155.52 MHz Number of Inputs Phase Measurement Output Phase Adjustment
Features
10
Revertive/Non-revertive mode Los of Lock Indication General Features Activity Monitoring Frequency Monitoring 8 bit micro-processor modes Holdover (with appropriate TCXO, OCXO) PBO on currently locked reference
ACS8522
4
14
14
Part No.
ACS8510
ACS8520
ACS8530
14
Recovered Clock
Framer
Data
SERDES
High-Rate (d d
ACS8946
Recovered Clock
SERDES
ACS85xx LC/P
Recovered Clock
SERDES
Part No.
Minimum input frequency
Features
Microprocessor Interface Automatic Ref Switching Number of Sync inputs
Performance Level
Short Term Holdover (ms) Long Term Holdover (indef)
Avail ability
Number of outputs
Number of inputs 3 3 2 2 1 2
Phase Buildout
FEC Rates
STM-16
STM-64
STM-4
STM-1
2 6 2 2 1 4
3 3
LOS
LOS
2 or 8*
PICMG AMC.0
AMC Slot 1
ACS8595 LC/P
AMC Slot 2
AMC Slot 3
AMC Slot 4 AMC Slot 2 Each Clock to AMC Module: 8kHz, E1, DS1 or 19.44MHz
Qual Lev
S1 bits b5 b8
SDH Description
P O H
0000 0001 0010 0011 0100 0101 0110 0111 1000 1001 1010 1011 1100 1101 1110 1111
Quality Level Unknown Reserved ITU Rec G.811 Reserved Rec. G.812 Transit Reserved Reserved Reserved Rec. G.812 Local Reserved Reserved Synchn Eqpt Time Src. SETS Reserved Reserved Reserved Do Not use for synchronization
Payload
1 2 3 4
5 6 7 8 9 10 11 12 13 14 15
Synchronization Byte
1 2 3 4 5 6 7 8
Qual Lev
S1 bits b5 b8
SONET Description
P O H
0000 0001 0010 0011 0100 0101 0110 0111 1000 1001 1010 1011 1100 1101 1110 1111
Synch Tracability Unknown - STU Stratum 1 Traceable ST1 Reserved Reserved Reserved Reserved Reserved Stratum 2 Traceable ST2 Reserved Reserved Stratum 3 Traceable ST3 Reserved SONET Minimum Clock Traceable Reserved Reserved for Network Synchronization Use Do Not Use for Synchronization
Payload
1 -
3 4 5 Use Assignable 7
Synchronization Byte
1 2 3 4 5 6 7 8
SSM Allocation Definitions for SONET From Bellcore GR253 CORE (12/97), Sect 5.4.2
Frame Payload
TS0 TS1 TS16 TS31
Qual Lev
Description
E1 Frame - Time Slots 0 to 31 - 256 bits - 125 us One Time slot = 8 bits
MF S M F Frame Num 0 1 2 I 3 4 5 6 7 8 9 10 II 11 12 13 14 15 Bit Number 1 to 8 1 C1 0 C2 0 C3 0 C4 0 C1 0 C2 0 C3 E C4 E 2 0 1 0 1 0 1 0 1 0 1 0 1 0 1 0 1 3 0 A 0 A 0 A 0 A 0 A 0 A 0 A 0 A 4 1 Sa41 1 Sa42 1 Sa43 1 Sa44 1 Sa41 1 Sa42 1 Sa43 1 Sa44 5 1 Sa51 1 Sa52 1 Sa53 1 Sa54 1 Sa51 1 Sa52 1 Sa53 1 Sa54 6 0 Sa61 0 Sa62 0 Sa63 0 Sa64 0 Sa61 0 Sa62 0 Sa63 0 Sa64 7 1 Sa71 1 Sa72 1 Sa73 1 Sa74 1 Sa71 1 Sa72 1 Sa73 1 Sa74 8 1 Sa81 1 Sa82 1 Sa83 1 Sa84 1 Sa81 1 Sa82 1 Sa83 1 Sa84
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Quality Level Unknown Reserved ITU Rec G.811 Reserved SSU-A (Was G.812 Transit ) Reserved Reserved Reserved SSU-B (Was G.812 Local ) Reserved Reserved SETS Reserved Reserved Reserved Do Not use for synchronisation
SSM Allocation Definitions for E1 From G.704 10/98 Table 5C Note 1: n = 4,5,6,7 or 8 ( ie one Sa bit only ) depending on operator selection
E1 Time Slot 0 (TS0) Multi-Frame (MF) (SMF = Sub Multi-Frame ) - From G.704 10/98 Table 5D
F-Bit
Fram Payload e
Bit 1 Bit 2 Bit 3 -------------------------------------------------------- Bit 192 Bit 193 --
G.811 G.812 Type II G.812 Type III G.812 Type IV Stratum 4 (Note) G.813 Option 3 G.812 Type V Synchronization Traceability Unknown Do not use for Synchronization Provisionable
11111111 00100000 11111111 00110000 11111111 00111110 11111111 00001000 11111111 00010100 11111111 01000100 11111111 00011110 11111111 00010000 11111111 00001100 11111111 00000010
Assigned SSM in DataLink acc G.704 10/98 Table 2, ANSI T1.403 Table 4, Bellcore GR-253 CORE (12/97), Sect 5.4.2. Note:All messages have the form 11111111 0 P1 P2 P3 P4 P5 P6 0 So each is one code of a basic 6 bit message
FPS 0 0 1 0 1 1
F-Bits CRC6 C1 C2 C3 C4 C5 C6 -
FDL m m m m m m m m m m m m -
Each F-Bit occurs in Bit 1 of each frame FPS = Framing Pattern Sequence (001011) CRC6 = CRC6 word C1 to C6 FDL = Facility Data Link, m = FDL bit
NE
NE
NE
NE
NE
PRC FAIL
NE
NE
NE
NE
NE
NE 2
DUS ST1 DUS ST1 ST1
Primary Secondary
NE 1 PRC G.811 NE 2
DUS ST1 DUS ST1 DUS ST1 ST1 ST1 ST1 LOS
NE 1
PRC G.811
DUS
NE 3 NE 3
ST1
NE 4
ST1
NE 5
NE 5
DUS
NE 4
DUS
LOS
NE 4
NE 5
DUS
NE 4
1. NE 1, 2, 3 cfgd so if P&S = same, use Secondary for timing. 2. NE 4,5 cfgd so if P&S = same, use Primary for timing.
SSM Definitions : DUS: Do not Use for Synchronization ST1: Stratum 1 SMC: SONET Minimum Clock
Break time
Coffee Break, standup and walk around, make your calls and eat lunch
The financial drive to switch to a shared transport versus dedicated transport is overwhelming.
The ratio in cost per megabit for native ethernet backhaul service versus traditional private line service is 1 to 6 or greater.
A Financial Example
Traditional Leased Line Access pricing model;
Assumed 100Mbps of an STM1 is used at RNC and 3xE1 at each Node B (giving 17 Node Bs in RNS). Assumed distance between RNC and provider network POP to be 5 miles, and average distance between provider network POP and Node Bs to be 5 miles. Then, yearly rental costs: RNC: 100,295 + 18,000 Node Bs: 100M/E1 x (4098 + 1000 + 1192) Total annual cost:
($700k, E560k)
NOTE - While this is an example and cannot be promised by Semtech, it provides a glimpse into the new paradigm of cost structure for mobile wireless network backhaul services.
10us
G.823 Traffic
1us
}
SDH
E3
100ns
E1
G.823 (Traffic) G.823 (Sync)
PLL
CDR
Framer
Can circuit emulation services solve the Packet Backhaul synchronization problem? What are circuit emulation services anyway?
Circuit emulation is the process of packetizing bit stream services like a T-1, E-1 for transmission over a packet network. The network can be native Ethernet or Ethernet trunks between MPLS nodes. There are several standards for CES. The IETF has one called PWE3. The Metro ethernet forum has one called CESoE. The ITU has the SAToIP or USAToIP. They all take in a bit stream and create a packet stream and they are point to point.
1588
IWF Processor
Data Clock
FR Eth line
SDiwf
Data
TDM service
Data
Clk. Rec.
Mpll
Fs
Fs
Inter-working Function
Adaptive-clocking can provide line-timing. Goal is to match the ingress service clock Fs, to the egress Fs while maintaining G.823 MTIE Adaptive-clocking has problems when :
- packet-loss rate significant - packet delay variation significant - path delay changes due to network reconfiguration or restoration
Timing in Circuit Emulation Services Network Clocking Network clocking uses a common network clock at each end of circuit:
Data
TDM service
Pktr
Data
Clk. Rec.
Mpll
Fs
Inter-working Function
Fs
Network Clock
Inter-working Function
Network-clocking has been providing line-timing (or external timing!) to NEs since the dawn of digital networks. Can still be used at end-points of Packet Networks. Noise is kept to G.823 limits by existing Network Clock distribution But network operators want to replace the TDM links with packet links:
CES
G.823 Traffic ports: CES is point to point so an ethernet path for each link is necessary G.823 service is frequency only so can only be used in FDD service To keep frequency transient below 50ppb needs a 20,000-second time constant for each millisecond of delay change (needs expensive, ultrastable OCXO)
G.8261 says CES impractical as a timing-transport mechanism using G.823 Traffic ports
RNC
Video
GPS Receiver
GPS Receiver
Node B
RNC
Video
This is a very expensive to install and operate. Typical GPS receiver with High precision holdover oscillator is $500.00 USD +. Antenna installation is typically $$thousands$$ of USD and requires annual calibration.
Node B
RNC
Video
This will not work unless the oscillators are caesium beam type which Typically cost $50,000.00 each.
Impairments Packet Networks Present to Synchronization? Most importantly traditional clock path continuity, the circuit, is broken due to Ethernets asynchronous timing. Line recovered timing with PRC traceability does not exist! In layer 3 IP networks the bi-path symmetry at any point in time is unknown and can change via route flap or RIP, BGP, or IS-IS mandated changes? The ITU in G.8261 has stated layer 3 networks are un-fit for circuit emulation services or cell site backhaul. Every packet is delayed by a differing amount of time as it passes through packet network switch queues. The result is a self-similar or fractional Brownian distribution model of PDV or Packet Delay Variation. There are 2 factors at play, switch queue depth and serialization delay.
ITU meeting this week in Geneva is modifying G.8261 for the third time to include IEEE 1588. The draft standard for Synchronous Ethernet is to be completed at this meeting. Will take years for deployment.
There are 2 elements to this modification. First is the replacement of the 100ppm crystal on the PHY. Second is the slow protocol to carry the SSM like information for clock quality definition.
Semtech is contributing the concept of network profiles as a means of determining traditionally synchronous services delivery over packet networks.
Measuring each path is useless as networks changes continuously.
NETWORK
Interworking function
IEEE 1588 Sync Slave #1
Voice & Data Video
Interworking function
IEEE 1588 Sync Slave #2
Voice & Data
Node B
RNC
Video
IEEE 1588 delivers a precise copy of the Network Clock to each end point to enable Real time service & VoATM packets via some Circuit Emulation Services Technique
Network Timing Distribution using IEEE1588 IEEE 1588 V2 (IEC61588) Precision Time Protocol Distributes time and frequency via WAN ethernet with expected end point time alignment precision measured in nanoseconds. Gets UTC to the network elements and node b without GPS Distributes the network clock to ingress and egress points of interworking function with frequency precision of <1ppb.
GPS satellite
1588 Master Locked to GPS
NE
1588 Slave
NE
1588 Slave
NE
1588 Slave
NE
Ethernet
WiMAX
EoLOS Rradio
IEEE-1588 Code Network protocol stack & OS Sync detector & timestamp generator Physical layer
Timestamp Point
IEEE-1588 Code Network protocol stack & OS Sync detector & timestamp generator Physical layer
Timestamp Point
IEEE-1588 Code Network protocol stack & OS Sync detector & timestamp generator Physical layer
Time at which a Delay_Req message passed the Timestamp Point Timestamp Point
IEEE-1588 Code Network protocol stack & OS Sync detector & timestamp generator Physical layer
Master clock receives: Delay_Req message Master clock sends: Delay_Resp message
Time at which a Delay_Req message passed the Timestamp Point Timestamp Point
IEEE-1588 Standard for Delivering Sync Synchronization computation in the Slave clock
Offset = receipt time precise sending time one way delay (for a Sync message) One way delay = {master to slave delay + slave to master delay}/2 (assumes symmetric delay) Master to slave delay = receipt time precise sending time (for a Sync message) Slave to master delay = Delay Request receipt time -precise sending time (of a Delay Request message) From this offset the slave corrects its local clock!
Real-World Experience:
Since April 2005, Semtech and Agilent and recently Symmetricom have been running a field trial on a live Public Metro Ethernet Network owned and operated by a major carrier. Agilent and Symmetricom provided the reference and measurement equipment. TIE data is gathered for every 24 hour period and analysed to get MTIE, TDEV and Frequency Offset. Semtech provided two ToPSync Evaluation boards to act as IEEE 1588 Master and Slave The Master and Slave are test-beds for 1588v2 concepts. The Master sends 1 Announce message every 2 seconds. The Slave sends 24 Delay-Request messages every second. The cost of sync in this test is 20kbps.
Atomic Clock
10MHz
DS1
TCXO
OCXO
Nortel lab tests of Disciplined IEEE1588 PBT with high priority CES traffic load
Large step load Held 9 hours 600ns/1000s (1s ref. T1 g.823 sync) back-to-back Still under G.8261 mask 11ppb > back-to-back
97% 57%
0%
80%
91%
68%
2.00E+03
4.00E+03
6.00E+03
8.00E+03
1.00E+04
1.20E+04
1.40E+04
2.00E+03
4.00E+03
6.00E+03
8.00E+03
1.00E+04
1.20E+04
1.40E+04
WiMAX Backhaul/Access
Network
GbE/FE Interfaces
GbE/FE Interfaces
MII ports
Reference Clocks
ToPSyncTM
Timebase Generating Engine Processor running Proprietary Algorithms DDS Process Stratum 3 G.812, G.813, GR-1244 Line Clocks
SPI
SRAM
Networks of tomorrow will use the most cost effective, manageable and reliable technique fitting the service model. Trunk networks will use traditional BITS based systems. Metro networks will use a combination of traditional systems and synchronous Gigabit ethernet. Access networks endpoints and wireless service delivery points will use IEEE 1558 V2 or some other packet based synchronization.
Enable UTRAN nodes to use lower cost backhaul technologies such as ADSL and ethernet versus PDH or SDH/SONET. Eliminate the need for expensive GPS holdover oscillators and antenna installations for low cost WiMAX in-building and outdoor basestations as well as for picoCDMA basestations. Intelligent layer 2 sync end point systems can have SNMP capability to allow the viewing of sync performance in real time remotely, no wasted truck roles for sync problems! Layer 2 synchronization techniques such as IEEE 1588 V2 use the existing infrastructure and are only required at the ends.
Summary
We are migrating from a TDM network to packet network, but still need to support TDM services. Interworking Functions have been defined and offer many clocking schemes. The only clocking scheme which allows the Public Switched Network to extend to the Customer Premise and meets the timing requirements, is IEEE 1588. Experience with a long-term IEEE 1588 field trial shows that excellent long term viability, accuracy and stability is consistently available on an evolving Metro ethernet. Future services could be based on time rather than frequency. IEEE 1588 delivers time as well as frequency.