ieee 1588 ptp over wan field trial - stac research€¦ · performance wan. two sites with existing...
TRANSCRIPT
![Page 1: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/1.jpg)
IEEE 1588 PTP over WAN field trial
![Page 2: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/2.jpg)
Page 2 © Endace 2016. All rights reserved
Agenda
A field trial of PTP to assess performance in a real-world WAN environment and compare with GPS accuracy.
How PTP works
The field trial
Results
Anomalies
Conclusion
Questions
![Page 3: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/3.jpg)
Page 3 © Endace 2016. All rights reserved
PTP
IEEE 1588-2008 (PTP) is a protocol for time distribution
• Simple Ethernet/IP transport
• Multiple clients per reference clock
PTP works well in controlled environments
• Dedicated networks
• Transparent switches
• Sub microsecond accuracy
Can PTP deliver in Enterprise WAN environments?
• GPS not always available or practical
• Non-dedicated networks
• Non-transparent switching/routing
![Page 4: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/4.jpg)
Page 4 © Endace 2016. All rights reserved
How PTP Works
Grandmaster Slave
Sync
Follow_Up
Delay_Request
Delay_Response
T1
T2
T3
T4
• T2-T1 is Master to Slave Delay
• T4-T3 is Slave to Master Delay
• (T2-T1) + (T4-T3) is RTT
• RTT/2 is One Way Delay or Latency Estimate
• ((T2-T1) - (T4-T3))/2 is Offset from Master Estimate
This requires symmetric path delay.
Path asymmetry cannot be distinguished from Slave offset.
![Page 5: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/5.jpg)
Page 5 © Endace 2016. All rights reserved
Field Trial
Our partner had some sites without GPS availability, but still required accurate timing. They wanted to know if PTP could be used to deliver accurate timing over their existing high performance WAN.
Two sites with existing GPS receivers
• Simulate a non-GPS site with PTP client, but compare to local GPS
• Installed PTP Grandmaster and slave
• Less than 2 miles apart ‘as the crow flies’
High performance Enterprise WAN
• 10Gbps Ethernet core
• OSPF routed
• Network path includes 2 switches, 4 routers
![Page 6: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/6.jpg)
Field Trial
Site AGrandmaster
Site BSlave
Master GPS
1PPS
PTP Grandmaster PTP Slave
1PPS
Reference GPS
1GE 1GE
10GE
![Page 7: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/7.jpg)
Raw One Way Delay Measurements
Trading Day
331µs
![Page 8: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/8.jpg)
Filtered One Way Delay Measurements
Trading Day
331µs
![Page 9: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/9.jpg)
Estimated Offset from Master
Trading Day
![Page 10: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/10.jpg)
PTP Slave 1PPS vs Reference GPS
Trading Day
![Page 11: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/11.jpg)
PTP Slave 1PPS vs Reference GPS Histogram
Median -155ns3σ 3.2µs
Outlier at 50µs
![Page 12: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/12.jpg)
Anomaly: PTP Slave 1PPS vs Reference GPS
15 minutes
280µs
![Page 13: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/13.jpg)
Anomaly: PTP Slave 1PPS vs Reference GPS
Raw Delays
![Page 14: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/14.jpg)
Anomaly: PTP Slave 1PPS vs Reference GPS
Compensated for Slave clock offset
![Page 15: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/15.jpg)
Anomaly: PTP Slave 1PPS vs Reference GPS
Slave reported Offset from Master
Actual Slave Offset from GPS
Compensated for Slave clock offset
![Page 16: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/16.jpg)
Site AGrandmaster
Site BSlave
Path Asymmetry: Route Flap
← 332µs →
![Page 17: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/17.jpg)
Site AGrandmaster
Site BSlave
Path Asymmetry: Route Flap
500µs →
← 332µs
![Page 18: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/18.jpg)
Site AGrandmaster
Site BSlave
Forwarding Asymmetry: Congestion Queueing
← 332µs
500µs →
Contention
Heavy Load
![Page 19: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/19.jpg)
Page 20 © Endace 2016. All rights reserved
Conclusions
PTP is inherently sensitive to asymmetric latency
• Static asymmetries must be calibrated out manually, otherwise invisible
• Dynamic symmetry changes cannot be calibrated out
• Possible causes include physical path changes or congestion queueing
• Slave Offset from Master estimate may be significantly incorrect
PTP may be viable over WAN – depending on requirements
• Measured Clock synchronization within ±3.2µs at 3σ
• Largest outlier over working day was 50µs
• Improvements possible through improved filtering and tuning
PTP is a potential solution for sites without GPS
• Simpler and potentially cheaper to provision to a site than GPS
GPS is still the gold standard
![Page 20: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/20.jpg)
Questions?
![Page 21: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/21.jpg)
Page 22 © Endace 2016. All rights reserved
Opinion
Bestaccuracy
Worstaccuracy
Deterministic Audit trail
GPS ~50ns ~100ns Yes Yes
PTP (LAN) < 1 µs > 10µs Maybe? Maybe?
PTP (WAN) < 10 µs > 100µs No No
![Page 22: IEEE 1588 PTP over WAN field trial - STAC Research€¦ · performance WAN. Two sites with existing GPS receivers • Simulate a non-GPS site with PTP client, but compare to local](https://reader030.vdocument.in/reader030/viewer/2022041001/5ea2b4d7f1f2266fe85d60bf/html5/thumbnails/22.jpg)
Page 23 © Endace 2016. All rights reserved
Recommendations
Where possible:
• Use PTP transparent equipment
• Use dedicated networks to avoid congestion
• Use priority tagging
• Avoid L3 Routing
• Avoid L1/2 redundancy mechanisms
• Use Traffic Engineering to provision symmetric network paths
Consider:
• Multiple Grandmasters
• Multiple diverse paths
• Dedicated dark fibre