patch panels in the sky: a case for free-space optics in data centers
DESCRIPTION
Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers. Navid Hamed Azimi , Himanshu Gupta Vyas Sekar, Samir Das. Datacenter network design is hard!. Performance. Cost. Energy. Cabling. Expandability. Cooling. Adaptability. Existing Choices. Cost. Core. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/1.jpg)
Patch Panels in the Sky:A Case for Free-Space Optics
in Data Centers
Navid Hamed Azimi, Himanshu GuptaVyas Sekar, Samir Das
![Page 2: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/2.jpg)
2
Datacenter network design is hard!
Cost
Performance
Cabling Expandability
Energy
Cooling Adaptability
![Page 3: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/3.jpg)
Over subscribed(tree, leaf spine,…)
3
Performance
Existing ChoicesCost
…
Core
Top of Rack (ToR)
![Page 4: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/4.jpg)
Over subscribed(tree, leaf spine,…)
Existing Choices
…
4
Over provisioned(Fattree, Jellyfish,…)
Performance
Cost
Top of Rack (ToR)
Core
![Page 5: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/5.jpg)
Existing Choices
…
5
Core
Over subscribed(tree, leaf spine,…)
Performance
Cost
Augmented (c-Through , 3D Beam)
Top of Rack (ToR)
Over provisioned(Fattree, Jellyfish,…)
![Page 6: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/6.jpg)
Existing Choices
6
Over subscribed(tree, leaf spine,…)
Performance
Cost
Augmented (c-Through , 3D Beam)
Over provisioned(Fattree, Jellyfish,…)
Can we get here?
![Page 7: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/7.jpg)
Our Vision
7
…
• Core Coreless
• Wired Wireless
• Static Flexible
![Page 8: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/8.jpg)
8
Potential Benefits of This Vision
CostPerformance
Cabling
ExpandabilityEnergyCooling
Adaptability
WirelessCoreless
Flexible
![Page 9: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/9.jpg)
9
Challenges in Realizing the Vision
• Flexible wireless links
• Network management
![Page 10: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/10.jpg)
10
Outline
• Flexible wireless links
• Network management
• Feasibility & cost
![Page 11: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/11.jpg)
11
Traditional RF is not Sufficient
…
• Wide beam High interference
![Page 12: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/12.jpg)
Traditional RF is not Sufficient
12
…
• Wide beam• Difficult to narrow
High interference
![Page 13: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/13.jpg)
Solution: Free Space Optical Links (FSOs)
13
• No interference• High throughput over long range
…
• Easy to narrow beam
![Page 14: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/14.jpg)
14
Concerns with FSOs
• Cost : $30K• Size : 3 ft³• Power: 60w• Flexibility
![Page 15: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/15.jpg)
15
Why Size, Cost, Power Can be Reduced?
• Traditional use : outdoor, long haul‒ High power‒ Weatherproof
• Data centers: indoor, short haul‒ Low power
• Feasible roadmap via commodity fiber optics ‒ E.g. Small form transceivers (Optical SFP)
![Page 16: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/16.jpg)
16
Proof of Concept (1 Gbps)
Fiber connectedto SFP (TX)
Lens LensMirror Mirror
SFP (RX)
SFP : 2x$40Lens : 2x$30
![Page 17: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/17.jpg)
17
<924 924- 928 928- 932 >932 Mbps
0
0.2
0.4
0.6
0.8
1Optical fiberFSO
FSO Link ThroughputPDF
Throughput
FSO link is the same as optical cable
![Page 18: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/18.jpg)
18
FSO Link Misalignment Tolerance• Effect of vibrations, etc.
Movement tolerance– 0.7mm at destination– 3mm at source
3 mm 0.7 mm
FSO link is stableTX RX
![Page 19: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/19.jpg)
19
• Cost : $30K• Size : 3 ft³• Power: 60w• Flexibility
FSOs (1Gbps)
• Cost : $140• Size : 1x4 in• Power: 0.3w• Flexibility
![Page 20: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/20.jpg)
Flexibility via Switchable Mirror
20
Sender
Ceiling Mirror
Receiver 1 Reciever2
• Switchable Mirror: glass mirror• Electronic control, low latency
SM in “mirror” mode
![Page 21: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/21.jpg)
Flexibility via Switchable Mirror
21
Sender
Ceiling Mirror
Receiver 1 Reciever2
SM in “mirror” mode
Receiver 1 Reciever2
• Switchable Mirror: glass mirror• Electronic control, low latency
![Page 22: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/22.jpg)
22
Outline
• Flexible wireless links
• Network management
• Feasibility & cost
![Page 23: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/23.jpg)
Management: Pre-ConfigurationInput: FSO#, SM#,…
23
Sender
Receiver 1 Reciever2
Output: Candidate links (Alignment of each SM)
![Page 24: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/24.jpg)
Management: Reconfiguration
Input: Traffic
24
Sender
Receiver 1 Reciever2
Output: Run-time topology
![Page 25: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/25.jpg)
25
Current Solutions: Simple Heuristics
• Pre-Configuration : Regular Random Graph
• Reconfiguration
Only reconfigure for large flows Only delete a link if network remains connected
![Page 26: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/26.jpg)
26
Outline
• Flexible laser link
• Management
• Feasibility & cost
![Page 27: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/27.jpg)
27
Throughput• 512 racks, 48 server/rack, hotspots traffic, flow level simulations
(4,5) (4,10) (8,5) (12,5) (8,10) (16,5) (12,10) (16,10)0
0.5
1
1.5
2Fattree 2G 3D-Beamforming
c-through FSO
(Hot Spots %, Average Load per Hot spot (Gbps))
Ave
rage
Thr
ough
put
Per S
erve
r (G
bps)
FSO based 2-4x improvement
![Page 28: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/28.jpg)
28
Cost ComparisonArchitecture Cost Effective Bisection
BandwidthFattree 1 Gbps $ 13 M 1 GbpsFSO based $ 38 M 8.5 GbpsFattree 10 Gbps $ 57 M 10 Gbps
FSO based: Near 10G performance with 65% of cost
![Page 29: Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers](https://reader035.vdocument.in/reader035/viewer/2022062501/568163ff550346895dd59ed9/html5/thumbnails/29.jpg)
29
Conclusions• Data center network is challenging
• Our vision: Fully flexible, coreless, wireless network
• Key enablers : FSO + switchable mirrors
• Early promise: ~ 10Gbps performance @ 65% cost
• Future work: Improve FSO, better management