mac layer for optically enhanced interconnectivity...

Overall Architecture MAC Layer for Optically Enhanced Interconnectivity for Computing Platforms G. Azmy 1 , M. Abd El Meguid 1 , M. Sowailem 1 , R. Varano 2 , D. Rolston 2 , Prof. O. Liboiron-Ladouceur 1 1 Photonic Systems Group, Dept. of Electrical and Computer Engineering, McGill University; 2 Reflex Photonics [email protected] [email protected] Networking (MAC) The OSI model is implemented on the FPGAs. The MAC layer was developed in VHDL in compliance with the IEEE 802.3ae full duplex 10G Ethernet standard Architecture Overview Motivation The increasing demand of bandwidth from scientific modeling, simulations and video streaming has created a new bottleneck at the interconnect level between processors where traditionally copper is used. Replacing copper with optics allows for a smaller footprint, longer cable runs and lower power consumption that fits in with the current top-of-rack architecture. Bringing the optics closer to the processor : • Limits RF interference • Improves latency • Opens the door to greater bandwidth. Multimode fiber-based optical backplane Courtesy of D. Rolston, Reflex Photonics Reflex Photonics LightABLE TM The experiment is done using Altera Stratix IV GX FPGAs to emulate the servers interconnected using the Reflex Photonics LightABLE optical module. Each module has 12 optical channels running at 10Gb/s each, and configured as either transmitters (VCSEL arrays) or receivers (photodetector arrays). The project starts with deploying the project on a single FPGA for testing and our goal is to have 8 such optically interconnected servers in a chassis. Three optical modules (8 x 10Gbps channels/module) per server as follows: • One TX block; 7 peer-to-peer (P2P) channels to the other servers, 1 broadcast channel • One RX block with 7 P2P channels • One RX block for receiving Broadcasts from the 7 other servers The MAC layer supports, P 2 P, broadcast and multicast communication, utilizing all the channels available. Conclusion In accordance with the goals the mature test-bed will be replicated on additional FPGAs and multiple high-bandwidth HD video streams will be used to demonstrate the capabilities. References • M.N. Sakib, M. Sowailem, M.S. Hai, H. Abbas, G. Azmy, R. Varano, D. Rolston, and O. Liboiron-Ladouceur, “Development of Optically Enhanced Interconnectivity for Computing Platforms," CIPI Annual General Meeting, Ottawa, May 2011. • IEEE 802.3ae 10GE http://standards.ieee.org/about/get/802/802.3.html RF Cables Optical Eval Board Development Board Receiver flow chart Transmitter flow chart Ethernet Packet Format Experimental Setup Application Layer Transport Layer Network Layer Datalink Layer Physical Layer LLC Layer (MAC client) MAC Layer Physical Layer Application will be simultaneous HD video processing in real time OSI Model

Upload: others

Post on 15-Aug-2020

0 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: MAC Layer for Optically Enhanced Interconnectivity …erbium.ece.mcgill.ca/.../sure2011_ece_azmygeorge.pdfgeorge.azmy@mail.mcgill.ca mohamed.mostafa2@mail.mcgill.ca Networking (MAC)

Overall Architecture

MAC Layer for Optically Enhanced Interconnectivity for Computing Platforms

G. Azmy1, M. Abd El Meguid1, M. Sowailem1, R. Varano2, D. Rolston2, Prof. O. Liboiron-Ladouceur1

1Photonic Systems Group, Dept. of Electrical and Computer Engineering, McGill University; 2Reflex [email protected] [email protected]

Networking (MAC)The OSI model is implemented on the FPGAs. The MAClayer was developed in VHDL in compliance with theIEEE 802.3ae full duplex 10G Ethernet standard

Architecture OverviewMotivationThe increasing demand of bandwidth from scientif icmodeling, simulations and video streaming hascreated a new bottleneck at the interconnect levelbetween processors where traditionally copper isused.

Replacing copper with optics allows for a smallerfootprint, longer cable runs and lower powerconsumption that fits in with the current top-of-rackarchitecture.

Bringing the optics closer to the processor :• Limits RF interference• Improves latency• Opens the door to greater bandwidth.

Multimode fiber-based optical backplane

Courtesy of D. Rolston, Reflex PhotonicsReflex Photonics LightABLETM

The experiment is done using Altera Stratix IV GXFPGAs to emulate the servers interconnected usingthe Reflex Photonics LightABLE optical module.Each module has 12 optical channels running at10Gb/s each, and configured as either transmitters(VCSEL arrays) or receivers (photodetector arrays).The project starts with deploying the project on asingle FPGA for testing and our goal is to have 8such optically interconnected servers in a chassis.

Three optical modules (8 x 10Gbps channels/module) perserver as follows:

• One TX block; 7 peer-to-peer (P2P) channels to theother servers, 1 broadcast channel

• One RX block with 7 P2P channels• One RX block for receiving Broadcasts from the 7

other serversThe MAC layer supports, P2P, broadcast and multicastcommunication, uti l izing all the channels available.

Conclusion

In accordance with the goals the mature test-bed will be replicated on additional FPGAs andmultiple high-bandwidth HD video streams will be used to demonstrate the capabilities.

References

• M.N. Sakib, M. Sowailem, M.S. Hai, H. Abbas, G. Azmy, R. Varano, D. Rolston, and O. Liboiron-Ladouceur, “Development of Optically Enhanced Interconnectivity for Computing Platforms," CIPI Annual General Meeting, Ottawa, May 2011.• IEEE 802.3ae 10GE http://standards.ieee.org/about/get/802/802.3.html

RF Cables

Optical Eval Board

Development Board

Receiver flow chart Transmitter flow chart

Ethernet Packet Format

Experimental Setup

Applicat ion Layer

Transport Layer

Network Layer

Datal inkLayer

Physical Layer

LLC Layer (MAC client)