![Page 1: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/1.jpg)
Intel® Ethernet
Depths of the Cloud:How Linux
Networking needs to evolve
Peter (PJ) Waskiewicz
Shannon Nelson
![Page 2: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/2.jpg)
Overview
•Putting our heads into The Cloud•Crossing the streams when we get there•Levitating The Cloud by offloading the work•Advanced hardware capabilities•Where Linux needs to evolve
2
![Page 3: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/3.jpg)
The Fractal Cloud
3
I've looked at clouds from both sides now,From up and down, and still somehowIt's cloud illusions I recall.I really don't know clouds at all.- Joni Mitchell
![Page 4: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/4.jpg)
The Fractal Cloud
4
SGI/Cyclone
Salesforce
Amazon
Your Name Here
Rackspace
Dropbox
![Page 5: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/5.jpg)
Amazon
The Fractal Cloud
5
US East
US West
Singapore
Tokyo
EU
Sao Paulo
![Page 6: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/6.jpg)
The Fractal Cloud
6
Peter’s Ghost
Finders WebDB
![Page 7: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/7.jpg)
The Fractal Cloud
7
Peter’s Ghost
Finders WebDB
Egon’s Spirit ChasersDB Web
![Page 8: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/8.jpg)
VM Hosting implements the Cloud
8
Egon’s
Peter’s
DB
Web
DB
Web
![Page 9: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/9.jpg)
Plumbing the VMs
9
Web VM DB VM
Host
![Page 10: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/10.jpg)
VM Management moves things…
10
Egon’s
Peter’s
DB
Web
DB
Web
![Page 11: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/11.jpg)
11
Egon’s
Peter’s
… maybe near …
DB
Web
DB
Web
![Page 12: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/12.jpg)
12
… maybe far…
DB
Web
DB
Web
![Page 13: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/13.jpg)
Something strange in the neighborhood…
13
DB VMWeb VM DB VM
Host Host
Web VM
Host
![Page 14: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/14.jpg)
Something strange in the neighborhood…
14
Oregon
Swindon
Virginia
DB VMWeb VM DB VM
Host Host
Web VM
Host
![Page 15: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/15.jpg)
Puffy problems
•VM’s sniffing each other’s packets•Host doing lots of work to direct traffic•One VM’s traffic can overwhelm the pipe and block out other VM’s traffic•Unexpected network/address changes when VM gets moved•… and other sticky things.
15
Who ya gonna call?
![Page 16: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/16.jpg)
Obligatory “Don’t cross the streams” reference
16
![Page 17: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/17.jpg)
The NIC can help
Basic traffic offloads•Checksum and CRC validation•Header/data splitting for better memory management•VLAN id insert and strip
17
![Page 18: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/18.jpg)
The NIC can help
Basic traffic offloads•Checksum and CRC validation•Header/data splitting for better memory management•VLAN id insert and strip
More advanced work•HW switching functionality•Bandwidth management• Traffic tunneling
18
![Page 19: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/19.jpg)
Linux and the Cloud
19
![Page 20: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/20.jpg)
Advanced hardware capabilities
Many advanced features in existing and future hardware•VEBs•VSIs• Port Aggregators• Port Extenders•EVB (IEEE draft)
Switch management is complex• Integrate with existing SW switch and bridge tools if possible•Make it seamless!
20
![Page 21: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/21.jpg)
Open vSwitch (OVS)
Alternative to native L2 bridge• http://openvswitch.org•Manages multi-system environment• Ease of VM state migration• Supports OpenFlow• (Somewhat) Platform agnostic
Offload support lacking• Limited existing offload support−Basic switch offloads, Cisco Nexus 1000V
• VxLAN tunneling patches in progress
21
![Page 22: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/22.jpg)
Tunneling overview
22
DB VMWeb VM DB VM
HostHost Host
Web VM
![Page 23: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/23.jpg)
Tunneling overview
23
DB VMWeb VM DB VM
HostHost Host
Web VM
![Page 24: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/24.jpg)
Tunneling overview
24
DB VMWeb VM DB VM
HostHost Host
Web VM
![Page 25: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/25.jpg)
Why tunnels matter
Cloud relies on tunnels•Allows transparent migration of VM’s•Secures traffic from other VM’s
Tunneling can be expensive•Software overhead to manage routing/forwarding•Not very scalable at big I/O−10GbE, 40GbE
•We can do better!25
![Page 26: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/26.jpg)
Tunnel types we target
VxLAN−Looks to be headed into OVS−IP in IP tunneling
NVGRE−IP in GRE−MAC in GRE
26
![Page 27: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/27.jpg)
How to accelerate?
Inner packet is the important one•Checksum offloads•CRC offloads•Segmentation offloads
Need offsets to inner headers•Tell hardware where to compute offloads•Kernel interface required to pass information
27
![Page 28: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/28.jpg)
Evolving the kernel
•Add fields to skb for inner header information•Wrap with CONFIG_NET_TUNNEL_OFFLOAD for generic support for all devices•Add offload netdev bit to identify devices•Populate in bridge or OVS kernel space•Rest of stack oblivious to changes
28
![Page 29: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/29.jpg)
Future work
Making Linux smarter•VxLAN offloads being scoped•NVGRE offloads scoping to follow VxLAN•Should share most of the same codebase
Don’t mess with ABI•Avoid impacting tools at all costs•No custom one-off tools please…
Offloaded or not, must be transparent to user
29
![Page 30: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/30.jpg)
Wrap up
The Cloud isn’t new!•Combination of many existing technologies•Buzzwords make it sound new and scary
Don’t be afraid of the Cloud•The secret is in the ease of management
Tunnels are the workhorse of the Cloud•Must have good offload abilities to scale
30
![Page 31: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/31.jpg)
Questions?
31
![Page 32: Intel ® Ethernet Depths of the Cloud: How Linux Networking needs to evolve Peter (PJ) Waskiewicz Shannon Nelson](https://reader035.vdocument.in/reader035/viewer/2022062713/56649cb85503460f9497f731/html5/thumbnails/32.jpg)
32