big data, better networks
TRANSCRIPT
v
Big Data with Cumulus
David Sinn
April 22, 2015
cumulusnetworks.com 2
Cumulus Networks: Making Networks Accessible
Vision Bringing the Linux Revolution to Networking
Mission To enable high capacity networks that are easy to
deploy and affordable helping customers realize the full promise of the software-defined data center.
cumulusnetworks.com 3
Big Data in the Data Center
Super-compute Clusters of x86 servers. Ultra-low latency Large scale east/west traffic
Distributed Storage/MapReduce Dynamic workloads, so locality is difficult
Costly Legacy Deployments
cumulusnetworks.com 4
Traditional BigData Deployments
Layer-2 based Constrained east/west High port costs Variable Latency Host resiliency
demands Closed protocols
cumulusnetworks.com 5
L3: A better design
ECMP based Fat Tree
East/west bandwidth
Better Failure Handling
Scalable: No Bottlenecks
Simple Feature Set
Open Protocols!
LEAF
SPINE
cumulusnetworks.com 6
Big Data Improvements
Stop worrying about locality Full bandwidth is available between any pair of
servers Location becomes irrelevant for performance Keep replicas as far away from each other as
possible
Faster recovery Plenty of core bandwidth to re-replicate after failure Host HA becomes a lower level concern
7
Unified Management
Converged administration Same automation tools for managing servers
now available for the network
cumulusnetworks.com
Layer 3 Fabric
Servers
Switches
CumulusNetworks.com 8
Cumulus Innovation Focus – Apps for the networking infrastructure
Don’t re-invent the wheel, but smoothen the ride
ONIE – Unmanned Install ZTP – Zero Touch Provisioning PTMd – Cable fault detection Unnumbered Interfaces – IP management Network Virtualization – Minimize physical changes Dual Home hosts – Simplified Networks
hardware
Cumulus Linux
routing
gangliabridging
hardware
operating system
app app app
Cumulus Networks and Partner Confidential 9
Automation Workflow
Installation Framework PXE & ONIE to install the OS’s Anisble to install the applications and configure
the nodes
bare metal server
Server OS
app
app
app
BIOS and PXEbare metal
switch
Network OS
app
app
app
Boot Loader and ONIE
Similar to installing a server OS using PXE
Network OSBoot Loader and
ONIE
boot into
Boot Loader and ONIE
boot into
ONIE looks for and installs network OS image
cumulusnetworks.com 10
Demo
Cumulus Customer Workbench
2-Spine + 2 Leaf• OSPF Unnumbered with PTM
2-Ubuntu Servers• Hortonworks Hadoop• HDFS & YARN• Server 1: master + worker• Server 2: worker
cumulusnetworks.com 11
Ansible
Example Automation Process
Network Define topology Install license Configure OSPF Unnumbered & PTM Start networking
cumulusnetworks.com 12
Ansible Continued
Server Setup Create users, setup networking Install packages and dependencies Deploy site specific Hadoop Config Start HDFS & YARN
Enjoy Your BigData Cluster
cumulusnetworks.com 13
Demo
Let’s switch to the demo
CumulusNetworks.com 14
The Data Center Network with Cumulus Linux
Open AffordableResponsive
Unlock Your Choices. Disaggregation of hardware and
software
Choice of best-in-class platforms and tools
Inherently flexible – with no vendor lock-in
Vast resources in the Linux community
Serve the Business Better. Rapid, accurate services with
automation – provisioning in minutes instead of days
Orchestration via server tools
Accelerated innovation via DevOps, open source, and broad solution ecosystem
Save as You Grow. Scalable, affordable capacity in
layer 2, layer 3 or layer 3 overlay networks
>50% CapEx savings with industry-standard hardware running Cumulus Linux
Opex savings through automation, use of server tools and simpler expansion
cumulusnetworks.com 15
© 2015 Cumulus Networks. Cumulus Networks, the Cumulus Networks Logo, and Cumulus Linux are trademarks or registered trademarks of Cumulus Networks, Inc. or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. The registered trademark Linux® is used pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the mark on a world-wide basis.
Thank You!
Unleashing the Power of Open Networking