red hat netapp openstack webinar-final storage august 21, 2014 ... cloud solutions group, netapp...
TRANSCRIPT
Deploying Red Hat Enterprise Linux OpenStack Platform 5 on NetApp Storage August 21, 2014 Bob Callaway Technical Marketing Engineer, Cloud Solutions Group, NetApp
Colin Devine Technical Partner Development Manager, Virtualization & OpenStack, Red Hat
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 1
Agenda
1) Introductions
2) Overview of RHEL-OSP5
3) NetApp’s OpenStack Integrations
4) Deploying RHEL-OSP 5 and NetApp in an HA configuration
5) Manila: OpenStack File Share as a Service
6) Q & A
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 2
Introductions Who are Bob & Colin?
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 3
! Technical Marketing Engineer, Cloud Solutions Group, NetApp
! ATC on various OpenStack projects
! PhD from NC State University
Introductions
! Technical Partner Business Development Manager, Virt/OpenStack
! 8 years at Red Hat
! RHCE, RHCVA, CL210
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 4
Red Hat Enterprise Linux OpenStack Platform 5 Overview
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 5
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
WORKLOADS ARE EVOLVING
TRADITIONALWORKLOADS
● Typically resides on a single large Virtual Machine
● Cannot tolerate any downtime● Needs expensive high availability
toolsfound in VMware vSphere
● Application scales up rather than out
CLOUDWORKLOADS
● Workload resides on multiple Virtual Machines
● Tolerates VM failure – if one fails, another quickly replaces it
● Fault tolerance often built into workload
● Application scales out rather than up
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
OPENSTACKCLOUD INFRASTRUCTURE FOR CLOUD
WORKLOADS
● Modular architecture, designed to easily scale out● Based on (growing) set of core services
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
● Modular architecture, designed to easily scale out● Based on (growing) set of core services ● It is dependent on the underlying Linux...
OPENSTACKCLOUD INFRASTRUCTURE FOR CLOUD
WORKLOADS
LINUX
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM 4.0
OPTIMIZED FOR AND INTEGRATED WITH RED HAT ENTERPRISE LINUX
RED HAT ENTERPRISE LINUX
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
OPENSTACK ARCHITECTURE
● Modular architecture
● Designed to easily scale out
● Based on (growing) set of core services
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
RED HAT UPSTREAM FOCUS
● Heavily engaged in community since 2011
● Established leadership position in community
● Both in terms of governance and technology
● Including several PTLs on multiple core services projects
● Creating and leading stable tree
● 2nd largest contributor to Folsom Release
● Largest contributor to Grizzly, Havana, and Icehouse releases
● Note: These statistics do not include external dependencies
eg. libvirt, kvm, Linux components
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
RED HAT UPSTREAM FOCUS
Source: Bitergia http://activity.openstack.org/dash/releases/index.html?data_dir=data/icehouse
Top Contributor to Icehouse Release
0
500
1000
1500
2000
2500
3000
3500
Red Hat
IBM
HP
Rackspace
Mirantis
SUSE
OpenStack Foundation
eNovance
Intel
0
50
100
150
200
250
300
350
400
Red Hat
Others
HP
Mirantis
IBM
Rackspace
Canonical
OpenStack Foundation
Dreamhost
● Overall commits per company (aggregated)
● Closed Tickets per company (aggregated)
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
RED HAT'S OPENSTACK LEADERSHIPWHY DO THESE STATISTICS MATTER?
● Proof that Red Hat has skills, resources to:● Support customers● Drive new features● In;uence strategy and direction of project● Enable partner collaboration
● Wide ranging participation, contrasts with most others who are more narrowly focused
● Important to highlight our leadership in the whole stack● Linux, KVM, libvirt, etc
● RHEL-OSP is an enterprise-grade distribution with ecosystem, lifecycle, and support that customers expect from Red Hat
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
BUILDING A COMMUNITY
● RDO Project
● Community distribution of OpenStack
● Packaged/tested for *EL6 and *EL7 and derivatives
● Freely available without registration
● Easy to install
● Vanilla distribution – closely follows upstream
● Upstream release cadence
● 6 month lifecycle – limited updates based on upstream
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
OPENSTACK PROGRESSION
Enterprise hardened
Red Hat OpenStack
technology
optimized for
and integrated with
Red Hat Enterprise Linux
Red Hat Support
Red Hat ecosystem
certi5cations
1+ year lifecycle
Bleeding edge upstreamOpenStack source code
Unstable community Linux
No certiCcationsCommunity supportSix month lifecycle
Bleeding edge upstreamOpenStack packaged as
RPMs
Enterprise Linux distros
(CentOS, RHEL, Fedora)
No certiCcationsCommunity supportSix month lifecycle
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
WHY RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM
● All beneCts of community OpenStack and...● Enterprise hardened code
● Co-engineered and integrated with Red Hat Enterprise Linux
● Enterprise software lifecycle
● World-class global support
● Worlds largest OpenStack partner ecosystem
● OpenStack training and certiCcation
● Integrated with trusted Red Hat stack● Red Hat CloudForms ● Red Hat Enterprise Virtualization● Red Hat Storage
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
● A typical OpenStack cloud is made up of at least 10 core services (Nova, Cinder, Keystone, Neutron,
glance, etc) + plugins to interact with 3rd party systems – eg. storage arrays, network switches.
● These services run on top of a Linux distribution with a complex set of userspace dependencies, requiring tight integration
● A supported, stable platform requires integration and testing of each of the components
THE IMPORTANCE OF INTEGRATION WITH LINUX...
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
● Many of the most complex features are provided by Linux with OpenStack providing management and orchestration
● For example: virtualization provided by the KVM hypervisor, with libvirt management interface, interacting with Open vSwitch userspace switch, transitioning to the kernel's networking stack to handle network namespaces – Each potentially managed by diGerent OpenStack services.
● These components need to be engineered & productized together
● OpenStack cannot be productized as a layered product
THE IMPORTANCE OF INTEGRATION WITH LINUX...
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
● Examples of RHEL optimized enablers for OpenStack:
● Virtualization – guest performance, reliability, and Windows
● Security - SELinux enforcing guest isolation● Network – SDN/OVS performance optimized● Storage – vendor plugins, performance, thin provisioning● Ecosystem – certiCcation of hardware, storage, and
networks
● The pairing of the Linux operating system and OpenStack is so tight that Red Hat Enterprise Linux OpenStack Platform is the only combination that can most eGectively support functionality, performance, security, system-wide stability, and ecosystem support
THE IMPORTANCE OF INTEGRATION WITH LINUX...
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
Red Hat Enterprise Virtualization Hypervisor*Red Hat Enterprise Linux KVM
● Lightweight / small footprint
● Less overhead
● Smaller attack surface
● Cost effective
● Closer to operating system DNA
● Provides massive scale-out capabilities
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM
HYPERVISOR SUPPORT
VMware vSphere*vCenter Driver
● Co-exist with existing infrastructure assets
● Provides a seamless path to future migration to OpenStack
● Uses NSX1 plugin for Neutron
1NSX is only supported in production environments, per VMware's support requirements
*ESXi driver not supported
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
●Red Hat Enterprise Linux 3
●Red Hat Enterprise Linux 4
●Red Hat Enterprise Linux 5
●Red Hat Enterprise Linux 6
*32 and 64 bit for all versions
●SUSE Linux Enterprise Server 10
●SUSE Linux Enterprise Server 11
*32 and 64 bit for all versions
●Windows XP SP3+1
●Windows 73
●Windows 83
Microsoft SVVP Certified●Windows Server 2003 SP2+3
●Windows Server 20083
●Windows Server 2008 R22
●Windows Server 20122
1 32 bit only2 64 bit only3 32 and 64 bit
GUEST SUPPORT
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
WORLD'S LARGEST OPENSTACK PARTNER ECOSYSTEM
OEMs and IHVs ISVs
Cloud Service ProvidersSystem Integrators
Channel PartnersManaged Service Providers
● Over 235+ members since launch in April 2013
● Over 900 certified solutions in partner Marketplace
● Over 4,000 RHEL certified compute servers
● Over 13,000 applications available on RHEL
● Large catalog of Windows certified applications
Red Hat OpenStack Cloud Infrastructure Partner Network
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908
THREE WAYS TO GET OPENSTACK FROM RED HAT
2
3
1
PURCHASE SUPPORTED PRODUCT90-DAY EVALUATION
redhat.com/openstack/evaluation
Learn more at: redhat.com/cloud
RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908 RED HAT OPENSTACK TECHNOLOGY (TECHNICAL PRESO) | 2013
NetApp’s Integrations with OpenStack Overview
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 25
! OpenStack Foundation ! Charter member (Gold level) ! OpenStack Summit Sponsors
NetApp’s OpenStack Involvement
! 1st Major Storage Provider ! Upstream Contributions ! Production Deployments
! Deployer of OpenStack
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 26
NetApp Joins
Integration Announced
Folsom Summit Sponsor
7-mode driver in
Essex
Havana Summit Sponsor
Direct Drivers in
Grizzly
Kilo Summit Sponsor
Manila
Incubation*
Essex Summit Sponsor
7-mode driver
previewed
Grizzly Summit Sponsor
Clustered
ONTAP driver in Folsom
Icehouse Summit Sponsor
RHEL-OSP on
FlexPod
Swift on E-series
2012.4 2013.4 2014.10 2011.3 2011.10 2012.10 2013.10 2014.4
Juno Summit Sponsor
E/EF-series
drivers in Icehouse
Integration Overview
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 27
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
NetApp’s Core Competencies
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 28
E-Series FAS
Service Automation Quality of Service
Unified Architecture
Storage Efficiency Seamless Scaling
Secure Multi-Tenancy
Continuous Operations
Data Mobility Data Protection
Simplicity
Vast Bandwidth Density
Consistency Horizontal Scaling
Broad Connectivity
Versatility
Data Mobility All-Flash
! File or Swift backends ! Simplicity advantage to File ! Rapid instance creation capability with File
Storage Efficient Image Registry & Repository Glance on Data ONTAP
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 29
Clustered Data ONTAP
Glance on NetApp
RHEL Fedora CentOS
CentOS Fedora CentOS CentOS CentOS Fedora
RHEL RHEL Fedora RHEL RHEL Fedora
90%+ Deduplication rates are often
observed
3 Copies… Commonly More Swift on JBOD
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 30
Swift Deployment
Storage Node
Storage Node
Storage Node Any single object stored three or more
times
Efficient Storage and Scaling Swift & Dynamic Disk Pools
! Dynamic distribution / re-distribution of data “De-clustered” RAID
! Deploying Swift with NetApp E-Series reduces: ! Required storage capacity ! Ongoing cost of operations ! Deployment footprint ! Replication traffic between Swift nodes
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 31
DDP reduces disk rebuild
times by
90%
Cinder deployment with NetApp Diverse Options for Diverse Use Cases
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 32
Clustered ONTAP
7-mode
E-Series
EF-Series
pNFS
NFS iSCSI
NFS
iSCSI
iSCSI
iSCSI
Cinder Volume Types Deliver Differentiated Block Storage Offerings
! Craft a catalog based upon tenant workload requirements
! Compose Cinder volume types with: ! Efficiency ! Performance ! Availability ! Protection
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 33
Cinder Volume Types
Archival
netapp:raid_type
netapp:disk_type
netapp:qos_policy_group
netapp_mirrored
netapp_dedup
netapp_nodedup
netapp_compression
netapp_thin_provisioned
netapp:raid_type
netapp:disk_type
netapp:qos_policy_group
netapp_mirrored
netapp_dedup
netapp_nodedup
netapp_compression
netapp_thin_provisioned
netapp:raid_type
netapp:disk_type
netapp:qos_policy_group
netapp_mirrored
netapp_dedup
netapp_nodedup
netapp_compression
netapp_thin_provisioned
netapp:raid_type
netapp:disk_type
netapp:qos_policy_group
netapp_mirrored
netapp_dedup
netapp_nodedup
netapp_compression
netapp_thin_provisioned
netapp:raid_type
netapp:disk_type
netapp:qos_policy_group
netapp_mirrored
netapp_dedup
netapp_nodedup
netapp_compression
netapp_thin_provisioned
Analytics Streaming Temporal Database
Policy-Based Block Storage Service
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 34
Cinder
SnapMirror
Silver
Remote Clustered ONTAP
Boot 8 CentOS LAMP instances with 2TB of
Silver please
Volume Types
Gold Bronze Silver Silver
Enhanced Instance Creation Instant, storage efficient persistent root disks
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 35
Clustered Data ONTAP
Boot 8 persistent RHEL instances… Glance on NetApp
Cinder on NetApp
Hypervisor
RHEL RHEL RHEL RHEL
RHEL RHEL RHEL RHEL
RHEL RHEL RHEL
RHEL RHEL RHEL RHEL
• Cloned, not copied • Instances, instantly
RHEL Fedora CentOS
RHEL
Highly Available Deployments of RHEL-OSP 5 and NetApp Storage
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 36
Staypuft choices Architecture of a highly available OpenStack deployment
! With/without Neutron
! Database
! Messaging subsystem
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 37
! Individual Cinder volumes are represented by: ! A File on NFS export ! An iSCSI LUN
! A Cinder backend should map to a storage virtual machine
! NFS is the recommended storage protocol ! More scalable than iSCSI ! Negligible performance degradation ! Proven solution with hypervisors for many years
Clustered DATA ONTAP NetApp Storage Layout
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 38
Networking Best Practices
! Follow the best practices in the OpenStack Security Guide
! 10GbE
! Separate storage management traffic from storage data traffic
! Use bonding (link aggregation) to provide resiliency to link failure & improved bandwidth
! NTP
! Use iSCSI multipath
! Jumbo frames for storage data traffic
! Load balancers with health checks for OpenStack services
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 39
Logical Management Networks
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 41
Logical Data Networks
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 42
Available today! HA Reference Architecture
! TR4323-DESIGN: “Highly Available OpenStack Deployments Built on NetApp Storage Systems” ! Solution Design document based on Icehouse ! Includes best practices for networking, storage, high availability
! Available for download from http://www.netapp.com/openstack/
! Follow us on Twitter for @openstacknetapp – we’ll tweet out a direct link when it’s posted ! Also NetApp’s OpenStack blog: http://netapp.github.io/openstack/
! RHEL-OSP5 & NetApp Solution Deployment guide (based on TR4323) ! Scheduled to be published before Kilo design summit in Paris
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 43
Manila: The OpenStack File Share Service Brief Overview
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 44
* Per IDC report, 2012
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 45
storage sold in 2012 for Shared File Systems* 65 %
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 46
Manila
Clustered Data ONTAP
Finance R&D Marketing
Share “R&D” with Instances 1 & 3
Create a “Marketing” share
for 2 & 4
Nova
Hypervisor
VM VM VM VM VM VM
Processes & Interaction Manila Architecture
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 47
REST
Manila Processes
Horizon Control Path
manila-api manila-scheduler
manila-share Driver
manila-share Driver
manila-share Driver
! Not in the path of storage data traffic
! Closely mirrors architecture of Cinder ! API, Scheduler, Share processes ! Multiple backends supported ! Share types
! Interacts with Neutron ! Ensure shares are accessible over tenant-
specific network ! Align multi-tenancy models between share
backend and Neutron network
Manila: NetApp Clustered Data ONTAP Driver
! Driver points at an existing Clustered Data ONTAP deployment
! A new storage virtual machine (SVM) is created for each share network
! Create a new Data Logical Interface (LIF) with the VLAN tag set to same VLAN tag of the Neutron network associated with the share network
! Access permissions are set at the controller for guests
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 48
manila create!
Control Path
Data Path
Manila
mount -t nfs!
Neutron
nova-compute
NFS
nova-compute
Manila: Gluster Driver
! Use Gluster to provide a Distributed Scale Out File System backend for Manila File Shares
! Current: Single Tenant GlusterFS driver using Gluster-NFS
! Future: Multi-Tenant driver that uses NFS Ganesha
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 49
/Gluster_Manila_Volume
/Marketing • 10.1.1.1 • 10.1.1.2
/Sales • 10.1.1.1
/Eng • 10.1.1.3
10.1.1.1 • Sales • Marketing
10.1.1.2 • Marketing • Eng
10.1.1.3 • Eng
manila create!manila access-allow!
Nova Compute
Control Path
Data Path
Manila Processes
manila-api manila-scheduler
manila-share Gluster Driver
manila-share Driver
manila-share Driver
A Winning Combination Red Hat Enterprise Linux OpenStack Platform 5 & NetApp
! The combination of RHEL-OSP 5 and NetApp allows you to: ! efficiently and effectively deploy OpenStack in an enterprise environment with strict SLAs ! take advantage of your current infrastructure investment ! make OpenStack consumable and safe for the enterprise
! NetApp’s OpenStack Block Storage drivers are certified by Red Hat for use with: " NetApp clustered Data ONTAP & Data ONTAP operating in 7 Mode " NetApp E-Series & EF-Series " Both NFS and iSCSI storage protocols " Red Hat Enterprise Linux OpenStack Platform versions 3, 4, and 5
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 51