openstack manila - home - netapp...
Post on 17-Apr-2018
220 Views
Preview:
TRANSCRIPT
OpenStack Manila Shared File Services for the Cloud Bob Callaway, PhD Chief Architect & Senior Manager, Technical Marketing – OpenStack Cloud Solutions Group, NetApp OpenStack Summit – Paris – November 3rd, 2014
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 1
Agenda
1) Project Overview
2) Use Cases
3) Demo
4) Architectural Overview
5) Drivers: Vendor Integrations
6) Automation
7) What’s new in Juno and Kilo Focus
8) How to get started with Manila
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 2
NetApp is a leading innovator in the OpenStack community Manila: The OpenStack Shared File Service Program
Manila
Clustered Data ONTAP
Finance R&D
Share “R&D” with Instances 1 & 3
Create a “Marketing” share for 2 & 4
Nova
Hypervisor
VM VM VM VM VM VM Marketing
Manila is now a
formally incubated
OpenStack program!
Applicable for a variety of use cases (DBaaS, generic file share, VDI, etc)
of all storage sold is for file-based use cases per IDC, 2012
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 4
65 %
Use Cases Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 5
Adding File Services along side Block & Object in OpenStack clouds Manila: Shared File Services within an OpenStack Deployment
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 6
An Open, Standard API for File System Provisioning and Management Manila: Standalone Shared File Services Management
§ Replace homegrown or legacy systems
§ Improve IT responsiveness by providing self-service share management
§ Integrate Manila with existing automation frameworks through REST API or CLI
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 7
Manila
Shared FileServices
REST API
Demo Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 8
Key Concepts & Architecture Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 9
Manila: Key Concepts
§ Share (an instance of a shared file system) § User specifies size, access protocol, “share type” § Can be accessed concurrently by multiple instances
§ Share access rules (ACL) § Defines which clients can access the share § Specified by IP in CIDR notation
§ Share network § Defines the Neutron network & subnet through which instances
access the share § A share can be associated with only one share network
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 10
Manila: Key Concepts (continued)
§ Security service § Finer-grained client access rules for Authn/z (e.g. LDAP, Active
Directory, Kerberos) § Share can be associated to multiple security services
§ Snapshots § Read-only copy of share contents § New share can be created from a snapshot
§ Backend § Provider of shares; a share resides on a single backend
§ Driver § Vendor or technology-specific implementation of backend API
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 11
Designed for highly available and scalable shared file services Manila: Architectural Overview
§ Manila is not in the data path!
§ manila-api§ Exposes REST API through WSGI
application
§ manila-scheduler§ Makes provisioning decisions for
share requests
§ manila-share§ Manager process + one process per
backend § Responsible for communicating with
storage subsystems
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 12
REST
Manila Processes
Horizon
manila-api manila-scheduler
manila-share Driver
manila-share Driver
manila-share Driver
Control Path
Supports a variety of strategies for diverse deployments Manila: Network and Storage Multitenancy
Network Segmentation Storage Segmentation
Manila Enablement Example Use Case
Layer 3 (IP)
Layer 3 (IP)
Direct Replace custom service Customer PoC on existing equipment
Layer 3 (IP)
Layer 2 (VLAN, VXLAN, GRE, STT, etc)
Single segment (e.g. VLAN) for all tenants
Replace custom service
Layer 2 (VLAN, VXLAN, GRE, STT, etc)
Layer 3 (IP)
Manila provides gateway Private cloud deployment
Layer 2 (VLAN, VXLAN, GRE, STT, etc)
Layer 2 (VLAN, VXLAN, GRE, STT, etc)
Manila configures storage to join appropriate tenant layer 2 network
Public cloud deployment
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 13
Drivers Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 14
A pluggable model for vendors and the community Manila Drivers
§ Reference Implementation § Nova VM (from Glance image) hosts NFS, CIFS servers § Cinder volume (of requested size) per share provides storage capacity
§ NetApp clustered Data ONTAP
§ EMC VNX
§ Red Hat GlusterFS
§ IBM GPFS (in review)
§ HP (in development)
§ More to come…
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 15
The worlds #1 storage OS is integrated with OpenStack Manila NetApp’s clustered Data ONTAP Manila Driver
§ Driver points at an existing Clustered Data ONTAP deployment
§ A new storage virtual machine (SVM) is created for each share network
§ Create a new Data Logical Interface (LIF) with the VLAN tag set to same VLAN tag of the Neutron network associated with the share network
§ Access permissions are set at the controller for guests
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 16
manila create
Control Path
Data Path
Manila
mount –t nfs
Neutron
nova-compute
NFS
nova-compute
Automation Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 17
puppet-manila Puppet Module contributed by NetApp now on Stackforge Automation for installation & configuration of Manila
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 18
How does a customer use puppet-manila?
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 19
Declare basic service parameters
(DB connection, AMQP, etc)
Declare other config key/value pairs
Installs the API service, configured to use Keystone
Installs Scheduler, Share packages from distro
How does puppet-manila configure/manage Manila?
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 20
User or Tool creates or updates manifest
Puppet parses and validates
manifest according to
module
Install distribution-
specific packages (e.g.
RPMs, deb files)
Creates/updates Manila
configuration files per manifest
declaration
Start declared Manila
processes
Monitor process state, configuration files for state
change; enforce
declared state
Juno & Kilo Status Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 21
What’s new in Juno
§ Officially an incubated OpenStack program (August 26th, 2014)! § Note: Manila repos are now under “openstack” Github organization
§ puppet-manila now on stackforge
§ Increased developer & admin documentation
§ Removal of obsolete/unmaintained drivers (NetApp 7mode, LVM)
§ Added concept of "share servers" with admin only APIs
§ Added tempest integration and gate tests
§ Remove a lot of utility code and replace it with Olso (significantly better Oslo integration)
§ Improvements to existing APIs (better filtering, more details, etc)
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 22
Kilo Roadmap – Manila Community
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 23
10/15 4/15 4/16 10/14
Manila Graduation & Customer PoC Manila Incubation
Features
Theme Proliferate Manila
- Manila currency and new features - Generic driver maintenance - TBD
- Manila:core maintenance and features - Triple-O
- Manila support at the undercloud
- Generic driver maintenance - Service implemented QoS
- investigation
- Manila Core - SDN compatibilities
- OVS bridge for non-SDN native backends
- Replication - manage / unmanage - Backup - automated mounts
- Generic driver maintenance - IPv6 Support - Consistency Groups - Enable Trove for Manila awareness - Deduplicate code via Oslo - Python 3
- Manila Core - SSC - Pools - Modular independence
- Deployment Automation - Shift devstack - Puppet & Chef
- Horizon shift - Deployer & Tenant facing
documentation - “Generic” driver maintenance - Require CI Slave - Extend Tempest Coverage - Support all TC graduation
requirements
Kilo L M Juno
Getting Started Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 24
Get involved with Manila! How to get started with Manila
§ Devstack § See our blog: http://netapp.github.io/openstack/2014/08/15/manila-devstack/
§ Distributions § RDO § RPMs are available now; Packstack integration coming soon
§ OpenSUSE § RPMs are available now; installer integration coming soon
§ More to come…
§ IRC on Freenode § #openstack-manila any time § #openstack-meeting-alt at 15:00 UTC on Thursdays
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 25
Questions? Manila – The OpenStack Shared File Service Program
© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 26
top related