puppet camp charlotte 2015: use puppet to manage your netapp storage infrastructure

Use Puppet to Manage your NetApp Storage Infrastructure   Dave Cain & Amit Borulkar Converged Infrastructure Engineering NetApp

© 2015 NetApp, Inc. All rights reserved. 1

Puppet Camp Charlotte Monday December 7th , 2015 11:45am EST

Are you…

§  Tired of the §  Complexity of modern-day storage deployment and

daily administration? §  Manual steps for common operations across your

environment?

§  Ready for §  Consistent and repeatable automation that fits into

the DevOps mentality across the enterprise? §  Using Puppet: an industry leading automation

framework?

§  On best-in-class and trusted storage platforms that you can depend on? §  99.9999% availability


§  Dave Cain §  B.S. in Computer Science @ NC State

University §  10+ years of datacenter experience §  Restores vintage machinery in his spare time

About Us

§  Amit Borulkar §  Masters in Computer Science @ NC State

University §  Research interests at school: Distributed

systems and cloud computing §  Enjoys hiking and cooking


@thedavecain

Agenda

1)  About NetApp §  About our company §  Data ONTAP

2)  Solution Architecture §  About NetApp Data ONTAP device module §  Flow diagram

3)  Live Demos §  Cluster scoped operation §  Storage Virtual Machine scoped operation §  Role-based Access Control demonstration

4) Call to Action and Wrap-Up §  Q&A


About NetApp Dave Cain


NetApp is a global provider of software, systems and services to manage and store data

From FORTUNE Magazine, February 3, 2014 © 2014 Time Inc. FORTUNE and FORTUNE 100 Best Companies to Work For are registered trademarks of Time Inc. and are used under license. FORTUNE and Time Inc. are not affiliated with, and do not endorse products or services of, NetApp.

US $6.3B revenue FORTUNE 500® NASDAQ: NTAP

Our Team: 12,000+ employees

150+ countries 3,200 patents

Founded in 1992

13 Years in a Row: FORTUNE 100 “Best Companies to Work

For®”


Clustered Data ONTAP Architecture

7

§  Nondisruptive operations

§  Rich storage efficiency and data management

§  On-demand scale out

§  Unified SAN and NAS

§  Secure multi-tenancy

§  Multi-hypervisor optimized

§  Efficient data transport: flash to disk to cloud

Flash, hybrid, SAN, NAS, DAS, Cloud, Next-Gen Media

Always-On Infrastructure Scale-Out Architecture Flash Ready Cloud Integrated

© 2015 NetApp, Inc. All rights reserved.

E

FCP FCoE iSCSI CIFS/SMB NFS

Workloads & Users

A B C D

A

B D A B C

E

Clustered Data ONTAP Terminology


HA HA

Node: A single storage controller running one instance of Data ONTAP® and its attached storage

HA pair: Equals 2-nodes; HA interconnect for heartbeat and resiliency

Cluster interconnect: 10GbE network connection for data communication across nodes

Storage virtual machine (SVM): Logical abstraction of resources through which data is accessed; contains volumes and LIFs

Logical network interface (LIF): Logical element that maps an IP address or WWPN to a physical network port on a node

Cluster: Logical grouping of storage systems composed of nodes, disks, and a cluster network

LIF4 LIF3 LIF2 LIF1

HA Pair HA Pair

Cluster

SVM

Solution Architecture Amit Borulkar


NetApp Data ONTAP Device module

§  First Puppet module for managing storage infrastructure

§  State driven approach for storage automation

§  Augments DevOps model by facilitating quick and reliable transitions between different storage configurations

§  Enables creation of storage catalogs for common storage operations (E.g. provisioning of a Logical Unit Volume to a client from NetApp storage)

§  Infrastructure as Code

10 © 2015 NetApp, Inc. All rights reserved.

Solution Architecture NetApp Data ONTAP Device Module


Puppet Master

Puppet Agent (proxy device)

FAS system Storage Virtual Machine

1. Retrieves catalog

2. cluster scoped

operations

2. SVM scoped

operations

facts facts

3. Report success/failure

Contains manifests

Contains device config

Flow Diagram


Puppet Master

Cluster/SVM

Puppet Agent (proxy device)

Connect to device in

“device.conf”

Compile the manifests

corresponding to the device

Catalog

Device

Query Initial state

Defined system state

Query status

Enforce defined

state

Report

2. Basic node info

7. Compare states

3. Request catalog

4. Node catalog

5. Request resource

state

6.Resource state

Device information

1. Connect to the device

8. Apply config

9. Report results

Live Demos! Amit Borulkar


Demo

§ Provision a LUN from NetApp FAS storage for a Windows client to perform NTFS operations.


Standard Workflow

storage aggregate create -aggregate aggr01_node03 -chksumstyle block -diskcount 6 -node puppet-dev-01 -raidtype raid-dp

vserver create -vserver vserver01 -rootvolume rootdir -language c -security-style unix -aggregate aggr01_node03

network interface create -vserver vserver01 -lif mgmt -role data -home-node puppet-dev-01 -home-port e0d -netmask 255.255.255.0 -address 172.21.10.127 -status-admin up -failover-policy disabled -firewall-policy mgmt

network interface create -vserver vserver01 -lif iscsi_data -role data -home-node puppet-dev-01 -home-port e0d -netmask 255.255.255.0 -address 172.21.10.128 -status-admin up -failover-policy disabled –data-protocol iscsi


Standard Workflow (2):

export-policy create -vserver vserver01 -policyname lab01_policy

export-policy rule create -vserver vserver01 -policyname lab01_policy -clientmatch 0.0.0.0/0 -rorule any -rwrule any

volume create -vserver vserver01 -volume client01_vol01 -aggregate aggr01_node03 -size 1g -state online -policy lab01_policy

lun create -vserver vserver01 -path /vol/client01_vol01/vserver01_lun -size 300m -ostype windows -space-reserve disabled

igroup create vserver01_iscsi -vserver vserver01 -protocol iscsi -ostype windows -initiator iqn.1991-05.com.microsoft:cis-jump85.cis.netapp.com

lun map -vserver vserver01 -path vol/client01_vol01/vserver01_lun


Puppet Automation


puppet device --verbose


Demo

•  Cluster scoped operations •  SVM scoped operations •  Role Based operations

https://www.youtube.com/watch?v=cGz04EztP5A

Wrapping Up Dave Cain


Not a commitment, but merely a statement of direction Things we’re looking into as next steps…

§  Absorbing user feedback from initial module

§  NetApp Clustered Data ONTAP §  CIFS Support §  Job Scheduler

§  NetApp E-Series §  SSD Read Cache §  Consistency Groups For Snapshots §  Scan and update the Web Services Proxy


Conclusion


§  NetApp is a Fortune 500 company that sells data management and storage solutions

§  NetApp has partnered with Puppet to make our storage platforms configurable in the same manner as most other components of your datacenter

§  The Network Device functionality leveraged by the co-developed Apache 2 licensed Puppet module provides §  A declarative (tell me what you want) style configuration template that reduces

complexity and time to value §  Provides consistency in common administration operations and tasks using

repeatable automation §  Multi-tenancy operations that leverage the power of Data ONTAP for cluster-

scoped or SVM scoped operations that suit whatever your needs

Call to Action

§ Module available today from the Forge: § https://forge.puppetlabs.com/puppetlabs/netapp §  Report issues:

https://github.com/puppetlabs/puppetlabs-netapp/issues

§ NetApp E-Series Puppet module also available: § https://github.com/NetApp/puppet-eseries

§ NetApp Technical Report § www.netapp.com/us/media/tr-4477.pdf

This means you!


Q&A


puppet camp charlotte 2015: use puppet to manage your netapp storage infrastructure

Software