opennebulaconf 2013 - opennebula in a multi-customer-environment by bernd erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

OPENNEBULACONF – 25TH OCTOBER 2013

OPENNEBULA IN A MULTI- CUSTOMER ENVIRONMENT

BERND ERK | NETWAYS GMBH

AGENDA

￭  Introduction ￭  Use case & Requirements ￭  History ￭  Today‘s Architecture ￭  Configuration Management ￭  Monitoring & Reporting ￭  Coming up ￭  Questions & Answers

INTRODUCTION NETWAYS

•  Founded 1995 •  Open Source since 1997

•  40 Employees

•  Specialized in Open Source Systems Management and Open Source Datacenter Infrastructure

Searching for awesome people!

NETWAYS COMPETENCIES

•  Monitoring & Reporting

•  Configuration Management

•  Service Management

•  Knowledge Management

•  Backup & Recovery

•  High Availability & Clustering

•  Cloud Computing

•  Load Balancing

•  Virtualization

•  Database Management

OPEN SOURCE SYSTEMS MANAGEMENT

OPEN SOURCE DATA CENTER

MANAGED SERVICES MONITORING HARDWARE CONFERENCES

PuppetCamp 2013/2014 •  28th November Munich •  11th April Berlin •  CfP is still open

Open Source Datacenter Conference •  8th – 10th April 2014 •  125 Attendees (2012) •  Datacenter | Automation | DevOps •  CfP open until 31th December 2013

OpenNebulaConf 2014 •  opennebulaconf.com •  2nd – 4th December 2014 •  Berlin

NETWAYS CONFERENCES

INTRODUCTION OPENNEBULA

USE CASE & REQUIREMENTS

USE CASE

REQUIREMENTS

￭  High Availability •  Automatic Failover

￭  Flexible Resources •  Resource allocation and accounting •  Isolation of noisy neighbours

￭  Independent Storage Architecture •  Persistent Images on existing technologies

￭  Client isolation •  Networking •  Monitoring

HISTORY

ARCHITECTURE - 2007

100% BareMetal

ARCHITECTURE - 2010

NFS on NetApp Filer

ARCHITECTURE – 2010 - PROBLEMS

￭  Missing overview •  Monitoring driven reboot •  Missing priorities •  No logic grouping on servers

￭  XEN-Problems •  Kernel in Debian •  Sometimes compatibility issues with Dell-HW

￭  No API •  Missing accounting •  Clear path for Puppet integration

NFS on NetApp Filer

WHAT NOW?

OpenStack

OpenNebula

Nigel Beighton (Rackspace)

DEPENDS ON THE PERSPECTIVE

￭  Technical Guy •  There is a tool for every customer

￭  Sales Guy •  There is a customer for every tool

WHAT WE DID?

TODAY’S ARCHITECTURE

ARCHITECTURE - 2012

NFS on NetApp Filer

ARCHITECTURE – 2012- CHALLENGES

￭  Failover •  Split-Brain situation

￭  NetApp •  We want to get rid of it •  No financial scaling

￭  Choosing the right filesystem •  OCFS2 sucks (sometimes) •  Ceph is nearly stable •  GlusterFS implementation is not (yet) ready

NFS on NetApp Filer

ARCHITECTURE – 2012- SOLUTIONS

￭  Pacemaker is controlling the stack •  Checking libvirt is important!

￭  Stonith – if something looks creepy ￭  Still working on NetAPP-NFS ￭  GlusterFS seems to be good for now •  Working on better integration in ONE •  First tests are promising

NFS on NetApp Filer

REPORTING & MONITORING

MONITORING - ICINGA

MONITORING - GRAPHING

REPORTING & ACCOUNTING

CONFIGURATION MANAGEMENT

PUPPET

￭  Puppet •  Configuration Management based on Ruby •  Life-Cylce-Management and Provisioning •  Live Management using MCollective

￭  How it works •  Puppet DSL (Domain Specific Language) •  Abstracted through Resource Abstraction Layer •  Define -> Simulate -> Enforce - > Report

PUPPET ENTERPRISE / FOREMAN

￭  Puppet Enterprise •  Graphical Interface •  Great Live Management

￭  Foreman •  Open Source interface for Puppet •  http://theforeman.org •  Great interface and additional features like •  Unattended Installation •  Integration of cloud frameworks

FOREMAN – VIRT-HOSTS

FOREMAN – PUPPET-CLASSES

FOREMAN – PUPPET - LIFECYLE

Configuration (Hiera, PuppetDB)

Dry Run using MCollective

Continuous Testing

Merge Environm

Final Test

Rollout

FOREMAN – PUPPET - LOADBALANCER

NFS on NetApp Filer

LB 1 LB 2

COMING UP

WHAT’S NEXT?

￭  Update OpenNebula to 4.2 ￭  Using GlusterFS •  Did some first tests with new qemu-versions •  GlusterFS-Support since version 1.3

￭  Fully automated provisioning of all systems including networking, backup and monitoring -> Software Defined Infrastructure

￭  Kicking out NetApp-Filer ￭  Adding new Nodes :-)

QUESTIONS & ANSWERS

NETWAYS GmbH Deutschherrnstrasse 15-19 90429 Nuremberg

Tel: +49 911 92885-0

Fax: +49 911 92885-77 Email: info@netways.de

Website: www.netways.de Twitter: twitter.com/netways Facebook: facebook.com/netways

Blog: blog.netways.de

QUESTIONS & ANSWERS

THANK YOU

SEE YOU NEXT YEAR 2ND – 4TH

DECEMBER 2014

opennebulaconf 2013 - opennebula in a multi-customer-environment by bernd erk

Technology

opennebulaconf 2014 - deploying opennebula in a snap using...

opennebula - opennebula and tips for centos 7

opennebulaconf 2013 - keynote: enabling scientific workflows...

opennebula conf 2014 | opennebula at cenatic - jose angel...

opennebulaconf 2016 - opennebula 5.0 highlights and beyond...

opennebulaconf 2013 - monitoring large-scale cloud...

opennebula techday boston 2015 - ha hpc with opennebula

opennebulaconf 2014 - dynamic virtual private clusters with...

opennebula conf 2014 | puppet and opennebula - david...

opennebulaconf 2014 - lightning talk: managing a scientific...

opennebulaconf 2013 - making clouds: turning opennebula into...

opennebulaconf 2014 - building hybrid cloud environments...

opennebulaconf 2013 - high performance computing cloud at...

opennebulaconf 2014 - centos, qa and opennebula - christoph...

opennebulaconf 2013 - monitoring of opennebula installations...

how can opennebula fit your needs - opennebulaconf 2013

opennebulaconf 2016 - hypervisors and containers hands-on...

opennebula techday waterloo 2015 - an introduction to...

opennebulaconf 2014 - opennebula at cenatic - jose angel...

opennebulaconf 2014 - puppet and opennebula - david...