devops and magento

DevOps and Magento

Meet Magento SwitzerlandOctober 23, 2015

Glattfelden, Zürich

Aarno Aukia, VSHN AG

23.10.2015 VSHN AG | http://vshn.ch 2

About me

● MSc Computer Science ETH

● Security Operations @ Google

● Co-Founder & CTO @ Atrila GmbH (Security Operations)

● Co-Founder & CTO @ VSHN AG (DevOps & Ops)

● @aarnoaukia

● http://about.me/aarno


Agenda

● What is DevOps ???

– Culture & Tools● DevOps tools in the Magento world


DevOps?

● Collaboration: Development (Dev) and Operations (Ops)

● Bring agile software engineering methods to operations

– Automation: infrastructure as a code, versioning/rollback

– Testing: continuous integration/testing/deployment● Bring operations engineering experience to developers

– Scalability: independent microservices

– Production insight: monitoring/logging/metrics● Together: make the application's owner happier


Dev + Ops collaboration

● Bring together Developers & Operations

● Practice agile Operations Engineering

● Counter fear of change with (automated) testing

● Provide developer and development infrastructure

– Tools for developers, preferably self-served


Infrastructure as code

● Change from hand-groomed servers to Operations Engineering (from pets to cattle)

● Speed & reliability

● Versioning & rollback

● Prerequisite for self-service

– Give each developer a full stack

– No manual changes in production

– As many testing instances as needed


Infrastructure tools

● Packaging code & dependencies for atomic deployment/rollback

– Deb/rpm, docker● Infrastructure state management (configuration mgmt)

– Puppet, salt, chef, ansible● Continuous Integration/Testing/Deployment

– Jenkins/TravisCI/GitlabCI● Self-Service

– Vagrant/Docker or through Continuous Deployment


Infrastructure testing

● Bring software engineering best practice to operations

● Large complex infrastructure (as code) → many moving parts

– Unit testing each module (webserver setup, database setup, cache setup, etc)

– Functional end-to-end testing of full stack (request to cache delivers content from database)

● Basically the same thing as production service monitoring but for each change


Infrastructure feedback

● Collect all logs in Elasticsearch-Logstash-Kibana

– Let the developers search for prod error root cause ● Collect Server & Application Metrics

– Correlate with deployments & site traffic


Software Delivery Automation

16

Backends

DB, File

Cache


the 30000ft view

Customer-specific customization, design, etc

Framework & Standard Modules (magento, ...)

App deployment (ssh, ftp, git, composer)

Application Server & Backends (PHP, mysql, ...)

Guest OS

Virtualization (OS, hypervisor)

Server

Network

Datacenter (power, cooling, etc) Colo

IaaS„hosting“

DevOps

You


Magento

● Server stack (puppet)

– Nginx, Varnish

– Php5.5-fpm (maybe HHVM, see previous talk)

– MySQL/MariaDB-Galera-Cluster

– Memcached/Redis/Solr/Elasticsearch (see next talk)● Application Deployment/update (capistrano/ansible)

● Deps in composer (via symfony, @seldaek)

● Automated Magento settings management with magerun

● Bundle know-how (settings, tunings, etc) in common module, override if necessary per customer


Compact stack (dev, Vagrant)


Single stack


Cluster stack


About VSHN

● Swiss DevOps & Ops Company, 12 people in Zürich

● Building the tools and workflows for self-service

● Managing web applications in the cloud

– We are cloud-agnostic: we run on AWS, MSA, GCE, DO, Hetzner, OVH, SafeSwissCloud, Cloudscale, Exascale and in different enterprise-internal private clouds

● We work for Amazee Labs, Liip, Mercedes Benz Switzerland,Migros, SaltCinema, SIX Group, Sherpany, Sobrado, Starticket, Suisa, Taskfleet, zurichopenair.ch, etc

● Maybe we can help you ?


Thanks

● Questions ?

● We're hiring System and Software Engineers @vshn_ch !

● Get in touch with @aarnoaukia or @tobruzh