devops on aws

DevOps on AWS

AWSwiss Meetup24.5.2016 Bern

Aarno AukiaVSHN AG - The DevOps Company

24.5.2016 VSHN AG | http://vshn.ch 2

About me

● MSc Computer Science ETH

● Security Operations @ Google

● Co-Founder & CTO @ Atrila GmbH (Security Operations)

● Co-Founder & CTO @ VSHN AG (DevOps & Ops)

● @aarnoaukia

● http://about.me/aarno

24.5.2016 VSHN AG | http://vshn.ch 3

DevOps?

● Collaboration: Development (Dev) and Operations (Ops)

● Bring agile software engineering methods to operations

– Automation: infrastructure as a code, versioning/rollback

– Testing: continuous integration/testing/deployment● Bring operations engineering experience to developers

– Scalability: independent microservices

– Production insight: monitoring/logging/metrics● Together: make the application's owner happier

24.5.2016 VSHN AG | http://vshn.ch 4

Dev + Ops collaboration

● Bring together Developers & Operations

● Practice agile Operations Engineering

● Counter fear of change with (automated) testing

● Provide developer and development infrastructure

– Tools for developers, preferably self-served

24.5.2016 VSHN AG | http://vshn.ch 5

Infrastructure as code

● Change from hand-groomed servers to Operations Engineering (from pets to cattle)

● Speed & reliability

● Versioning & rollback

● Prerequisite for self-service

– Give each developer a full stack

– No manual changes in production

– As many testing instances as needed

24.5.2016 VSHN AG | http://vshn.ch 6

Infrastructure tools

● Packaging code & dependencies for atomic deployment/rollback

– Deb/rpm, docker● Infrastructure state management (configuration mgmt)

– Puppet, salt, chef, ansible● Continuous Integration/Testing/Deployment

– Jenkins/TravisCI/GitlabCI● Self-Service

– Vagrant/Docker or through Continuous Deployment

24.5.2016 VSHN AG | http://vshn.ch 7

Infrastructure testing

● Bring software engineering best practice to operations

● Large complex infrastructure (as code) → many moving parts

– Unit testing each module (webserver setup, database setup, cache setup, etc)

– Functional end-to-end testing of full stack (request to cache delivers content from database)

● Basically the same thing as production service monitoring but for each change

24.5.2016 VSHN AG | http://vshn.ch 8

Infrastructure feedback

● Collect all logs in Elasticsearch-Logstash-Kibana

– Let the developers search for prod error root cause ● Collect Server & Application Metrics

– Correlate with deployments & site traffic

24.5.2016 VSHN AG | http://vshn.ch 9

Software Delivery Automation

24.5.2016 VSHN AG | http://vshn.ch 10

Customer case 1● Server stack (Puppet)

– Nginx, Varnish

– PHP versions 5.6 and 7

– MySQL/MariaDB-Galera-Cluster

– Memcached/Redis/Solr/Elasticsearch● Application Deployment/update (Ansible/SSH)

● Bundle know-how (settings, tunings, etc.) in common module, override if necessary per customer through YAML-File in Git-Repository

● Docker image for local testing/developing

24.5.2016 VSHN AG | http://vshn.ch 11

Case1

24.5.2016 VSHN AG | http://vshn.ch 12

Customer case 2● OpenShift: Plattform as a Service

● Docker, Kubernetes (Google), Openshift (Redhat)

● 100% opensource, enterprise support available

● Swiss public PaaS: appuio.ch

● EU public: AWS

● Dedicated/private available worldwide

– AWS

– Enterprise on-premises

24.5.2016 VSHN AG | http://vshn.ch 13

OpenShift

24.5.2016 VSHN AG | http://vshn.ch 14

About VSHN

● Swiss DevOps & Ops Company, 17 people in Zürich

● Building the tools and workflows for self-service

● Managing web applications in any cloud

– We are cloud-agnostic: we run on AWS, MSA, GCE, DO, Hetzner, OVH, SafeSwissCloud, Cloudscale, Exoscale and on any on-premises Enterprise private cloud

● We work for Amazee Labs, Liip, Mercedes Benz Switzerland,Migros, SaltCinema, SIX Group, Sherpany, Sobrado, Starticket, Suisa, Taskfleet, zurichopenair.ch, etc.

● How can we help YOU?

24.5.2016 VSHN AG | http://vshn.ch 16

Thanks

● Questions ?

● We're hiring System and Software Engineers @vshn_ch !

● Get in touch with @aarnoaukia or @tobruzh