by feike steenbergen pgconf.eu 2015 - postgresql wiki · patroni forked from compose governor...

Patroni PGConf.EU 2015 by Feike Steenbergen

Upload: vodieu

Post on 11-Nov-2018

222 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

PatroniPGConf.EU 2015

by Feike Steenbergen

Some Zalando numbers

200+ deployment units (WARs)

1300+ production instances

120+ database master instances

100+ different databases

700+ technologists

10 database engineers

Page 3: by Feike Steenbergen PGConf.EU 2015 - PostgreSQL wiki · Patroni Forked from Compose Governor manages a single PostgreSQL cluster requires etcd, Zookeeper, or Consul is aware of its

What problems do we have?

● We don’t have automatic failover● New clusters are managed by the teams● These clusters will run on AWS● We expect more instance failures on

AWS● Many new clusters will be created● We don’t like to be called, at night, or at

all

Patroni

● Forked from Compose Governor● manages a single PostgreSQL cluster● requires etcd, Zookeeper, or Consul● is aware of its peers● has an api

○ healthcheck/status○ management

● Is running production systems

Page 5: by Feike Steenbergen PGConf.EU 2015 - PostgreSQL wiki · Patroni Forked from Compose Governor manages a single PostgreSQL cluster requires etcd, Zookeeper, or Consul is aware of its

Patroni in general

Page 6: by Feike Steenbergen PGConf.EU 2015 - PostgreSQL wiki · Patroni Forked from Compose Governor manages a single PostgreSQL cluster requires etcd, Zookeeper, or Consul is aware of its

Patroni on AWS (Spilo)

Auto Scaling Group

Master ELBprod.example.com

Replica ELBprod-replica.example.com

Page 7: by Feike Steenbergen PGConf.EU 2015 - PostgreSQL wiki · Patroni Forked from Compose Governor manages a single PostgreSQL cluster requires etcd, Zookeeper, or Consul is aware of its

Patroni in our Datacenter

Zookeeper

10.0.0.4

● Patroni has a callbacks featureon some events a configured script can be run

● We use it to switch IP-address from master to slave and vice-versa

10.0.1.4

Page 8: by Feike Steenbergen PGConf.EU 2015 - PostgreSQL wiki · Patroni Forked from Compose Governor manages a single PostgreSQL cluster requires etcd, Zookeeper, or Consul is aware of its

Thanks

Tech Blog: tech.zalando.com

GitHub: github.com/zalando

Patroni: github.com/zalando/patroni

Twitter: @ZalandoTech

Jobs: http://tech.zalando.com/jobs

https://tech.zalando.com/

http://github.com/zalando

https://github.com/zalando/patroni

http://tech.zalando.com/jobs

PostgreSQL and XML - Prague PostgreSQL Developers Day … · PostgreSQL and XML Peter Eisentraut [email protected] Prague PostgreSQL Developers’ Day 2008

Connecting the Debian and PostgreSQL worlds · Connecting the Debian and PostgreSQL worlds Christoph Berg [email protected] [email protected] PGconf.EU 2011, Amsterdam October

PgConf.eu, Tallinn, November 2016 Honza Horak

Hacking PostgreSQL with · Hacking PostgreSQL with Eclipse Metin Döşlü [email protected] PGCONF.EU 2017 1

How can I backup my PGConf.eu 2019 PostgreSQL databases? · I’m down. Yesterday my PostgreSQL cluster had a storage problem. I can’t bring it up. Don’t let me down! You can’t

Foreign Data Wrappers and their utilization in real world ... · Foreign Data Wrappers / PgConf.EU Milano, 18 October 2019 Mongo FDW – A table in PostgreSQL CREATE SCHEMA mongo;

Migrating to PostgreSQL · 2019-10-24 · Migrating to PostgreSQL / PgConf.EU Milano, 16 October 2019 Take Advantage of the Application Some applications support multiple databases

Migrating to PostgreSQL...Migrating to PostgreSQL / PgConf.EU Milano, 16 October 2019 Top Reasons to Stay in Open Source 1.Competitive features, innovation 2.Freedom from vendor lock-in

Wri$ng’DjangoExtensionsfor’ PostgreSQL’ · Wri$ng’DjangoExtensionsfor’ PostgreSQL’ Jonathan’S.’Katz Exco’Ventures’ PGConf.eu’2011’–Oct20,’2011’

PostgreSQL Notes for Professionals - goalkicker.com · SQL;}} PostgreSQL Notes for Professionals GoalKicker.com PostgreSQL PostgreSQL Notes for Professionals

PostgreSQL, PostgreSQL monitoring and monitoring postgresql · PostgreSQL, PostgreSQL monitoring and monitoring postgresql.org ... [email protected] Nagios conference 2008

Ansible (really) loves PostgreSQL · 2019-10-24 · Ansible (really) loves PostgreSQL PGConf.EU 2019 Cédric Villemain [email protected] 16 October 2019 Cédric Villemain [email protected]

C3 PostgreSQL 運用テクニック・レベルアップ編 · PostgreSQL Conference 2012 1 【 C3 】 PostgreSQL 運用テクニック・レベルアップ編 PostgreSQL Conference

What’s New in PostgreSQL 9.6, by PostgreSQL · PDF fileOperation PostgreSQL 9.4 PostgreSQL 9.5 PostgreSQL 9.6 SELECT - Support foreign table inheritance Support foreign table inheritance

Migration to PostgreSQL Preparation and Methodologyjoeconway.com/presentations/migrating-pgconf.eu.2014.pdf · Migration to PostgreSQL Preparation and Methodology Joe Conway, Michael

Documentation PostgreSQL 10 · Documentation PostgreSQL 10 ... Préface xix

The PostgreSQL Global Development Group · 2019-09-26 · PostgreSQL 9.5.19 Documentation The PostgreSQL Global Development Group. PostgreSQL 9.5.19 Documentation by The PostgreSQL

Securing PostgreSQL Exploring the PostgreSQL STIG · PDF fileSecuring PostgreSQL { Exploring the PostgreSQL STIG and ... $ systemctl restart postgresql-9.5 ... Securing PostgreSQL

Autovacuum, explained for engineers, new improved version PGConf.eu 2015 Vienna

Documentation PostgreSQL 9.6 · Documentation PostgreSQL 9.6 ... Préface xix

Documentation PostgreSQL 9.2 · Documentation PostgreSQL 9.2 ... Préface xxi

Migration to PostgreSQL - preparation and … · Overview Oracle to PostgreSQL Informix to PostgreSQL MySQL to PostgreSQL MSSQL to PostgreSQL Replication and/or High Availability

PostgreSQL · PostgreSQL as a Schemaless Database. Christophe Pettus PostgreSQL Experts, Inc. PgDay FOSDEM 2013

PostgreSQL: Introduction and Concepts - justpainjustpain.com/eBooks/Databases/PostgreSQL/PostgreSQL Introductio… · Title: PostgreSQL: Introduction and Concepts Author: Bruce Momjian

Manually Upgrading PostgreSQL 9.1to PostgreSQL 9.4

PostgreSQL for developers · PostgreSQL for developers Dimitri Fontaine PostgreSQL Major Contributor A BOOK ABOUT POSTGRESQL BY DIMITRI FONTAINE

Migration to PostgreSQL - preparation and methodology · 2020-02-02 · Overview Oracle to PostgreSQL Informix to PostgreSQL MySQL to PostgreSQL MSSQL to PostgreSQL Replication and/or

Securing PostgreSQL · Securing PostgreSQL Christophe Pettus PostgreSQL Experts, Inc. PGConf EU Tallinn, November 2016

Migration to PostgreSQL Preparation and · PDF fileMigration to PostgreSQL Preparation and Methodology ... Data types PostgreSQL supported Data ... your PostgreSQL application ugly

Mastering PostgreSQL · Mastering PostgreSQL In Application Development Dimitri Fontaine PostgreSQL Major Contributor 1st Edition !

FROM FULL-TIME ONSITE DBA TO REMOTE EXPERTISE - … · A journey in effective PostgreSQL support - PGConf.eu 2019 - Milano - 2019-10-16 - @saschild [email protected] - cc-by-nc

Documentation PostgreSQL 9.0 · Documentation PostgreSQL 9.0 ... Préface xx

Hacking PostgreSQL · PostgreSQL Source Code Hacking PostgreSQL Final Code PostgreSQL Subsystems Hacking the PostgreSQL Way Top Level Backend Code Backend Code - Down the Rabbit Hole

PostgreSQL Disaster Recovery with Barman (PGConf.EU 2013)