postgresqlwiki.postgresql.org/images/a/ae/froscon09_pg_en_stefan_k... · 2009-08-30 · – the bad...

21
Stefan Kaltenbrunner [email protected] http://www.kaltenbrunner.cc/blog PostgreSQL the postgresql.org infrastructure Froscon 2009 - Sankt Augustin, Germany

Upload: others

Post on 29-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Stefan Kaltenbrunner

[email protected]://www.kaltenbrunner.cc/blog

PostgreSQLthe postgresql.org infrastructure

Froscon 2009 - Sankt Augustin, Germany

Page 2: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Agenda

Infrastucture? Facts and figures Webservices Operational aspects The future

Page 3: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

A marketing problem?

-sysadmins is like -core it's just that -core is doing their “secret stuff” in public ...

... -core is listed on the website but figuring out who is the sysadmin team and how to contact

them is way more difficult

German core member on IRC

Page 4: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Infrastructure - why?

Infrastructure - wth? cvs, website, wiki, mailinglists – something else?

services pugs, pgfoundry, wwwmaster, wiki

anoncvs, git hosting, dns, monitoring

web and ftp-mirrors, ftp-master

archives, pmt, jabber, pgweb

development hosts

planet

Page 5: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Who?

pgfoundry team (gforge, project approval, support)

web weam (website and webservices)

sysadmin team (servers, monitoring, operations)

Subteams (translation, commitfest,...)

Page 6: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Agenda

Infrastructure? Facts and figures Webservices Operations The future

Page 7: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Facts and figures

~60 Hosts (~75% community managed) 400 Service FreeBSD, Debian, Ubuntu, Slackware, CentOS,

Redhat Enterprise Linux, VMware Server Austria, Canada, France, Israel, Panama,

Sweden, USA

Page 8: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Facts and figures

Page 9: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Agenda

Infrastructure? Facts and figures Webservices Operations The future?

Page 10: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

The website

http://www.postgresql.org - static http://wwwmaster.postgresql.org - dynamic master subversion repository 3-4 active commiters PHP with PostgreSQL backend hourly snapshots & replication Interfaces for news, events, feature matrix, doc

comments, mirror management, community login

Page 11: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Webservices

git.postgresql.org – Python/Django git community project hosting

planet.postgresql.org – Python/Django Blog aggregation

wiki.postgresql.org – PHP/Mediawiki The wiki :)

commitfest.postgresql.org – Perl PostgreSQL release management reloaded

Page 12: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

www.postgresql.org – the bad stuff

Syncronisation issues, replication delays release coordinierung PHP and subversion source layout and code historic codebase complex framework user account integration

Page 13: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

www.postgresql.org – the good stuff

Very robust and reliable Very low requirements for the mirrors hosts can be added/removed very quickly fast scalable

Page 14: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Agenda

Infrastructure Facts and figures Webservices Operations The future?

Page 15: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Operations

Nagios 3 Smokeping Munin Trac Dokumentation, (internal) tickets coordination IM and Mailinglists internal tools (change tracking,...)

Page 16: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Operations

FreeBSD jails 2-8 Jails/Host Nagios + NRPE Munin/Smokeping Custom developed checks (hardware checks,

pg specific tasks, security updates) Rant: freebsd-update(8) needs “check/report”

Page 17: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Operations – the bad stuff

widely diverse hardware “remote hands” zoo of operating systems timezones network issues/notification “my servers/my services”

Page 18: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Operations

Page 19: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Agenda

Infrastructure Facts and figures Webservices Operations The future?

Page 20: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

The future?

Central user management HTTPS Support automatic deployment & documentation more marketing in the community FreeBSD 7.x Getting faster and more reliable DNS/mailing lists

Page 21: PostgreSQLwiki.postgresql.org/images/a/ae/Froscon09_pg_en_Stefan_K... · 2009-08-30 · – the bad stuff Syncronisation issues, replication delays release coordinierung PHP and subversion

Danke

Infrastructure is boring stuff but...

... any questions