![Page 1: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/1.jpg)
Killing containers to make weather
beautifulJacob Tomlinson
Met Office Informatics Lab @_jacobtomlinson
![Page 2: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/2.jpg)
Who am I?
![Page 3: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/3.jpg)
![Page 4: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/4.jpg)
Visualising 4D data in a
web browser
Confidence in
integration
![Page 5: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/5.jpg)
Visualising 4D data in a web browser
![Page 6: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/6.jpg)
Ingestion
![Page 7: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/7.jpg)
Supercomputer
Binary files
PNG images
Videos
The browser
![Page 8: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/8.jpg)
![Page 9: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/9.jpg)
![Page 10: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/10.jpg)
Service types
![Page 11: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/11.jpg)
Long running daemons
Short running workers
![Page 12: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/12.jpg)
Kubernetes
![Page 13: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/13.jpg)
Mixing job types
![Page 14: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/14.jpg)
Docker Host
nginx
Syst
em C
apac
ity
Docker Host
nginxSy
stem
Cap
acity
Docker Host
nginx
Syst
em C
apac
ity
![Page 15: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/15.jpg)
Docker Host
Syst
em C
apac
ity
Docker Host
Syst
em C
apac
ity
Docker Host
Syst
em C
apac
ity
nginx nginx nginx
![Page 16: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/16.jpg)
Docker Host
nginx
Syst
em C
apac
ity
Docker Host
nginxSy
stem
Cap
acity
Docker Host
nginx
Syst
em C
apac
ity
![Page 17: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/17.jpg)
Docker Host
nginx
Syst
em C
apac
ity
Docker Host
nginxSy
stem
Cap
acity
Docker Host
nginx
Syst
em C
apac
ity
worker
worker
worker
worker
worker
worker
worker
worker
worker
worker
worker
worker
![Page 18: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/18.jpg)
Docker Host
nginx
Syst
em C
apac
ity
Docker Host
Syst
em C
apac
ity
Docker Host
Syst
em C
apac
ity
worker
nginx nginx
workerworker
![Page 19: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/19.jpg)
Docker
nginxSyst
em
worker
Docker
Syst
em
worker
nginx
Docker
Syst
em
worker
nginx
Docker
Syst
em
worker
worker
worker
worker
worker
![Page 20: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/20.jpg)
Docker
Syst
em
worker
Docker
Syst
em
worker
Docker
Syst
em
worker
Docker
Syst
em
worker
nginx
worker
nginxnginxnginx
workerworkerworker
![Page 21: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/21.jpg)
Persistence
![Page 22: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/22.jpg)
EBS backed persistent volumes
![Page 23: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/23.jpg)
Docker Host
mongo
EBS Volume
Docker Host Docker Host
![Page 24: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/24.jpg)
Docker Host
EBS Volume
Docker Host Docker Host
mongo mongo
![Page 25: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/25.jpg)
Docker Host
EBS Volume
Docker Host Docker Host
mongo
![Page 26: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/26.jpg)
Scaling by queue
![Page 27: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/27.jpg)
AWS cost vs scale
![Page 28: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/28.jpg)
Confidence in integration
![Page 29: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/29.jpg)
Short containers
Long containersDaemon processes which listen to requests
Asynchronous processes doing repetitive workloads
![Page 30: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/30.jpg)
Short containers
![Page 31: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/31.jpg)
∞ jobs 1 job
n jobs
![Page 32: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/32.jpg)
Pros Conceptual simplicity
Confidence
Cons Overhead
![Page 33: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/33.jpg)
Long containers
![Page 34: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/34.jpg)
Run forever
Finite runtime
![Page 35: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/35.jpg)
Scaling down
![Page 36: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/36.jpg)
Being confident
![Page 37: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/37.jpg)
Conclusion
![Page 38: KubeCon EU 2016: Killing containers to make weather beautiful](https://reader031.vdocument.in/reader031/viewer/2022011722/58f154ab1a28abba388b45c3/html5/thumbnails/38.jpg)
Questions
Jacob Tomlinson @_jacobtomlinson