enabling cache for monitoring application alexandre beche
DESCRIPTION
Enabling cache for monitoring application Alexandre Beche. Outlines. Deployment model Caching technologies + how they fit to monitoring applications Memcached Varnish Benchmark Configuration Conclusion. This presentation is not…. …A benchmark between different caching technologies. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/1.jpg)
IT-SDC : Support for Distributed Computing
Enabling cache for monitoring application
Alexandre Beche
![Page 2: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/2.jpg)
Alexandre Beche 2IT-SDC
Outlines
Deployment model Caching technologies + how they fit
to monitoring applications Memcached Varnish
Benchmark Configuration Conclusion
09 May 2013
![Page 3: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/3.jpg)
Alexandre Beche 3IT-SDC
This presentation is not…
…A benchmark between different caching technologies.
Only two technologies has been tested: Memcached (Backend cache) Varnish (Frontend cache)
09 May 2013
![Page 4: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/4.jpg)
Alexandre Beche 4IT-SDC
User request data Using a LB alias
Request can goes on different servers
Web servers get data from the same DB
Deployment model of monitoring applications
Application DB
09 May 2013
![Page 5: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/5.jpg)
Alexandre Beche 5IT-SDC
Memcached
Application DB
memcached
09 May 2013
![Page 6: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/6.jpg)
Alexandre Beche 6IT-SDC
Memcached
Application DB
memcached
09 May 2013
![Page 7: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/7.jpg)
Alexandre Beche 7IT-SDC
Consistent and efficient caching
Application DB
memcached memcached
Cache is load once per hostPossible inconsistency
09 May 2013
![Page 8: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/8.jpg)
Alexandre Beche 8IT-SDC
Consistent and efficient caching
Application DB
memcached memcached
Cache is load once per hostPossible inconsistency
Cache is load once per clusterData are 100% consistent
Application DB
memcached
09 May 2013
![Page 9: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/9.jpg)
Alexandre Beche 9IT-SDC
Varnish
Application DB
Varnish
09 May 2013
![Page 10: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/10.jpg)
Alexandre Beche 10IT-SDC
Varnish
Application DB
Varnish
09 May 2013
![Page 11: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/11.jpg)
Alexandre Beche 11IT-SDC
Caching proxy
Application DB
Memcached
Varnish Varnish
Less stress on server
Varnish: Store the whole request
Memcached: Store data from the DB Guarantee consistency
09 May 2013
![Page 12: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/12.jpg)
Alexandre Beche 12IT-SDC
Bench has been done for the “most popular” query Default page
Bench specifications: Run 100 requests Variable number of concurrent clients (from 1 to 100) Each request is roughly 10kB of data Average on 100 executions has been kept
Test 3 scenarios: Without any cache Memcache only Memcache + varnish
Benchmark using ab(credits to Olga)
09 May 2013
![Page 13: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/13.jpg)
Alexandre Beche 13IT-SDC
25 concurrent access max without caching
Few failures when only memcached
Varnish improves memcached’s performance
Benchmark using ab(credits to Olga)
09 May 2013
![Page 14: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/14.jpg)
Alexandre Beche 14IT-SDC
Enabling caching Memcached:
0-conf: install the RPM and start the service Comes for “free” with Django apps (decorator) Require development effort for legacy dashboard
applications (all actions need to be adapted)
Varnish: Trivial configuration to run it on port 80 and get httpd
on 8080 (or anything else) All HTTP request will be cached
09 May 2013
![Page 15: Enabling cache for monitoring application Alexandre Beche](https://reader036.vdocument.in/reader036/viewer/2022062520/56816412550346895dd5bfb3/html5/thumbnails/15.jpg)
Alexandre Beche 15IT-SDC
Conclusion Two main caching technologies has been tested:
Backend caching and caching proxy Different roles
Bench are awesome but “useless”: Monitoring apps will never have this load
Is caching useless then? NO!!! Most popular queries can be pre-cached for allowing
fast response.
09 May 2013