Upload File

9 s ® - d m / 1 b ; ø...^ ¾ 7 m • services/app • consul • mysql(in rds) • redis,...

  • Home
  • Documents
  • 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •
19
ᄓኮचԭلԯጱ قᶎ۸ຝਫ᪢ Michael Ding

Upload: others

Post on 30-Aug-2020

1 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Michael Ding

Page 2: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

•

• Ruby VS Python

• Ucloud VS

• Boss VS Boss

• 10 VS 1

Page 3: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

• Services/App

• Consul

• MySQL(in RDS)

• Redis, Twemproxy

• Elasticsearch

• Log collector

• Python App(Django, Flask, Tornado)

• MQ

• Spark(Not yet in Shanbay)

• Deploy

• Ansible

• bash

• NOT included

• Mesos

• K8s

Page 4: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Consul https://consul.io

https://consul.io
Page 5: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

• Service Discovery • register/deregister service

• HTTP/DNS interface

• Failure Detection • health check

• update service register

• Multi Datacenter

• Key/Value Storage • store information

• store data

Page 6: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

• register & deregister a service

• service health check & auto deregister unhealthy services

• query services & load balance based on DNS

Page 7: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Docker https://www.docker.com

https://www.docker.com
Page 8: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

•

• Docker VS VM(Virtual Machine)

• os kernel

• docker image: (fs)

• docker container:

Page 9: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Service Distribution Workflow

Page 10: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

• Build: -> make image

• Ship: -> upload/download image

• Run: -> fetch config && create container && register service

Page 11: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

2 types of services

• Elasticsearch — normal service

• Django(uwsgi) — need gracefully reload

based on workflow

Page 12: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Elasticsearch•

Get config

Run

Register service & health check

Image contains service

Page 13: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Djangoreload instead of restart

when code updated

Image ONLY contains environments

Page 14: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Web

Page 15: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •
Page 16: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •
Page 17: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

• HA(High Available) — Load Balance

• Easy to Scale Out —

• LL(Low Latency) —

• Developer Friendly —

• Team —

Page 18: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

–Johnny Appleseed

“Docker + Consul is just good for us.”

Page 19: 9 s ® - D M / 1 B ; ø...^ ¾ 7 m • Services/App • Consul • MySQL(in RDS) • Redis, Twemproxy • Elasticsearch • Log collector • Python App(Django, Flask, Tornado) •

Thank You!

We’re [email protected]

mailto:[email protected]?subject=

Amazon · Amazon ElastiCache for Redis ElastiCache for Redis User Guide Table of Contents What Is ElastiCache for Redis

RedisConf17 - Redis Enterprise: Continuous Availability, Unlimited Scaling, Secure and Cost-Effective Redis

Using Redis as a Cache Backend in MagentoUsing Redis as a

What's new with enterprise Redis - Leena Joshi, Redis Labs

Redis in Kenshoo microservices - Redis Labs · Redis in Kenshoo microservices Jesque based delayed priority queue system Presented by Dima Vizelman. A Redis Use-Case Performance Aggregation

Proxy v1.1 Guide VMware Application · 2018. 10. 10. · 28 MySQL 29 nginx_plus 30 Nginx 31 php-fpm 32 Pivotal Server 33 Postgres 34 Redis 35 Riak 36 RabbitMQ 37 Sharepoint 38 Twemproxy

Redis : Play buzz uses Redis

Redis Presentation

Spring Data Redis Reference Documentation · Spring Data Redis 1.2.0.RELEASE Spring Data Redis Reference Documentation 2 1. Why Spring Data Redis? The Spring Framework is the leading

Intel® Memory Drive Technology Redis Performance ... · Redis servers on the system and Redis clients on the client machines. • The Redis server is started with multiple instances

Back your App with MySQL & Redis, the Cloud Foundry Way- Kenny Bastani, Pivotal

Application Device Queues (ADQ) with Redis* Solution Brief · Redis* Figure 3. Redis* is a representative application for testing both key caching and a database back end Redis scales

Redis tutoring

Redis - Baidu

Redis Introduction

Build a Geospatial App with Redis 3.2- Andrew Bass, Sean Yesmunt, Sergio Prada, Deanna Shih, Coding House

Redis Persistence

Redis - Partitioning

Redis twemproxy failover

Taller Redis

Using Redis for Geospatial Applications · Using Redis for Geospatial Applications RedisTimeSeries RedisAI Rock Pereira CUGOS Fall Fling Oct 06, 2019. 1 Intro: Data Analysis Vs App

Redis Beyond

Redis as a Reliable Work Queue - Percona Redis as a... · Redis Reliable Queueing Service Producer ... Bronto’s Reliable Queue implementation ! Redis running on Intel(R) Xeon(R)

DPDK Summit China 2017 · PDF fileDPDK Summit China 2017. ... (corouting,php,python,) APP (nws,nginx,redis,) ... CTPClassification=CTP_PUBLIC:VisualMarkings=

Applied Redis

Troubleshooting redis

Redis Day Keynote Salvatore Sanfillipo Redis Labs

Twemproxy flow

Back your app with MySQL and Redis on Cloud Foundry

Introducing redis

Redis / Redis Labs Overview and then busting 4 myths … · Redis / Redis Labs Overview and then busting 4 myths about Redis Yiftach Shoolman Co-Founder & CTO Home of Redis

Developer`s Overview of Sonic Part 2…Redis Server database container (multi Redis Instance) Redis Server 2-way read\write to support Warm Restart 1.) Redis-server, different DBs,

Gurobi Optimization Application Demos · Demo1 Worker MongoDB SaaS AWS Load Balancer AWS Redis Elasticache Demo2 Worker Demo1 App Demo2 App /demo1 /demo2 AWS Cloud Watch AWS Elastic

Design tradeoffs in the Redis project - antirezantirez.com/misc/Zenconf-Redis-antirez.pdf · Design tradeoffs in the Redis project Salvatore Sanfilippo @antirez — Pivotal ... •

Multiple NoSQL Use Cases with Redis Modules · Redis Modules C extensions to Redis Work at native speed Add commands Can implement their own native data types Can extend redis or