elasticsearch and mongodb on microsoft azure in 5 minutes

23
ELASTICSEARCH AND MONGODB on Microsoft Azure in 5 minutes

Upload: ivan-fioravanti

Post on 18-Jul-2015

2.012 views

Category:

Software


2 download

TRANSCRIPT

Page 1: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

ELASTICSEARCH AND MONGODBon Microsoft Azure in 5 minutes

Page 2: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

Ivan Fioravanti

4wardCTO

co-founder

WHO?

http://www.4ward.it

http://www.4ward365.com

@ivanfioravanti

ivan.fioravanti(at)4ward.it

Page 3: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

2 PARTS

MONGODBReplicaSet

Sharded ClusterPerformance

ELASTICSEARCHSharded Cluster

Scale OutPerformance

Page 4: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

4ward365: AZURE + OPENSOURCEIt’s a kind of magic

Page 5: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

FIRST MAGIC: AZURE MONGODB REPLICASET

Photo  by  Nasa  (http://www.nasa.gov/mission_pages/station/multimedia/gallery/iss030e078095.html)

East Coast... USA...

Virginia... Azure “G”

GODZILLA!

Page 6: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

REPLICASET?Group of servers that maintain the same data set.

PRIMARY SECONDARY SECONDARY

20 GB 20 GB 20 GB

Page 7: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

REPLICASET?

AVAILABILITY

Group of servers that maintain the same data set.

PRIMARY SECONDARY SECONDARYPRIMARY

20 GB 20 GB 20 GB

Page 8: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

DEMO REPLICASET ON AZURE

REPLICASET WITH MMS

1 Azure Subscription

Azure Command Line

MongoDB MMS Account

GitHub: http://bit.ly/1LJw5X4

Page 9: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

SECOND MAGIC: AZURE MONGODB SHARDINGEasy and in less than 5 minutes J

Page 10: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

SHARDING?

SCALABILITY

Dataset distributed on more servers or replica sets

SHARD A200GB

SHARD B200GB

CONFIG SERVERS

400GB

Router MONGOS

Page 11: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

DEMO SHARDING ON AZURE

1 DEV-TESTSERVER

No MMS, only scripting

Single Server with

1 config server

4 mongod server

1 mongos

Page 12: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

AZURE TYPE “G” + MONGODB = PERFORMANCE!Up to:32 Core448 GB di RAM6.144 GB di SSD

HOW TO TEST IT?...

Page 13: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

IDEA! SIOPE DATA IN REALTIME!

Same used in soldipubblici.gov.it

Page 14: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

DEMO AZURE PERFORMANCE

Page 15: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

LET’S CONTINUE OUR JOURNEY WITH...

Page 16: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

ELASTICSEARCH?

DOCUMENT BASEDFULL TEXT SEARCH

REAL-TIME DATA AND ANALYTICS

Page 17: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

AWESOME!MY OPINION on ELASTICSEARCH?

Page 18: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

DEMO ELASTICSEARCH ON AZURE

LET’S START!

Page 19: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

Powered by

WHAT HAVE WE CREATED?

Page 20: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

What? OFFICE 365 REPORTING AND MANAGEMENT

Open sourceLinux, MongoDB, AngularJS,

Bootstrap, Elasticsearch

AzureServiceBus, Scheduler, Redis,

Web/Worker Roles, Web Sites, VM, Virtual Network,

Machine Learning (coming soon)

Page 21: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

FINAL RESULT DEMO

Page 22: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

Q&A E LINKSeasy-azure-opensourcehttps://github.com/ivanfioravanti/easy-azure-opensource

4ward365 http://www.4ward365.com

@ivanfioravantiivan.fioravanti(at)4ward.it

Page 23: Elasticsearch and MongoDB on Microsoft Azure in 5 minutes

AZURE LOVES OPENSOURCE