elasticsearch and mongodb on microsoft azure in 5 minutes
TRANSCRIPT
ELASTICSEARCH AND MONGODBon Microsoft Azure in 5 minutes
Ivan Fioravanti
4wardCTO
co-founder
WHO?
http://www.4ward.it
http://www.4ward365.com
@ivanfioravanti
ivan.fioravanti(at)4ward.it
2 PARTS
MONGODBReplicaSet
Sharded ClusterPerformance
ELASTICSEARCHSharded Cluster
Scale OutPerformance
4ward365: AZURE + OPENSOURCEIt’s a kind of magic
FIRST MAGIC: AZURE MONGODB REPLICASET
Photo by Nasa (http://www.nasa.gov/mission_pages/station/multimedia/gallery/iss030e078095.html)
East Coast... USA...
Virginia... Azure “G”
GODZILLA!
REPLICASET?Group of servers that maintain the same data set.
PRIMARY SECONDARY SECONDARY
20 GB 20 GB 20 GB
REPLICASET?
AVAILABILITY
Group of servers that maintain the same data set.
PRIMARY SECONDARY SECONDARYPRIMARY
20 GB 20 GB 20 GB
DEMO REPLICASET ON AZURE
REPLICASET WITH MMS
1 Azure Subscription
Azure Command Line
MongoDB MMS Account
GitHub: http://bit.ly/1LJw5X4
SECOND MAGIC: AZURE MONGODB SHARDINGEasy and in less than 5 minutes J
SHARDING?
SCALABILITY
Dataset distributed on more servers or replica sets
SHARD A200GB
SHARD B200GB
CONFIG SERVERS
400GB
Router MONGOS
DEMO SHARDING ON AZURE
1 DEV-TESTSERVER
No MMS, only scripting
Single Server with
1 config server
4 mongod server
1 mongos
AZURE TYPE “G” + MONGODB = PERFORMANCE!Up to:32 Core448 GB di RAM6.144 GB di SSD
HOW TO TEST IT?...
IDEA! SIOPE DATA IN REALTIME!
Same used in soldipubblici.gov.it
DEMO AZURE PERFORMANCE
LET’S CONTINUE OUR JOURNEY WITH...
ELASTICSEARCH?
DOCUMENT BASEDFULL TEXT SEARCH
REAL-TIME DATA AND ANALYTICS
AWESOME!MY OPINION on ELASTICSEARCH?
DEMO ELASTICSEARCH ON AZURE
LET’S START!
Powered by
WHAT HAVE WE CREATED?
What? OFFICE 365 REPORTING AND MANAGEMENT
Open sourceLinux, MongoDB, AngularJS,
Bootstrap, Elasticsearch
AzureServiceBus, Scheduler, Redis,
Web/Worker Roles, Web Sites, VM, Virtual Network,
Machine Learning (coming soon)
FINAL RESULT DEMO
Q&A E LINKSeasy-azure-opensourcehttps://github.com/ivanfioravanti/easy-azure-opensource
4ward365 http://www.4ward365.com
@ivanfioravantiivan.fioravanti(at)4ward.it
AZURE LOVES OPENSOURCE