Transcript
Page 1: Integrating Elasticsearch for Real-Time Analytics with Kibana
Page 2: Integrating Elasticsearch for Real-Time Analytics with Kibana

@DavidOstrovsky

Senior Architect @ SelaCo-author of:

“Pro Couchbase Server” – Apress Media 2014“Essentials of Developing Windows Store Apps Using C#”“Advanced Windows Store App Development Using C#”

Big data and NoSQL nerd

CodeHardBlog.azurewebsites.net

Page 3: Integrating Elasticsearch for Real-Time Analytics with Kibana

What’s up?

Why Couchbase and ElasticSearch?How do I connect the two?What can I do with this?Does it scale?

Page 4: Integrating Elasticsearch for Real-Time Analytics with Kibana

Why use Couchbase Server?

If you don’t know this, you might be in the wrong room.

Page 5: Integrating Elasticsearch for Real-Time Analytics with Kibana

Why use ElasticSearch?

Fast full-text searchesSupports over a hundred languages

Geo-querying, scoring, facetingEasy to deploy, use and scaleHuge number of plug-insHigh buzzword count

Page 6: Integrating Elasticsearch for Real-Time Analytics with Kibana

Why these two in particular?

Both use JSON documentsComplimenting strengths:

ElasticSearch for flexible search, geolocation, analytics tools, and moreCouchbase for efficient data storage and retrieval, extremely fast response times

Couchbase uses XDCR to push data to ElasticSearchLower latency than polling, e.g. with River

Page 7: Integrating Elasticsearch for Real-Time Analytics with Kibana

Demo

Demo time!

Page 8: Integrating Elasticsearch for Real-Time Analytics with Kibana

Common use cases

Ad-hoc querying an existing Couchbase databaseGeospatial searches on dataReal-time analytics of Couchbase data

Page 9: Integrating Elasticsearch for Real-Time Analytics with Kibana

Demo

More demo time!

Page 10: Integrating Elasticsearch for Real-Time Analytics with Kibana

Putting it all together

A typical Couchbase-ElasticSearch deployment uses a 2:1 or 3:1 ratio of nodes

ElasticSearch only stores indexed dataSource data stored in CouchbaseAll CRUD operations go to Couchbase

Page 11: Integrating Elasticsearch for Real-Time Analytics with Kibana

Kibana is a dashboard for real-time visualization of streaming dataTalks directly to ElasticSearchDrag-and-drop dashboard construction

No coding required

Live analytics with Kibana

CouchbaseElasticSearch KibanaServer ClientCouchbase

Couchbase

Page 12: Integrating Elasticsearch for Real-Time Analytics with Kibana

Demo

So many demos!

Page 13: Integrating Elasticsearch for Real-Time Analytics with Kibana

Summary

Connecting Couchbase to ElasticSearch and Kibana is awesome!Lets developers and analysts focus on what each does bestProvides a resilient, scalable data storage and BI solution

Page 14: Integrating Elasticsearch for Real-Time Analytics with Kibana

Questions


Top Related