couchbase 105: realtime analytics and reporting using couchbase with elastic search + kibana, and...
TRANSCRIPT
![Page 1: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/1.jpg)
![Page 2: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/2.jpg)
Part I
People Love Monkeys
![Page 3: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/3.jpg)
Lowly Code Monkey
![Page 4: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/4.jpg)
More Experienced Code Monkey
![Page 5: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/5.jpg)
Mighty Code Ape
![Page 6: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/6.jpg)
Mostly Human Software Architect
@DavidOstrovskySenior Solutions Architect @ Couchbase
Co-author of:“Pro Couchbase Server” – Apress Media 2014
“Essentials of Developing Windows Store Apps Using C#”
“Advanced Windows Store App Development Using C#”
Big data and NoSQL nerd
CodeHardBlog.azurewebsites.net
![Page 7: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/7.jpg)
Part II
Doing Something Useful
![Page 8: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/8.jpg)
What is this all about?
Couchbase + ElasticSearch + Kibana = Awesome
![Page 9: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/9.jpg)
Why use Couchbase Server?
Document database
Scales easily
Built for performance
High throughput
Low latency
Cross-cluster replication
![Page 10: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/10.jpg)
Why use ElasticSearch?
Fast full-text searches
Supports over a hundred languages
Geo-querying, scoring, faceting
Easy to deploy, use and scale
Huge number of plug-ins
High buzzword count
![Page 11: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/11.jpg)
Why these two in particular?
Both use JSON documents
Complimenting strengths:
ElasticSearch for flexible search, geolocation, analytics tools, and more
Couchbase for efficient data storage and retrieval, extremely fast response times
Couchbase uses XDCR to push data to ElasticSearch
Lower latency than polling, e.g. with River
![Page 12: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/12.jpg)
Demo
Demo time!
![Page 13: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/13.jpg)
Common use cases
Ad-hoc querying an existing Couchbase database
Geospatial searches on data
Real-time analytics of Couchbase data
![Page 14: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/14.jpg)
Demo
More demo time!
![Page 15: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/15.jpg)
Kibana is a dashboard for real-time visualization of streaming data
Talks directly to ElasticSearch
Drag-and-drop dashboard construction
No coding required
Why use Kibana?
![Page 16: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/16.jpg)
Putting it all together
A typical Couchbase-ElasticSearch deployment uses a 2:1 or 3:1 ratio of nodes
ElasticSearch only stores indexed data
Source data stored in Couchbase
All CRUD operations go to Couchbase
CouchbaseElasticSearch KibanaServer ClientCouchbase
Couchbase
![Page 17: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/17.jpg)
Demo
So many demos!
![Page 18: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/18.jpg)
![Page 19: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/19.jpg)
Summary
Connecting Couchbase to ElasticSearch and Kibana is awesome!
Lets developers and analysts focus on what each does best
Provides a resilient, scalable data storage and BI solution
Fast and inexpensive
![Page 20: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js](https://reader033.vdocument.in/reader033/viewer/2022052912/55a209e01a28ab90368b45db/html5/thumbnails/20.jpg)
Questions