![Page 1: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/1.jpg)
Extending Grafana to a new time-series analysis
platform with Hastic
Alexey Velikiy
![Page 2: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/2.jpg)
About Alexey Velikiy
https://github.com/jonyrockhttps://twitter.com/jonyrock
![Page 3: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/3.jpg)
I am a software engineer, who
● Makes libs, tools, plugins for Grafana and contributes into it.
● Founded CorpGlory Inc. which helps companies to solve complex monitoring tasks based on Grafana (consulting)
![Page 4: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/4.jpg)
Projects for Grafana like:
● Webpack Template for Grafana plugins developmenthttps://github.com/CorpGlory/grafana-plugin-template-webpack
● Typings for TypeScript for plugins for Grafanahttps://github.com/CorpGlory/types-grafana
● Multibar Graph Panelhttps://github.com/CorpGlory/grafana-multibar-graph-panel
● …. more: https://github.com/CorpGlory/
![Page 5: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/5.jpg)
The story
● Started a year ago● When I called Daniel Lee....
![Page 6: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/6.jpg)
Grafana is GREAT
![Page 7: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/7.jpg)
● It’s reliable metrics visualisation platform
● Most of data-sources already there● … and this is our foundation for Hastic
![Page 8: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/8.jpg)
Now I want to detect patterns
![Page 9: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/9.jpg)
These two peaks are different:
It might be also drops, jumbs, thoughts...
![Page 10: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/10.jpg)
Pattern might be weird:
![Page 11: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/11.jpg)
What is Hastic exactly?● A node.js \ python app for processing time-series data● An app for Grafana with UI for labeling and rendering
patterns● You only need a laptop to make it run
![Page 12: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/12.jpg)
Hastic-app
![Page 13: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/13.jpg)
1. Label your pattern occurrence
2. Get detections when the pattern appears
![Page 14: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/14.jpg)
3. If detection is false ...
4. You can mark is as false (negative labeling) to train Hastic
![Page 15: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/15.jpg)
Hastic-server
![Page 16: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/16.jpg)
Grafana
data
data
labels
persistence
Grafana-Datasource-kit
Time seriesDatabase
nedb
WebhooksServer
detectionswebhooks
data
![Page 17: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/17.jpg)
The Hastic project...
![Page 18: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/18.jpg)
Design principles
● Originally, is a tool to help you deal with false-positive● It is a tool, but not an ultimate solution● We make something stable first and then make a
foundation for something bigger (so now only patterns)● “Server” is stable, but analytic-units are not● You use our webhooks for alerting, but you can use it
with your alert system● You need to secure your hastic-server instance
![Page 19: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/19.jpg)
● First public announcement on Monitorama September 5, 2018
● … from that moment ...
![Page 20: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/20.jpg)
Hastic-Server:
* Features: 12* Bugfixes: 29
* Enhancements: 14
Hastic-App:
* Features: 9* Bugfixes: 17
* Enhancements: 11
![Page 21: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/21.jpg)
HighlightsGraphite / Prometheus / ElasticSearch / PostgreSQL / TimescaleDB support.
Positive / Negative labels
Threshold detector
RPM
Panel -> Application
Webhooks.
Reduce amount of required labeled segments for learning (>=1)
Parallel learning for analytic units
Decouple "analytics" and "server" processes to different docker containers.
![Page 22: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/22.jpg)
Hastic is BETA NOW!
![Page 24: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/24.jpg)
![Page 25: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/25.jpg)
A new platform?
● You can create your “Detectors” for detecting anomalies and apply custom statistical modelsIt is a python class to implement
● You can make Grafana plugins with Hastic’s API for detecting not only single-value metrics, but geospatial, graph, text data
![Page 26: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/26.jpg)
Our business model
We are inspired by Grafana
● Hastic as a service● Hastic on-premise● Paid services and consulting
![Page 27: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/27.jpg)
Thanks too...
![Page 28: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/28.jpg)
Grafana LabsFor a great support
![Page 29: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/29.jpg)
American Consulate in WarsawFor processing my emergency case
![Page 30: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/30.jpg)
CorpGlory Dev teamFor hard work
@rozetko, @amper43, @VargBurz, @sanke1
![Page 31: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/31.jpg)
My girlfriendinstagram.com/katetito
![Page 32: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/32.jpg)
MonitoramaFor spreading the first word about us
@obfuscurity
![Page 33: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/33.jpg)
Our early adoptersFor testing and features requests
![Page 34: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/34.jpg)
You guysFor making this day so awesome
![Page 35: Extending Grafana to a new time-series analysis platform ......2019/03/01 · I am a software engineer, who Makes libs, tools, plugins for Grafana and contributes into it. Founded](https://reader033.vdocument.in/reader033/viewer/2022060905/60a02997e25a1d4c6115fff6/html5/thumbnails/35.jpg)
Our contacts:https://github.com/hastichttps://hastic.io/
For all your inquiries:[email protected]
Thank you!