monitoring the health and performance of big data environments
TRANSCRIPT
![Page 1: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/1.jpg)
www.selectstar.io
MONITORING THE HEALTH AND PERFORMANCE OF BIG DATA ENVIRONMENTS
![Page 2: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/2.jpg)
www.selectstar.io
TODAYS DBAs
The Good Old Days for DBAs
&
![Page 3: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/3.jpg)
www.selectstar.io
More data platforms. More database tools.
TODAYS DBAs
Experts in Everything?
Big Data Cloud RDBMS NoSQL
![Page 4: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/4.jpg)
www.selectstar.io
DATABASE MANAGEMENT IS DECADES BEHIND
Agile Code. Not-So-Agile DB Management.Master Feature Production
Devs QADBAs
Production
Stage
vs.
![Page 5: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/5.jpg)
www.selectstar.io
Host-centric monitoring won’t work for Hadoop.
Be Service OrientedKeep tabs on the technologies that
make up your Hadoop
ecosystem.
Monitor the Right MetricsMonitor Hadoop
alongside your other data layer
technologies.
Use a Single PlatformThe right alert settings will notify and advise
you on resolution.
Take Advantage of Alerts
4 STEPS TO BETTER HADOOP MONITORING A DECADE OF IT OPERATIONS EXPERIENCE
2 431
![Page 6: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/6.jpg)
www.selectstar.ioCLUSTER 1
CLUSTER 2
CLUSTER 3
CLUSTER 4
CLUSTER 5
CLUSTER 6
SERVICE-ORIENTEDARCHITECTURE
OTHER CLOUD MANAGERS
1
![Page 7: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/7.jpg)
www.selectstar.io
HDFS: DataNode• Blocks Removed• Blocks
Replicated• Blocks Written• Data Read• Data Written• Disk Remaining• Failed Volumes• Metric Endpoint
HDFS: NameNode• Blocks Missing• Capacity Remaining• Capacity Used• DataNodes Dead• Metric Endpoint• Volume Failures
Total
YARN: ResourceManager• NodeManagers Active• NodeManagers
Decommissioned• NodeManagers Lost• NodeManagers Rebooted• NodeManagers Unhealthy• Applications Completed• Applications Failed• Applications Running• Metric Endpoint• Queue Memory Allocated• Queue Memory Available• Users Active
YARN: NodeManager • Containers Allocated• Containers Completed• Containers Failed• Containers Launched• Memory Allocated• Memory Allocated Ratio• Memory Available• Metric Endpoint• Virtual Cores Allocated• Virtual Cores Allocated
Ratio• Virtual Cores Available• Virtual Cores Total
TOP METRICS TO MONITOR APACHE HADOOP2
![Page 8: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/8.jpg)
www.selectstar.io
Know your next steps with intelligent alerts and DBA-designed recommendations.
Embedded Expertise
INTRODUCING SELECTSTAR AGILE DATABASE MANAGEMENT
Get query-level detail and historical data on more than 95% of databases.
Data Depth and BreadthSee a single view of all your databases, wherever they reside.
Comprehensive SaaS platform
3
![Page 9: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/9.jpg)
www.selectstar.io
COVERS ALL YOUR (DATA)BASES SELECTSTAR3
![Page 10: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/10.jpg)
www.selectstar.io
Get an instant assessment of your organizations overall data health with our aggregate, customizable score.
Personalized health scoresSee which databases need attention now with our prioritized list of database cards.
Dynamic database dashboardKnow your next steps the
minute an issue arises with intelligent alerts that tell you exactly how to resolve the issue.
Actionable alerts
AGILE DATABASE MANAGEMENT
Identify Unhealthy Nodes, Clusters Instantly4
![Page 11: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/11.jpg)
www.selectstar.io
DEMO
![Page 12: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/12.jpg)
www.selectstar.io
QUESTIONS?
@getselectstar @getselectstar SelectStar.io
![Page 13: Monitoring the Health and Performance of Big Data Environments](https://reader036.vdocument.in/reader036/viewer/2022062903/58ed06641a28ab221b8b45c7/html5/thumbnails/13.jpg)
www.selectstar.io
Get started with your free trial at Selectstar.io/trial
THANK YOU