monitoring the health and performance of big data environments

13
www.selectstar.io MONITORING THE HEALTH AND PERFORMANCE OF BIG DATA ENVIRONMENTS

Upload: selectstar-powered-by-blue-medora

Post on 11-Apr-2017

160 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

MONITORING THE HEALTH AND PERFORMANCE OF BIG DATA ENVIRONMENTS

Page 2: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

TODAYS DBAs

The Good Old Days for DBAs

&

Page 3: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

More data platforms. More database tools.

TODAYS DBAs

Experts in Everything?

Big Data Cloud RDBMS NoSQL

Page 4: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

DATABASE MANAGEMENT IS DECADES BEHIND

Agile Code. Not-So-Agile DB Management.Master Feature Production

Devs QADBAs

Production

Stage

vs.

Page 5: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

Host-centric monitoring won’t work for Hadoop.

Be Service OrientedKeep tabs on the technologies that

make up your Hadoop

ecosystem.

Monitor the Right MetricsMonitor Hadoop

alongside your other data layer

technologies.

Use a Single PlatformThe right alert settings will notify and advise

you on resolution.

Take Advantage of Alerts

4 STEPS TO BETTER HADOOP MONITORING A DECADE OF IT OPERATIONS EXPERIENCE

2 431

Page 6: Monitoring the Health and Performance of Big Data Environments

www.selectstar.ioCLUSTER 1

CLUSTER 2

CLUSTER 3

CLUSTER 4

CLUSTER 5

CLUSTER 6

SERVICE-ORIENTEDARCHITECTURE

OTHER CLOUD MANAGERS

1

Page 7: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

HDFS: DataNode• Blocks Removed• Blocks

Replicated• Blocks Written• Data Read• Data Written• Disk Remaining• Failed Volumes• Metric Endpoint

HDFS: NameNode• Blocks Missing• Capacity Remaining• Capacity Used• DataNodes Dead• Metric Endpoint• Volume Failures

Total

YARN: ResourceManager• NodeManagers Active• NodeManagers

Decommissioned• NodeManagers Lost• NodeManagers Rebooted• NodeManagers Unhealthy• Applications Completed• Applications Failed• Applications Running• Metric Endpoint• Queue Memory Allocated• Queue Memory Available• Users Active

YARN: NodeManager • Containers Allocated• Containers Completed• Containers Failed• Containers Launched• Memory Allocated• Memory Allocated Ratio• Memory Available• Metric Endpoint• Virtual Cores Allocated• Virtual Cores Allocated

Ratio• Virtual Cores Available• Virtual Cores Total

TOP METRICS TO MONITOR APACHE HADOOP2

Page 8: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

Know your next steps with intelligent alerts and DBA-designed recommendations.

Embedded Expertise

INTRODUCING SELECTSTAR AGILE DATABASE MANAGEMENT

Get query-level detail and historical data on more than 95% of databases.

Data Depth and BreadthSee a single view of all your databases, wherever they reside.

Comprehensive SaaS platform

   

3

Page 9: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

COVERS ALL YOUR (DATA)BASES SELECTSTAR3

Page 10: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

Get an instant assessment of your organizations overall data health with our aggregate, customizable score.

Personalized health scoresSee which databases need attention now with our prioritized list of database cards.

Dynamic database dashboardKnow your next steps the

minute an issue arises with intelligent alerts that tell you exactly how to resolve the issue.

Actionable alerts

AGILE DATABASE MANAGEMENT

Identify Unhealthy Nodes, Clusters Instantly4

Page 11: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

DEMO

Page 12: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

QUESTIONS?

@getselectstar @getselectstar SelectStar.io

Page 13: Monitoring the Health and Performance of Big Data Environments

www.selectstar.io

Get started with your free trial at Selectstar.io/trial

THANK YOU