sergey a. razin ph.d., chief technology officer, sios technology at mlconf sea - 5/01/15
TRANSCRIPT
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
Clusters Your Way.™
Machine Learning as The Key Ingredient to
“self-driving data center”
Applying Machine Learning to the Cloud
Sergey A. Razin, CTO, SIOS Technology Corp.
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
2
Who is SIOS?
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
Founded in 1999
Formerly Steeleye Technology
Headquarters in San Mateo, CA
Offices across the US, UK and Japan
Recognized experts in application availability
More than 50,000 licenses installed globally
in a wide range of industries
Partners are industry leaders
Who is SIOS?
3
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
4
How did we start?
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
How did we start?
5
™
Network Security
Speech Recognition
Signal Processing
Human Behavior Analysis
Datacenter Analytics
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
6
MLConf=> (who-is-sios? "BI")
"no“
MLConf=> (who-is-sios? "IToA")
"yes"
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
7
How did IT start?
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
8
How did IT started?
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
9
How did IT started?
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
10
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
11
COMPLEXITY
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
Gap in tools
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
Gaps in Current Approaches
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
?
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
15
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
16
Goodbye, Big Data!
Hello, Smart Data!
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
Source: http://www.itoa-landscape.org/
IT Operations Analytics
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
18
SIOS SemanticIO™
Platform
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
SemanticIO™ - 5 Key Requirements
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.20
SemanticIO - Process
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
SemanticIO™ Platform
Provider Framework
Open Consumer API
vGraph™ Analytics Engine
Algorithm Plugins
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
22
Semi-supervised
Root Cause Analysis
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
23
Root Cause Analysis – “Noisy Neighbor”
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
24
Anomaly Detection – K-means Clustering
Root Cause Analysis – Anomaly Detection
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
25
Root Cause Analysis – Topological
Analysis
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
26
Root Cause Analysis – Causal Network
Algorithm (Naïve Bayes based)
Object type: VM
Observation: Latency
Object type: VM
Priors: 25%
Posterior: 5%
Object type: DS
Priors: 50%
Posterior: 50%
Object type: Storage
Observation: Latency
Prior Probabilities
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
27
Root Cause Analysis – Recommendations
Object type: VM
Observation: Latency
Object type: VM
Priors: 25%
Posterior: 5%
Object type: DS
Priors: 50%
Posterior: 50%
Object type: Storage
Observation: Latency
Recommendation
Priors: 25%
Posterior: 5%
Description: Offload
the shared resource.
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
28
Root Cause Analysis – Recommendations
and Semi-supervised Input
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
29
Crowdsourcing
Of IToA
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
30
Crowdsourcing
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
31
Want to See It
in Action?http://us.sios.com/
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
SIOS iQ™
Machine Learning Analytics for optimizing
VMware environments
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
33
Clusters Your Way.™
Copyright © 2014 SIOS Technology Corp. All Rights Reserved.
Sergey A. Razin, Ph.D.
Chief Technology Officer
SIOS Technology Corp.
Email: [email protected]
LinkedIn: http://www.linkedin.com/in/sergeyrazin
Follow me: http://www.twitter.com/TechDozor
Read me: http://blog.techdozor.org