monitoring*the*industrial*internetof*things*...enernoc’s*energy*intelligence*sotware*...
TRANSCRIPT
![Page 1: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/1.jpg)
Copyright © 2016 Splunk Inc.
Chris Winkler Performance Engineering Team Lead, EnerNOC
Monitoring The Industrial Internet Of Things A Guide To ApplicaIon Performance Monitoring In Splunk
![Page 2: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/2.jpg)
Disclaimer
2
During the course of this presentaIon, we may make forward looking statements regarding future events or the expected performance of the company. We cauIon you that such statements reflect our current expectaIons and esImates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward-‐looking statements, please review our filings with the SEC. The forward-‐looking statements made in the this presentaIon are being made as of the Ime and date of its live presentaIon. If reviewed aTer its live presentaIon, this presentaIon may not contain current or
accurate informaIon. We do not assume any obligaIon to update any forward looking statements we may make. In addiIon, any informaIon about our roadmap outlines our general product direcIon and is
subject to change at any Ime without noIce. It is for informaIonal purposes only and shall not, be incorporated into any contract or other commitment. Splunk undertakes no obligaIon either to develop the features or funcIonality described or to include any such feature or funcIonality in a future release.
![Page 3: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/3.jpg)
Agenda
• EnerNOC Intro
• Performance Engineering Intro
• Splunk and EnerNOC
• Epiphanies
• Q&A
3
![Page 4: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/4.jpg)
EnerNOC’s Energy Intelligence SoTware For enterprises: pla[orm and soluIons focus on the 3 drivers of energy expense
How you buy it
Budgets and Procurement
Utility Bill Management (UBM)
How much you use
Visibility and Reporting
Facility Optimization Project Tracking
When you use it
Demand Response
Demand Management
![Page 5: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/5.jpg)
EnerNOC EIS Pla;orm
EnerNOC Database Servers
Cloud Hosted Database Servers
EnerNOC Hosted Web
Servers
EnerNOC Hosted
Application Servers
Cloud Hosted Web
Servers
Cloud Hosted
Application Servers
32TB Persisted
4000/1000 Users Daily/Hourly 100 Countries
Data Streaming and Processing at Scale
5
![Page 6: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/6.jpg)
About Chris
6
Performance Engineering Team Lead @ EnerNOC since 2011
#1 Goal – Improve customers' experience while ensuring reliable and scalable applicaIons are delivered into producIon
Started using Splunk to parse data from web logs in March 2012 – Self proclaimed winner of the “Best Splunk Index” award at EnerNOC ,
3 years in a row Fostering a culture of performance at EnerNOC
![Page 7: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/7.jpg)
“Bet your Business” pla[orm
Team Mission: Ensure Pla[orm Scalability & Stability
![Page 8: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/8.jpg)
QuesIons We Want Answers To:
Q: How fast can we reduce energy consumpIon across all of the buildings in a region? Q: How quickly can we send Demand Response noIficaIons? Q: How quickly are we processing device readings into our pla[orm Q: Who is using our pla[orm? Q: How many people logged into each of our applicaIons today? Q: What did they do aTer logging in? Q: How was their experience?
Answer before Splunk:
![Page 9: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/9.jpg)
Where Did We Start With Splunk?
• 2012 Splunk POC – Web logs forwarded into Splunk for analysis
• 2013 Splunk On-‐site training
![Page 10: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/10.jpg)
Where Are We Now?
![Page 11: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/11.jpg)
My Splunk Epiphany • index=server "logged in" | timechart span=10m count
![Page 12: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/12.jpg)
Which Led To: • index=web | timechart span=2m dc(userName)
![Page 13: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/13.jpg)
Which Led To:
![Page 14: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/14.jpg)
• UserId • Method • Elapsed Ime
Secret Sauce: InstrumentaIon
![Page 15: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/15.jpg)
Epiphany #2 Use Splunk to monitor criIcal business processes: interval data collecIon
• Are we meeIng our data collecIon SLA and can we proacIvely alert on data latency problems?
• How long does it take for readings to be processed and available to our front end applicaIons?
• Does our data collecIon process scale?
• What are the interval collecIon counts, by device type, over Ime?
Challenge: Our meter data needs to be fresh, accurate, and available to our customers.
![Page 16: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/16.jpg)
Data CollecIon: From Device To Disk
Device Data Needs To Be Available To Our Front End Apps Quickly
![Page 17: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/17.jpg)
Data CollecIon Architecture
s s
![Page 18: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/18.jpg)
Performance Budget and InstrumentaIon Requirements
Interval available to front end apps
KPI’s: Start and End Imestamps of each component
Interval Timestamp
![Page 19: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/19.jpg)
Secret Sauce: Instrument the Incoming Data • Data stream ID • Device type • Reading value • Source Imestamp • Processed Imestamp
![Page 20: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/20.jpg)
Data CollecIon Dashboard
![Page 21: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/21.jpg)
Epiphany #3 Use Splunk to monitor our pla[orm during Demand Response events
• How quickly have our devices responded to our control commands? • How many devices can be curtailed within SLA? Does our pla[orm scale? • How does today’s performance compare to the past?
Challenge: When EnerNOC is dispatched by a grid operator, we have to reduce energy consumpIon across a region...FAST!!!
![Page 22: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/22.jpg)
Secret Sauce: Monitor Device Workflow States
• Monitoring enhanced to capture device workflow states
![Page 23: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/23.jpg)
Monitoring Device States During Demand Response Event KPI’s highlighted in the top row
Count of meters as they progress through all phases of the event
Performance comparison to recent events
Key Takeaway: Log KPI’s to track performance in Splunk
![Page 24: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/24.jpg)
Epiphany #4: Use Splunk to monitor NoIficaIon Pla[orm Performance
• How long did it take to send out the noIficaIons?
• How many noIficaIons were sent?
• Does our noIficaIon process scale? How many can we send within our SLA?
Challenge: When EnerNOC is dispatched by a grid operator, we have to noIfy our customers…..FAST!!!
![Page 25: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/25.jpg)
NoIficaIon InstrumentaIon Requirements
First Step: breakdown architecture and idenIfy KPI’s Dispatch
Trigger
AcIon CreaIon
Build NoIficaIon Payload
Send Payload to Provider
Time for Provider to send ISP Time Time to open
NoIficaIon
EnerNOC Company ConfidenDal
• Start and end Imestamps of each component • Unique idenIfier for each noIficaIon event (allows us to find the needle in the haystack
![Page 26: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/26.jpg)
NoIficaIon Performance Dashboard
Key Takeaway: Instrument your code and log KPI’s to track performance in Splunk
![Page 27: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/27.jpg)
Key Takeaways • Use Splunk to visualize performance of your IOT infrastructure
• Breakdown the anatomy of your applicaIon & idenIfy the KPI’s
• Instrument your applicaIon to capture the KPI’s
• Create Performance Dashboards for criIcal business processes
![Page 28: Monitoring*The*Industrial*InternetOf*Things*...EnerNOC’s*Energy*Intelligence*SoTware* For*enterprises:*plaorm*and*soluIons*focus*on*the*3*drivers*of* energyexpense Howyoubuyit Budgets](https://reader034.vdocument.in/reader034/viewer/2022042118/5e972a2f84cd91610818d49e/html5/thumbnails/28.jpg)
Business Benefit
• PromoIng a culture of performance:
• Increased visibility in performance metrics = increased incenIve to make apps faster
• Performance monitoring against SLA’s in development and producIon
• In depth understanding of our limitaIons/capabiliIes
• AlerIng of performance issues to minimize custom impact