integrating matlab analytics into enterprise applications file2 analytics understand what has...
TRANSCRIPT
![Page 1: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
Integrating MATLAB Analytics into
Enterprise Applications
Pallavi Kar
Application Engineer
![Page 2: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/2.jpg)
2
Analytics
understand what has happened,
predict what will happen, and
suggest decisions or actions.
Descriptive & Diagnostic
Predictive
Prescriptive
Apply robust, statistically-motivated methods to data produced
from complex systems to
![Page 3: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/3.jpg)
3
Enterprise Integration – Forecasting ModelForecast electricity demand for US power grids with live data from ISOs and weather stations using Neural Network
http://54.165.201.58:8080/DemandForecastWeb/demandForecast.jsp
Easy and accurate day-
ahead system load forecast
Requirements:
– Acquire and clean data
from multiple sources
– Serve Multiple requests
– Deploy to production
environment
![Page 4: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/4.jpg)
4
Deployment Scenarios
Sharing Reports Sharing & Integrating
Algorithms Deploying Industrial Analytics
Enterprise scale analytics
![Page 5: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/5.jpg)
5
Why is Deployment challenging?
Multiple internal and external consumers of MATLAB algorithms
Algorithm integration in different IT Applications and Workflows
Scaling up model for multiple (simultaneous) users and big data
+My analytic Technical InfrastructureTechnical Infrastructure
A Developer’s challenge to solve …
![Page 6: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/6.jpg)
6
How MATLAB can ease the challenges?
What about an end to end solution on one single platform!!!
MATLAB: Single Platform
Analytics Integration
• Integrate algorithms with IT
• Analytics run on Embedded targets
![Page 7: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/7.jpg)
7
Key Takeaways for Today’s Session
1. Distribute applications to MATLAB users with Apps.
2. Distribute applications to non-MATLAB users as standalone applications.
3. Integrate MATLAB functions into existing workflows and development
platforms.
4. Deploy MATLAB applications to service simultaneous user requests
enterprise-wide.
![Page 8: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/8.jpg)
8
Let’s solve them one by one…
1. Deploy MATLAB applications to service simultaneous user requests
enterprise-wide
2. Integrate MATLAB functions into existing workflows and development
platforms.
3. Distribute applications to non-MATLAB users as standalone applications.
4. Distribute applications to MATLAB users with Apps.
![Page 9: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/9.jpg)
9
Enterprise Integration – Forecasting ModelForecast electricity demand for US power grids with live data from ISOs and weather stations using Neural Network
http://54.165.201.58:8080/DemandForecastWeb/demandForecast.jsp
Easy and accurate day-
ahead system load forecast
Requirements:
– Acquire and clean data
from multiple sources
– Serve Multiple requests
– Deploy to production
environment
![Page 10: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/10.jpg)
10
Enterprise scale deployment of an Analytic
![Page 11: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/11.jpg)
11
MATLAB
Desktop
Deployed AnalyticsMATLAB Production Server
MATLAB
Production
Server
Web
Application
Server
MATLAB
Production Server
Re
qu
est B
roke
r
CTF
Apache Tomcat
Web Server/
Webservice
Weather
Data
Energy
Data
Predictive
Models
Train in
MATLAB
![Page 12: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/12.jpg)
12
MATLAB Production Server
Request
Broker
&
Program
Manager
Enterprise Application
HTTP(S)
MWHttpClient
object
Request Management
Calculation
Process
Calculation
Process
Worker Pool
Data is too big to process!
![Page 13: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/13.jpg)
13
Use MATLAB with Spark on Clusters
tall arrayor
tall tables
![Page 14: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/14.jpg)
14
Run MATLAB scripts on SPARK & HADOOP
Worker NodesMaster Name Node
Hadoop & Spark
Library
HDFS
YA
RN
Data NodesResource
Manager
Edge Node
Spark-submit script
Job submitted using Java RDD API
MATLAB workers on worker nodes in the cluster
• MDCS workers (working from MATLAB)
![Page 15: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/15.jpg)
15
MATLAB Production ServerEnterprise Class Framework For Running Packaged MATLAB Programs
Server software
– Manages packaged MATLAB
programs and worker pool
MATLAB Runtime libraries
– Single server can use runtimes
from different releases
RESTful JSON interface and
lightweight client library (C/C++, .NET,
Python, and Java)
MATLAB Production Server
MATLAB
Runtime
Request Broker
&
Program
ManagerEnterprise
ApplicationRESTful
JSON
Enterprise
Application
MPS Client
Library
![Page 16: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/16.jpg)
16
Key Takeaways
1. Distribute applications to MATLAB users royalty-free.
2. Distribute applications to non-MATLAB users royalty-free
3. Integrate MATLAB functions into existing workflows and development
platforms.
4. Deploy MATLAB applications to service simultaneous user requests
enterprise-wide.
![Page 17: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/17.jpg)
17
Sharing Solar Analysis with Python users
![Page 18: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/18.jpg)
18
Compiling Libraries
![Page 19: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/19.jpg)
19
Calling MATLAB Compiled Package from Python
![Page 20: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/20.jpg)
20
MATLAB library leveraged in Python
Retain MATLAB’s capability
![Page 21: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/21.jpg)
21
1
2
Integrate MATLAB-based Components With Your Own
Software
MATLAB
Toolboxes
MATLAB
Runtime
Application Author
Software Developer
43C/C++
Java
.NETMATLAB
ProductionServer
Python
MATLAB Compiler SDK
![Page 22: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/22.jpg)
22
Learn More
![Page 23: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/23.jpg)
23
Consumer otoscope in a mobile device
![Page 24: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/24.jpg)
24
https://www.mathworks.com/matlabcentra
l/fileexchange/53027-matlab-to-android-
made-easy-example-files
https://www.mathworks.com/matlabcentra
l/fileexchange/48954-matlab-to-iphone-
made-easy-example-files
https://www.mathworks.com/videos/matlab-to-iphone-and-android-made-easy-107779.html
Resources:
![Page 25: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/25.jpg)
25
Key Takeaways
1. Distribute applications to MATLAB users royalty-free.
2. Distribute applications to non-MATLAB users royalty-free
3. Integrate MATLAB functions into existing workflows and development
platforms.
4. Deploy MATLAB applications to service simultaneous user requests
enterprise-wide.
![Page 26: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/26.jpg)
26
![Page 27: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/27.jpg)
27
Application Deployment
![Page 28: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/28.jpg)
28
Compiling MATLAB functions
![Page 29: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/29.jpg)
29
Application Author
End User
1
2
Share Applications Built Completely in MATLAB
MATLAB
ExcelAdd-in Hadoop
StandaloneApplication
Toolboxes
MATLAB Compiler
MATLAB
Runtime3
![Page 30: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/30.jpg)
30
Can I run multiple analysis through multiple .exes?
• Do they run in parallel or serial?
• What if they need to run for
different datasets?
Resource Management??
MATLAB has solutions designed for production
environments:
• MATLAB Production Server
• MATLAB Distributed Computing Server
![Page 31: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/31.jpg)
31
ChallengeReduce waste and machine downtime in plastics manufacturing
plants
SolutionUse MATLAB to develop and deploy monitoring and predictive
maintenance software that uses machine learning algorithms to
predict machine failures
Results More than 50,000 euros saved per year
Prototype completed in six months
Production software run 24/7
Mondi Implements Statistics-Based Health Monitoring
and Predictive Maintenance for Manufacturing Processes
with Machine Learning
Link to user story
“MathWorks Consulting’s support
is among the best I’ve seen; the
consultants are fast and
exceptionally knowledgeable.
We’ve already seen a positive
return on investment from cost
savings, and now we have more
budget and time to complete
more machine learning projects
that will provide similar benefits.”
Dr. Michael Kohlert
Mondi
One of Mondi Gronau’s plastic production
machines, which deliver about 18 million tons of
plastic and thin film products annually.
![Page 32: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/32.jpg)
32
Key Takeaways
1. Distribute applications to MATLAB users royalty-free.
2. Distribute applications to non-MATLAB users royalty-free
3. Integrate MATLAB functions into existing workflows and development
platforms.
4. Deploy MATLAB applications to service simultaneous user requests
enterprise-wide.
![Page 33: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/33.jpg)
33
MATLAB Apps to share algorithms with MATLAB users
MATLAB Apps helps users prototype
algorithms faster.
You can use Apps with parallel .
Automate or generate code from
Apps.
How to package my own app?
![Page 34: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/34.jpg)
34
Key TakeawaysWhat have we learnt?
1. Distribute applications to non-MATLAB users royalty-free.
2. Integrate MATLAB functions into existing workflows and development
platforms.
3. Deploy MATLAB Analytics for Big Data on Hadoop enabled Spark
Clusters.
4. Deploy MATLAB applications to service simultaneous user requests
enterprise-wide via web or cloud frameworks.
![Page 35: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/35.jpg)
35
Write Your Programs Once
Then Share To Different Targets
MATLAB
C/C++ExcelAdd-in JavaHadoop .NET
MATLAB
Compiler
MATLABProduction
Server
StandaloneApplication
MATLAB
Compiler SDK
Apps Files
Custom Toolbox
Python
With MATLAB
Users
With People Who Do
Not Have MATLAB
MATLAB
Coder
Source Code
![Page 36: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/36.jpg)
36
Databases
Cloud
Storage
IoT
Visualization
Web
Custom App
Public Cloud Private Cloud
Technology Stack
Platform
Data Business System
MATLAB
Production Server
Analytics
Request
Broker
Azure
Blob
MATLAB
Distributed
Computing
Server
![Page 37: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/37.jpg)
37
MathWorks Services
Consulting– Integration
– Data analysis/visualization
– Unify workflows, models, data
Training
– Classroom, online, on-site
– Data Processing, Visualization, Deployment, Parallel Computing, Machine Learning
www.mathworks.com/services/consulting/
www.mathworks.com/services/training/
![Page 38: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/38.jpg)
38
Online ResourcesCall to action
• Documentation – MATLAB Production
Server
• Technical Newsletter - Data-Driven
Insights with MATLAB Analytics: An
Energy Load Forecasting Case Study
• Free White Paper – Building a Website
with MATLAB Analytics
• Website – Using MATLAB With Other
Programming Languages
• Website – MATLAB for Enterprise scale
Applications
![Page 39: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/39.jpg)
39
Speaker Details
Email: [email protected]
LinkedIn: https://www.linkedin.com/in/pallavi-kar-2a591518
Twitter: @PallaviKar2512
Contact MathWorks India
Products/Training Enquiry Booth
Call: 080-6632-6000
Email: [email protected]
Your feedback is valued.
Please complete the feedback form provided to you.
![Page 40: Integrating MATLAB Analytics into Enterprise Applications file2 Analytics understand what has happened, predict what will happen, and suggest decisions or actions. Descriptive & Diagnostic](https://reader030.vdocument.in/reader030/viewer/2022041213/5e0144ff338e970cd91d4d3c/html5/thumbnails/40.jpg)
40© 2015 The MathWorks, Inc.