analyzing fleet test data · 2 topics reasons for analyzing fleet data matlab datatypes for...
TRANSCRIPT
![Page 1: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
Analyzing Fleet Test DataMaster Class
Seth DeLand
![Page 2: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/2.jpg)
2
Topics
Reasons for analyzing fleet data
MATLAB datatypes for improved productivity
Scaling up analysis with mapreduce and parallel computing
Machine Learning
Moving to production
![Page 3: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/3.jpg)
3
Why Analyze Fleet Data?
Big-picture view that was previously unavailable
Design Decisions
– Real-world fuel economy
– Emissions
– Vehicle dynamics
– Ride and handling
– Prognostics
– Durability
Algorithm Validation
– Engine
– Prognostics
– ADAS
– Hybrid/EV
![Page 4: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/4.jpg)
4
Accessing Fleet Data
File I/O• Text
• Spreadsheet
• XML
• CDF/HDF
• Image
• Audio
• Video
• Geospatial
• Web content
Hardware Access• Data acquisition
• Image capture
• GPU
• Lab instruments
Communication Protocols• CAN (Controller Area Network)
• DDS (Data Distribution Service)
• OPC (OLE for Process Control)
• XCP (eXplicit Control Protocol)
Database Access• ODBC
• JDBC
• HDFS (Hadoop)
![Page 5: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/5.jpg)
5
New MATLAB Datatypes
Table
– Mixed-type tabular data
– Flexible indexing
– Built-in functionality (merge, sort,
join, etc.)
Datetime
– Time stamps, Durations
– Add, subtract, sort, compare, plot
– Customize display formats
– Nanosecond precision
![Page 6: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/6.jpg)
6
Working with Fleet Data
Goals
Import data from different sources
Clean-up and preprocess data
Merge data
Share analysis with others
![Page 7: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/7.jpg)
7
Scaling up analysis
Parallel Computing Toolbox
– MATLAB worker on each core of your desktop
– Loops: for -> parfor
– Built-in support in many functions
– MATLAB Distributed Computing Server
Map-Reduce
– Datastore for accessing data
– Mapreduce for processing data
– Run on Hadoop, or on MATLAB Distributed
Computing Server
![Page 8: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/8.jpg)
8
Event Detection
Parse data, find sudden deceleration
Map Reduce workflow
– Serial on Desktop
– Parallel on Desktop
– Point to HDFS
– Deploy to Hadoop
![Page 9: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/9.jpg)
9
Machine Learning
Machine learning uses data and produces a program to perform a task
Standard Approach Machine Learning Approach
𝑚𝑜𝑑𝑒𝑙 = <𝑴𝒂𝒄𝒉𝒊𝒏𝒆𝑳𝒆𝒂𝒓𝒏𝒊𝒏𝒈𝑨𝒍𝒈𝒐𝒓𝒊𝒕𝒉𝒎
>(𝑠𝑒𝑛𝑠𝑜𝑟_𝑑𝑎𝑡𝑎, 𝑎𝑐𝑡𝑖𝑣𝑖𝑡𝑦)
Computer
Program
Machine
Learning
𝑚𝑜𝑑𝑒𝑙: Inputs → OutputsHand Written Program Formula or Equation
If X_acc > 0.5
then “SITTING”
If Y_acc < 4 and Z_acc > 5
then “STANDING”
…
𝑌𝑎𝑐𝑡𝑖𝑣𝑖𝑡𝑦= 𝛽1𝑋𝑎𝑐𝑐 + 𝛽2𝑌𝑎𝑐𝑐+ 𝛽3𝑍𝑎𝑐𝑐 +
…
Task: Human Activity Detection
![Page 10: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/10.jpg)
10
Overview – Machine Learning
![Page 11: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/11.jpg)
11
Clustering ExampleGear Selection
Goal
Given data for engine speed and
vehicle speed, identify clusters of data using kmeans
Other applications
– Separating different operating conditions
– Clustering driver/buyer types
![Page 12: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/12.jpg)
12
Classification ExampleHuman Activity Learning Using Mobile Phone Data
Machine
Learning
Data:
3-axial Accelerometer data
3-axial Gyroscope data
Other applications:
ADAS: Ground-truth
Predictive Maintenance
![Page 13: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/13.jpg)
13
Overview – Machine Learning
![Page 14: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/14.jpg)
14
Analysis Domains
![Page 15: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/15.jpg)
15
Taking MATLAB to Production
![Page 16: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/16.jpg)
16
Additional Resources
![Page 17: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/17.jpg)
17
MathWorks Services
Consulting– Integration
– Data analysis/visualization
– Unify workflows, models, data
Training
– Classroom, online, on-site
– Data Processing, Visualization, Deployment, Parallel Computing, Machine Learning
www.mathworks.com/services/consulting/
www.mathworks.com/services/training/
![Page 18: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/18.jpg)
18
Summary
Reasons for analyzing fleet data
MATLAB datatypes for improved productivity
Scaling up analysis with mapreduce and parallel computing
Machine Learning
Moving to production
![Page 19: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine](https://reader036.vdocument.in/reader036/viewer/2022070702/5e6ca0f41883b650d0738d6b/html5/thumbnails/19.jpg)
19© 2015 The MathWorks, Inc.
Questions?