beyond the “i” in ai€¦ · there are many ways artificial intelligence can fail no data...

54
© 2019 The MathWorks, Inc. 1 Beyond the “I” in AI Chris Hayhurst

Upload: others

Post on 28-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 1

Beyond the “I” in AI

Chris Hayhurst

Page 2: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 2

Watt Steam Engine

Page 3: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 3

Artificial intelligence is a transformative technology

based on McKinsey’s latest AI forecast – September 2018

Seoul National University Hospital

Page 4: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 4

AI has tremendous potential to increase productivity

3x

AI 4x

2x

=

Page 5: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 5

Yet AI is struggling

Why Most AI Projects Fail

Oct, 2017

Most AI Projects Fail. Here’s

How to Make Yours Successful.

July, 2018

3 Common Reasons Artificial

Intelligence Projects Fail

May, 2018

Page 6: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 6

TayTweets AI project taken down within 24 hours

March 24, 2016

Page 7: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 7

There are many ways Artificial Intelligence can fail

No data

scientists

Not enough data

Too much data

Problem is a

poor fit for AI

Poor ROI

Beyond the skill

of the team

Problem is

unsolvable

Incomplete

tools

Can’t integrate with

other systems

Page 8: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 8

AI is more than just the intelligence of the algorithm

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 9: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 9

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 10: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 10

Bring human insights into AI

Select data

Make tradeoffs

Evaluate results

AI

Page 11: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 11

Improving New Zealand Dairy Processing

• University of Auckland

• Auckland University of Technology

Page 12: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 12

Continuous

Plant

ProcessPowdered MilkRaw Milk

Days later

Page 13: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 13

Powdered Milk

Raw Milk

AI modelPlant Variables Predict Results

Near real-time

Page 14: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 14

Powdered Milk

Raw Milk

They had lots of data

Plant Variables

• Millions of data points

• 3 plants

• 6 years

Page 15: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 15

Powdered Milk

Raw Milk

But…

AI modelPlant Variables

Page 16: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 16

Key Insights Made

1. Predictions were wrong

Page 17: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 17

Key Insights Made

1. Predictions were wrong

2. Need to build a separate

model for each plant

Plants behaved differently

from each another

Page 18: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 18

Key Insights Made

1. Predictions were wrong

2. Need to build a separate

model for each plant

3. Plant’s operating state

changes each year

Each year was like a

completely different plant

Page 19: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 19

Tru

e C

lass

Predicted Class

Bulk density prediction results were inaccurate

• Many false positives

• Unused classes

Page 20: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 20

Key Insights Made

1. Predictions were wrong

2. Need to build a separate

model for each plant

3. Plant’s operating state

changes each year

4. Training data was biased

Page 21: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 21

Tru

e C

lass

Predicted Class

100%

90%

83%

93%

93%

93%

97%

10%

10%

3%3%

3%

3%

3%

3% 3%

3%

3%

Resampling data resulted in higher predictive accuracy

• Resampled data

• Reduced the number of bins

Page 22: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 22https://imgur.com/gallery/8B5Tx

“It’s great to sit down with our industry

partners and watch their jaws drop when

they see how productive we are with

MATLAB and how quickly we can

analyze and plot data.”

- David Wilson, Industrial Information

and Control Centre

Page 23: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 23

To be successful with AI, you must …

Combine AI model building

with scientific and engineering insights

Page 24: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 24

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 25: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 25

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 26: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 26

Implementation is about designing the solution

Testing

Data analysis

Reporting

Developing concept

Prototyping

Deployment

Requirements building

Modeling and simulation

Verification and validation

Page 27: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 27

“Deliver on the promise of self-driving cars today.”

Page 28: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 28

Voyage’s goal was to quickly get to market

1. Target retirement communities

Page 29: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 29

Voyage’s goal was to quickly get to market

1. Target retirement communities

2. Use off-the-shelf components

wherever possible

Page 30: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 30

Voyage’s goal was to quickly get to market

1. Target retirement communities

2. Use off-the-shelf components

wherever possible

3. Bring in the right software tools

across the entire workflow

Page 31: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 31

Voyage completed their AI system first

AI

Perception

System

Page 32: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 32

But they needed to connect the AI to the rest of the system

AI

Perception

System

Vehicle

Control

System

Vehicle

Dynamics

Environment

Page 33: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 33

Started with Simulink example that they could build upon

Page 34: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 34

Started with Simulink example that they could build upon

Find out more:

자율시스템을위한센서융합및추적

센서신호처리및무선기술

서기환

Page 35: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 35

Deployed controller as ROS node and generated code

Robotics System Toolbox

Embedded Coder

Page 36: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 36

Train your AI faster with tight simulation loops

Field Data Algorithms

Usage

Better

Synthetic

Data

Simulated

Usage

Page 37: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 37

One example of leveraging simulation for data synthesis

Simulation workflow

Simulate Auto-label

Traditional workflow

Record Label

Transfer

Learning

AI model

Preliminary

AI model

Page 38: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 38

“Simulink + ROS allowed us to

deploy a Level 3 autonomous

vehicle in less than 3 months.”

− Alan Mond, Voyage

Page 39: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 39

To be successful with AI, you must …

Use tool chains that span

the entire design workflow

Page 40: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 40

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 41: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 41

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 42: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 42

Integration with complex systems

Page 43: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 43

What was the larger system the vehicle had to operate in?

Page 44: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 44

“Proactive patient care”

Page 45: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 45

Statistics and Machine Learning Toolbox

Signal Processing Toolbox

MATLAB Coder

Embedded Coder

Page 46: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 46

EarlySense’s AI can predict critical events before they happen

Continuous

Monitoring

Early

Detection

Early

Intervention

Better

Outcomes

AI AI

Page 47: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 47

Integrate into nurses’ stations

and hallway monitors

Page 48: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 48

Integrate with hand-held

devices carried by staff

Page 49: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 49

Address problems before they

become emergencies

Page 50: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 50

To be successful with AI, you must …

Design how our systems will

integrate and interact within their environment

Find out more:

딥러닝과강화학습

인공지능과딥러닝

김종남

Page 51: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 51

Summary

▪ AI is a transformative technology

▪ But AI projects can and do fail

▪ Success requires more than just intelligence

Page 52: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 52

Page 53: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 53

Intelligence

Integration

Insights

Implementation

Apply domain

expertise

Connect with

other systems

Span the entire

design workflow

Page 54: Beyond the “I” in AI€¦ · There are many ways Artificial Intelligence can fail No data scientists Not enough data Too much data Problem is a poor fit for AI Poor ROI Beyond

© 2019 The MathWorks, Inc. 54

How will you apply AI to your projects?

We have the right tools → MATLAB and Simulink

–Discover and apply insights to fully understand your system

–Implement your complete system across the entire workflow

–Design the systems which will integrate into a larger world