assessing the benefits of advanced analytics on ...€¦ · copyright © 2019 boeing. all rights...

21
Copyright © 2019 Boeing. All rights reserved. BOEING PROPRIETARY September 2019 Andrew Hall, Director, Data Science Assessing the Benefits of Advanced Analytics on Maintenance Processes and Costs

Upload: others

Post on 06-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. BOEING PROPRIETARY

September 2019

Andrew Hall, Director, Data Science

Assessing the Benefits of Advanced Analytics on

Maintenance Processes and Costs

Page 2: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

Agree or Disagree?

The goal of predictive maintenance is to prevent AOGs.

Page 3: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 3

• Assessing Unscheduled Maintenance Costs

• Predictive Alerting

• Cost Effectiveness of Predictive Alerting

• Combining Predictive and Prescriptive Maintenance

• The Benefits of Predictive and Prescriptive Maintenance

Agenda

Page 4: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 4

• Assessing Unscheduled Maintenance Costs

• Predictive Alerting

• Cost Effectiveness of Predictive Alerting

• Combining Predictive and Prescriptive Maintenance

• The Benefits of Predictive and Prescriptive Maintenance

Agenda

Page 5: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

Flight

Disruption

Component

Repair

Maintenance

Productivity

Engineering

Costs

Repair/replace

Repair cycle time

Over/under labor

No prep time

Inspections

Tracking

Disruption costs

Customer loyalty

Assessing Unscheduled Maintenance Costs

Component

Logistics

AOG shipping

Holding costs

Page 6: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

The Primary Assertion

The application of

predictive and prescriptive

maintenance capabilities

will optimize many

categories of maintenance

cost, without compromising

operational performance or

passenger experience.

Page 7: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 7

• Assessing Unscheduled Maintenance Costs

• Predictive Alerting

• Cost Effectiveness of Predictive Alerting

• Combining Predictive and Prescriptive Maintenance

• The Benefits of Predictive and Prescriptive Maintenance

Agenda

Page 8: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.Copyright © 2019 Boeing. All rights reserved.

8

Engineer

Relevant historical data → Identify features & models → Validated alert logic

Data

Scientist

+

Developing a Predictive Alert Algorithm

Page 9: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.Copyright © 2018 Boeing. All rights reserved.

Predictive Maintenance is a “Team Sport”

Expert KnowledgePhysics / MBEReview of the findings

OEMExpertise

Machine Learning Scaled Validation

Data Infrastructure

DataScience& Tech

Predictive Maintenance

Success Smooth FlowsSmart DeploymentUrgent when neededRepair Cost Mgmt

ComponentLogistics

Data acquisition Operations Context

Planning Prioritization

Tech Ops

Asset Productivity

Efficient Maintenance

Page 10: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

Aug

2018

Sep Oct Nov Dec Jan

2019

Feb Mar Apr May Jun Jul

Air Cycle

Machine

Nose Wheel

Veering Spoiler PCU

Valve

CAC Check

ValveFuel Manifold

Cracking

CRU Clogging

Wing Tip Light

PECs

Pump

Advanced Alerts are Scaling

Page 11: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

OEM KnowledgeValidated Machine

Learning

Prognostic-Driven

Action

Example: 787 Air Cycle Machine (ACM) Predictive Alert

Page 12: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

12

Achieving Flow in Line Maintenance – ACM example

Predictive

Insights

Proactive

Plans

Information

Action

Action

Page 13: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 13

• Assessing Unscheduled Maintenance Costs

• Predictive Alerting

• Cost Effectiveness of Predictive Alerting

• Combining Predictive and Prescriptive Maintenance

• The Benefits of Predictive and Prescriptive Maintenance

Agenda

Page 14: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.Copyright © 2019 Boeing. All rights reserved.

14

Engineer or

Ops CenterMaintainer

Predictive Condition → Decision Support → Optimized Actions

Predictive Alerts Lead to Maintenance Optimization

Alerting

Software

+

Other Boeing

Applications

Page 15: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

• Imagine a ‘perfect’ alert

• Trade-off between precision

and recall, given horizon

• Costs of NFF versus cost of

Avoidable Unscheduled

Removal

• Ability-to-act is key

• Confidence in a specific

prediction

Assessing the Effectiveness of a Predictive Alert

Precision Recall

Percentage of

predictions that

are correct

Percentage of

actual events

predicted

No Fault Found

Costs

Avoidable

Unscheduled

Maintenance Cost

Vs

Page 16: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 16

• Assessing Unscheduled Maintenance Costs

• Predictive Alerting

• Cost Effectiveness of Predictive Alerting

• Combining Predictive and Prescriptive Maintenance

• The Benefits of Predictive and Prescriptive Maintenance

Agenda

Page 17: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 17

Decision Model for Maintenance Action

Diagram Source:

MIT Sloan Management Review: Spring 2017 Issue

Ajay Agrawal, Joshua S. Gans, and Avi Goldfarb

Judgment required to assess fix

effectiveness and backlog of work Action space defined by

schedule and resources

(e.g. part availability)

Prescriptive Maintenance combines

predictive alerting with resource planning

and maintenance decision support

Page 18: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

Combining Predictive and Prescriptive Maintenance

Program

Flight Schedule Labor

Inventory

Predictive Alerts

Planning Decision Support

Page 19: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 19

• Assessing Unscheduled Maintenance Costs

• Predictive Alerting

• Cost Effectiveness of Predictive Alerting

• Combining Predictive and Prescriptive Maintenance

• The Benefits of Predictive and Prescriptive Maintenance

Agenda

Page 20: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved. 20

Flight

DisruptionComponent

Repair

Maintenance

ProductivityEngineering

Costs

The Value of Predictive and Prescriptive Maintenance

Component

Logistics

Saves / avoided

Disruptions

Increased

utilization &

revenue potential

Reduced AOG

logistics costs

Reduced

holding costs

Avoid spot buys

Reduced repair

cost

Smoothed

repair cycle

time

Balance labor

supply and

demand

Lead time for

job preparation

Reduced

investigations

Prioritized mod

campaigns

Page 21: Assessing the Benefits of Advanced Analytics on ...€¦ · Copyright © 2019 Boeing. All rights reserved. OPERATE WITH CONFIDENCE. Title: Slide 1 Author: Michael Hren Created Date:

Copyright © 2019 Boeing. All rights reserved.

OPERATE WITH CONFIDENCE