Explore the Future of Mining with Immersive Technologies

Afzal Jessa, Chief Digital Officer, ValeSrinivasan Natarajan (Nat), Associate Vice President, Infosys Center for

Emerging Technology Solutions

EXPLORE THE FUTURE OF

MINING WITH

IMMERSIVE TECHNOLOGIES

Afzal JessaChief Digital Officer

Vale

Srinivasan “Nat” NatarajanAssociate Vice President

Infosys Center for Emerging Technology solutionsInfosys Ltd

How many of you have..

- Watched a 3D movie?

- Played Minecraft or Pokémon Go?

- Played a Virtual Reality game?

What does this have to do

with MINING? !!

Future of work is rapidly being shaped by digital technology

advancements

WORKFORCE

DEMOGRAPHY

TECHNOLOGY

ADVANCEMENTS

BUSINESS

OBJECTIVES

FUTURE

OF

WORK

The Future of Work is shaped by the

decisions of business today in

response to the evolving market,

technological and geo-political

forces.

- Safety

- Environment

Advancements in Cloud platforms,

Industrial IOT, Artificial Intelligence,

Experience technologies & Network

Infrastructure (5G) are transforming

the way businesses are run.

Businesses that lead the way in their digital

transformation journey would do well to

prepare for the demographic shifts to its

workforce to navigate this transformation

successfully.

Immersive Technologies

Technologies that extend the

reality using 360 space to

create an extended digital

environment or an experience

Take inputs through gaze,

gestures, motion, sensors or

physical controllers

VIRTUAL REALITY

AUGMENTED REALITY

MIXED REALITY

360 DEGREE EXPERIENCE

SURROUND SOUND EXPERIENCE

HAPTIC

Emerging Trends Tree©

for Mining industry

© Infosys Ltd 2019

Augmented Reality – A new way to interact with the real world

Augmented Reality (AR) provides a live view of a physical, real-world environment which are augmented by

computer-generated input such as information, sound, video, graphics, or GPS dataSource: Wikipedia

ARReal

World

Virtual

Layer

Devices

Cast AR Moverio Meta Vuzix

Sony Smart Eye

Glass

Google

GlassMobile / Tablets

▪ Industrial Maintenance

▪ Gaming

▪ Marketing & Advertisement – AR Out-store

Experience

▪ Location based services & Navigation

▪ Education & Training

Virtual Reality – Transforming every sphere of our lives

Virtual reality (VR), also known as immersive multimedia or computer-simulated reality, is a computer

technology that replicates an environment, real or imagined, and simulates a user's physical presence and

environment to allow for user interactionSource: Wikipedia

VR Virtual WorldReal World

Inputs

Oculus

Rift/Quest/G

o

Microsoft

HoloLens

Sony

PlayStation

VR

▪ Industrial – Training and learning

▪ Retail – Virtual Catalogue & Fitting Rooms

▪ Technology -Virtual Designing & Modelling

▪ Marketing – Virtual Test Drives

▪ Hotel Industry – Virtual Vacations

▪ Education & Training

Major VR Use Cases

HTC Vive

Popular VR Devices

Mixed Reality – Embraces VR & AR to create new reality

Opportunities to apply immersive technologies in Mining

▪ Planning & simulation

▪ 3D & 360 VR exploration

of surface &

underground mines

▪ Designing & Modelling

▪ Virtual Maps &

Navigation

▪ Digital Twins

▪ Predictive

maintenance

▪ Remote assisted

maintenance

▪ Real-life immersive

simulations

▪ Immersive Safety training

▪ Interactive Learning

▪ Remote collaboration

with experts

▪ Remote

collaboration with

3D content

▪ Data visualization

Operations &

Maintenance

Education ,

Learning &Training

Collaboration &

Data VisualizationPlanning and

Exploration

VR & AR MR & ARARVR

Case Study: Mixed reality based collaboration experience

▪ Enables all members to visualize the real-time state of

the mines from remote locations, Visualize data, and

monitor the mines

▪ Participants can collaborate over the model with

changes and annotations visible to all, and collectively

arrive at the best action to be taken.

CASE STUDY: Mixed reality based collaboration experience

▪ Enables all members to visualize the real-time

state of the mines from remote locations,

Visualize data, and monitor the mines

▪ Participants can collaborate over the model with

changes and annotations visible to all, and collectively

arrive at the best action to be taken.

CASE STUDY: Mixed reality based collaboration experience

Digital Twin of Jet Turbine on AWS

3D Printed Turbine Instrumented with

Temperature and RPM sensors

Digital Twin of Turbine

• Immersive experience is enabled via

Sumerian AR, Quick Sight and Lex Bot

based front end to visualize the data and

interact with the physical asset

• Instrumented sensors such as RPM

and Temperature stream data via

gateway to the AWS cloud where

the aggregation and analysis is

performed

• The solution is built completely on AWS IoT stack

and leverages AWS Sagemaker to apply machine

learning techniques on the acquired data to derive

predictive maintenance insights

Digital Twin of Jet turbine with Microsoft HoloLens

• Remote Maintenance – Technicians can remotely

manage the entire physical asset and uncover

operational inefficiencies

• Reduce Downtime – Predicting the health of the

asset in advance leveraging the real time

operational & health parameters along with

historical data

• Education & Training – Digital twins can be used

a medium to educate and train the engineers

about the product & complex processes involved

• Continuous Improvement - Understand the

operational behavior of the assets throughout

their life cycle

Benefits of Virtual Reality based training

1 Safe training environment

2Create realistic training scenarios with repetition &/or

random scenarios

3 Remote training in with collaboration with an expert

4 Increase trainee focus with immersion and gamification

5 Create site specific customized training

6 Lower training cost