prof. darren cosker & prof. james bilzon university of

Prof. Darren Cosker & Prof. James Bilzon – University of Bath

www.camera.ac.uk / @CAMERA_Bath

D.P.Cosker@bath.ac.uk / @dopomoc

CAMERA

Applied Visual Technology: Computer Vision, Graphics,

AR, VR, Motion Capture & Analysis

Centre for Digital Entertainment (CDE)

Motion Analysis ‘in the wild’,3D/4D Capture,

Augmented Reality

Statistical Modeling of Motion,Recognition, Motion Analysis

‘in the wild’

Physical Performance Modeling and Analysis, Training, Injury Prevention and Treatment

Human Performance Enhancement Sport Analysis,

AR/VR, 3DCultural Impact

Ecomomic Impact

British SkeletonBMT Defence Services

Impact PartnersHealth,

Rehabilitation,Assistive Tech.

Injuries, DisabilitiesProsthetics

Cultural ImpactEconomic ImpactSocietal Impact

Ministry of Defence

Impact Partners

Movies, TV and Video Games

Motion Capture,Rotoscoping,

Tracking

Cultural ImpactEconomic Impact

The ImaginariumThe Foundry

Impact Partners

About CAMERA

• One of six EPSRC Digital Economy (DE) Research Hubs

• ~£5,000,000 FEC – EPSRC/AHRC (to 2020)

• ~£5,000,000 external partner contributions

• Co-created research activities/problems

• Short/Medium/Long-term collaboration mechanisms: Fundamental and Applied Research (RCUK/InnovateUK/EngD/PhD)• HARPC (Synthesia and Dimension Studios)

• DOVE (MLF and Fat Duck)

• Arthritis Flare Profiler (Living With and NHS)

• Commercial Projects (TV and Film Clients) as impact vehicles• Include REWIND, Aardman, BBC, Satore Studios, Marshmallow Laser Feast

Goal Oriented Intelligent Performance Retargeting (GRIP) Head Mounted Camera for Augmented Reality Displays (HARPC)

Deformable Objects for Virtual Environments (DOVE)

Biped to Animal (B2A)

HUMAN PERFORMANCE ENHANCEMENT

www.camera.ac.uk @CAMERA_Bath

REHABILITATION

www.camera.ac.uk @CAMERA_Bath

Professor James BilzonDirector, Centre for DisAbility Sport & HealthCo-Director, CAMERADepartment for HealthUniversity of Bath

Using new video and digital technologies to support health and wellbeing

Current Initiatives

Exergaming Imaging

Clinical Gait Analysis

Health ‘Apps’

Exergaming

Enjoyment and adherence to MICT higher for integrated video game vs. standard ergometry (Warburton et al., 2007)

Creating competition can increase exercise intensity during self-selected cycling (Shaw et al., 2016)

Could VR-exergaming be effective in increasing exercise intensity and/or enjoyment of HIIT?

Warburton et al. (2007). Appl Physiol Nutr Metab, 32.Shaw et al. (2016). PeerJ Computer Science, 2.

Exergaming

Acute exercise ✓Oliveira et al. (2018)

Short-term training studies ✓Vella et al. (2017)

Long-term real-world ?Roy et al. (2018)

Visit 1

VO2peak

HIIT

8 x 60 s @ 70% Wmax

Visits 2 + 3

Blank

Track

Visits 4 + 5

Ghost

Hard

https://www.youtube.com/watch?v=0TeOZpSoLvY&feature=youtu.be

5

Exergaming

0

50

100

150

200

250

300

350

Blank Track Ghost Hard

To

tal energ

y e

xpenditure

(kcal)

0

50

100

150

200

250

300

350

Blank Track Ghost Hard

To

tal energ

y e

xpenditure

(kcal)

*

Exergaming

Exergaming

1

2

3

4

5

6

7

Blank Track Ghost Hard

Enjo

ym

ent

*

Exergaming

• VR-exergaming increases enjoyment of acute HIIT.

• Encouraging participants to race against their own performance increases energy expenditure.

• This motivates individuals to overcome an increase in resistance and work substantially harder.

• Longitudinal studies, using modified versions (e.g. upper-body exercise) are underway.

Imaging

Mapping Amputee Residuum Change and Manufacturing Personalised, Adaptable

Prosthetic Inserts

Project Team

Prof James Bilzon, Dr Vimal Dhokia, Matthew Young, Dr Elena Seminati, Dr Martin Twiste*

The postoperative phase after lower limb amputation is characterised by residuum volume reduction (decrease in oedema-muscle atrophy).

17% and 40% of the original volume

Diurnal changes between -3.5% & +10.9%

Fitting problems reduced mobility low quality of life

Surgery

4-8 weeks post acute hospital phase

Intermediate Recovery phase (4-6 months)

Wound Healed

Transition to Stable Phase (12-18 months)

Relative Limb stabilisation

time

Imaging

Imaging

3 months post-amputation 11 months

First pilot studies (3D Scans) on human limbs

ARTEC EVA SCANNER

Imaging

Validation of the 3D ARTEC scanner

6

The Artec is a valid tool for assessing residuum volume/shape changes in lower limb amputees (validity < 2%)

Small volume fluctuations can be identified[Intra and inter-rater reliability coefficients 7 to 10-fold less than methods currently used in clinical practice (~5%)].

A

(validation study including 216 scans: 12 residual limb models, 3 operators, 3 repetitions, 2 scanners: ARTEC vs ROMER)

Imaging

25

[de Boer-Wilzing et al., 2011, APMR]

Repeatability coefficients (ml)

13.918.5

Inter-rater

Intra-rater

Imaging

Design and manufacture of the first personalised prototype liner

Design

Cryogenic CNC Machining

3 components personalised liner

Imaging

5. Mechanical tests

STATIC CONDITIONS DYNAMIC CONDITIONS

Liner Socks Liner Socks

Fibula Head 82.1 ± 4.9 89.9 ± 4.4 31.3 ± 1.5 42.4 ± 1.2#

Tibia Crest 28.8 ± 2.8 35.1 ± 3.0 9.7 ± 0.4 17.2 ± 0.4#

Cut end of the tibia 81.9 ± 1.1 198.9 ± 1.6# 39.4 ± 1.7 91.1 ± 1.3#

Max in kPa (mean ± SD)

# indicates statistical differences between the pressure measured with the liner and the socks.

All pressures were lower with the liner than the sock, which highlights the importance for cushioning the residuum.

Imaging

4

Patient preparation Scan sessions

Results

3D ARTEC SCANNER

OMEGA SCANNER

Imaging

Machining Thermal Assessment Personalised Liner

Imaging

Prevention Management

Clinical Gait Analysis

Clinical Gait Analysis

Clinical Gait Analysis

Clinical Gait Service

DMRC Headley Court

Gait Retraining Service

Clinical Gait Analysis

Clinical Gait Analysis

Unilateral vs. Bilateral vs Non-injured ControlTreadmill walking speeds between 1- 3 mph and of 3% and 5% gradients.

Group PAEE (kcal·min-1) HR (bpm)

Unilateral vs. Control 1.4 to 1.7 ↑ 1.3 to 1.5 ↑

Bilateral vs Control 2 to 2.6 ↑ 1.5 to 1.7 ↑

Unilateral vs. Bilateral 1.4 to 1.6 ↑ 1.1 to 1.3 ↑

What is the impact on:• Free-living PAEE?• Body Composition?• Cardiometabolic Health?• Integration into the

community environment?

Health ‘Apps’

R2 = 0.73; SEE = 1.01 kcal.min-1

Unilateral Amputees

Spinal Cord Injured

Health ‘Apps’

Health ‘Apps’

Thompson et al. (2015). Exerc Sport Sci Rev, 43(2): 67-74.

Health ‘Apps’

CAMERA – Rehabilitation Theme

• Exergaming technology appears to enhance effort and enjoyment during high intensity exercise.

• Imaging technology enhances the tracking and personalisation of prosthetic components.

• Clinical Gait Analysis technologies will enhance clinical decision-making and inform clinical practice.

• New personalised ‘Apps’ will help patients self-manage their condition and live and active lifestyle.

Going forward

• New Application Areas• Linking across science & tech areas: Engineering, Psychology,

Architecture, Mathematics, Policy• Robotics, Bionics, Ageing Population, Clinical Psychology

• Sustainability• Industrial Strategy Challenge Fund – Live Events, AHRC Clusters,,

InnovateUK• CDTs, Global Challenge Fund, Programme Grants• Larger facilities leading to increased research + commercial volume

and ambition

www.camera.ac.uk

www.camera.ac.uk / @CAMERA_Bath

D.P.Cosker@bath.ac.uk / @dopomoc

Prof. Darren Cosker & Prof. James Bilzon