towards mobile multimodal learning analytics

© author(s) of these slides including research results from the KOM research network and TU Darmstadt; otherwise it is specified at the respective slide

19-Sep-14

Prof. Dr.-Ing. Ralf Steinmetz

KOM - Multimedia Communications Lab

EC-TEL-Workshop 2014

Towards Mobile Multimodal

Learning Analytics

Laila Shoukry

Laila Shoukry, M.Sc.

KOM – Multimedia Communications Lab 2

Why Learning Analytics on Smartphones?

KOM – Multimedia Communications Lab 3

Why Learning Analytics on Smartphones?

KOM – Multimedia Communications Lab 4

Front-Facing Camera

KOM – Multimedia Communications Lab 5

Front-Facing Camera

KOM – Multimedia Communications Lab 6

Front-Facing Camera

KOM – Multimedia Communications Lab 7

Microphone

KOM – Multimedia Communications Lab 8

Microphone

KOM – Multimedia Communications Lab 9

Microphone

KOM – Multimedia Communications Lab 10

Touch Interactions

KOM – Multimedia Communications Lab 11

App Usage

KOM – Multimedia Communications Lab 12

Background Information

KOM – Multimedia Communications Lab 13

Multimodal LA & Sensor Fusion

KOM – Multimedia Communications Lab 14

Overcoming Smartphone Limitations

KOM – Multimedia Communications Lab 15

Privacy Concerns

KOM – Multimedia Communications Lab 16

Why Learning Analytics on Smartphones?

KOM – Multimedia Communications Lab 17

Smartphone-Based Learning Analytics

Advantages:

• Unobtrusive

• Suitable for different interaction paradigms

• Constant connectivity

• Enriching logging data

• More personalization

Challenges:

• Smartphone Limitations: Processing Power,

Storage, Battery Life

• Uncontrolled Context: mobility, illumination &

exposure variation, unstable camera

• Privacy Concerns:

-> Cloud Computing, sensor-

fusion for algorithm efficiency

-> sensor-fusion

-> keeping least info: e.g.

cropping of images

KOM – Multimedia Communications Lab 18

Questions & Contact