towards mobile multimodal learning analytics
DESCRIPTION
My EC-TEL 2014 Presentation for the Workshop: Learning Analytics for and in Serious GamesTRANSCRIPT
© author(s) of these slides including research results from the KOM research network and TU Darmstadt; otherwise it is specified at the respective slide
19-Sep-14
Prof. Dr.-Ing. Ralf Steinmetz
KOM - Multimedia Communications Lab
EC-TEL-Workshop 2014
Towards Mobile Multimodal
Learning Analytics
Laila Shoukry
Laila Shoukry, M.Sc.
KOM – Multimedia Communications Lab 2
Why Learning Analytics on Smartphones?
KOM – Multimedia Communications Lab 3
Why Learning Analytics on Smartphones?
KOM – Multimedia Communications Lab 4
Front-Facing Camera
KOM – Multimedia Communications Lab 5
Front-Facing Camera
KOM – Multimedia Communications Lab 6
Front-Facing Camera
KOM – Multimedia Communications Lab 7
Microphone
KOM – Multimedia Communications Lab 8
Microphone
KOM – Multimedia Communications Lab 9
Microphone
KOM – Multimedia Communications Lab 10
Touch Interactions
KOM – Multimedia Communications Lab 11
App Usage
KOM – Multimedia Communications Lab 12
Background Information
KOM – Multimedia Communications Lab 13
Multimodal LA & Sensor Fusion
KOM – Multimedia Communications Lab 14
Overcoming Smartphone Limitations
KOM – Multimedia Communications Lab 15
Privacy Concerns
KOM – Multimedia Communications Lab 16
Why Learning Analytics on Smartphones?
KOM – Multimedia Communications Lab 17
Smartphone-Based Learning Analytics
Advantages:
• Unobtrusive
• Suitable for different interaction paradigms
• Constant connectivity
• Enriching logging data
• More personalization
Challenges:
• Smartphone Limitations: Processing Power,
Storage, Battery Life
• Uncontrolled Context: mobility, illumination &
exposure variation, unstable camera
• Privacy Concerns:
-> Cloud Computing, sensor-
fusion for algorithm efficiency
-> sensor-fusion
-> keeping least info: e.g.
cropping of images
KOM – Multimedia Communications Lab 18
Questions & Contact