guided research: analyzing the usage of a video annotation ... · existing approaches • existing...

21
Software Engineering für betriebliche Informationssysteme (sebis) Fakultät für Informatik Technische Universität München wwwmatthes.in.tum.de Guided Research: Analyzing the usage of a video annotation tool Daniel Schosser

Upload: others

Post on 01-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Software Engineering für betriebliche Informationssysteme (sebis)

Fakultät für Informatik

Technische Universität München

wwwmatthes.in.tum.de

Guided Research: Analyzing the usage of

a video annotation toolDaniel Schosser

Page 2: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Agenda

1. Study existing approaches for analyzing behavior of learners in existing video

annotation tools.

2. Determine essential data that have to be collected for the analysis of learner’s

behavior in context of video annotation tools.

3. Implement and evaluate prototype for automatic analysis of learner’s behavior

as part of own learning video annotation tool.

© sebisGuided Research: Analyzing the usage of a video annotation tool 2

Page 3: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Existing approaches

• Existing video annotation tools

• VideoANT

• VideoNot.es

• Matterhorn

• Annotating Academic Video Tool

• Analyzing behavior of learners in “video annotation tools”

• YouTube

• Comparative Analysis of multiple tools

(Echo360, Omnisio, MediaSite, ePresence)

© sebisGuided Research: Analyzing the usage of a video annotation tool 3

Study existing approaches for analyzing behavior of learners in existing video

annotation tools.

Page 4: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

© sebisGuided Research: Analyzing the usage of a video annotation tool 4

Video

Timeline

Prototype

Page 5: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Prototype

© sebisGuided Research: Analyzing the usage of a video annotation tool 5

Play Framework

AngularJS

Twitter Bootstrap

YouTube-API

PostgreSQL

JQuery

Page 6: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Use case #1 – live session

© sebisGuided Research: Analyzing the usage of a video annotation tool 6

Presenter creates event

Presenter starts recording

Audience take notes

Presenter stops recording

Merge video and notes

1

2

3

4

Page 7: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Use case #2 – recorded session

© sebisGuided Research: Analyzing the usage of a video annotation tool 7

Presenter uploads video

Audience watch the video

Audience take notes

1

2

Page 8: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Database overview

© sebisGuided Research: Analyzing the usage of a video annotation tool 8

Name Purpose

User Contains the user information

Video Contains the video information

Note Contains the notes

User

id <int>

Video

owner <User>

notes List<Note>

Note

video <Video>

author <User>

Page 9: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Database overview

© sebisGuided Research: Analyzing the usage of a video annotation tool 9

User

id <int>

email <String>

hash <String>

Video

id <int>

title <String>

description <String>

url <String>

recordingStartTime <int>

recordingEndTime <int>

isOnAir <Boolean>

owner <User>

notes List<Note>

Note

id <int>

content <String>

isPrivate <Boolean>

timestampVideo <int>

timestampStart <int>

timestampEnd <int>

video <Video>

Note-Table is almost identical to the approach from “Annotating Academic Video (AAV)” Project

Page 10: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Start & end time

© sebisGuided Research: Analyzing the usage of a video annotation tool 10

A: Does this connect … ?

Page 11: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Start & end time

© sebisGuided Research: Analyzing the usage of a video annotation tool 11

A: Does this connect … ?

B: … typing …

Page 12: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Start & end time

© sebisGuided Research: Analyzing the usage of a video annotation tool 12

A: Does this connect … ?

B: … typing …

A: This looks interesting

Page 13: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Start & end time

© sebisGuided Research: Analyzing the usage of a video annotation tool 13

A: Does this connect … ?

B: Yes, because it …

A: This looks interesting

Page 14: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Start- & end time

© sebisGuided Research: Analyzing the usage of a video annotation tool 14

A: Does this connect … ?

A: This looks interesting…

B: Yes, because it …Sort by send-time instead of

start time

Page 15: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Analyzing opportunities

© sebisGuided Research: Analyzing the usage of a video annotation tool 15

• Categorize Notes (tags)

• Questions

• Bullet points

• Notes

• Answers

• …

Page 16: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Analyzing opportunities

© sebisGuided Research: Analyzing the usage of a video annotation tool 16

• Categorize Notes (tags)

• Questions

• Bullet points

• Notes

• Answers

• …

• Analyze Notes

• Intuitive vs. Long thought

• Mostly notes from category <X>

• …

Page 17: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Analyzing opportunities

© sebisGuided Research: Analyzing the usage of a video annotation tool 17

• Categorize Notes (tags)

• Questions

• Bullet points

• Notes

• Answers

• …

• Analyze Notes

• Intuitive vs. Long thought

• Mostly notes from category <X>

• …

• Analyze Video

• Relevant/Interesting Parts

• Content of Frame

Page 18: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Conclusion & future ideas

© sebisGuided Research: Analyzing the usage of a video annotation tool 18

• Target group can be generic

• Different requirements for live/recorded sessions

• A lot of potential to analyze the users behavior

• Extend Prototype

• Merging of “Live”-video and Notes

• Analyzing features

Page 19: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Thank you for your attention!

Questions?

© sebisGuided Research: Analyzing the usage of a video annotation tool 19

Page 20: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

© sebisGuided Research: Analyzing the usage of a video annotation tool 20

Backup-Slides

Annotating Academic Video (AAV)

Source: https://github.com/entwinemedia/annotations/wiki/Rest-annotation

Page 21: Guided Research: Analyzing the usage of a video annotation ... · Existing approaches • Existing video annotation tools • VideoANT • VideoNot.es • Matterhorn • Annotating

Backup-Slides

© sebisGuided Research: Analyzing the usage of a video annotation tool 21

Prototype