ximpel - 10 years of immersive media experiences

47
XIMPEL 10 Years of Immersive Media Experiences Hugo Huurdeman, Winoe Bhikharie, Anton Eliëns University of Oslo, VU University Amsterdam ximpel.net / bit.ly/VisualNavigationProject Presentation at Big Video Sprint conference, Aalborg, Nov. 2017

Upload: timelessfuture

Post on 22-Jan-2018

55 views

Category:

Education


3 download

TRANSCRIPT

Page 1: XIMPEL - 10 Years of Immersive Media Experiences

XIMPEL10 Years of Immersive Media Experiences

Hugo Huurdeman, Winoe Bhikharie, Anton Eliëns

University of Oslo, VU University Amsterdam

ximpel.net / bit.ly/VisualNavigationProject

Presentation at Big Video Sprint conference, Aalborg, Nov. 2017

Page 2: XIMPEL - 10 Years of Immersive Media Experiences
Page 3: XIMPEL - 10 Years of Immersive Media Experiences
Page 4: XIMPEL - 10 Years of Immersive Media Experiences

•The past ten years, online video has transformed from a mere novelty to one of the most popular pastimes on the internet.

•While online video platforms, such as YouTube, provide countless possibilities to disseminate traditional video, they lack options to create deep, interactive and immersive experiences.

Page 5: XIMPEL - 10 Years of Immersive Media Experiences

XIMPEL

• Using XIMPEL, an open media platform*, you can weave together video, audio, images and other media

• thus constructing highly interactive narratives

• * (based on HTML5 & XML)

Page 6: XIMPEL - 10 Years of Immersive Media Experiences

Versatility

• The versatility of XIMPEL is exemplified by the wide variety of its use in the past ten years, including

• online interactive media applications

• multimedia education, and

• interactive exhibitions involving large touch screens.

Page 7: XIMPEL - 10 Years of Immersive Media Experiences

The journey

• This presentation will take you on a journey along 10 years of XIMPEL

Page 9: XIMPEL - 10 Years of Immersive Media Experiences

The journey

• This presentation will take you on a journey along 10 years of XIMPEL

• Discussing seven key characteristics of the framework

Page 10: XIMPEL - 10 Years of Immersive Media Experiences

1. Immersion

• No distractions

• Immersive environments (using video, machinima, etc)

• Who do you Trust? (2016)

• Treasure Hunting Pyramid Castle Island Fairytale (2016)

• Seamless branching

Page 11: XIMPEL - 10 Years of Immersive Media Experiences

•“Poor man’s immersion” [Eliëns et al 2007]

• deploying the immersive realism of video, based on conventions of storytelling and film editing

• (substitute for interactive 3D immersion)

Page 12: XIMPEL - 10 Years of Immersive Media Experiences

2. Choice• Offer possibilities of choice without leaving the

environment

• Provides sense of agency

• Allows for a variety of serious (and experimental) techniques

• Space Suitcase (2008)

• Forest of Life (2015)

Page 13: XIMPEL - 10 Years of Immersive Media Experiences

3. Story graphs

• Model choices and narratives

• Also as an educational tool

• Branch, converge, loop, etc

Page 14: XIMPEL - 10 Years of Immersive Media Experiences
Page 15: XIMPEL - 10 Years of Immersive Media Experiences
Page 16: XIMPEL - 10 Years of Immersive Media Experiences
Page 17: XIMPEL - 10 Years of Immersive Media Experiences

3. Story graphs

• Model choices and narratives

• Also as an educational tool

• Branch, converge, loop, etc

• Or even randomness

•50s Driving Challenge (2009)

Page 18: XIMPEL - 10 Years of Immersive Media Experiences

4. Multiple viewpoints

• Offer a variety of viewpoints (authoring)

• Explore viewpoints by following paths (playing)

•Code of Conduct (2013)

•Reversed Cluedo (2015)

Page 19: XIMPEL - 10 Years of Immersive Media Experiences
Page 20: XIMPEL - 10 Years of Immersive Media Experiences

5. Reflection & Feedback• Allow for viewer reflection by showing followed paths

• Utilize custom score variables

• “Between narrative(s) and gameplay” [EliensEtAl2008]

• Show custom materials b/o choices

• Offer feedback

• Climate Profiler (2007-2009)

Page 21: XIMPEL - 10 Years of Immersive Media Experiences
Page 22: XIMPEL - 10 Years of Immersive Media Experiences
Page 23: XIMPEL - 10 Years of Immersive Media Experiences
Page 24: XIMPEL - 10 Years of Immersive Media Experiences
Page 25: XIMPEL - 10 Years of Immersive Media Experiences
Page 26: XIMPEL - 10 Years of Immersive Media Experiences
Page 27: XIMPEL - 10 Years of Immersive Media Experiences
Page 28: XIMPEL - 10 Years of Immersive Media Experiences
Page 29: XIMPEL - 10 Years of Immersive Media Experiences
Page 30: XIMPEL - 10 Years of Immersive Media Experiences

6. Declarative format

• Something “in-between” pure design & pure coding

• Create XML playlists

• Specify what, but not how

• (assistive tools)

Page 31: XIMPEL - 10 Years of Immersive Media Experiences

6. Declarative format

• Something “in-between” pure design & pure coding

• Create XML playlists

• Specify what, but not how

• (assistive tools)

Page 32: XIMPEL - 10 Years of Immersive Media Experiences

7. eXtensible

• Add new modules (media types) for whichever functionality you are interested in (Javascript)

• Some examples include:

• Minigames, maps, ..

• touch-based book viewer, visualizations

Page 33: XIMPEL - 10 Years of Immersive Media Experiences

Mikaela Aamodt | Dan Michael Heggø | Hugo Huurdeman | Helge Mjelde | Live Rasmussen | Heidi Rustad | Kyrre Låberg | Nina Thodesen

Visual Navigation Project

University of Oslo Library

bit.ly/VisualNavigationProject

Project Outline & Progress

Page 34: XIMPEL - 10 Years of Immersive Media Experiences

rethink how users can explore & interact with library materials

in the digital and physical library space

Visual Navigation Project

Page 36: XIMPEL - 10 Years of Immersive Media Experiences
Page 37: XIMPEL - 10 Years of Immersive Media Experiences

Large video collection - 100 (streamed) events per yearCross-links with collection, topic experts, researchers, etcHow to connect and visualize in sensible ways?

Page 38: XIMPEL - 10 Years of Immersive Media Experiences

Mikaela Aamodt | Dan Michael Heggø | Hugo Huurdeman | Helge Mjelde | Live Rasmussen | Heidi Rustad | Kyrre Låberg | Nina Thodesen

Visual Navigation Project

University of Oslo Library

bit.ly/VisualNavigationProject

Project Outline & Progress

Page 39: XIMPEL - 10 Years of Immersive Media Experiences

XIMPEL 10 years - Why?•Power of the “empty canvas”

•you can add interactivity, but you don’t have to …

•you can add multiple storylines, but you don’t have to …

•you can add annotations, but you don’t have to …

•you can add custom media types, but you don’t have to …

•you can add gaming elements, but you don’t have to …

Page 40: XIMPEL - 10 Years of Immersive Media Experiences

XIMPEL 10 years - How?

•Simplicity - (relatively) easy to maintain

•Declarative (XML) format

•Extendable & open-source

•Contributions by aficionados & students

Page 41: XIMPEL - 10 Years of Immersive Media Experiences

XIMPEL in the next 10 years • Further extend interaction

modalities

• eye tracking, …

• Extend feedback

• textual and graphical

• Profiling methods

• statistics-based recom-mendation of choices

• Simultaneous interactions

• Further develop MOOC features

• New media types

• 360 degrees, etcetera :)

Page 42: XIMPEL - 10 Years of Immersive Media Experiences

Role in video-based research dissemination

• XIMPEL could serve as a way to:

• enhance interactivity and transparency in illustrating and disseminating video-based research online

• export video and annotations (from analysis tools)

• use as “display resource”

•visualize (multistream) video & annotations (using templates)

• alternative for “immersive” viewing experience?

• e.g. large touch screens (touch, swipe, pinch)

Page 43: XIMPEL - 10 Years of Immersive Media Experiences

Role in video-based research dissemination

Page 44: XIMPEL - 10 Years of Immersive Media Experiences

• e.g., as a display resource ( model from Pea & Hoffert ’07 )

Role in video-based research dissemination

Page 45: XIMPEL - 10 Years of Immersive Media Experiences

Role in video-based research dissemination

• XIMPEL could serve as a way to:

• enhance interactivity and transparency in illustrating and disseminating video-based research online

• export video and annotations (from analysis tools)

• use as “display resource”

•visualize (multistream) video & annotations (using templates)

• alternative for “immersive” viewing experience?

• e.g. large touch screens (touch, swipe, pinch)

challenge-

any datasets & annotations we

can test?

Page 46: XIMPEL - 10 Years of Immersive Media Experiences

..big thanks!

• XIMPEL.net• Winoe Bhikharie, Marek van de Watering, prof. Anton Eliëns • All contributors, incl. Melvin Roest

• University of Oslo Library:• All colleagues & collaborating students & study participants

• & organizers BigVideo conference congress!

Page 47: XIMPEL - 10 Years of Immersive Media Experiences

XIMPEL10 Years of Immersive Media Experiences

Hugo Huurdeman, Winoe Bhikharie, Anton Eliëns

University of Oslo, VU University Amsterdam

ximpel.net / bit.ly/VisualNavigationProject

Presentation at Big Video Sprint conference, Aalborg, Nov. 2017