eresearch - hlanganani junction...• unity 5.1 / unreal engine studio 4.8 • unreal studio is oss...

43
Hlanganani Junction

Upload: others

Post on 17-Mar-2020

13 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Hlanganani Junction

Page 2: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Emerging Researcher Series

Data Visualisation Facilities?Data Visualisation Facilities?

Thursday, 16 March 2017

Research Analyst

Jason van Rooyen, PhD

Engineer

Timothy Carr

Page 3: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

OverviewOverview

Page 4: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Research

Life Cycle

Acquire

Plan

Analyse

Access

Collaborate

Manage

Archive

Publish

Reuse

Data

HPC

Cloud

Virtual labs

HPC

Cloud

Virtual labs

Dataset transfer

Databases

Web-based file sharing

Collaborative sites

Dataset transfer

Databases

Web-based file sharing

Collaborative sitesAutomated ingest

and management

Automated ingest

and management

RDM supportRDM support

Technical advice

Costing

Grant assistance

Technical advice

Costing

Grant assistance

Comprehend

Visualisation facilitiesVisualisation facilities

Institutional repositoryInstitutional repository

Page 5: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

16 March 2016

VR

Visualisation wall

Digital Dome

This talk….This talk….

Page 6: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

The build Demonstration

This talk….This talk….

Data Visualisation Facilities

16 March 2016

Page 7: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

InspirationInspiration

Page 8: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• The data deluge

• Visual learning

• Visualisation infrastructure is

transforming research

Why?Why?

Data Visualisation Facilities

insights

collaboration

16 March 2016

Page 9: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Continuum of tech

• Scale

• Complexity

• Cost

• Off the shelf or custom

What is out there?What is out there?

Data Visualisation Facilities

16 March 2016

Page 10: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Virtual RealityVirtual Reality

Data Visualisation Facilities

• …and it’s commercial

Oculus Rift

MS HoloLens

16 March 2016

Page 11: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Virtual RealityVirtual Reality

Data Visualisation Facilities

16 March 2016

Page 12: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Video wallsVideo walls

Data Visualisation Facilities

Georgia State University: the CURVE

http://library.gsu.edu/home/services-and-support/services/curve/

16 March 2016

Page 13: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

University of Dayton: Interactive Projection Wall

http://heyhush.com/work/university-of-dayton-interactive-wall/

Video wallsVideo walls

16 March 2016

Page 14: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

University of California, San Diego: WAVE, StarCAVE, NexCAVE, TourCAVE

http://www.calit2.net/newsroom/article.php?id=2273 /

Video wallsVideo walls

16 March 2016

Page 15: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

Video wallsVideo walls

KAUST: NexCAVE, AESOP, OptiPortal, REVE

https://kvl.kaust.edu.sa/Pages/Showcase.aspx

16 March 2016

Page 16: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

University of Illinois at Chicago's Electronic Visualization Lab

http://www.ci.anl.gov/blog/walls-visualization-cave

Video wallsVideo walls

16 March 2016

Page 17: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

CAVE, WAVE,

http://www.mechdyne.com

Video wallsVideo walls

16 March 2016

Page 18: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

Video wallsVideo walls

Virginia Tech’s: the Cube

https://www.icat.vt.edu/content/cube-0

16 March 2016

Page 19: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

Planetarium Planetarium

Definiti 4K Projection System Museum of

Science, Boston Charles Hayden Planetarium

Queen Mary projection system

16 March 2016

Page 20: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Our JourneyOur Journey

Page 21: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Inspired by the CAVE2 @Monash

OriginsOrigins

Data Visualisation Facilities

https://youtu.be/TVem-BiRYTo

16 March 2016

Page 22: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Visualisation walls:

• Panoramic Designs, Interactive, Great collaborative area, Immersive

• Near-seamless panels, HPC Render Farm, Positional Tracking, Audio

• Considerations:

• Expensive to build. University real estate

• Limitation (n) people, research groups. The consumer could not

own one.

Pros and Cons of technologiesPros and Cons of technologies

Data Visualisation Facilities

16 March 2016

Page 23: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• VR:

• Replacing the real world with a simulated one

• Immersive, Interactive, Portable, Connected, Not expensive, Available to

the consumer.

• Creating a "Software-Defined World" in which anything is possible.

• Considerations:

• Not novel

• Various health related issues associated with VR e.g. nausea

• Commercial

Pros and Cons of technologiesPros and Cons of technologies

Data Visualisation Facilities

16 March 2016

Page 24: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Commercial off-the-shelf VR

• Motion control integration

• Oculus DK2

• 7" OLED display

• Resolution 960 x 1080

• Positional Tracker (LED camera)

• Caveats which need addressing:

• Resolution is too low

• Head mount does not suit glasses

• Longer cables

• HMD USB causes jitter

Oculus @UCTOculus @UCT

Data Visualisation Facilities

https://youtu.be/w4rvr346os4

16 March 2016

Page 25: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Hardware requirements:

• GPU:

• > Nvidia GTX 970

• General:

• 8GB Memory, (16GB)

• Sufficient USB ports

• Quad-core

• Software Development:

• Unity 5.1 / Unreal Engine

Studio 4.8

• Unreal Studio is OSS and

supports the Oculus and Leap

natively.

What’s needed for the Oculus @UCTWhat’s needed for the Oculus @UCT

Data Visualisation Facilities

• Access:

• Eat-in or takeaways?

16 March 2016

Page 26: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Textured 3D models and other spatial data of

heritage sites across Africa.

• 72 TB of data

• Online Virtual Worlds are created to aid site

management, education, tourism and

conservation

Research with the Oculus @UCTResearch with the Oculus @UCT

Data Visualisation Facilities

16 March 2016

Page 27: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Inspired by the CAVE2 @Monash

• Researcher engagement spaces

• Libraries are traditional homes of

data and interrogation

• E.g. James B. Hunt Library - NCU

Visualisation wall @UCTVisualisation wall @UCT

Data Visualisation Facilities

16 March 2016

Page 28: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Requirements:

• Research/teaching/meeting

• Immersive

• Large

• Bright (day-time functions)

• Private

• 3D

• Touch

• Impressive sound

• Low cost

Visualisation wall @UCTVisualisation wall @UCT

Data Visualisation Facilities

16 March 2016

Page 29: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Hardware:

• High-spec PC

• 3 Quadro m4000

• 10 Pvision 49 inch LCD panels

• 3.5 mm image to image

• 20 mil pixels

• Bose sound

• 2K video in

Visualisation wall @UCTVisualisation wall @UCT

Data Visualisation Facilities

16 March 2016

Page 30: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Iziko Planetarium being upgraded

• Digital facility providing state-of–the-art edu-entertainment and

enabling leading-edge research

• A budget of R25 million has been set aside for the digital

transformation: Department of Science and Technology (DST); National Research Foundation

(NRF); National Lotteries Commission (NLC); University of Cape Town (UCT));

University of the Western Cape (UWC); and Cape Peninsula University of

Technology (CPUT).

CT Digital PlanetariumCT Digital Planetarium

Data Visualisation Facilities

16 March 2016

Page 31: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Planetarium - currentlyPlanetarium - currently

Data Visualisation Facilities

• Popular Cape Town location

• 80k to 100k visitors per year

• Currently using 1977 Minolta slide technology to project star fields

• Technology is at end of life and needs to be replaced urgently!

16 March 2016

Page 32: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Planetarium – Digital DomePlanetarium – Digital Dome

Data Visualisation Facilities

• Full dome digital

• 360 °

• 6x JVC 8k

• 5000 lumens

• 38 mil pixels

• From planetary and solar system science to

geology, oceanography, climate and earth

science, medical science, molecular- and bio-

chemistry, and even town planning

• 15 hrs/week for research

https://www.youtube.com/watch?v=pH3MH_EWgno

https://vimeo.com/160134795

16 March 2016

Page 33: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

VR

Visualisation wall

Digital Dome

Available for youAvailable for you

16 March 2016

Page 34: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

DemoDemo

Page 35: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Art

• https://www.google.com/culturalinstitute/beta/category/artist

• https://www.google.com/culturalinstitute/beta/exhibit/gQnHkHo6

• Science (contextual)

• https://www.eso.org/public/images/archive/zoomable/

• Immersive

• http://www.gigapan.com/galleries/11203/gigapans/152220

• http://www.gigapan.com/galleries/6969/gigapans/80370

• http://www.gigapan.com/galleries/8030/gigapans/97067

ImmersionImmersion

Data Visualisation Facilities

16 March 2016

Page 36: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Maps

• http://www.digitalcollections.lib.uct.ac.za/humanitec/

• http://www.openstreetmap.org/#map=15/-33.9537/18.4692

• https://www.google.com/maps/@-33.91353,18.0956096,9z

• Biological samples

• http://tinyurl.com/jqzp9se

• Charts and pathways

• http://biochemical-pathways.com/#/map/1

Scale and context Scale and context

Data Visualisation Facilities

16 March 2016

Page 37: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Bringing statistics to life

• http://flowingdata.com/2015/12/15/a-day-in-the-life-of-americans

• http://www.theguardian.com/society/ng-interactive/2015/feb/05/-sp-watch-how-

measles-outbreak-spreads-when-kids-get-vaccinated

• http://www.trulia.com/vis/tru247/

• https://evolutionofweb.appspot.com/

• Mass publications

• http://qz.com/

• http://flowingdata.com/

Data – big and smallData – big and small

Data Visualisation Facilities

16 March 2016

Page 38: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Visualisation libraries and tools

• https://github.com/d3/d3/wiki/gallery

• SeaBorn

• Plotly

• IPython

Data – big and smallData – big and small

Data Visualisation Facilities

16 March 2016

Page 39: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Interactive visualisations

• http://maps.tnc.org/migrations-in-motion/#4/45.15/-106.57

• https://earth.nullschool.net/#current/wind/surface/level/azimuthal_equidistant=

25.16,-46.01,862

• http://www.weathersa.co.za//media/data/observation/synoptic/ma_sy.gif

• http://htwins.net/scale2/

• http://stuffin.space/?search=

Data – new dimensionsData – new dimensions

Data Visualisation Facilities

16 March 2016

Page 40: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• UHD video

• Fantasy/Narratives:

• https://vimeo.com/108650530

• Art

• https://www.youtube.com/watch?v=qulvodbkUHA

• Nature

• https://www.youtube.com/watch?v=OJgPBbVwTVY

• Architecture

• https://www.youtube.com/watch?v=5dQ7513NsFM

MotionMotion

Data Visualisation Facilities

16 March 2016

Page 41: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

• Interactive infographics

• http://www.fallen.io/ww2/

• Live streaming

• http://www.n2yo.com/space-station/

• http://www.ustream.tv/channel/iss-hdev-payload

MotionMotion

Data Visualisation Facilities

16 March 2016

Page 42: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

CollaborationCollaboration

Data Visualisation Facilities

Scalable Amplified Group Environment

Dept. of Computer Science, University of Illinois at Chicago

• Video conferencing

• Virtual screen

• Co-presentation

16 March 2016

Page 43: eResearch - Hlanganani Junction...• Unity 5.1 / Unreal Engine Studio 4.8 • Unreal Studio is OSS and supports the Oculus and Leap natively. What’s needed for the Oculus @UCT Data

Data Visualisation Facilities

Thank you!Thank you!

16 March 2016