gam02 kinect1, kinect2

Template designed by

Kinect 1, Kinect 2, Leap Motion, Intel

Perceptual Computing: quale scegliere?

Matteo Valoriani

mvaloriani@gmail.com - @MatteoValoriani

Template designed by

brought to you by

WHO I AM…

PhD Student at Politecnico of Milano

CEO of Fifth Element

Consultant

FOLLOW ME ON

TWITTER OR THE

KITTEN GETS IT:

@MatteoValoriani

Template designed by

Why NUI

Sensors

• Kinect 1

• Leap Motion

• Intel Camera

• Kinect 2

Which to choose?

Agenda

Why NUI?

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

NUI devices

Template designed by

Kinect

Template designed by

3D DEPTH SENSOR

RGB CAMERA

MULTI-ARRAY MIC MOTORIZED TILT

Hardware

Depth resolution:

320x240

RGB resolution:

640x480

FrameRate:

60 FPS

Latency

90 ms

Kinect - Specs

Template designed by

43° vertical by 57° horizontal field of view

Kinect - Field of View

Template designed by

Skeleton Data

Maximum two players

tracked at once

Six player proposals per

Kinect

dem

o

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Leap Motion

https://www.youtube.com/watch?v=_d6KuiuteIA

https://airspace.leapmotion.com/

Template designed by

Hardware

Template designed by

Leap Motion -Field of View

150° - Long Side

120° - Short Side

Max 60 cm abovethe controller

Max 60 cm wide on each side

Template designed by

Leap Motion for Developers

Template designed by

Hands Recognition

Template designed by

Comfortable use of Leap

Place the Leap Motion Controller on your desk where it's comfortable to use.

Relax your shoulders. If standing or sitting high in a chair, hold your elbows near your side, and keep

your forearms parallel to the floor and at a right angle from your body. If sitting at usual desk height,

you can rest your elbows or forearms on your desk, but not on a sharp edge. Hold your hands just

above the device, your wrist and hands in roughly a straight line

Template designed by

dem

o

Template designed by

Intel Perceptual Computing

https://www.youtube.com/watch?v=WePIY7svVtg

Template designed by

Camera Specs

Hardware:

Depth resolution:320x240

RGB resolution:1280x720

FrameRate:30 FPS

• Size:10.15 x 5.1 x 5 cm

Template designed by

dem

o

Template designed by

Xbox One - Kinect 2

http://youtu.be/Hi5kMNfgDS4

Template designed by

Kinect 2 - Specs

3D DEPTH SENSOR

RGB CAMERA

MULTI-ARRAY MIC

Hardware:

Depth resolution:512×424

RGB resolution:1920×1080 (16:9)

FrameRate:60 FPS

Latency:60 ms

Template designed by

Kinect 2 vs Kinect 1

Version 1 Version 2

Depth range 0.4m → 4.0m 0.4m → 4.5m

Color stream 640×480 1920×1080

Depth stream 320×240 512×424

Infrared stream None 512×424

Audio stream 4-mic array 16 kHz 4-mic array 48 kHz

USB 2.0 3.0

Hand Traking External tools Yes

Face Traking Yes Yes+Expressions

FOV 57° H 43° V 70° H 60° V

Tilt Motorized Manual

dem

o

Which to choose?

Template designed by

Some selection criterias…

1° 2° 3° 4°

2 or + users Kinect 2 Kinect 1 Intel Leap

Full body interaction Kinect 2 Kinect 1 - -

Hand Recognition Intel Leap Kinect 2 Kinect 1*

Accuracy Leap Intel Kinect 2 Kinect 1

Voice command Intel (Kinect 2) Kinect 1

Minimum Hardware Intel Leap Kinect 1 Kinect 2

Price Leap Kinect 1 Intel* (Kinect 2)

Compatibility Leap Intel Kinect 1 Kinect 2

Template designed by

Microsoft Kinect Issues:

The device is large

A dedicated power cord is required

The amount of data generated by the sensor also tends to saturate

a USB controller

Kinect cannot easily distinguish individual fingers on a hand

Most of the features listed above require the Microsoft SDK, which

is only supported for desktop applications on Windows 7 and 8.

Which to choose? ALL

Microsoft Kinect

Advantages:• Skeletal tracking

• Face tracking

• Multiple sensors:

• Raw data

• Voice control

Best for:

Kiosks, installations, and digital signage projects where the user will be

standing fairly far away from the display.

Template designed by

Leap Motion Issues:Sensing range is fairly limited.

Only fingers are tracked.

There is no skeleton or face tracking.

No access to the raw sensor data.

Which to choose? ALL

Leap Motion Advantages:• Finger tracking is fast and

accurate.

• Smaller and less expensive

• Framework support: .NET, Processing, Cinder, etc.

• Compatible: Mac OS and Windows.

Best for:

Controlled kiosk environments with a pointing-based UI.

Generally best for general audience desktop apps which can be distributed in the Airspace

store.

Template designed by

Intel Issues:

Getting some of the deeper features (like age and gender

detection) to work is a bit tricky.

Device and software are in beta.

Due to the close range of the tracking system, hand

gestures must be designed such that a user’s hand doesn’t

occlude their own view of the display.

Which to choose? ALL

Intel Advantages:• Smaller and less expensive

• Close-range tracking

• Hand posture/gesture recognition

• Facial analysis

• Speech (built-in support for speech synthesis powered by Nuance).

• Raw data

• Framework support: Processing, Unity and OpenFrameworks

Best for:

Desktop/laptop applications where the user will be seated in front of the PC.

Close range applications where features, apart from hand tracking and recognition, are

necessary without too much precision or accuracy.

… TIRED?

Template designed by

So Long

and

Thanks for

all the Fish

Template designed by

brought to you by