zero code reflections on (interaction design) research historic perspective beyond wimp interactions...

Pierre-Louis Xechplxech@microsoft.com Partenariats RechercheMicrosoft France

http://www.microsoft.com/france/msdn/annuaire/xml/plxech.xml http://research.microsoft.com/~plxech/

Desktop 2015: libérez les fenêtres!

Topics

Zero codeReflections on (Interaction Design) researchHistoric perspectiveBeyond WIMP interactions

Overcoming constraints of “point and clik” interactionsMulti touch interactions, interactive surfaces & computer vision techniques

Illustration from (some) Microsoft Research projects (and from somewhere else too)Form factor issues and devices

Microsoft Research 2007http://research.microsoft.comFounded in 1991Staff of over 800 covering 55 areas

Core research facility for entire company

Centrally funded, sets own agendaInternationally recognized research teamsStrong engagement with Microsoft product groups

Research labsRedmond, WashingtonSan Francisco, CaliforniaMountain View, CaliforniaCambridge, United KingdomBeijing, People’s Republic of ChinaBengalore, India

Joint Labs

« Le présent est indéfini, le futur n’a de réalité qu’en tant qu’espoir présent, le passé n’a de réalité qu’en tant que souvenir présent. » Jorge Luis Borges

Fictions

5

2001

2057

Fiction

1968

2007

Research

1968 …"I don't know why we call it a mouse. It started that way and we never changed it.“

Doug Engelbart, Stanford University, 1968 The mother of all demos

complete recording at http://sloan.stanford.edu/mousesite/1968Demo.html

… 2015?

8

9

ChallengesLarge displays«Hiding» computersPeripheral awareness«Augmenting» surfacesSeamless transitionsMore natural interactionsMulti-touch interactionsCollaborationNew kind of devicesPerceived affordances

10

Emerging research domains

Ubiquitous computing (Ubicomp) integrates computation into the environment, rather than having computers which are distinct objects

Augmented reality (AR) is a field of computer research which deals with the combination of real world and computer generated data

Mixed Reality (MR) is the merging of real world and virtual worlds to produce a new environment where physical and digital objects can co-exist and interact

Tangible User Interface (TUI) is a User interface in which a person interacts with digital information through the physical environment

11

Large Displays

Reinventing mouse

The Soap devicePatrick BaudischMicrosoft Research Redmond

Multi-touch interactions

Sensing surfaces

Rear projection sheet

Glass

IR Filter

CameraProjector

IR lightIR light

Objects on surface of table

Augmenting Surfaces

PlayAnywhere

Short-throw projector, very wide angle lens on the cameraLens distortion & projective transform correction for camera-projector alignmentOff-axis IR LED illuminant

Very few assumptions about the appearance of the surfaceAll calibration is done at the “factory”

17

Table top interactions

Play Anywhere Andy WilsonMicrosoft Research, Redmond

Wall size display interactions

« Touchlight »Andy Wilson

Microsoft Research Redmond

18

Collaboration

Play TogetherDaniel C. Robbins, Andy WilsonMicrosoft Research, Redmond

Interacting with photos

Surface ecology

21

The Picture BowlShahram Izadi, Alex TaylorMicrosoft Research, Cambridge

Interacting with music

The ReacTable & the MediaTableSergi Jordà & al.Universitat Pompeu Fabra, Barcelona

http://www.iua.upf.es/mtg/reacTable/ http://www.youtube.com/watch?v=0h-RhyopUmc

24

http://mrl.nyu.edu/~jhan/ftirtouch/

Surface computing (Other)

Jeff Han – New-York University

Interactive surfaces for all?

25

The Future

Display Technology

Laser Projection

Conclusions

It took almost 15 years before the mouse became mainstreamEverything is best for something and worst for something else!Emerging user experience concepts and techniques

Multi-touch interactionsTable-top and wall display sensingRobust computer vision techniques

Promising new devices and technology29

… Tomorrow!

30

ReferencesTangible bits project, MIT Media Lab

http://tangible.media.mit.edu/projects/

Doug Engelbart’s 68 demohttp://sloan.stanford.edu/mousesite/1968Demo.html

Microsoft Researchhttp://research.microsoft.comhttp://research.microsoft.com/research/vibehttp://research.microsoft.com/~awilson http://research.microsoft.com/cml/

The ReacTablehttp://www.mtg.upf.edu/reactable/

Flat & rollable displayshttp://www.camfpd.comhttp://www.polymervision.nl

Laser projectionhttp://www.lightblueoptics.com/http://www.symbol.com

Questions?

© 2007 Microsoft France

Votre potentiel, notre passion TM