Transcript
Page 1: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Tangible Bits: Towards Seamless Interfacesbetween People, Bits and Atoms

Published in the Proceedings of CHI '97Hiroshi Ishii and Brygg Ullmer

MIT Media LaboratoryTangible Media Group

20 Ames Street, Cambridge, MA 02139-4307 USA

Page 2: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

GUI => TUI

Page 3: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Key concepts

1. Interactive surfaces2. Coupling bits & atoms3. Ambiant media

Page 4: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Tangible Bits

Page 5: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

metaDESK

• http://tangible.media.mit.edu/projects/metadesk/

Page 6: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science
Page 7: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

transBOARD

• Networked digitally-enhanced physicalwhiteboard.

• Java applet• Hypercard

Page 8: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Interactive public ambient displays: Transitioning form implicit to explicit, public

to personal, interaction with multiple users

Page 9: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Design principles

• Calm aesthetics• Comprehension• Notification• Short-Duration Fluid interaction• Immediate usability• Shared Use• Combining public and personal information• Privacy

Page 10: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Video

• http://www.dgp.toronto.edu/%7Eravin/videos/uist2004_ambient.avi

Page 11: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick-and-Drop: A Direct Manipulation Technique

for Multiple Computer Environments

Jun RekimotoSony Computer Science Laboratory Inc.3-14-13 Higashigotanda, Shinagawa-ku,

Tokyo 141 Japan+81-3-5447-4380

[email protected]://www.csl.sony.co.jp/person/rekimoto.ht

ml

Page 12: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Abstract

• New field of user interfaces called multi-computer direct manipulation

• Pick and Drop system– The pen can Pick Up– As a physical object

KEYWORDS: direct manipulation, graphical user interfaces, input devices, stylus interfaces, peninterfaces, dragand- drop, multi-computer user interfaces, ubiquitous computing, computer augmented environments

Page 13: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• Using multiple computers withoutconsidering the user-interface = problems– Restriction of input devices– Today‘s user interface techniques are not

designed for multiple-computer environments

Page 14: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

Page 15: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

Page 16: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 17: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 18: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 19: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 20: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

• Applications– Transfert a file between 2 computers, PDA– Pick up information from kiosk terminal– Draw on the wall with a tablet– Take pictures from a book– …

Page 21: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 22: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Conclusion

• The difference between copy and pick and drop is about the user interface

• Faster• More logical

PickPick and Drop and Drop MovieMovie ::http://www.csl.sony.co.jp/person/rekimoto/pickdrop/pd1.mpg

Page 23: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

The metaDESKModels and Prototypes for Tangible User Interfaces

Published in the Proceedings of UIST '97, October 14-17, 1997, © 1997 ACM

Brygg Ullmer and Hiroshi IshiiMIT Media Lab

Tangible Media Group20 Ames St., E15-445

Cambridge, MA 02139 USA+1 617 253 4121

{ullmer, ishii}@media.mit.edu

Page 24: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Abstract

• Tangible interface• Giving physical form to windows, icons,

handles, menus, and controls• Present design and implementation• A prototype application

– Tangible Geospace

Keywords: tangible user interfaces, input devices, hapticinput, augmented reality, ubiquitous computing

Page 25: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• This paper present– “Tangible User Interfaces” (TUIs)

• User interfaces employing– Physical objects– Instruments– Surfaces– Spaces as physical interfaces to digital information

Page 26: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

Page 27: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• What is a metaDesk?– A graphically intensive system driven by

interaction with graspable physical objects.– In this case :

• Geographical space• Tangible Geospace

Page 28: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• metaDesk Components– The Desk– A nearly horizontal back projetcted graphical surface– The active lens– A flat panel display– An optically transparent surface– An assortment of physical object used on the desk

surface

Page 29: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Design Approach

Page 30: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Design Approach

Page 31: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Prototype System

Page 32: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Prototype System

Page 33: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Prototype System

Page 34: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Implementation

3 PCs

Magnetic andelectric sensors

Back projection

Plexiglassdiffuser surface

Page 35: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Interaction Issues

Page 36: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Interaction Issues

Page 37: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Future Work

• Explore phicons with different level of abstraction

• Use the metaDesk in a another context• Use other metaphor

metaDesk Movie :

http://tmg-video.media.mit.edu/metadesk/metadesk_352x240.mpg


Top Related