tangible bits: towards seamless interfaces between people ......pick-and-drop: a direct manipulation...

37
Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms Published in the Proceedings of CHI '97 Hiroshi Ishii and Brygg Ullmer MIT Media Laboratory Tangible Media Group 20 Ames Street, Cambridge, MA 02139-4307 USA

Upload: others

Post on 04-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Tangible Bits: Towards Seamless Interfacesbetween People, Bits and Atoms

Published in the Proceedings of CHI '97Hiroshi Ishii and Brygg Ullmer

MIT Media LaboratoryTangible Media Group

20 Ames Street, Cambridge, MA 02139-4307 USA

Page 2: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

GUI => TUI

Page 3: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Key concepts

1. Interactive surfaces2. Coupling bits & atoms3. Ambiant media

Page 4: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Tangible Bits

Page 5: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

metaDESK

• http://tangible.media.mit.edu/projects/metadesk/

Page 6: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science
Page 7: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

transBOARD

• Networked digitally-enhanced physicalwhiteboard.

• Java applet• Hypercard

Page 8: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Interactive public ambient displays: Transitioning form implicit to explicit, public

to personal, interaction with multiple users

Page 9: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Design principles

• Calm aesthetics• Comprehension• Notification• Short-Duration Fluid interaction• Immediate usability• Shared Use• Combining public and personal information• Privacy

Page 10: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Video

• http://www.dgp.toronto.edu/%7Eravin/videos/uist2004_ambient.avi

Page 11: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick-and-Drop: A Direct Manipulation Technique

for Multiple Computer Environments

Jun RekimotoSony Computer Science Laboratory Inc.3-14-13 Higashigotanda, Shinagawa-ku,

Tokyo 141 Japan+81-3-5447-4380

[email protected]://www.csl.sony.co.jp/person/rekimoto.ht

ml

Page 12: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Abstract

• New field of user interfaces called multi-computer direct manipulation

• Pick and Drop system– The pen can Pick Up– As a physical object

KEYWORDS: direct manipulation, graphical user interfaces, input devices, stylus interfaces, peninterfaces, dragand- drop, multi-computer user interfaces, ubiquitous computing, computer augmented environments

Page 13: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• Using multiple computers withoutconsidering the user-interface = problems– Restriction of input devices– Today‘s user interface techniques are not

designed for multiple-computer environments

Page 14: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

Page 15: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

Page 16: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 17: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 18: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 19: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 20: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

• Applications– Transfert a file between 2 computers, PDA– Pick up information from kiosk terminal– Draw on the wall with a tablet– Take pictures from a book– …

Page 21: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Pick and drop system

Page 22: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Conclusion

• The difference between copy and pick and drop is about the user interface

• Faster• More logical

PickPick and Drop and Drop MovieMovie ::http://www.csl.sony.co.jp/person/rekimoto/pickdrop/pd1.mpg

Page 23: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

The metaDESKModels and Prototypes for Tangible User Interfaces

Published in the Proceedings of UIST '97, October 14-17, 1997, © 1997 ACM

Brygg Ullmer and Hiroshi IshiiMIT Media Lab

Tangible Media Group20 Ames St., E15-445

Cambridge, MA 02139 USA+1 617 253 4121

{ullmer, ishii}@media.mit.edu

Page 24: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Abstract

• Tangible interface• Giving physical form to windows, icons,

handles, menus, and controls• Present design and implementation• A prototype application

– Tangible Geospace

Keywords: tangible user interfaces, input devices, hapticinput, augmented reality, ubiquitous computing

Page 25: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• This paper present– “Tangible User Interfaces” (TUIs)

• User interfaces employing– Physical objects– Instruments– Surfaces– Spaces as physical interfaces to digital information

Page 26: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

Page 27: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• What is a metaDesk?– A graphically intensive system driven by

interaction with graspable physical objects.– In this case :

• Geographical space• Tangible Geospace

Page 28: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Introduction

• metaDesk Components– The Desk– A nearly horizontal back projetcted graphical surface– The active lens– A flat panel display– An optically transparent surface– An assortment of physical object used on the desk

surface

Page 29: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Design Approach

Page 30: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Design Approach

Page 31: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Prototype System

Page 32: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Prototype System

Page 33: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Prototype System

Page 34: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Implementation

3 PCs

Magnetic andelectric sensors

Back projection

Plexiglassdiffuser surface

Page 35: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Interaction Issues

Page 36: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Interaction Issues

Page 37: Tangible Bits: Towards Seamless Interfaces between People ......Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science

Future Work

• Explore phicons with different level of abstraction

• Use the metaDesk in a another context• Use other metaphor

metaDesk Movie :

http://tmg-video.media.mit.edu/metadesk/metadesk_352x240.mpg