a framework for developing pervasive cross-media applications based on physical hypermedia and...

17
ICPCA 2008, October 7 A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components Beat Signer and Moira C. Norrie Institute for Information Systems, ETH Zurich 8092 Zurich, Switzerland

Upload: beat-signer

Post on 28-Nov-2014

1.335 views

Category:

Technology


5 download

DESCRIPTION

Presentation given at ICPCA 2008, 3rd International Conference on Pervasive Computing and Applications, Alexandria, Egypt, October 2008 ABSTRACT: We present a framework that supports the development of pervasive cross-media applications through a clean separation of interaction design and application programming. The approach is based on a novel concept of active components that provides a lightweight mechanism for linking physical and digital entities to services. We show how the development of cross-media applications can be simplified by adopting an authoring rather than a programming approach and how we achieved this by integrating the active component concept into an extensible hypermedia server.

TRANSCRIPT

Page 1: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7

A Framework for Developing Pervasive

Cross-Media Applications based on Physical

Hypermedia and Active Components

Beat Signer and Moira C. Norrie

Institute for Information Systems, ETH Zurich

8092 Zurich, Switzerland

Page 2: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Pervasive Cross-Media Applications

The Lost Cosmonaut

iTable PaperPoint

EdFest

Page 3: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Cross-Media Link Server

Page 4: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

RSL Metamodel and iServer

Page 5: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

iServer Resource Plug-ins

Resource

RFID space

XHTML document

document page

mpeg file, avi file etc.

mpeg file, avi file etc.

mp3 file, wav file etc.

gif file, jpeg file etc.

...

Medium

physical object

web page

paper

movie

movie

sound

image

...

Selector

RFID tag

XPointer

shape

time span

shape

time span

shape

...

Page 6: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components

<?xml version="1.0" encoding="UTF-8" ?>

<iserver>

<activeComponent id="s1a" creator="beat">

<name>Show slide 1</name>

<properties>

<parameter>

<key>org.ximtec.iserver.ac:command</key>

<value>showSlide</value>

</parameter>

<parameter>

<key>org.ximtec.iserver.ac:slide</key>

<value>1</value>

</parameter>

</properties>

<identifier>PAPERPOINT_CONTROL</identifier>

</activeComponent>

...

</iserver>

PAPERPOINT_CONTROL

Show slide 1

command showSlide

slide 1

Page 7: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components ...

Execute code (services) on the client and server side

Active Component

A

Active Component

B

Active Component

C

iS

erv

er

AC Manager

Server

R

eq

ue

st S

en

de

rActive Component

Stub B

AC Names

ACS Manager

C

lien

t D

evic

e

AC Names

Client

HT

TP

Page 8: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components ...

Page 9: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components ...

package org.ximtec.iserver.activecomponent.logic;

public class CommandLine extends EmptyLogic {

}

package org.ximtec.iserver.activecomponent.stub;

import java.io.IOException;

...

public class CommandLineStub extends SingleEventStub {

public static final String PARAM_COMMAND = "command";

public void finish() {

try {

Runtime.getRuntime().exec(getParameter(PARAM_COMMAND));

}

catch (IOException e) {

LOGGER.log(Level.SEVERE, Constant.EMPTY_STRING, e);

}

} // finish

}

Page 10: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components ...

Page 11: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components ...

Button

Slider

Slider2D

DateSelector

Browser

MapSelector

Capture

CaptureAndOcr

CaptureAndSpeak

Image

Sound

Movie

SQLClient

XCMRequest

ClientCtrlRequest

PaperPointControl

PaperPointAnnot

...

Page 12: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Slider / Slider2D Active Component

Page 13: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Cross-Media Authoring Tool

Page 14: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Active Components Editor

PAPERPOINT_CONTROL

Show slide 1

command showSlide

slide 1

Page 15: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

The Lost Cosmonaut

Writing as a collaborative

act of memory and story-

telling

Reading, writing and

narrative as an act of

making sense

Handwriting as a tool for

human computer

interaction

In collaboration with Axel Vogelsang,

Artists in Labs Programme

Page 16: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Conclusions

Separation of interaction design and application

programming

Authoring rather than programming approach

Extensible cross-media framework

modular and extensible active components

resource plug-ins

Rapid prototyping

Page 17: A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components

ICPCA 2008, October 7 Beat Signer, [email protected]

Further Information

http://vub.academia.edu/BeatSigner

Fundamental Concepts for Interactive Paper

and Cross-Media Information Spaces, Beat

Signer, ISBN 978-3-8370-2713-6, May 2008

Prof. Moira Norrie Dr. Beat Signer Nadir Weibel Adriana Ispas