a framework for developing pervasive cross-media applications based on physical hypermedia and...

Post on 28-Nov-2014

1.335 Views

Category:

Technology

5 Downloads

Preview:

Click to see full reader

DESCRIPTION

Presentation given at ICPCA 2008, 3rd International Conference on Pervasive Computing and Applications, Alexandria, Egypt, October 2008 ABSTRACT: We present a framework that supports the development of pervasive cross-media applications through a clean separation of interaction design and application programming. The approach is based on a novel concept of active components that provides a lightweight mechanism for linking physical and digital entities to services. We show how the development of cross-media applications can be simplified by adopting an authoring rather than a programming approach and how we achieved this by integrating the active component concept into an extensible hypermedia server.

TRANSCRIPT

ICPCA 2008, October 7

A Framework for Developing Pervasive

Cross-Media Applications based on Physical

Hypermedia and Active Components

Beat Signer and Moira C. Norrie

Institute for Information Systems, ETH Zurich

8092 Zurich, Switzerland

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Pervasive Cross-Media Applications

The Lost Cosmonaut

iTable PaperPoint

EdFest

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Cross-Media Link Server

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

RSL Metamodel and iServer

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

iServer Resource Plug-ins

Resource

RFID space

XHTML document

document page

mpeg file, avi file etc.

mpeg file, avi file etc.

mp3 file, wav file etc.

gif file, jpeg file etc.

...

Medium

physical object

web page

paper

movie

movie

sound

image

...

Selector

RFID tag

XPointer

shape

time span

shape

time span

shape

...

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components

<?xml version="1.0" encoding="UTF-8" ?>

<iserver>

<activeComponent id="s1a" creator="beat">

<name>Show slide 1</name>

<properties>

<parameter>

<key>org.ximtec.iserver.ac:command</key>

<value>showSlide</value>

</parameter>

<parameter>

<key>org.ximtec.iserver.ac:slide</key>

<value>1</value>

</parameter>

</properties>

<identifier>PAPERPOINT_CONTROL</identifier>

</activeComponent>

...

</iserver>

PAPERPOINT_CONTROL

Show slide 1

command showSlide

slide 1

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components ...

Execute code (services) on the client and server side

Active Component

A

Active Component

B

Active Component

C

iS

erv

er

AC Manager

Server

R

eq

ue

st S

en

de

rActive Component

Stub B

AC Names

ACS Manager

C

lien

t D

evic

e

AC Names

Client

HT

TP

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components ...

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components ...

package org.ximtec.iserver.activecomponent.logic;

public class CommandLine extends EmptyLogic {

}

package org.ximtec.iserver.activecomponent.stub;

import java.io.IOException;

...

public class CommandLineStub extends SingleEventStub {

public static final String PARAM_COMMAND = "command";

public void finish() {

try {

Runtime.getRuntime().exec(getParameter(PARAM_COMMAND));

}

catch (IOException e) {

LOGGER.log(Level.SEVERE, Constant.EMPTY_STRING, e);

}

} // finish

}

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components ...

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components ...

Button

Slider

Slider2D

DateSelector

Browser

MapSelector

Capture

CaptureAndOcr

CaptureAndSpeak

Image

Sound

Movie

SQLClient

XCMRequest

ClientCtrlRequest

PaperPointControl

PaperPointAnnot

...

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Slider / Slider2D Active Component

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Cross-Media Authoring Tool

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Active Components Editor

PAPERPOINT_CONTROL

Show slide 1

command showSlide

slide 1

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

The Lost Cosmonaut

Writing as a collaborative

act of memory and story-

telling

Reading, writing and

narrative as an act of

making sense

Handwriting as a tool for

human computer

interaction

In collaboration with Axel Vogelsang,

Artists in Labs Programme

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Conclusions

Separation of interaction design and application

programming

Authoring rather than programming approach

Extensible cross-media framework

modular and extensible active components

resource plug-ins

Rapid prototyping

ICPCA 2008, October 7 Beat Signer, signer@inf.ethz.ch

Further Information

http://vub.academia.edu/BeatSigner

Fundamental Concepts for Interactive Paper

and Cross-Media Information Spaces, Beat

Signer, ISBN 978-3-8370-2713-6, May 2008

Prof. Moira Norrie Dr. Beat Signer Nadir Weibel Adriana Ispas

top related