- List of Multimodal Libraries -

(UniFr students only)

The MMI team MMI_01

Multimodal Interfaces Toolkits : small project ( - UniFr)Toolkits : small project ( - UniFr)

For UniFr students: A) Small project using the designated library B) Provide a documentation (3 copies) and a CD containing:

The Library How to install and use the project What it does and how it works Details about the library Quick state of the art of the specific domain, if applicable

PPPP

The MMI team MMI_01

Multimodal Interfaces TK2: Papier-Mâché TK2: Papier-Mâché !! Taken !!!! Taken !!

Target : tangible interaction

« Open-source toolkit for building tangible interfaces using computer vision, electronic tags, and barcodes. »

Langage : java / Platform : all

Suggested form : small project

http://hci.stanford.edu/research/papier-mache/index.html

Project: Localize a particular object on a table Mixing RFID for identification and vision for localisation (webcam)

PPPP

PPPP

The MMI team MMI_01

Multimodal Interfaces TK4: ARToolkit +jARToolkit TK4: ARToolkit +jARToolkit !! Taken !!!! Taken !!

Target : augmented reality « Software library for building Augmented Reality (AR) applications. These are

applications that involve the overlay of virtual imagery on the real world. » Language : C / Platform : all Suggested form : small project http://www.hitl.washington.edu/artoolkit/ http://sourceforge.net/projects/jartoolkit/

Project: Augment paper documents with information on the content and authors, dates, etc.

PPPP

PPPP

The MMI team MMI_01

Multimodal Interfaces TK6: Infovis + Prefuse ToolkitTK6: Infovis + Prefuse Toolkit

Target : visualisation toolkit « A Java-based toolkit for building interactive information visualization

applications. » Language : Java / Platform : all Suggested form : small project http://ivtk.sourceforge.net/ http://prefuse.sourceforge.net/

Project: Infovis contest 2004 (visualize articles by, e.g.,

authors, date of publishing, etc.); XML source data already parsed by your favorite assistant ^^

PPPP

PPPP

The MMI team MMI_01

Multimodal Interfaces TK9: CLSU toolkit (1)TK9: CLSU toolkit (1)

Target : speech dialog

« A comprehensive suite of tools to enable exploration, learning, and research into speech and human-computer interaction. »

Platform : Win32

Suggested form : small project

http://cslu.cse.ogi.edu/toolkit/download/index.html

Project: Make a dialog system to order a pizza

PPPP

PPPP

The MMI team MMI_01

Multimodal Interfaces TK15: ReacTiVision TK15: ReacTiVision !! Taken !!!! Taken !!

Target : tangible interaction

« open source, cross-platform computer vision framework for the fast and robust tracking of fiducial markers in a real-time video stream. It was mainly designed as a toolkit for the rapid development of table-based tangible user interfaces (TUI). »

Platform : All (nearly)

Suggested form : small project

http://www.iua.upf.es/mtg/reacTable/?software

Project: Tracking of an object on a table

PPPP

PPPP

The MMI team MMI_01

Multimodal Interfaces TK16: EyesWeb (2)TK16: EyesWeb (2)

Target : multimodal toolkit

« EyesWeb consists of a number of integrated hardware and software modules which can be easily interconnected and extended. »

Plate-forme : Windows

Suggested form : small project

http://www.infomus.dist.unige.it/Index.html

Project: Recognize letters of the alphabet drawn with the body “YMCA project” :-)

PPPP