Cyclic input of characters throCyclic input of characters through a single digital button ugh a single digital button without visual feedbackwithout visual feedback

Yang Xiaoqing

xiaoqing.yang@uta.fi

New Interaction TechniquesNew Interaction TechniquesDept. of Computer and Dept. of Computer and Information SciencesInformation SciencesUniversity of TampereUniversity of Tampere25.02.200325.02.2003

Introduction to the problemIntroduction to the problem

Spatial-temporal mapping Spatial-temporal mapping

& perceptive features& perceptive features

Control by the sonification Control by the sonification

of of spatial patterns spatial patterns

MobileMobile

People with special needs People with special needs

Background Background and previous researchand previous research

Traditional seven-segment display Traditional seven-segment display element is used as a layout for symbol element is used as a layout for symbol imaging. imaging. Commercial systems and Commercial systems and equipments are on sale, but most are equipments are on sale, but most are used for displaying numbers.used for displaying numbers. If each of the segments is lighted aIf each of the segments is lighted accordingly to a single user action a teccordingly to a single user action a temporal sequence can be useful for immporal sequence can be useful for imaging in cyclic input techniques.aging in cyclic input techniques.

Objectives in generalObjectives in general

To study the features of user perception of To study the features of user perception of

spatial-temporal mapping through spatial-temporal mapping through

sonification of spatial patternssonification of spatial patterns

Spatial ModelSpatial Model Cyclic SynthesisCyclic Synthesis

A B /8 C D E F G /6 H I J

K L M N O /0 P Q R S /5 T /7

U V W X Y Z /2 1 3 9

Sound ModelSound Model Cyclic SynthesisCyclic Synthesis

Sound

Time

soundgraph

act i

on

sound

Sound

Sound

F0

mu

sica

l in

terv

al

Fm

ax

Schedule Schedule

Design the method & Design the method & Preliminary testsPreliminary tests

Early March (2 weeks)Early March (2 weeks)

Usability testingUsability testing Mid MarchMid March

Data analysisData analysis Mid March (1 week)Mid March (1 week)

Project report /draftProject report /draft Early AprilEarly April

Revising & Final Revising & Final paperpaper

Early April (3 days)Early April (3 days)

Research methods Research methods

Conceptual modeling for spatial-temporal Conceptual modeling for spatial-temporal structures and relationships. structures and relationships.

Constructive research to design and simulate Constructive research to design and simulate the temporal components and relationships.the temporal components and relationships.

Usability evaluation of user activity under Usability evaluation of user activity under different time conditions and communication different time conditions and communication with computer without visual feedback. with computer without visual feedback.

Empirical research of the rhythmic musical Empirical research of the rhythmic musical sequences coordinated to spatial seven-sequences coordinated to spatial seven-segment layout.segment layout.

Experimental setupExperimental setup

Snapshot of the program during testingSnapshot of the program during testing

Experimental setupExperimental setup

• Snapshot of the program with opened frame of the tools

Preliminary resultsPreliminary results

From previous investigation, From previous investigation, tthe duration of the cycle in this case depends on the speed on which the user can act.

Even if the user had Even if the user had experience s/he could not experience s/he could not predict what next symbol predict what next symbol will be presented. Therefore will be presented. Therefore the first segment is the most the first segment is the most difficult, at least, during the difficult, at least, during the test. test.

Forecasted results Forecasted results The new techniques for an evaluation of user beThe new techniques for an evaluation of user be

havior concerning temporal features of feedback havior concerning temporal features of feedback cues. cues.

Dynamics for user performance evaluated Dynamics for user performance evaluated through:through:

reaction time per spatial pattern /symbolreaction time per spatial pattern /symbol;; a number of errorsa number of errors Sound parameters for sonification the array of sSound parameters for sonification the array of s

patial patternspatial patterns Conceptual model for a simple spatial-temporal Conceptual model for a simple spatial-temporal

structurestructure

Prospective scientific issues Prospective scientific issues & possible applications& possible applications

The temporal space for human-computer The temporal space for human-computer interaction:interaction:

perception features of temporal events;perception features of temporal events; influence of modality onto the time influence of modality onto the time

perceptionperception

Event modality & spatial-temporal mappingEvent modality & spatial-temporal mapping

Synthesis and visualization of temporal objectsSynthesis and visualization of temporal objects

References References Kirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of tKirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of t

he 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlhe 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlbaum (1995). baum (1995).

Lauruska, V.: Computerized Control and Communication System for Handicapped. In: KlLauruska, V.: Computerized Control and Communication System for Handicapped. In: Klaus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, aus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, (Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) 515-520(Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) 515-520

Keytools TM Product information available at: Keytools TM Product information available at: http://www.keytools.com/input/ability.htmhttp://www.keytools.com/input/ability.htm

Mind Controlled Switch, information available at: Mind Controlled Switch, information available at: http://www.mctos.com/htm/mctos.htmhttp://www.mctos.com/htm/mctos.htm

Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Manipulation In Proc. of the 8Manipulation In Proc. of the 8 thth Int. Conf. on Computers Helping People with Special Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002, Linz, Austria, 15-20 July. J.Klaus, K.Miesenberger, W. L. Zagler Needs. ICCHP 2002, Linz, Austria, 15-20 July. J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp. 259-266. (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp. 259-266. 

Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp.735-736.INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp.735-736.

Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information Technology, 2000, Vol. 19(6), 451-463.Information Technology, 2000, Vol. 19(6), 451-463.

Hanappe, P. Design and implementation of an integrated environment for music Hanappe, P. Design and implementation of an integrated environment for music composition and synthesis. PhD Theses, 1999, available at: composition and synthesis. PhD Theses, 1999, available at: http://www.ircam.fr/equipes/repmus/Rapports/PeterHanappe99/http://www.ircam.fr/equipes/repmus/Rapports/PeterHanappe99/