sensorial and

musical interaction

Birgitta Cappelen, AHO, 2. November 2012

Overview Sensorial and musical interaction

the context – the RHYME-project

the design challenge

the assignments

Group presentations

Exhibition 16.30 – 19.00

the context

module in master course

Tangible Interaction

Interaction Design

3 RHYME courses 2010 e-textile (with KhiO-textile)

2011 Musical interaction and e-textile (KhiO)

2012 Sensorial and musical interaction

the

RHYME project

(2010-2015)

VERDIKT – The future of Internet

RHYME co-creation through

tangible interaction

and music

co-creation with tangible,

spatial, cross-media

by communicative, musical and

narrative principles

to improve health and well-being

for people with severe disabilities

RHYME

project background

music effects

health and wellbeing

16 family musiking in Vinings

multisensory room- Snoezelen

a white Snoezelen Room

the Internet of Things

Ubiquitous Computing

multidisiplinary:

tangible interaction

universal design

music therapy

interactive Art

RHYME

project goal

improve health through

24 playing in ORFI

reduction of

isolation and passivity

family playing in Wave Carpet

evoke positive feelings

increase ability to master

develop and strengthen

social relations

RHYME

development so far

2 new generations of

interactive musicking “things”

(tangibles)

5 new hardware platforms

to sketch up new concepts

iDevice, jDevice, kDevice (bluetooth)

(iPhone/iPod,

RHYME mobile breakout card, sensors,LEDs)

RHYME wireless (Android, Google I/O ADK)

RHYME wired

(Arduino Mega, Shield, MiniMac)

iPod Touch inside Wave Orange

tactile textile touch sensors

33 Current music technology

Wave Carpet’s bubble field

Reflect’s ligt field

people with dementia remember with music playing in Wave Carpet

details of light and sound fiels in Wave Orange

the design challenge

the design challenge

motivate musicking for diverse users

sensorial embodied interaction

cross-media possibilities

e-textile and soft interaction

mobile technology

resource orientation

empowering

design for diversity

Musicking

40

musicking

from Music as a work of art (object)

to Music as a meaning making and relation building

equal activity (verb)

play, listen, sing, dance, hum, move, rug, shake,

stroke, sleep, clapping, running, step...

It is about expressing ones identity in and with music

and music related activities in everyday situations

41

42 friends playing in ORFI

cross-media explorations

build cross-media consistent expectations over time

offer many ways of self-expression and cross-media interaction

Cross-media possibilities in Wave Carpet

so far...

limited smart textile

available possibilities

Current smart textile possibilities

(X-labs, Worbin, Diffus)

too slow

too fragile and

unsatisfactory surface qualities

current smart textile possibilities, Philips, Diffus

transparency and tactility

Girl interacting with Wave Carpets bubble field

Anima ligt bubbles

Resource and Empowerment

orientation

Focus on the persons strengths and abilities, not their

special needs, weaknesses and diagnosis

offer:

positive experiences, no wrongs or failing

ways to vitality and self-expression

ability to act and build competence (mastering)

ways to strengthen mutual social relations

diverse ways to share and participate

54

55 Boy musicking in ORFI

Accessibility

Design for Diversity

the assignments

4 Weeks 1. Sensorial Interaction . Create 4 input sensors each.

Focus on Shape, Structure, Material, Surface, Interaction, Accessibility.

2. Create 3 Concepts for Sensorial and Musicking Tangibles.

Focus on motivation, musicking and co-creation over long time.

Use iPod Touch, kDevice, mobile battery, Speaker,

3. 4. Designing and build one concept .

Focus on making it work, interaction, sensorial stimulation and

musicking.

Group presentation

Stump Drum - Valeria, Martin, Sven-Håkon

Rolling Rock - Amra, Anders

Cove - Berit, Lucien

Chilli Net - Ron, Mariko

Ebbe - Sara, Bai Daniel

Whispering willow - Hans Jakob, Rosita

www.RHYME.no