ubiquitous computing field studies - parkjonghyuk.net

Ubiquitous

Computing

Field Studies Part 1

1

Table of contents

Introduction

Three Common Types of Field Studies

Current Behavior

Proof of Concept

Experience Using a Prototype

Study Design

What will Participants Do?

What Data Will You Collect?

How Long is Your Study?

Table of Contents 2

Introduction

3

Introduction

Introduction

People and their use of technology are the

center of ubiquitous computing

Various method to know Human Computer

Interaction.

This chapter describes Field Study.

Field study observe people in the real world

Trade-off is from realism is loss control over

the participant’s experience

Introduction 4

3 Common Types of Field

Studies

5

3 Common Type of Field Studies

Three Common Types of Field Studies

Help you determine the research question

for your study

Think carefully about what you wish to learn

by conducting field study

Three common types are

Studies of current behavior

Proof-of-concept studies

Experience using a prototype

3 Common Type of Field Studies 6

Current Behavior (1 of 2)

Explores how people use existing

technology

Contribution : understanding of current

behavior and implications for future

technology

Research Questions : typically emphasize

how people use technology


Current Behavior (2 of 2)

Example 1

Home Technology Sharing and use.

Research Question : How do families use and

share technology in their homes?

Example 2

Proximity of Users to Their Mobile Phones

(Phone Proximity)

Research Question : Is mobile phone a

suitable proxy for the owner’s location?


Proof of Concept (1 of 2)

Develop novel technology or seek to

validate new algorithm and approaches

Contribution : Technological advance. Field

study is to validate the feasibility of an

approach or prototype

Research question : generally focus on

whether the prototype or algorithm

functions appropriately in a real

environment


Proof of Concept (2 of 2)

Example 1:

Team Aware (Augmented basketball jersey)

Research Question: Are augmented jersey

usable and useful? Do people understand

the displays?


Experience Using a Prototype (1 of 3)

Deploying Ubiquitous computing prototype

for longer period

Contribution : Experience of the people

using the prototype that not commercially

available. In some cases use Wizard of Oz.

Research question : focus on concept of

the prototype embodies or tests.


Experience Using a Prototype (2 of 3)

Example 1:

CareNet, Ambient Display and sensed data

for elder care.

Hypothesis: Ambient displays can positively

impact the local members of an elder’s care

network


Study Design

13

Study Design

Table of contents

Study Design

What will Participants Do?

Control Condition

What Data Will You Collect?

Logging

Surveys

Experience Sampling Methodology

Diaries

Interviews

Unstructured Observations

How Long is Your Study?

Study Design 14

What Will Participants Do? (1 of 2)

Depends on type of field study and

research question

Traditionally, researcher create hypothesis

Do the field study to reject the hypothesis

Identify variable called Independent

variable vary between Conditions in order

to understand the Dependent variable they

are measuring.

What will participants do 15

What Will Participants Do? (2 of 2)

The two main laboratory study designs are within-subjects and between-subjects

Within-subject design also called repeated measures design. Each participant experiences all condition.

Between-subject divide participants into different groups, typically randomly, each participant experiences only one condition.

Some studies use a mixed design where some independent variables are within-subjects and some are between-subjects


Control Condition

Measure the dependent variables for a

certain period before you introduce the

technology

To obtain baseline information about your

participants and their expectations.

However, collecting control data is not

appropriate for all ubicomp studies


Addition to deciding on your study method

If you are introducing new technology,

some considerations :

Will participants use the technology as they

wish or to complete specific tasks?

Will you give the participant technology to

use or augment the technology the

participant already owns?

Should you simulate any part of the

participant’s experience?


What Data Will You Collect

Quantitative data can be objectively

observed and represented numerically

Qualitative data helps understand what

people think and hopefully why people

behaved in certain ways during study

It is valuable to collect both quantitative

and qualitative data.

There are various methods for collecting

data (such as Logging, Surveys, etc)

What data will you collect 19

Logging

Often the main method for collecting

quantitative data about technology usage.

Prototype writes information to a data file.

Considerations for logging

How will you use the logged data?

Have you forgotten to log something

important?

Will your logging help you know if the study is

going smoothly?


Surveys (1 of 2)

Often used to gather data before field

study begins (presurvey)

After any changes of condition in a

between subjects study (postcondition)

At the end of the study (postsurvey)

They may also be used at regular intervals

(e.g. a weekly survey).

Common types of survey question like

open-ended, multiple choice and likert

question


Surveys (2 of 2)

Several factors to consider when creating

survey questions

Are the questions stated to allow both

positive and negative responses?

Are the questions clear to other?

Will the questions obtain the information

needed from participants?


Experience Sampling Methodology

A technique borrowed from psychology.

Fill out questionnaires at various points

To get qualitative data

Considerations

How often should you ask participants to

answer question?

How many questions will you ask on each

survey?

Do you want to collect sensor data using ESM

techniques?


Diaries

Participants are making diary entries

To get something that would not be possible to sense using ESM tool

Greater concerns about participation, because participant not carrying a device that interrupts them

Considerations

How will you remind participant to complete their diary entries?

How will you incent participants to complete their diary entries?


Interviews & Unstructured Observation

To get qualitative data.

Researcher frequently use semi structured interview

Considerations

Are your questions phrased as neutrally as possible?

Are you prepared to take negative feedback without becoming defensive

When collecting data through observation, participants are observed as they engage in their normal lives.


How Long Is Your Study?

No definitive answer. Considerations :

What type of study is it?

Do you expect novelty effects to be an issue?

How much work do participants have to do?

How frequently will participants use your

technology or engage in the behavior you

are trying to study?

How many times during the study will you

interact with participants?

How long is your study 26

Thank you Questions?

27

ubiquitous computing field studies - parkjonghyuk.net

Documents