determining readability

41
Determining Readability How to Find Out Whether Users Understand Your Content Angela Colter (@angelacolter) UPA 2010 Munich

Upload: angela-colter

Post on 25-Dec-2014

3.028 views

Category:

Design


5 download

DESCRIPTION

Ever wondered whether your audience could understand your information? Here are a few methods you can use to estimate the reading level required to understand text and to test whether your readers understand your content.

TRANSCRIPT

Page 1: Determining Readability

Determining Readability How to Find Out Whether Users Understand Your Content

Angela Colter (@angelacolter)UPA 2010Munich

Page 2: Determining Readability

The Reading Process

Page 3: Determining Readability

Decoding

Recovering the spoken word that the printed

word represents

Page 4: Determining Readability

The quick brown fox jumps over the lazy dog

phoneme morpheme

literal comprehension

Page 5: Determining Readability
Page 6: Determining Readability

Find out what users understand,

not what they say they understand.

Page 7: Determining Readability

Test Text with Users

Page 8: Determining Readability

Cued response

Read the text, then paraphrase aloud

Page 9: Determining Readability
Page 10: Determining Readability

Pre-test / Post-testTest domain knowledge,Read the text, Test again

Page 11: Determining Readability

Cloze procedure

Delete every 5th word,fill in the blanks

Page 12: Determining Readability
Page 13: Determining Readability

ActivityCloze Procedure

Page 14: Determining Readability

Cloze Example

Short-term memory works a _________ like the bucket you _________ to

catch water dripping _________ a leak in the _________. When the bucket is

_________ —but you can see _________ more water is coming—_________

do you do? You _________ it all out and _________ the empty bucket back

_________ the leak. If short-term _________ has been filled to _________ but

more is coming, _________ don’t selectively discard what’s _________ there.

We dump everything _________ so we can catch _________ rest. That means

it’s _________ a good idea to _________ lots of information hoping _________

readers will remember some _________ it. It’s likely they _________

remember any of it. _________ characteristic of short-term memory

_________ to everyone, but there _________ differences in the size _________

the bucket. Adults with _________ literacy skills can store _________ seven

chunks of information _________ a time in short-term _________. The

number for poor _________ may be closer to _________ or fewer.

Page 15: Determining Readability

Cloze Example

Short-term memory works a LOT like the bucket you USE to

catch water dripping FROM a leak in the CEILING. When the bucket is

FULL —but you can see THAT more water is coming— WHAT

do you do? You THROW it all out and PUT the empty bucket back

UNDER the leak. If short-term MEMORY has been filled to CAPACITY but

more is coming, WE don’t selectively discard what’s CURRENTLY there.

We dump everything OUT so we can catch THE rest. That means

it’s NOT a good idea to LIST lots of information hoping YOUR

readers will remember some OF it. It’s likely they WON’T

remember any of it. THIS characteristic of short-term memory

APPLIES to everyone, but there ARE differences in the size OF

the bucket. Adults with ADEQUATE literacy skills can store AROUND seven

chunks of information AT a time in short-term MEMORY. The

number for poor READERS may be closer to FIVE or fewer.

Page 16: Determining Readability

Score = (exact matches / blanks)

• 60% or more: “independent level” Reader understood 90% of the material

• 40-60%: “instructional level” Reader understood 75% of the material

• Under 40%: “frustration level”Material is too difficult for this audience

Page 17: Determining Readability

Estimate the Grade Level

of Text

Page 18: Determining Readability

Readability Formulas

Page 19: Determining Readability

.39 x ( ) + 11.8 x ( ) - 15.59# of words

# of sentences

syntacticfactor

Flesch Grade Level Formula

# of syllables# of words

semanticfactor

Page 20: Determining Readability

ActivityFry Readability Graph

Page 21: Determining Readability

Fry Readability Graph Exercise

I stand here today humbled by the task before us, grateful for the

trust you have bestowed, mindful of the sacrifices borne by our

ancestors.

Forty-four Americans have now taken the presidential oath. The

words have been spoken during rising tides of prosperity and the

still waters of peace. Yet, every so often, the oath is taken amidst

gathering clouds and raging storms. At these moments, America

has carried on not simply because of the skill or vision of those in

high office, but because We the People have remained faithful to

the ideals of our forebearers, and true to our founding documents.

Page 22: Determining Readability

Use a 100-word sample

I stand here today humbled by the task before us, grateful for the

trust you have bestowed, mindful of the sacrifices borne by our

ancestors.

Forty-four Americans have now taken the presidential oath. The

words have been spoken during rising tides of prosperity and the

still waters of peace. Yet, every so often, the oath is taken amidst

gathering clouds and raging storms. At these moments, America

has carried on not simply because of the skill or vision of those in

high office, but because We the People have remained faithful to

the ideals of our forebearers, and true to our founding documents.

Page 23: Determining Readability

Count the number of syllables and sentences

I stand here today humbled by the task before us, grateful for the

trust you have bestowed, mindful of the sacrifices borne by our

ancestors.

Forty-four Americans have now taken the presidential oath. The

words have been spoken during rising tides of prosperity and the

still waters of peace. Yet, every so often, the oath is taken amidst

gathering clouds and raging storms. At these moments, America

has carried on not simply because of the skill or vision of those in

high office, but because We the People have remained faithful to

the ideals of our forebearers, and true to our founding documents.

Page 24: Determining Readability

Only mark after the first syllable

I stand here today humbled by the task before us, grateful for the

trust you have bestowed, mindful of the sacrifices borne by our

ancestors.

Forty-four Americans have now taken the presidential oath. The

words have been spoken during rising tides of prosperity and the

still waters of peace. Yet, every so often, the oath is taken amidst

gathering clouds and raging storms. At these moments, America

has carried on not simply because of the skill or vision of those in

high office, but because We the People have remained faithful to

the ideals of our forebearers, and true to our founding documents.

✓ ✓ ✓ ✓

Page 25: Determining Readability

Fry Readability GraphN

umbe

r of

sen

tenc

es

Number of syllables

Page 26: Determining Readability

Remember to• Understand the limitations of

formulas

• Use an appropriate formula

• Use an automated tool

• Prepare the text

• Avoid writing to the formula

Page 27: Determining Readability

The quick brown fox jumps over the lazy dog.

This sentence is written at a second grade level:

Page 28: Determining Readability

Brown over the dog quick the lazy jumps fox.

So is this one:

Page 29: Determining Readability

Dxr owcn kothv ert oghe qazui pelju mps foy.

This one too:

Page 30: Determining Readability

Remember to• Understand the limitations of

formulas

• Use an appropriate formula

• Use an automated tool

• Prepare the text

• Avoid writing to the formula

Page 31: Determining Readability
Page 32: Determining Readability

Remember to• Understand the limitations of

formulas

• Use an appropriate formula

• Use an automated tool

• Prepare the text

• Avoid writing to the formula

Page 33: Determining Readability

Improving comprehension by writing to a readability formula is like lighting a match under a thermometer to warm up a room.

George Klare

Page 34: Determining Readability

Estimate the Reading Level

of Users

Page 35: Determining Readability

Who is the general public?

Page 36: Determining Readability

In the United States

44%

of adults have low literacy skills

%

2003 National Assessment of Adult Literacy

Page 37: Determining Readability

Rate of adults with low literacy skills

Sweden 25%

Netherlands 36%

Germany 42%

Australia 44%

Switzerland 47%

United Kingdom 50%

Ireland 57%

Hungary 67%

Portugal 80%

1998 International Adult Literacy Survey (OECD)

Page 38: Determining Readability

REALM Rapid Estimate of Adult Literacy in Medicine

• Word recognition test

• Quick and easy to administer

• Participant says each word out loud. Scored on number pronounced correctly61-66: not low lit45-60: grade 7-819-44: grade 4-6 0-18: grade 3 or below

• Doesn’t matter if they know the word’s meaning

fat fatigue allergic

flu pelvic menstrual

pill jaundice testicle

dose infection colitis

eye exercise emergency

stress behavior medication

smear prescription occupation

nerves notify sexually

germs gallbladder alcoholism

meals calories irritation

disease depression constipation

cancer miscarriage gonorrhea

caffeine pregnancy inflammatory

attack arthritis diabetes

kidney nutrition hepatitis

hormones menopause antibiotics

herpes appendix diagnosis

seizure abnormal potassium

bowel syphilis anemia

asthma hemorrhoids obesity

rectal nausea osteoporosis

incest directed impetigo

Davis T, Long S, et alRapid estimate of adult literacy in medicine: a shortened screening instrumentFam Med. 1993; 25: 391-395

Page 39: Determining Readability

ActivityREALM

Page 40: Determining Readability

How have you tested readability

?

Page 41: Determining Readability

Q&A Angela Colter angelacolter.com/readability [email protected]