Download - Observation and Usability Studies
![Page 1: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/1.jpg)
Observation and Usability Studies
Ericka BrunsonDorothy HirschMollee MarchJoanna McCloudDenise Tiller
![Page 2: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/2.jpg)
Focus on human behavior & actions
Part of mixed-methods approach
Naturalistic: how people really behave
What they have in common
![Page 3: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/3.jpg)
Test validity of other findings
Study specific processes or behaviors
Access behaviors of those unable to communicate
Observation studies can
![Page 4: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/4.jpg)
Three types of studies
Participant Observation
Reactive Observation
Unobtrusive Observation
![Page 5: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/5.jpg)
Study reference transactions
Analyze patron/librarian behavior
Study patron use of resources and tools
Library uses
![Page 6: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/6.jpg)
a thorough study over time
conducted in a natural environment
when the observer becomes part of the group being studied
rarely used by libraries because of expense in time and money
the basis of most cultural anthropological/ethnology group studies
Participant observation is
![Page 7: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/7.jpg)
Only studies behaviors, not cognition
Prone to research bias/misconceptions
Can be expensive, both in time and money
Ethical considerations
Limitations
![Page 8: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/8.jpg)
How information is obtained
What is done with the information
Do no harm: emotionally mentally socially economically
Ethical issues
![Page 9: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/9.jpg)
Are you watching me right now…or am I watching you?
Reactive observation
![Page 10: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/10.jpg)
A “real world” observational research method that studies individuals and groups of people in a natural, controlled setting
Participants are aware that they are being studied.
What is reactive observation?
![Page 11: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/11.jpg)
Behavior reflects aspects of social desirability
Observations can be manipulated to fit the research design
Reactive observation positives
![Page 12: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/12.jpg)
Individuals are reacting to observation
External validity
Reactive observation negatives
![Page 13: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/13.jpg)
Continuous monitoring
Time allocation
Common methods of reactive observation
![Page 14: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/14.jpg)
Involves studying the behavior of participants and recording as much as possible.
Works best in organizational settings such as:the workplaceeducational instituteswhen monitoring nutrition (exercise, food
intake, etc.)
Continuous monitoring
![Page 15: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/15.jpg)
The “Hawthorne Effect” states that “workers react to the attention they are getting from the researchers and in turn their productivity increases.”
The “Hawthorne Effect”
![Page 16: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/16.jpg)
Done at random
Researcher will choose the time and place to record activities before the researcher’s presence is known
Time allocation
![Page 17: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/17.jpg)
Descriptive
Inferential
Evaluative
Variables to consider in evaluating observations
![Page 18: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/18.jpg)
Subjects are unaware that they are being observed and researchers do not intrude on the study.
Unobtrusive measures
![Page 19: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/19.jpg)
Behavior trace studies
Disguised field observations
Types of measures
![Page 20: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/20.jpg)
Natural behavior of subjects
Reduces bias
Unobtrusive positives
![Page 21: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/21.jpg)
Researcher has little control over type of data collected
Not always a usable method
Subjects unaware of data being gathered
Other ethical issues
Unobtrusive negatives
![Page 22: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/22.jpg)
Tests system performance with typical users
Many library applications
Quick, easy, inexpensive
Usability studies - a bright idea
![Page 23: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/23.jpg)
Exploratory – early stage using screen shots and paper visuals
Assessment – mid-point focusing on the actual product
Verification – final stage to ensure product meets standards
Comparison – used in any stage to compare design options
Four types of usability studies
![Page 24: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/24.jpg)
Usefulness
Ease of learning
Ease of use
User satisfaction
Usability studies test
![Page 25: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/25.jpg)
Card sort
Prototypes
Usability tasks
Focus groups
Individual interviews
Methods used to collect data
![Page 26: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/26.jpg)
Type of study Exploratory
Purpose Test JoCo Library Children’s Web site
Methods used Prototypes, usability tasks, focus group
Participants Eleven children ages 6 to 11
Examples of library usability studies
Johnson County Public LibrariesJoCoKids Usability Study
April 25, 2009
![Page 27: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/27.jpg)
![Page 28: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/28.jpg)
Type of study Assessment
Purpose Test new web site
Methods used Prototypes, usability tasks, focus group
Participants Five mothers with children under age 6
Johnson County Public Libraries6 by 6 Usability StudySeptember 1-2, 2009
![Page 29: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/29.jpg)
Step 1Let participants explore the prototype web site and record comments
Step 2Usability tasks
6 by 6 usability study
![Page 30: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/30.jpg)
![Page 31: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/31.jpg)
Type of study Verification
Purpose Verify usability of new paper application
Methods used Usability task
Participants 10 patrons
Johnson County Public LibrariesNew Paper Application Card Usability
StudyJune 16, 2009
![Page 32: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/32.jpg)
Anschutz Library Renovation Project
2009-2010
Dec Emailed survey to faculty, staff and students
Mar-Sept Redesigned the main library floor and created the Learning Studio
Oct “Snapshot Day”
![Page 33: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/33.jpg)
![Page 34: Observation and Usability Studies](https://reader036.vdocument.in/reader036/viewer/2022062501/56816273550346895dd2e426/html5/thumbnails/34.jpg)
Beck, S.E. & Manuel,K. (2008). Observation and usability. In Practical research methods for librarians and information professionals. New York, N.Y.: Neal-Schuman Publishers, Inc.
Brown, L. & Trochim, W.M. (2006). Research methods knowledge base. Retrieved from Cornell University website: http://researchmethods.net.
Brown, L. (n.d.). Observational ield Research [Online tutorial]. Retrieved from Cornell University Library website: http://www.socialresearchmethods.net/tutorial/Brown/lauratp.htm.
Hendry, J. (1999). Other people's worlds: An introduction to cultural and social anthroplogy. New York, New York: Washington Square University Press.
Kumar, K. (1996). Using direct observation techniques [ CDIE Tips Series,4]. Retrieved from USAID Evaluation Publications website: http://pdf.usaid.gov/pdf_docs/PNABY208.pdf.
Lee, R.M. (2000). Introduction to unobtrusive methods. In Unobtrusive methods in social research, pp. 1-16.
Norlin, E. (2000). Reference evaluation: a three strep approach – surveys, unobtrusive observations, and focus groups. College and Research Libraries, 61(6),pp. 546-553.
Paul, B.D. (1953). Interview technigues and field relationships. In Kroeber, A.L. (1953). Anthropology Today: an encyclopedic inventory. Chicago, Illinois: University of Chicago Press.
Radin, P. (1966). The method and theory of ethnology: An essay in criticism[2nd ed.] New york and London, England: Basic Books. Reece, R.D. & Siegal, H. A. (1986). Studying people: A primer in the ethics of social research. Macon, Georgia: Mercer University Press.
Romanczyk, R.G. ,Kent, R.N., Diament, C., & O'Leary, D. (1973). Measuring the reliability of observational data: a reactive process. Journal of Applied Behavior Analysis, 6(1), 175-184.
Trochim, W.M. The research methods knowledge base, [2nd ed.]. Retrieved from: http://www.socialresearchmethods.net/kb/. Last revised: 10/20/2010.
Usability studies at Johnson County Libraries (n.d.) Retrieved from: http://jocolibrary.org/templates/JCL_InfoPage.aspx?id=3063&epslanguages=EN.
References