claw workshop slides oct25 (read-only)€¦ · analyzing qualitative data: intro...

ANALYZE THISCoding Qualitative Data

Shailoo Bedi & Ruby Warren

OVERVIEW: QUALITATIVE METHODS

Analyzing Qualitative

Data:Intro

When would you use qualitative methods?

Qualitative methods are useful to use when one:

• Is trying to answer “how” or “why” related to their assessment questions

• May have little control over an environment or event

• Needs to focus on a current issue or situation

• Requires an extensive “in-‐depth” description or assessment of the situation


Data:Intro

Examples of Qualitative Methods

• case study

• narrative inquiry

• interviews

• focus groups

• ethnography


Data:Intro

ACTIVITY15 minutes:

Discuss your experiences with qualitative methods.

• What was your assessment inquiry and why did you select a qualitative method?

• Which qualitative method did you select? And why the particular method you did?

• What challenges did you encounter?

CODING TRANSCRIPTS


Data:Get Those

Transcripts(Audio)

• Transcription Services

– Literally a million of them

– Transcript Heroes (Toronto, $35/hour)

– KJ Typing (Local Winnipeg, $25/hour)

• Transcription Software

– Dragon Naturally Speaking (desktop, $300)

– Transcribe (web, $20 annual fee)

– Express Scribe (desktop, foot pedal compatible, Free -‐$50)

• For When You Have No Money

– Use Enhancements in WMP to Slow Audio Play Speed

– Good ol’ Word Doc

– Literal mountain of coffee


Data:Get Those

Transcripts(Other)

• Field Notes

• Email/Letters/Memos

• Observer Notes

• Written Participant Responses

• Etc.


Data:CODING!!!

• "A code in qualitative data analysis is most often a word or short phrase that symbolically assigns a summative, salient, essence-‐capturing, and/or evocative attribute for a portion of language-‐based or visual data." -‐ Saldaña 2011

• You could also begin with Theming, which involves using long sentences to describe thematic elements in the text.

– This is less common & less flexible so we’ll skip it.


Data:Types of Coding

• Process Coding

– A word or phrase representing actions (-‐ing words)

• Descriptive Coding

– Summarizes the topic (nouns)

• In Vivo Coding

– Code using words/phrases from that section of the transcript

• Values Coding

– Identifying the Values, Beliefs, and Attitudes in the text

• Versus Coding

– Identifying conflicts in the data


Data:In Vivo

Example

• MP: I find, its kind of hard because sometimes when you’re only like two people and like you said different libraries have different policies right. But if you kind of just want a quiet area to work, in like, like a room, sometimes the librarian might say, oh you need two, three people.

• MI: Right.

• MP: So one time what we did, I’m not sure if this was legal or not, but we called, we pretended to call like one of our friends, we were like, hey can you come over, we need three people and just be here and the librarian was like, okay go ahead to the room, but he never showed up (chuckle). I know that’s bad but its kind of hard sometimes because we just want like two groups like since we were studying for math and the other person wasn’t in math at all.

“DIFFERENT POLICIES”

“WANT A QUIET AREA”

“KIND OF HARD”


Data:In Vivo Coding

ACTIVITY10 Minutes:

Code the one page transcript in front of you using In Vivo coding.


Data:In Vivo Coding

ACTIVITY5 Minutes:

Write the In Vivo codes you used into a list. Hang onto it, we’re gonna come back to it!


Data:Descriptive

Example

• MP: I find, its kind of hard because sometimes when you’re only like two people and like you said different libraries have different policies right. But if you kind of just want a quiet area to work, in like, like a room, sometimes the librarian might say, oh you need two, three people.

• MI: Right.

• MP: So one time what we did, I’m not sure if this was legal or not, but we called, we pretended to call like one of our friends, we were like, hey can you come over, we need three people and just be here and the librarian was like, okay go ahead to the room, but he never showed up (chuckle). I know that’s bad but its kind of hard sometimes because we just want like two groups like since we were studying for math and the other person wasn’t in math at all.

POLICY FRUSTRATION

GROUP SIZE

POLICY CIRCUMVENTION

GROUP SIZE


Data:Open

Coding

ACTIVITY10 Minutes:

Code a second copy of the one page transcript in front of you using descriptive coding.


Data:Open

Coding

ACTIVITY5 Minutes:

Write the Descriptive codes you used into a list.


Data:Improving

Credibility/Confirmability

• You can go forward like this on your own!

OR

• You can increase the number of coders on your project in order to increase your credibility.


Data:Creating a

Unified Code List

PAIR (or TRI) ACTIVITY15 Minutes:

• Grab a buddy (or two buddies if your table is odd numbered).

• Compare your lists of Descriptive codes. Try to consolidate codes with similar meanings or definitions into an agreed upon code.

• Write your list of agreed codes (& any unique codes from each individual list) into a new list of codes.


Data:ReCoding

ACTIVITY10 Minutes:

Re-‐code a fresh copy of the one page transcript using your agreed-‐upon code list.


Data:ICR (&

improving ICR)

• After creating a unified code list in this way, you can test your ICR (Inter Coder Reliability) using a variety of methods.

– Fleiss’ Kappa is the most common one, but there are others.

• Repeat these steps for each new transcript coded – adding to the unified list as necessary for new concepts, unifying those new concepts, and recoding with them.


Data:Improving

Credibility/Confirmability

• Once the final unified code list is completed, you may decide to return and re-‐code all transcripts/interviews with the complete list.

– Ensures that a concept identified later wasn’t simply missed earlier.

– Makes results seem more dependable.


Data:Categories

• Next, we group our codes into little abstractly labelled groups that make sense together, or Categories.

• We can then group those categories into broader top level categories if necessary.

• For traditional grounded theory, you want one final category – other theorists say 3-‐7 is final goal.


Data:Categories

• While making codes and categories it can be helpful to make small analytic memos to yourself – these can explain how codes fit into categories, or potential connections you want to investigate later.

• Try to use formatting to make your memos skimmable.


Data:Categories

Example

• POLICY FRUSTRATION

• GROUP SIZE

• POLICY CIRCUMVENTION

• CONVENIENCE

• PRE-‐BOOKING

• PROCEDURE VISIBILITY

• DIDN’T KNOW ABOUT SERVICE

• POLICY ENFORCEMENT


Data:Categories

Example

• LIBRARY POLICY– POLICY

FRUSTRATION

– POLICY CIRCUMVENTION

– POLICY ENFORCEMENT

• ACCESS– CONVENIENCE

– PRE-‐BOOKING

– GROUP SIZE

• AWARENESS– DIDN’T KNOW

ABOUT SERVICE

– PROCEDURE VISIBILITY


Data:Categories

Example

• LIBRARY POLICY– POLICY

FRUSTRATION




– PRE-‐BOOKING

– GROUP SIZE


ABOUT SERVICE


• RULES– POLICY

FRUSTRATION




– PRE-‐BOOKING

– POLICIES ONLINE

– GROUP SIZE


ABOUT SERVICE



Data:Categories

ACTIVITY10 Minutes:

Look at your In Vivo code list. Divide your codes into categories that make sense to you.

TIP: A category should pass a “touch” test – can you touch it? Find a more abstract way of communicating.


Data:Categories

ACTIVITY10 Minutes:

Look at your Unifed Descriptive code list. Divide your codes into categories that make sense to you.

TIP: A category should pass a “touch” test – can you touch it? Find a more abstract way of communicating.


Data:Finding

Relationships

• Next we use memos, the transcripts, and diagrams to identify potential relationships between our categories.

• Feel free to write more memos at this stage! Explain your relationships – this becomes a rough draft of your report.


Data:Grounded

Theory

• The effort to make Qualitative Data more rigorous, increasing credibility and perceived reliability.

• 10-‐30 interviews

• Cyclical process – open coding, categorizing (sometimes called axial coding), adding open codes as necessary with next interview and categorizing/recategorizing, etc etc

• Finally identifying a single theme

CODING VISUAL IMAGES


Data:The Case for

Visual Images

At your tables, please discuss the following questions: (5 mins)

• Why use visual qualitative approaches?

• What are some examples of visual forms that can provide us with data?

• What is so special about visual data?


Data:How to Code

Visual Images

When coding an image:• Look for meaning• Think about context

Ask yourself:– What is being framed in the photo?

– What labels might you apply?– Are there patterns? If so, what do the patterns highlight?


Data:Visual Image

Coding

ACTIVITY


Data:Visual Image

Coding

Activity Wrap up


Data:Visual Image

Coding

Strengths to using visual data for assessment

Challenges or limitations


Data:References &

Further Reading

• Gubrium, J. F., Holstein, J. A., Marvasti, A. B. & McKinney, K. D. (2012). The SAGE handbook of interview research: The complexity of the craft Thousand Oaks, CA: SAGE Publications Ltd doi: 10.4135/9781452218403

• Kelle, U. (2007). The development of categories: different approaches in grounded theory. In Bryant, A. & Charmaz, K. The SAGE handbook of grounded theory (pp. 191-‐213). : SAGE Publications Ltd. doi: 10.4135/9781848607941

• Pink, S. (2001). Doing ethnography: Images, media and representation in research. London: Sage.

• Pink, S. (2003). Interdisciplinary agendas in visual research: Re-‐situating visual anthropology. Visual studies, 18(2), 179-‐192.

• Saldaña, J. (2011). Fundamentals of Qualitative Research. New York: Oxford University Press.

• Schwartz, D. (1989). Visual ethnography: Using photography in qualitative research. Qualitative Sociology, 12(2), 119-‐154.

• Spencer, S. (2011). Visual research methods in the social sciences: Awakening visions. London & New York: Routledge.

claw workshop slides oct25 (read-only)€¦ · analyzing qualitative data: intro...

Documents