Demonstration of Narrative Analysis Software (NVivo 7.0)
Lori Kurth and Fumiyo Tao
Abt Associates Inc.
Overview
• Quantitative and qualitative analysis of first year MSP reports
• Types of qualitative data• Method of qualitative analysis• Coding categories• Software demo• Developing models from analyses• Questions and comments
Quantitative and Qualitative Analyses
• Quantitative analyses for numerical Project Profile data
• Qualitative analyses of narrative data in Project Profiles and Project Narratives
• Preliminary quantitative analyses and some qualitative analyses from Project Profile data presented tomorrow
Types of Qualitative Data
• Attributes– Definable characteristics of a project (e.g.,
content area or grade span)
• Larger categories– Specific themes of PD activities and evaluation
(e.g., details of summer institutes or matched comparison evaluation design)
Method of Qualitative Analysis
• NVivo 7.0 software– Flexible coding of narrative data within specific
categories– Analyze data within and between categories
Coding Categories
*See Coding Tree handout (end of slides)
1 Description of Project
2 Characteristics of Professional Development
3 Project Evaluation
Software Demo
Developing Models from Analyses
Materials and assessments PD models
Questions and Comments
DRAFT Coding Tree - ED MSP APR Narrative Data
1 Description of Project
1-1 Goals
1-1-1 Goals – Addl info
1-2 Abstract
1-3 Partners and their Roles/Providers
1-3-1 Partners and their Roles/Providers – Addl info
1-41-4 Other Information on Project (Including Budget, Schedule, Antic Outcomes, Dissem Plans, Innovative Activ, Lessons
Learned, Future Plans, etc)
1-5 Appendices
1-6 Great Quotes on Project
2 Characteristics of Professional Development
2-1 Types of PD Activities and Structure
2-1-1 Summer Institutes
2-1-2 On-line Course Work
2-1-3 Distance Learning Networks
2-1-4 On-site Professional Learning Experience
2-1-5 Study Groups
2-1-6 Types of PD Activities and Structure – Addl info
2-2 Content
2-2-1 Math Content Only
2-2-2 Science Content Only
2-2-3 Math and Science
2-2-4 Other
2-2-5 Content – Addl info
2-3 Resource Development (including curric materials, use for states not implementing a PD program)
2-4 Needs of Districts/Participants (including basic info on participants and recruitment and retention issues)
2-4-1 Needs of Districts/Participants – addl info,including names, #s, etc.
2-5 Purposes of PD Activities
2-5-1 Train teacher leaders/mentors/coaches
2-5-2 Increase teacher content knowledge
2-5-3 Purpose of PD Activities – Addl Info
2-6 Other PD Information
2-7 Great Quotes on PD
DRAFT Coding Tree (continued)
ED MSP APR Narrative Data
3 Project Evaluation
3-1 Evaluation Design and Analysis Methods
3-1-1 Evaluation Design and Analysis Methods – Addl info
3-2 Student Assessments
3-2-1 Math State Assessment
3-2-2 Science State Assessment
3-2-3 Other Assessment
3-2-4 Student Assessments – Addl info
3-3 Teacher Assessments
3-3-1 Tchr Content Knowledge Assessment
3-3-2 Classroom Observation Protocol
3-3-3 Other
3-3-4 Teacher Assessments – Addl info
3-4 Student Findings
3-4-1 Student Findings - Addl info
3-5 Teacher Findings
3-5-1 Teacher Findings - Addl info
3-6 School-Level Findings
3-6-1 School-Level Findings - Addl info
3-7 Other Evaluation Information
3-8 Great Quotes on Evaluations