social network analysis for evaluation: open and closed approaches carl hanssen november 6, 2008...
TRANSCRIPT
Social Network Analysis for Evaluation:
Open and Closed Approaches
Carl HanssenNovember 6, 2008
American Evaluation Association
The Milwaukee Mathematics Partnership (MMP) is supported with funding from the National Science Foundation.
www.hanssenconsulting.com 2
Agenda
Context
Open & Closed Approaches
Strengths & Limitations
www.hanssenconsulting.com 3
Context
Milwaukee Math Partnership Comprehensive Work in multiple schools Goal: Distributed Leadership
Life Sciences for a Global Community Institute partnership Work with 3 cohorts of 30 teachers Goal: Teacher leader network
www.hanssenconsulting.com 4
Open Approach
Respondent pool defined by the organization
Clean slate
Interested in network members inside and outside the organization
Interested in specific individual roles
www.hanssenconsulting.com 5
Low
Student Achievement:2007: 66% Proficient3-year trend: -9%
School n Total Named
Network density
Density in school
MTL Role--In Degree
MTS Role--In Degree
K 11 57 3.8% 13.7% 7.6 0.4
Average 23 66 4.8% 10.7% 16.5 3.4 SD 9.3 24 1.7% 2.5% 6.4 4.1 Median 23 64 4.1% 11.0% 15.0 1.4
www.hanssenconsulting.com 6
High
Student Achievement:2007: 53% Proficient3-year trend: +3%
School n Total Named Network density
Density in school
MTL Role--In Degree
MTS Role--In Degree
G 32 79 5.0% 12.1% 16.3 5.4
Average 23 66 4.8% 10.7% 16.5 3.4 SD 9.3 24 1.7% 2.5% 6.4 4.1 Median 23 64 4.1% 11.0% 15.0 1.4
www.hanssenconsulting.com 7
Closed
Respondents defined by cohort
Fixed slate
Interested in collaboration within network
Similar expectations for all members
www.hanssenconsulting.com 8
Cohort 1
www.hanssenconsulting.com 9
District A
Red diamond—institute participantGreen box – science teacherGreen square – other teacher (English, math, etc.)
www.hanssenconsulting.com 10
Strengths
Open Flexible Reduces bias Focus on roles Track evolution over
time Informs action
Closed Clean data collection All participants are
equal Track evolution over
time Informs action
www.hanssenconsulting.com 11
Limitations
Open Messy data Non-responses
Closed Limited scope Requires clean subject
lists Non-responses
www.hanssenconsulting.com 12
Contact Information
Carl Hanssen, Ph.D.
Hanssen Consulting, LLC
1324 Lake Dr. SE, Suite 6
Grand Rapids, MI 49506
616-808-2867