network analysis (sna/ona) methods for assessment & measurement
DESCRIPTION
Many nonprofits and foundations have been using social network analysis (SNA) and organizational network analysis (ONA) techniques in program assessment, planning, and measurement. This webinar will review a number of techniques that are being used and the ways that the results of network analysis are informing and supporting the ways that nonprofits are leveraging networks to achieve greater good by creating, facilitating, and weaving networks.TRANSCRIPT
Using Network Analysis toAssess and Measure Networks
January 14, 2012Patti Anklam With June Holley and Claire Reinelt
2
Webinar Goals
Share current thinking about how network analysis is used in designing and evaluating nonprofit programs
Provide examples of network analysis used in assessment and measurement contexts
Stimulate thinking about correlating network analysis with measurement and evaluation outputs and outcomes
Network Thinking & Non-Profits
4
The Evolution of Network Thinking
5
What is Network Analysis?
• Social network analysis (SNA) is a collection of techniques, tools, and methods to map and measure the relationships among people and organizations
• Organizational network analysis (ONA) often refers to the use of SNA methods in the context of organization dynamics and development
• In practice, we use these tools to map connections among people and ideas, issues, and other entities as well as the social and organizational connections
6
Network Analysis: The Method in a Nutshell
Step Activities/ToolsDesign Identify boundaries
Clarify and design questionsCollect Data Surveys
InterviewsFacebook, LinkedInEmail logs
Analyze data to generate maps and metrics
(Netdraw/UCINET, NodeXL, Gephi … many others)
Review data Validate; look for questionsPrepare evaluation Match network results with context
and storiesMove into action Weaving & other interventions
7
Survey Example
8
Survey Example – Demographic Component
9
Survey Example – Affiliation Component
10
Survey Example – Network Questions
11
Network Questions Probe Relationships
12
Analyses Outputs: Map Patterns
Multi-Hub Hub and Spoke
Stove-piped (Siloed) Core/Periphery
13
Quick View: What an Analysis Can Tell
• Overall very well connected• One region distinctly
clustered with fewconnects to otherregions
• Staff are highlycentral
• Identification ofkey connectors
14
Reasons for a Network Analysis: Examples
1. Assessment, Planning, & Weaving
2. Measure changes over time3. Sense-making & story-
finding4. Positioning and working with
individuals in the network
15
Assessment, Planning, & Weaving
• Assess the network’s capacity for collaboration, information transfer, innovation
• Identify key individuals• Establish goals for enhancing connectivity• Create an action plan
Strategic Purpose
1
16
Assessment: Capacity for Collaboration
Source: Transcending Boundaries: Strengthening Impact. The Full Potential of a Justice Network (Research & Network-Building Project Report, April 2011, Criminal Justice Funders Network). Courtesy of June Holley.
When funders indicate with whom they would like to work in the near future, the network becomes more robust.Funders are saying they want to work more together.
Current Funder Interaction Network Future Funder Interaction Network
17
Assessment: Affiliation Network
• Identify potential relationships among people based on shared events, meetings, ideas, or areas of expertise
• Nonprofits use this to see which organizations “attach” to different ideas
• Forms the basis for network weaving
Strategic Purpose
18
Drill Down Into Affiliation Network
• Identify people with common interest – basis for building communities of practice
• See which people share interest in multiple issues or topics
• A way for the network to reveal itself and have rich conversations
19
Measuring Changes Over Time
1
2
3
4
5
6 7
8
9
10
11 12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
Very Well
Well
Somewhat
2005
Maps copyright © 2012 New Directions CollaborativeSource: Boston Green & Healthy Building Network, Beth Tener and Al Nierenberg, January 2008
1
2
3
4
5
6 7
8
9
10
11 12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
2007
Boston Green & Healthy Building Network
2
20
• Look at the whole network and its components:– Overall cohesion– Degrees of separation
• Good for comparing groups within networks or for comparing changes in a network over time
Analyses Outputs: Metrics
• Look at positions of individuals in the network:– # of connections– Favorability of position
• Good for identifying people who are well positioned to influence the network or to move information around
Individual position metricsOverall network metrics
21
How the Metrics Enhance the Maps
2010
2011Year # Density Avg # ties
2009 55 2.2% 1.2
2010 90 2.7% 2.4
2011 85 5.3% 4.5
2012 82 8% 6.88
2009
2012
22
Sense-Making & Emergence
• Barr Foundation Fellows Program– See changes over time, but really to see how the network has supported
emergence – Work to shift Barr staff from the center
Pat Brandes
Source: Networking a City, Marianne Hughes & Didi Goldenhar, Stanford Social Innovation Review, Summer 2012
3
23
Sense-Making: New School Development in Boston
• An intentional network may have no other purpose than to enable emergence
• Maps that show the evolving relationships within a network help to identify powerful network stories
“This person has helped me accomplish work-related tasks.”
Source: Networking a City, Stanford Social Innovation Review, Summer 2012
24
Positioning: The Individual View 4Node Betweenness Indegree OutDegree
62 792.67 26 3080 660.48 17 3264 530.61 20 3323 333.36 20 1471 321.42 21 2056 316.42 20 18
• Centrality metrics identify people with the most ties (in-degree and out-degree)
• Those positioned to move information around in the network or be in the know (betweenness)
• Can identify people to lead task teams, to provide resources to, or to train as weavers
25
Tracking Individuals’ ChangesI learned something from this person that made me a better leader. – 2009
2005
2007
2008
2009
2010
26
Tracking Individuals’ ChangesI learned something from this person that made me a better leader. – 2011
Network Analysis & Measuring Outcomes
28
Summary – What We Know
• Measure the cohesion of the network overall:– High-level structure (stove-piped, core/periphery, highly clustered)– Average degree of separation– Average number of connections each person has
• Identify individuals by their centrality to the network:– Core or periphery? How do you bring people in from the outside?– Broker? Connector? Facilitator? Bottleneck?– Number and diversity of connections
• See changes over time
What We Can Measure and Show in an Analysis:
29
Things We Can Do With What We Know
Ways to change patterns in networks
Practices from the KM/OD Repertoire
Weaving. Create intentional connections
Convene. Make introductions through meetings and webinars, face-to-face events
Increase the flow of knowledge Establish collaborative workspaces, install instant messaging systems, make existing knowledge bases more accessible and usable; implement social software or social network software
Create awareness Provide expertise directories
Connect disconnected clusters Weave: establish knowledge brokering roles; expand communication channels
Create more trusted relationships Assign people to work on projects together
Alter the behavior of individual nodes Create awareness of the impact of an individual’s place in a network; foster network literacy
Increase diversity Add nodes; connect and create networks; encourage people to bring knowledge in from their networks in the world
30
Measurement Challenges
• Maps area snapshot in time• Targets and thresholds
– How much cohesion is “enough?” Is there a point at which increasing the number of ties makes the network less efficient?
– Is it reasonable to set a target for the cohesion metric?
• Tying Network Metrics to Outcomes– We have to think of the metrics as
indicators and as correlates of other survey questions Source: Dave Snowden, Cynefin Advanced Practitioner’s Course December 2012
31
Questions?
Question
• [email protected]://www.pattianklam.com
•[email protected]://www.leadershiplearning.org/
•[email protected]://www.networkweaving.com
Thank you.