making data work for you - the data assemblyline
DESCRIPTION
So you've learned the Results-Based Accountability framework. The next step is to build systems of accountability within the organization? This short course offers the "brass tacks" in building a data collection, presentation and analysis assembly-line with your staff. Michael Moser, from the Vermont State Data Center and Shelagh Cooley from Common Good Vermont provide examples, tools and concrete next steps that you can implement immediately. Watch the video here: http://www.cctv.org/watch-tv/programs/make-data-work-you#TRANSCRIPT
![Page 1: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/1.jpg)
Making Data Work for You
The Data Assembly Line 5/1/14
Lauren-Glenn Davitian, hostShelagh Cooley, Common Good Vermont
Michael Moser, Vermont State Data Center
1
![Page 2: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/2.jpg)
Logistics
Watch on your computer.
Interaction – We want to hear from you!
Comments and Questions – Chat Box
Slides and Recording Afterwards.
Satisfaction Survey.
2
![Page 3: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/3.jpg)
The Data Assembly Line
Setting the Stage
Data Audit
Data Collection
Data Management
Data Analysis
Data Utilization
3
![Page 4: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/4.jpg)
Setting the Stage
Why is data important?
What results do you seek?
Who is your audience?
How will they use the information?
4
![Page 5: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/5.jpg)
Question Cat
Who is YOUR audience?
5
![Page 6: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/6.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
“I can honestly say that not a day goes by when we don’t use those evaluations in one way or another.”
6
![Page 7: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/7.jpg)
Example: Foodshelf
Result: Food security for people in the region.
Audience: Board, funders, policy makers, staff
7
![Page 8: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/8.jpg)
PERFORMANCE MEASURESFoodshelf
# Clients Served
lbs. of Food Provided
% Nutritious Food
% Clients Satisfied with food choice
Staff-Client Ratio
# Clients not returning
-after 6 months- after 1 year
% of Clients not returning
-after 6 months- after 1 year
QUANTITY (#) QUALITY (%)
8
![Page 9: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/9.jpg)
Question Cat
Who is YOUR audience?
9
![Page 10: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/10.jpg)
The Data Assembly Line
Setting the Stage
Data Audit
Data Collection
Data Management
Data Analysis
Data Utilization
10
![Page 11: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/11.jpg)
Data Audit - PeopleWhat people do you have?
How are they involved?
Do they have “will” & “skill”?
Is it in their job description?
11
![Page 12: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/12.jpg)
Data Audit - Data• What data do you already have?
• What data do you need?
• What data is most useful?
12
![Page 13: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/13.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
13
![Page 14: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/14.jpg)
Data Source Tracking SheetFremework Evaluation
QuestionData Source Indicator
Food How much food do we serve?
Inventoroy # pounds of food/day
Clients How many clients do we serve
Registration Forms #clients/month
Satisfaction How satisfied are clients with the food they receive?
Satisfaction Survey % of very satisfied clients/month
Quality of Food How nutritious is the food?
Receipts to Clients % of Food distributed that is nutritious
Food Security How many clients are food secure after 6 months? 1 year?
# Clients Receiving less than 5 lbs of food per month
14
![Page 15: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/15.jpg)
Question Cat
Where do you collect your data from?
15
![Page 16: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/16.jpg)
Data Sources
•Calendars: Events, Meals, Clinics
•Internal Databases: Clients
•Attendance Sheets: Youth
•Log Sheets: Services Received
•Surveys: Satisfaction
16
![Page 17: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/17.jpg)
Question Cat
Where do you collect your data from?
17
![Page 18: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/18.jpg)
The Data Assembly Line
Setting the Stage
Data AuditData Audit
Data Collection
Data Management
Data Analysis
Data Utilization
18
![Page 19: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/19.jpg)
Data Collection
Data You Already Collect Data Development Agenda
Data Audit
19
![Page 20: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/20.jpg)
Data Collection Value of the Performance Measure
System
Buy-in
Standard
20
![Page 21: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/21.jpg)
Question Cat
What tools do YOU use to collect dat?
21
![Page 22: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/22.jpg)
Data Collection Tools
22
![Page 23: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/23.jpg)
Benefits of Using Tools
• Reduce human error, increase consistency.
• Standardizing data reduces time “cleaning data”
• Online (remote access for multiple sites).
• Automatic reports and organized data.
• Automatically backed up.
• It’s EASIER!!!
23
![Page 24: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/24.jpg)
Question Cat
What tools do you use to collect data?
24
![Page 25: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/25.jpg)
The Data Assembly Line
Setting the Stage
Data AuditData Audit
Data Collection
Data Management
Data Analysis
Data Utilization
25
![Page 26: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/26.jpg)
Data ManagementIs your data secure?
What is your time frame?
Do you have back-ups?
Who is responsible?
26
![Page 27: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/27.jpg)
Example of Dashboard
27
![Page 28: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/28.jpg)
Data ManagementDon’t mix up your data types.
28
![Page 29: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/29.jpg)
PERFORMANCE MEASURESFoodshelf
# Clients Servedlbs. of Food Provided
% Nutritious Food
% Clients Satisfied with food choice
Staff-Client Ratio
# Clients not returning
-after 6 months- after 1 year
% of Clients not returning
-after 6 months- after 1 year
QUANTITY (#) QUALITY (%)
29
![Page 30: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/30.jpg)
Data Management Example
January 1-15
January 16-31
January Average
February 1-15
February 16-28
February Average
2008 258 275 266.5 350 375 362.5
2009 245 272 258.5 324 370 347
2010 242 267 254.5 356 368 362
2011 235 265 250 333 362 347.5
2012 222 260 241 332 360 346
2013 216 262 239 313 345 329
2014 224 252 238 310 370 340
30
![Page 31: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/31.jpg)
Data Management Example
31
![Page 32: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/32.jpg)
Data Management ExampleJanuary 1-15
January 16-31
February 1-15
February 16-28
March 1-15
2008 258 275 350 375 297
2009 245 272 324 370 297
2010 242 267 356 368 279
2011 235 265 333 362 234
2012 222 260 332 360 285
2013 216 262 313 345 262
2014 224 252 310 370 155
32
![Page 33: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/33.jpg)
Data Management Example
33
![Page 34: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/34.jpg)
Data Management Best Practices1. Training2. Buy-In3. File Naming4. Security Practices5. Code Book
34
![Page 35: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/35.jpg)
Stretch Break
Send in Your Questions!
35
![Page 36: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/36.jpg)
The Data Assembly Line
Setting the Stage
Data AuditData Audit
Data Collection
Data Management
Data Analysis
Data Utilization
36
![Page 37: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/37.jpg)
Analyzing the Data
Remember, who is your audience?
How often will the data be analyzed?
Time Series vs. Non-Time Series Data
37
![Page 38: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/38.jpg)
Example of Survey Monkey
38
![Page 39: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/39.jpg)
Trend Lines
39
![Page 40: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/40.jpg)
The Data Assembly Line
Setting the Stage
Data AuditData Audit
Data Collection
Data Management
Data Analysis
Data Utilization
40
![Page 41: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/41.jpg)
Data Utilization
Decision Making
Fundraising
Community Building
Education
41
![Page 42: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/42.jpg)
Data Utilization
Convene your audience.
What story does the data tell?
Are we achieving the results we want?
What will we do differently?
42
![Page 43: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/43.jpg)
Why Visualize Data?
“A picture is worth a thousand words”
Higher Engagement from audience.
Broader audience.
43
![Page 44: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/44.jpg)
Examples of Visualization
44
![Page 45: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/45.jpg)
Examples of Visualization
45
![Page 46: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/46.jpg)
Example of Visualization
46
![Page 47: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/47.jpg)
Sources: http://thegrio.com/2013/06/07/hunger-in-america-food-insecurity-disproportionately-affects-african-americans/#s:foodinsecurity2
http://www.vtfoodatlas.com/plan/chapter/4-1-food-security-in-vermont
Percentage
Food Insecurity
Very Low Food
Security1999-2001 9.1 1.82001-2003 8.9 32003-2005 9.5 3.92005-2007 10.2 4.62007-2009 13.6 6.22009-2011 12 5.4
Infographic Example:-Simple-Key information is highlighted-Effective Messaging
47
![Page 48: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/48.jpg)
Visualizing Data Tools
48
![Page 49: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/49.jpg)
Rules to Live By
Continue to adapt & improve measures
Learn from others
Be willing to invest if the information has value to you.
Keep it Simple.
Be realistic & practical
49
![Page 50: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/50.jpg)
Assembly Line Not Automatic
50
![Page 51: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/51.jpg)
PERFORMANCE MEASURES
HOW MUCH ARE WE DOING?
HOW WELL ARE WE DOING IT?
HOW WELL ARE WE DOING IT?
HOW WELL ARE WE DOING IT?
QUANTITY (#) QUALITY (%)
51
![Page 52: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/52.jpg)
PERFORMANCE MEASURESAfterschool
# Youth served
# Hours of Programming (academic vs. non-
academic)
# of Enrichment activities
% High Quality Interaction
% Youth Satisfaction
% Parent Satisfaction
Staff-youth Ratio
# Youth Honor Roll
# Youth 90% School Attendance
# Youth leading activities
% Youth Honor Roll
% Youth with 90% School Attendance
% Youth leading activities
QUANTITY (#) QUALITY (%)
52
![Page 53: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/53.jpg)
PERFORMANCE MEASURESMental Health
# Clients Served Size of Waiting list
Average time to next appointment
# of Clients in school or working
# of Clients into institutional care
# of Clients to less restrictive care
% of Clients in school or working
% of Clients into institutional care
% of Clients to less restrictive care
QUANTITY (#) QUALITY (%)
53
![Page 54: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/54.jpg)
Upcoming Events
Let’s Talk Shop: Regional Mixers - Brattleboro 6/19
Leadership Vermont Luncheons-Burlington 5/21-Brattleboro 6/20-Barnet 10/1
54
![Page 55: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/55.jpg)
ResourcesIdealware http://www.idealware.org/ Helping Nonprofits Make
Smart Software Decisions
Youtube Video: How to Add a Trend Line in Excel: https://www.youtube.com/watch?v=svFSKnmAlKQ
An Introduction to Regression Analysis: Alan O. Skyes: http://www.law.uchicago.edu/files/files/20.Sykes_.Regression.pdf
CGVT Know More, Do More with Data Visualization http://blog.commongoodvt.org/2013/10/video-storytelling-with-data/
CGVT Surveys and Spreadsheetshttps://www.cctv.org/watch-tv/programs/making-data-work-you-
survey-spreadsheets
55
![Page 56: Making Data Work For You - The Data Assemblyline](https://reader035.vdocument.in/reader035/viewer/2022081414/54b936d04a79590b4f8b45a4/html5/thumbnails/56.jpg)
References
Trying Hard is Not Good Enough, Mark Friedmanhttp://resultsleadership.org/product/trying-hard-is-not-good-
enough-by-mark-friedman/
Essentials of Utilization-Focused Evaluation (Sage, 2012) by Michael Quinn Patton
Edward Tufte, Data Visualization: http://www.edwardtufte.com/tufte/index
American Evaluation Association – Tools, Tips, Trainings http://www.eval.org/
Also, check out courses offered at area colleges.
56