finding meaning in the numbers: tools for data analysis & dashboards
DESCRIPTION
TRANSCRIPT
FINDIN
G MEANIN
G
IN T
HE NUMBERS:
TOOLS
FOR D
ATA A
NALYSIS
& DASHBOARDS
TI E
RN
EY
SM
I TH
, T
EC
HS
OU
P C
AN
AD
A
ABOUT TECHSOUP CANADA
Is my org eligible?
a) Does your business number end in RR0001?
b) Do you have a Letters Patent from Industry Canada?
c) Are you incorporated as a not-for-profit corporation with your province?
d) Are you a library?
You may be eligible to get donations of…
DONATIONS PROGRAM
Microsoft’s donations & discounts are now open to faith-based nonprofits & charities, including:
GOOD NEWS: MICROSOFT DONATIONS!
More info: https://www.techsoupcanada.ca/en/community/blog/microsoft-expands-eligibility-for-faith-based-organizations-and-hospices
ABOUT ME
• Community Engagement Manager
• Online community & resources about nonprofit technology
For example… the nonprofit tech self-assesment: https://www.techsoupcanada.ca/en/community/blog/are-your-technology-priorities-in-order-take-the-tech-se
lf-assessment
@[email protected]/techsoupcanadatechsoupcanada.ca/community/blogyoutube.com/techsoupcanadaslideshare.net/techsoupcanada
AGENDA
• Let’s talk about data
• The journey to “data-informed”
• Data analytics & dashboard tools
WHY
DATA?
5 STAGES OF MEASUREMENT ACCEPTANCE
1. Denial
2. Fear
3. Confusion
4. Delight
5. Data-Informed
Source: Beth Kanter, http://www.bethkanter.org/12ntcdataviz/
DENIAL
My program is an art, not a science…
it can’t be measured!
Spiritual growth can’t be measured
FEAR
What if my strategy/program
doesn’t show success?
CONFUSION
I know I should be measuring our
program, but I’m not sure how?
DELIGHT
Hey, check out these cool metrics!!
DATA-INFORMED
What does the data say?
5 STAGES OF MEASUREMENT ACCEPTANCE
1. Denial
2. Fear
3. Confusion
4. Delight
5. Data-Informed
Where is your
organization?
Further reading – measuring church “success”:http://www.transformingchurch.com/resourcetoolbox/2009/04/transforming_le_10.phphttp://godsfaintpath.com/measure-success-http://pastors.com/measure-success/
WHY SHOULD WE NOT MEASURE?
• Can’t measure the real impact
• Takes extra time
• Complex systems may be required
• Don’t have the skills
WHY SHOULD WE MEASURE?
• Help us make informed decisions -> improve our work
• Demonstrate impact to donors & funders
• Accountability to board
• Increased impact
CASE STUDY: ROCA
B E F O R E M E A S U R I N G
• 3 year program
• High risk young men and women
• Ineffective in medium-long term
• Length of program increased dependency
A F T E R M E A S U R I N G
• 2 year program + 2 years of follow up
• Focus on highest risk men & pregnant young mothers
• Theory of change mirrored in programming & data collection
• Long term impact
THE D
ATA JO
URNEY
I NS
PI R
AT
I ON
TA
KE
N F
RO
M N
TE
N’ S
WO
RK
BO
OK
:
“ GE
T TI N
G S
T AR
TE
D W
I TH
DA
T A- D
RI V
EN
DE
CI S
I ON
MA
KI N
G”
HT T
P: /
/ WW
W. N
TE
N. O
RG
/ RE
SE
AR
CH
/ 20
13
- DA
T A-
WO
RK
BO
OK - D
OW
NL O
AD
STEPS ON THE JOURNEY
1.Define your question2.Choose metrics3.Collect data4.Share data5.Use data6.Tweak, learn, improve, repeat
1) DEFINE YOUR QUESTION:WHAT AREA WOULD YOU LIKE TO EXPLORE?• Recruiting clients
• Efficiency of a process
• A specific program
• Annual campaign
• Email list-building
• Social media outreach
What is your action question?
TECHSOUP CANADA’S DATA JOURNEY
Are our marketing efforts
leading to increased donation requests?
2) CHOOSE METRICS:WHAT METRICS SHOULD YOU MEASURE?
Consider:
• What decisions do you want to be able to make based on the data?
• What actions could you/constituents/others take that would affect the action question, and how could you measure it?
• What data are you already tracking?
• What data could you be tracking?
• # of clicks on a product in email
• # of donation requests of that product
• Better: # of donation requests of that product from people who received the email
TECHSOUP CANADA METRICS
… but are you using it?
3) COLLECT DATA:YOU PROBABLY ALREADY HAVE LOTS OF DATA…
Source: http://www.nten.org/research/2012-state-of-data
THE MANY ASPECTS OF USING DATA
Source: http://www.nten.org/research/2012-state-of-data
4) SHARE DATA:WHAT IS A DASHBOARD/WHY DASHBOARD
”“5) USE DATA:MAKE METRICS A PART OF YOUR LIFE
Momsrising holds a weekly staff meeting
nicknamed “Metrics Monday.” Each program and campaign staff person reviews their reports in preparation for a group conversation about what actions to reinforce, how refine messages, and other improvements. Says Kristin, “Our dashboards have multiple views – a high level view and the ability to drill down into specific campaigns – this informs our discussion.”
Source: http://www.bethkanter.org/momsrising-key-results/
NUTS A
ND BOLT
S:
DASHBOARD TOOLS
4 APPROACHES TO DASHBOARDS
Excel or PowerPoint1
2
3
4
Built-in dashboards (in your database/ CRM/donor management system)Reporting/dashboard/business intelligence tool
Custom built dashboards
EXCEL & POWERPOINT DASHBOARDS
PROS• Familiar tools
• No IT expertise needed
• Flexible, easy to customize
• Helps you experiment
CONS• Less powerful
than other tools
• Usually involves manual effort
• No real-time feedback
1
EXCEL EXAMPLE: NTEN1
Source: http://www.nten.org/blog/2009/04/16/dashboards-track-your-organizational-progress
POWERPOINT EXAMPLE: YEAR UP1
Source: http://www.givewell.org/files/04-3534407/B/Dashboard%20assessment.ppt
TECHSOUP CANADA1
INTRO TO PIVOT TABLES1
BUILT-IN DASHBOARDS
PROS• Pulls directly
from existing data automatically
• Often update in real time
• No new systems required
CONS• Requires a
robust dashboard feature in your existing system
• System may not include all relevant data
2
SALESFORCE2
Case study: https://www.techsoupcanada.ca/en/learning_center/articles/dashboard
GOOGLE ANALYTICS2
More info: http://gettingattention.org/articles/625/evaluation/increase-nonprofit-marketing-impact-google-analytics.htmlhttp://googlefornonprofits.blogspot.ca/2013/07/how-to-keep-track-of-multiple-marketing.html
DASHBOARD TOOL
PROS• Integrate multiple
data sources
• Not reliant on built-in dashboard functionality
• More features available (e.g. compared to a spreadsheet)
CONS• A new system to
acquire and learn
• May require IT assistance, or at least some tech savvy
3
DASHBOARD TOOLS
Features to consider:
• Data sources
• Drill-down-ability
• Ease of updating
• Data analysis capabilities
3
More info: https://www.techsoupcanada.ca/en/community/blog/jane-vs-tierney/dashboard-challengehttp://www.dashboardinsight.com/articles/digital-dashboards/fundamentals/7-small-business-dashboard-design-dos-and-donts.aspx
ZOHO REPORTS3
More info: https://www.techsoupcanada.ca/en/community/blog/jane-vs-tierney/zoho-reports-review
GECKOBOARD3
CUSTOM DASHBOARDS
PROS• Exactly
customized for you, maximum flexibility
• Integrate multiple data sources
CONS• Custom
development (IT) required
• Need capacity to maintain it
4
EXAMPLE: ONE ACRE FUND4
Source: http://www.oneacrefund.org/results/dashboard/
EXAMPLE: INDIANAPOLIS MUSEUM OF ART4
Source: http://dashboard.imamuseum.org/
GOOD DATA VISUALIZATION PRACTICES
Source: http://www.techsoupcanada.ca/community/blog/data-visualization-foundations
FURTHER READING
• Getting started with Data-Driven Decision making (NTEN workbook)
http://www.nten.org/research/2013-data-workbook-download
• Jane vs. Tierney: Dashboard Tools for Nonprofitshttps://www.techsoupcanada.ca/en/community/blog/jane-vs-tierney/dashboard-challenge
• Data visualization for dummies: how your nonprofit can tell powerful stories with data
http://www.techsoupcanada.ca/community/blog/data-visualization-foundations
• Understanding Software for Program Evaluation (report by Idealware)
http://www.idealware.org/reports/understanding-software-program-evaluation
QUESTIONS?
@T
EC
HS
OU
PC
AN
AD
A O
R F
AC
EB
OO
K. C
OM
/ TE
CH
SO
UP
CA
NA
DA