australasian evaluation society conference 2011 influencing best practice in aboriginal programs...

Australasian Evaluation Society Conference 2011

Influencing best practice in Aboriginal programs through strengths based

evaluation approaches.

Margaret Scott, Senior Consultant WestWood Spice, Sydney

margaretscott@westwoodspice.com.au

Introduction

• Need to build evidence base • Need to capture successes• Need to build capacity• Need to influence service managers, non-

Aboriginal workers, funders and policy makers and community

• Need for appropriate approaches to legitimise Aboriginal ways of working

Context

• Services and programs • Settings - mainstream & Aboriginal community

controlled• Partnerships between services - variable• Different ways of working needed• Mismatch with mainstream protocols,

frameworks, indicators

Case studies

• MRAMSA Review of mental health and social and emotional well-being services.

• Capacity building review of NSW aboriginal Sexual Health Worker Network

• Review of SSWAHS Aboriginal Chronic Disease Program.

• Evaluation of Aboriginal Legal Access Program• Evaluation of Walgan Tilly – Aboriginal Chronic

Disease Program.

Aboriginal workers – the vital links

• Ways of working– community engagement, outreach,

informal/indirect, cultural/community protocols• Cultural & community knowledge • Conduits to services, advocates for community• Multiple roles, community expectations• Racism & discrimination• Personal & community issues

Evaluation challenges/opportunities

• Lack of program/service planning/logic• Variable quality & approaches• Poor data collection systems• Inconsistent roles• Workforce capacity & experience variable• Need appropriate indicators, meaningful data• Navigating sensitivities & politics• Relationship building

Approaches

• Flexible, tailored to purpose – mixed methods• Strengths based – appreciative focus• Consultative, participatory • Capacity building• Cultural considerations• Strong scoping, attention to framing questions• Attention to outcomes as well as process• Settings/informal conversations – “yarn-ups” • Feedback & checking findings

Levels of influence

• Workers• Non-Aboriginal workers• Managers• Funders, policy makers• Other service providers• Community members

Overall comments

• Many examples of quality programs – local successes• Diversity, innovation• Leadership matters• Strong partnerships essential• Service capacity is building incrementally• Need for – workforce reform, development & support– robust logic models – impact pathways, appropriate

indicators– advocacy with mainstream, cultural competence

Conclusion

• Quality Aboriginal community based programs and services are models of best practice for the whole community.

• Current opportunities with focus on Closing the Gap

• Need for ongoing capacity building