how to engage community members in outcome evaluation?

HOW TO ENGAGE COMMUNITY MEMBERS IN OUTCOME EVALUATION?

HSCI 825-3 – Spring 2013Binod Sharma

April 4th, 2013

OverviewIntroduction of Community Engagement

Concept of Outcome Evaluation

Community Engagement Process

Factors Contributing to the Success

Limitations & Challenges

Summary

What is Community Engagement?

“It is a powerful vehicle for bringing about environmental and behavioral changes that will improve the health of the community and its members. It often involves partnerships and coalitions that help mobilize resources, influence systems, change relationships among partners, and serve as catalysts for changing policies, programs, and practices” (Fawcett et al., 1995).

Passive approaches Proactive approaches

• Just inform people about the decisions

• Doesn't bring them into the decision making process

• May not address their issues

• Collaboration with other people or agencies

• Empower and self motive

• Priorities on their issues

• Play active role in social change

• Responsible and aware on social issues

Approaches of Community Engagement

What is Outcome Evaluation?Skills, attitude and knowledge

Behavioral changes: quit smoking

Changes in individual conditions: health

condition

Changes in social conditions: educational status

Institutional changes: policies or practices

Types of Evaluation

1. Formative Evaluation

2. Process Evaluation

3. Summative Evaluation

Summative Evaluation

Short-term Outcomes:

Immediate changes in individuals’ or participants’ awareness, knowledge, or behavior

Its prediction of long-term outcomes?

Long-term Outcomes:

Assess the larger impacts of a program on a community

Implement in the community?

Program Logic ModelEating Behavior of Student in SFU

Activities Short-term outcomes

Staffs

·Student·Residents

Data Sources

·National data·Provincial data·Communal data

Equipment

·IT hardware and software·Lab·Questionnaire

Others

·Funding·Community support

·Increase percentage of healthy eating student·Increased in health information sharing trend·Ongoing monitoring trend in eating behaviour of Students·Increase in evidence based interventions planning and evaluation.

·Collaborate with local agencies·Management of require fund·Recruitment of manpower·Trained health professional·Conduct work shop and awareness campaigns·Encourage people to participate in social work·Conduct health related program·Supervise and monitor program ·Ensure the participation of community member in each program·Provide regular feedback·Link existing data sources·Insure data security and confidence·Disseminate the program information

Inputs

Long-term outcomes

Positive changes in eating behavior and improve quality of life

Outcome Evaluation Process

Clarify intentions and expectations

Define the project activity

Develop outcome indicators

Data collection(mail or self administration)

Analysis and reporting(tables, figures, videos, stories)

Disseminate the results

Use of results to inform future planning

Major Issues of Community Engagement

Trying to solve complex issues

Multiple social sectors are included in the process (i.e. government agencies, community members)

Identify local priorities rather than exclusive problems

Major Issues of Community Engagement (cont’d)

Consider more collaboration and social

inclusion

Create vision and change

Sharing responsibilities and leaderships

Focus on empowerment and motivation

Avoid discrimination and injustice

Factors Contributing to the SuccessEnvironmentalHistory of collaboration in the communityCollaborating groupFavorable political and social climateMembership Mutual respect, understanding, and trustAppropriate cross-section of membersAbility to compromiseProcess/StructureMembers feel ownershipFlexibility of collaborating groupClear rules and guidelines

Factors Contributing to the Success (cont’d)

CommunicationOpen and frequent interactionInformal and formal channels of communicationsPurposeGoals clear and realistic to all partnersResourcesSufficient fundsSkilled manpower

Benefits of Community Engagement

Improve target and effectiveness of servicesPerformance evaluation of agencies, organizations,

and partnershipsBuild community ownership, development, and

leadershipCooperative working and empowering community

membersTake more responsibility for what is happening

Benefits of Community Engagement (cont’d)

Higher quality solution

Develop the positive attitude and build trust

Focus on social justice by ensuring a political, social and economic priority (equity)

Connect people and resources

After analysis and interpretation the findings

Comparison data with baseline information, control group or sample population

Report should disseminate the information to the public

Make sure that all community members are participating

Maintain high levels of confidentiality.

Disseminating the Results

SummaryEncourage and empower the public

Make them more responsible

Increase collaboration and cooperation

Trends in information sharing habits

Improve quality of life

Summary

References:

http://www.theinnovationcenter.org/files/Reflect-and-Improve_Toolkit.pdf http://www.qld.gov.au/web/community-engagement/guides-factsheets/peo

ple-disabilities/ http://tamarackcommunity.ca/g3s11.html#top6CommunityEngagement

http://www.partnershipsforolderadults.org/resources/resource.aspx?resourceGUID=4bb867a0-888d-4997-b59d-03b1cbf2132b&sectionGUID=17e73f4e-b245-4e74-88dd-4664d83f42a

http://www.health.state.mn.us/communityeng/

Fawcett, S. B., Paine-Andrews, A., Francisco, V. T., Schultz, J. A., Richter, K. P., Lewis, R. K., ... & Lopez, C. M. (1995). Using empowerment theory in collaborative partnerships for community health and development. American journal of community psychology, 23(5), 677-697.

http://www.cdc.gov/phppo/pce/part1.htm

Questions/ Comments

?