using what works: adapting evidence-based programs to fit your needs

48
Using What Works: Adapting Evidence-Based Programs to Fit Your Needs Introducing an Important New Tool Carol Ann M. Covington, MS, NCI’s Cancer Information Service June 15, 2009

Upload: clove

Post on 24-Feb-2016

49 views

Category:

Documents


0 download

DESCRIPTION

Using What Works: Adapting Evidence-Based Programs to Fit Your Needs. Introducing an Important New Tool Carol Ann M. Covington, MS, NCI’s Cancer Information Service June 15, 2009. Pre-Test and Introduction. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Using What Works:Adapting Evidence-Based Programs

to Fit Your Needs

Introducing an Important New Tool

Carol Ann M. Covington, MS, NCI’s Cancer Information Service

June 15, 2009

Page 2: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Pre-Test and Introduction

Evidence Based Cancer Control is an emerging area – addressing program planning, development and evaluation

An evolving discipline with many perspectives and resources

“Designing for Dissemination”

Page 3: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Objectives

Describe evidence-based programs and the value of using them

List resources for finding evidence-based programs

Give an overview of Using What Works Modules

Page 4: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Question

What do you think of when you hear the term

“evidence-based”?

Page 5: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Answer

An evidence-based program has been: Implemented with a groupEvaluatedShown to be effective and has published

results Also referred to as

“research-tested programs”

Page 6: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

What is Evidence-Based Cancer Control?

“...the development, implementation, and evaluation of effective cancer education and screening programs through systematic uses of data and research information, and appropriate use of theory-based program planning models.”

Adapted from Brownson et al., J Public Health Management Practice 1999,5:86-97

Page 7: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

What Is Evidence?

Surveillance DataSystematic Reviews of Multiple

Intervention StudiesAn Intervention Research Study Program EvaluationWord of MouthPersonal Experience

OBJECTIVE

(fact)

SUBJECTIVE(opinion)

Page 8: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Your Experience

What has your experience been with evidence-based programs? Where have you heard of them before? Have any of you used these programs in the

past?

Page 9: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Why use Evidence-based Interventions?Saves timeMay save moneyProven effective in the study populationsReduces the time it takes to research a

communityHelps narrow the evaluation.

Page 10: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Why Use Evidence-based Interventions?

More Federal funders are requiring program planners to use evidence-based programs.

Some Federal funders consider evidence that is proven through research (explicit).

Some Federal funders consider evidence that is derived from experience or practice (tacit).

The best evidence may be a combination of research and practice.

Page 11: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

More Advantages of Evidence-Based ProgramsAdds value to a grant application Increased certainty of successSaves time and resources during

planning and implementation

Page 12: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

And Even More Advantages of Evidence-Based ProgramsThe organization is successful soonerCreates a clear vision of how best to

use resourcesPresents new ideas for consideration

that could work well

Page 13: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Barriers

Using evidence-based programs limits my creativity.

Evidence-based programs take too much time and/or money.

Evidence-based programs are too scientific. I do not know what evidence-based programs

are or where to find them.

Page 14: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Evidence-Based Program Barriers

My community is unique. An evidence-based program will not be as appropriate as if I developed the program myself.

Page 15: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Evidence-based Programs have been Assessed for Different Levels of Evidence

Level 1 has the strongest level of evidence Level 5 has acceptable evidence Level 1 may be more effective than Level 5,but level 5 may serve as a useful model

Page 16: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Levels of Evidence in Programs

Can choose any one of these levels to adapt The choice is based on resources and time

available Remember: Using programs with less

evidence (e.g., Level 4 or 5) requires more rigorous evaluation measures

Page 17: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

http://www.thecommunityguide.org/

Page 18: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Two Primary Objectives for the Community Guide

• As a standard reference for effectiveness information on population based interventions –

“what does the scientific evidence tells us what works?”• Supporting prevention research “where there is insufficient evidence of effectiveness or when we want to develop localized version of generally effective interventions”

Page 19: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs
Page 20: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs
Page 21: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Finding an Evidence-Based Program

Excerpts from Module 3

Page 22: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Where Can I Find Evidence-Based Programs?

Cancer Control PLANET—http://cancercontrolplanet.cancer.gov Step 4: Research-tested Intervention Programs (RTIPs) Program summaries include a list of journal articles

about the program.

For Level 1 Programs

Page 23: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

http://cancercontrolplanet.cancer.gov

Page 24: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs
Page 25: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs
Page 26: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs
Page 27: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs
Page 28: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Other Sources for Evidence-Based Programs Journals that report on evidence-based

programs, such as Evidence-based Healthcare and Public Health http://www.harcourt-international.com/journals/ebhc/

Page 29: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Where Can I Find Evidence-Based Programs?

PubMed: from US National Library of Medicine http://pubmed.gov

Educational Resource Information Center (ERIC): “…sponsored by the Institute of Education Sciences (IES) of the US Dept of Education… premier database of journal and non-journal education literature.”www.eric.ed.gov

Databases for peer-reviewed journals:

Page 30: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Where Can I Find Evidence-Based Programs?

PubMed Central: NIH “…free digital archive of biomedical and life sciences journal literature.”www.pubmedcentral.nih.gov *full-text articles.

EBSCO’s Electronic Journals Service: “…containing millions of articles from hundreds of different publishers, all at one web site.”http://ejournals.ebsco.com/home.aspNOTE: not a free service, but your university or library might be a subscriber.

Page 31: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Where Can I Find Evidence-Based Programs?

FirstSearch: “…a rich collection of reference databases.” Sponsored by the Online Computer Library Center. http://www.oclc.org/firstsearch

Web of Science: “…information from approximately 8,700 of the most prestigious, high impact research journals in the world.” *Must access through institution.

http://portal.isiknowledge.com/portal.cgi?DestApp=WOS&Func=FrameTutorial: http://scientific.thomson.com/tutorials/webofscience

Page 32: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Where Can I Find Evidence-Based Programs?

SAMHSA (Substance Abuse & Mental Health Services Administration) NREPP Program (National Registry of Evidence-based Programs and Practices).www.modelprograms.samhsa.gov

Promising Programs Effective Programs Model Programs

Note: NREPP programs are mostly focused on substance abuse

Page 33: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Where Can I Find Evidence-Based Programs?

The Cochrane Review (UK)http://www.cochrane.org/reviews/ “The abstracts of the reviews are available free… Where available, plain language summaries are also provided…short synopses of the reviews' core findings, with a minimum of technical terms.”

Other services available by subscription

Page 34: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Other Sources for Evidence-Based Programs

Google Scholar http://scholar.google.com“…a simple way to broadly search for scholarly literature…

peer-reviewed papers, theses, books, abstracts and articles, from academic publishers, professional societies, preprint repositories, universities and other scholarly organizations.”

Another site (not from Using What Works)

Page 35: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Once you find evidence-based programs, what do you do with them?

Become familiar with and understand the entire study:

objective, methods, results/conclusions, and limitations.

Page 36: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Once you find evidence-based programs, what do you do with them?

Refer to your needs assessment and compare it to the program(s) you found: Was the program conducted with people who

had similar: Socioeconomic status Resources Ethnicity Traditions Priorities Community structure and values. Age

Page 37: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Criteria for Selecting a Program

Pay attention to the strategies the programs used to achieve their objectives. Giving information Enhancing skills Improving services or support systems Addressing barriers Promoting access policy changes.

Consider your resources

Page 38: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Talking With the Principal Investigator

Whenever you can, speak with the team that developed the program or product in which you are interested. They can share information about the program that may be helpful.

Page 39: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Needs Assessment: Getting To Know Your

Audiences Better

Module 2

Page 40: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Objectives Know how to assess your audience—know who

they are, what they value, and what factors influence their health.

Be able to find resources and methods for collecting data from first-hand (primary) and second-hand (secondary) sources.

Understand the value of using good data sources to drive your program.

Be able to find other groups and agencies that could assist—or that may compete—with your program efforts.

Page 41: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Making the Evidence-Based Program Fit Your Needs:

Adaptation and YourProgram Summary

Module 4

Page 42: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Objectives

Know how to use program planning and brainstorming activities to find out what needs to be changed in your evidence-based program.

Know what can be changed and what cannot be changed in your program.

Know ways of shaping an evidence-based program.

Page 43: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Print Materials and CultureIn addition to reading level, you should ask yourself: 

If you answer these questions, it may help you find other needed text changes.

Is the language appropriate for the culture? Are there different meanings for words? Could

the words be misinterpreted? Do the materials fit with my audience’s culture?

Page 44: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

FoCaS Program Flyer

Page 45: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Team Up Greene County

Page 46: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Does It Work? Evaluating Your Program

Module 5

Page 47: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Objectives

Know how to use different methods of evaluation.

Be able to match your evaluation methods with your program objectives.

Know where to apply methods for evaluation in the different stages of your program.

Page 48: Using What Works: Adapting Evidence-Based Programs  to Fit Your Needs

Using What Works:Adapting Evidence-Based Programs

to Fit Your Needs

To order: Call1-800-4-CANCER (1-800-422-6237)

Order online: http://cancer.gov/publications

Download: http://cancercontrol.cancer.gov/use_what_works/start.htm