roi committee third meeting november 15, 2013. meeting agenda meeting objectives: review a draft...

ROI Committee Third MeetingNovember 15, 2013

Meeting Agenda

Meeting Objectives:

•Review a draft dashboard concept and continue our discussion of audiences and data reporting

•Discuss and make initial decisions around the governance structure of the ROI Framework

•Outline a communications plan, including key messages, audiences, and opportunities for building buy-in

8:00 Welcome and Introductions 8:10 Dashboard Demo and Discussion 8:50 Governance: Functions and Roles 9:30 Communications / PR Planning Discussion 9:50 Wrap-Up and Next Steps

10:00 Adjourn

ROI in Practice

Audiences

More FormativeMore Summative

Providers“What drives value?”

Investors*“What are we getting for

our money?”

* Broadly defined; can include legislators, taxpayers, and philanthropy

DASHBOARD TOPICS

Audiences

Objects of Evaluation

Dashboard Concept

Print Reports

Services/Program Types

ROI in Practice

Object of Evaluation

More GranularMore Broad

Services

Funding Streams

* Broadly defined; can include legislators, taxpayers, and philanthropy

Programs

Providers

Target Populations

DASHBOARD TOPICS

Audiences

Objects of Evaluation

Dashboard Concept

Print Reports

Services/Program Types

ROI in Practice

Dashboard Concept

DASHBOARD TOPICS

Audiences

Objects of Evaluation

Dashboard Concept

Print Reports

Services/Program Types

ROI in Practice

Methodological notes, caveats, and guidelines for appropriate use throughout

Primary ReportPerformance Across Whole System, Including

Major Programs, Regions and Funding Streams (?)

“What Works?”Performance by Types of

Programs and Services

“Who is Impacted?”Performance by Types of

Programs and Services

Program Reports (?)

Technical Appendices

DASHBOARD TOPICS

Audiences

Objects of Evaluation

Dashboard Concept

Print Reports

Services/Program Types

ROI in Practice

TrainingCredentials?

Support Services

High-Intensity vs. Low-IntensityHow to Define?• Cost• Duration• Services

Similar ProgramsHow to define?• Population Served• Programmatic Goals• Intensity of Service

DASHBOARD TOPICS

Audiences

Objects of Evaluation

Dashboard Concept

Print Reports

Services/Program Types

Governance and Functions

ConsiderationsCredibility / Conflicts of Interest

Institutional IncentivesCapacity

Scope

Governance - Examples

WSIPPDoesn’t Recommend Policy or Operate/Administer Programs

Academics, Researchers, Experts Play Advisory Role; Communities of Practice

Research Questions Driven by Lawmakers, Board

Strong Connection to Higher Education

Board: Legislators, Gov. Appointees, Legislative Staff, Higher Education

Takes Pains to Explain Methodologies, Decisions, Revisions; Sensitivity Analysis

CBODoesn’t Recommend Policy or Operate/Administer Programs

Academics, Researchers, Experts Play Advisory Role; Communities of Practice

Research Questions Driven by Lawmakers

Strong Rules on Employee Financial Interests and Political Activities

Takes Pains to Explain Methodologies, Decisions, Revisions; Sensitivity Analysis

Functions

Data Provision/Management

Evaluation

Auditing/Review

Standard-Setting

Communications& Reporting

Communications & PR

Key Messages

Key Audiences

Opportunities for Building Buy-In

Strategy and Game Plan

Finishing Up

Next Webinar

Tuesday, December 1010:00 am - Noon