introducing the hud outcome measurement system

Presentation Developed By:U.S. Department of Housing and Urban Development

Office of Community Planning and Development

Introducing the HUD Introducing the HUD Outcome Measurement SystemOutcome Measurement System

Agency NameProgramDate

TopicsTopics

Introduce the HUD Outcome Measurement Framework

Provide overview of objectives, outcomes, indicators & data collection requirements for program

Next steps for implementation



Overview of HUD Outcome Overview of HUD Outcome Performance Measurement SystemPerformance Measurement System

What is Performance Measurement?What is Performance Measurement?

Performance measurement is a program management tool. It is ……

an organized process for gathering information to determine how well programs and activities are meeting established needs and goals.

Connects activities and results to statutory/program goals

May be used in program funding decisions

Will be used to demonstrate program results to decision-makers & public

Federal Performance MeasurementFederal Performance Measurement

Now a requirement for all Federal programs

Government Performance Results Act of 1992

OMB’s Performance Assessment Rating Tool (PART)

HUD Consolidated Plan programs – HOME, CDBG, ESG, HOPWA– ConPlan regulations amended 2/9/06; effective 3/13/06– Applies to new ConPlans submitted after 3/13/06– Applies to all (old and new) activities not completed by

10/1/06

Development of HUD’s SystemDevelopment of HUD’s System

HUD needed a tool to capture data on program outcomes from grantees

Working Group formed including diverse group of grantees, HUD & OMB

Goals:– Collect data on program outcomes that can be reported

nationally (required consistent framework)– Minimize the reporting burden on grantees (augment

IDIS data reporting)

Highlights of the SystemHighlights of the System

Common performance measures that apply to all four programs

Outcome measures are driven by local intent – Not required to change criteria or program focus

Indicators use data commonly collected by grantees

Data collected will enable HUD to “roll up” results to national level

3 Key Components3 Key Components

Objectives: statutory purpose Creating Suitable Living Environments Providing Decent Affordable Housing Creating Economic Opportunities

Outcomes: change or result you are seeking Availability/Accessibility Affordability Sustainability

Indicators: standardized data that measure results

Linking Objectives & Outcomes – Linking Objectives & Outcomes – Outcome StatementsOutcome Statements

Outcome 1:Availability/Accessibility

Outcome 2:Affordability

Outcome 3: Sustainability

Accessibility for the purpose of

creating Suitable Living

Environments


providing Decent Affordable Housing


creating Economic Opportunities

Affordability for the purpose of creating Suitable

Living Environments

Affordability for the purpose of providing Decent

Affordable Housing

Affordabilityfor the purpose of creating Economic

Opportunities

Sustainability for the purpose of creating Suitable

Living Environments

Sustainability for the purpose of

providing Decent Affordable Housing

Sustainability for the purpose of

creating Economic Opportunities

Objective #1 Suitable

Living Environment

Objective #2 Decent

Housing

Objective #3 Economic Opportunity

Outcome Statements

SL-1 SL-2 SL-3

DH-1 DH-2 DH-3

EO-1 EO-2 EO-3

IndicatorsIndicators

Common Indicators (4)– Generally apply to all activities– Grantees only report data items that are currently

required Specific Indicators

– 18 indicators, many with several data items– Applicable indicators determined by type of activity– Only report on data items relevant to the specific activity

performed

Common IndicatorsCommon Indicators

Amount of money leveraged

Number of persons, households, businesses, units or beds assisted

Income levels of persons or households – 30, 50, 60, or 80 percent of AMI

(only levels currently required)

Race, ethnicity, and disability data for activities that currently report these data

RolesRoles

HUD’s Role– Use IDIS data to summarize program outcomes,

performance & trends nationally– Respond to Congressional/other inquiries

Role of State Grantees– Classify activities using the framework– Report outcome data to HUD

Role of Local Recipients– Collect & report data to States on all ConPlan activities

Applying the System to ActivitiesApplying the System to Activities

For each activity that a grantee plans and funds:

1. Determine the goal of the activity based on local intent

2. Identify one objective and one outcome for each activity in Con Plan submissions (e.g., next Annual Action Plan)

3. Indicate the objective and outcome in IDIS when setting up an activity

4. Report on applicable indicators in IDIS/CAPER/PER



Implementing Performance Implementing Performance MeasuresMeasures

Key Changes to Implement PMKey Changes to Implement PM

Changes to:– Process for funding activities (application/selection)– Written agreements– Data collection & reporting

Opportunities to participate/comment during ConPlan process

Funding ActivitiesFunding Activities

Application/RFP changes:– (list)

Who specifies the objective/outcome: state or local recipient?

Will the outcome system affect selection criteria?– More points for more outcome?– Points for specific types of outcomes?

AgreementsAgreements

Update to standard agreements to require collection and reporting of performance data:– Type of data to be reported– Timeframe for submission– Files to be kept

May need to amend existing agreements for activities not completed by 10/1/06 to require similar collection & reporting

Data Collection & ReportingData Collection & Reporting

Approach:– Integrated PM within existing data collection effort– Data collection/reporting as early as possible– Data reporting is a condition of performance

Forms (as applicable):– Revised application– Project setup– Project completion – Other data collection forms



Sample Outcome, Sample Outcome, Objectives, IndicatorsObjectives, Indicators

The Steps The Steps

When setting up any activity, first identify the purpose/intent of the activity

Then..– Select the appropriate objective

AND– Select the appropriate outcome

And identify relevant indicators

Finally, collect & report the data



Housing Activities

Select Objective

Suitable Living Environment

Decent Housing

Economic Opportunity

Choose one objective based on:– Type of activity– Funding source– Local program intent

Selecting an ObjectiveSelecting an Objective

Determine Outcome

Improved Availability/ Accessibility

Improved Affordability

Improved Sustainability

Choose an outcome based on:– Purpose for the activity - Why did the grantee fund this activity?

Select one outcome for the activity

Selecting an OutcomeSelecting an Outcome

Indicators/DataIndicators/Data

Grantees are required to report on the following information:– Total number of housing units completed– # units available for purchase only by HHs below 80% of AMI– # years affordability restrictions apply (if applicable)– # units meeting Energy Star standards– # units meeting Section 504 accessibility standards– # units occupied by HHs previously in subsidized housing

Additional measures apply to units designated as affordable:– # occupied by elderly households– # designated for persons with HIV/AIDS– # designated for homeless households– # specifically designated for the chronically homeless



Economic Development Activities

Select Objective

Suitable Living Environment

Decent Housing

Economic Opportunity

Suitable living environment: possible for activities that improve living environment in a geogr. area

Commercial revitalization in blighted business district

Decent affordable housing: unlikely for ED

Creating economic opportunities: most likely Job creation/retention, incr. economic activity/opportunity


Determine Outcome

Improved Availability/ Accessibility

Improved Affordability

Improved Sustainability

Availability/accessibility: activities that improve availability/accessibility of goods/services or jobs

Affordability: make capital affordable to businesses Sustainability: activities that increase sustainability of

a geographic area


Objectives, Outcomes & Objectives, Outcomes & Outcome StatementsOutcome Statements




Enhance Suitable Living Environment thru Improved/New

Accessibility to Jobs,

Goods/Services

Provide Economic Opportunity thru

Improved/New Accessibility to

Jobs

Provide Economic Opportunity thru

Improved/New Affordability (capital for businesses)

Enhance Suitable Living Environment

thru Improved Sustainability of

Area (e.g. Business District)

Provide Economic Opportunity

through Improved Sustainability of

Area


Living Environment

Objective #2 Decent

Housing


Outcome Statements

Example: Jobs Data ReportingExample: Jobs Data Reporting

E.D. activities that use the LMI jobs national objective must report on:– For job creation:

Total # jobs created in the program year # jobs with employer sponsored health care #persons who were unemployed prior to taking job created #jobs by EDA job classifications

– For job retention: Total # jobs retained in the program year # jobs with employer sponsored health care # jobs by EDA job classifications

Changes to Jobs Data CollectionChanges to Jobs Data Collection

Have been reporting on # jobs created or retained

But have NOT been collecting information on:– Jobs with employer sponsored health care– Jobs filled by previously unemployed persons– Jobs by EDA categories

Need to provide guidance to businesses, subrecipients & involved parties on the new reporting requirements

Businesses Assisted ReportingBusinesses Assisted Reporting

Applies to the following E.D. activities: Comm/ind improvements (IDIS Matrix Codes 17A-D) Rehab of comm/ind buildings (IDIS Matrix Code 14E) Direct assistance to companies (Matrix Codes 18A-C)

If one of the previously listed activities, collect: Total # businesses assisted # new businesses assisted # existing businesses assisted (expanding/relocating) # businesses with façade or business building rehab # businesses providing goods/services meeting needs of area DUNS no. for each business assisted



Public Facility & Improvement Activities

Types of Public Facilities ActivitiesTypes of Public Facilities Activities

Types of activities carried out:– Construction or installation of infrastructure

improvements such as street, water, sewer, drainage improvements

– Neighborhood facilities such as libraries, police stations, recreational facilities, parks & playgrounds

– Facilities for persons with special needs such as: Battered spouses, nursing homes, group homes for the

disabled, transitional housing for the homeless

Objectives & OutcomesObjectives & Outcomes

Select objective that most closely reflects why activity was funded

Select 1 outcome category for each public facility/improvement activity

See Table on next page of sample activities and the objectives & outcomes that might be chosen

Examples of ActivitiesExamples of Activities




Handicap access ramps

Transitional housing Nursing

homes

Road improvements to

factory

Water treatment plant

Public improvements in low/mod housing

Community park Nghd police station

LibraryStreet/sidewalk

impr.

Public site improvements to

serve low/mod apartments


Living Environment

Objective #2 Decent

Housing


Reporting on Public Facility & Reporting on Public Facility & Improvement ActivitiesImprovement Activities

Data Required– # persons assisted with new access to facility/infrstr.– # persons assisted with improved access to facility/infr.– (If facility/infrastructure will meet a quality standard or

will measurably improve quality) # persons no longer only have access to substandard facility/infrastructure

Grantees must report on public facility & improvement beneficiaries annually – Even when the activity is not yet completed



Public Service Activities

Types of Public Service ActivitiesTypes of Public Service Activities

– Employment services (e.g., job training)– Crime prevention– Child care– Health services– Drug abuse services (e.g., counseling and treatment)– Education– Fair housing counseling– Energy conservation– Welfare (excluding the provision of income payments)– Homebuyer downpayment assistance– Recreational needs


Select one outcome for ea public service activity

Suitable Living Environment– Ex: After-school program for high school kids to

prevent/reduce crime in a target neighborhood

Decent Housing – Ex: Housing counseling activities that assist low/mod

income individuals resolve tenant/landlord disputes

Creating Economic Opportunities – Ex: Job training & placement for persons with disabilities


Availability/Accessibility – Ex: Day care center for students so educ. opportunities

remain available and accessible to young mothers Affordability

– Ex: Free housing counseling to LMI families to enable them to obtain such assistance without charge

Sustainability – Ex: Programs in a local community center to provide

nghd. children with structured activities after school

Public Service Data CollectionPublic Service Data Collection

Data Required:– # persons assisted with new access to a service– # persons assisted with improved access to a service– Where the activity will meet a quality standard or will

measurably improve quality, report # of persons that no longer only have access to a substandard service



Homeless Housing Activities

Selecting an Outcome & ObjectiveSelecting an Outcome & Objective

Outcomes Availability/Accessibility Affordability Sustainability

Objectives

SuitableLivingEnvironment

- Emergency shelter

- Transitional housing program

- Essential services

DecentAffordableHousing

- Homeless prevention.

- Rental rehabilitation

- TBRA

CreatingEconomicOpportunities

ESG Activity ReportingESG Activity Reporting

Under IDIS 10.0, ESG data largely the same– But report actual counts v. %/averages– Phase I of new IDIS will add data for ESG (Fall 2006)

Emergency Shelter data:– # adults and children (actual unduplicated count)– # households served by household type– # persons served by special need category– # persons served by facility type– # persons served by race and ethnicity

ESG Activity Reporting, cont.ESG Activity Reporting, cont.

Homeless prevention & essential services to non-sheltered homeless data:– # individuals served on an annual basis.– # persons served by race and ethnicity.



HOPWA Activities

Choosing an Outcome & ObjectiveChoosing an Outcome & Objective

Outcomes Availability/Accessibility Affordability Sustainability

Objectives

SuitableLivingEnvironment

DecentAffordableHousing

- TBRA

- STRMU

- Rental rehabilitation

- Facility-based housing operations

CreatingEconomicOpportunities

TBRA DataTBRA Data

# households receiving TBRA, including:– # previously homeless households– # chronically homeless households

# persons receiving TBRA, broken down by:– The number of persons with HIV/AIDS; and – The number of other family members.

# persons assisted by age, gender, race, and ethnicity # households assisted by income category Prior living situation of household # households exiting the program, by destination or life event

STRMU DataSTRMU Data

# households receiving STRMU assistance by:– # receiving mortgage assistance– # received assistance in prior reporting year– # received assistance in prior two reporting years

# persons receiving STRMU assistance by:– The number of persons with HIV/AIDS– The number of other family members

# persons assisted by gender, age, race, and ethnicity # households assisted by income category Prior living situation of household # households exiting the program, by destination or life event



Closing and Next Steps Closing and Next Steps

Using the Outcome Framework to Using the Outcome Framework to Improve Local PerformanceImprove Local Performance

In addition to serving national purposes, framework can be used for local program management– To assess grantee goals v. actual– To evaluate results of particular programs– To evaluate results of particular partners– To track progress against identified needs

What possible uses do you envision?


Housing– How many units are created annually over time?– What is our cost per unit and how is it changing?– How much of our costs are paid with leveraged funds and

is that improving?– What are the average incomes of our beneficiaries and

how is that changing?– What are the other demographics of our beneficiaries and

are we reaching our targeted populations?– Compare outcome data to other sources (Census) to

assess other results, e.g.,reductions in substandard housing or increases in property tax revenues


Economic development:– How many jobs are created annually over time?– Are we creating jobs that fill a local need or that lead to

family self sufficiency?– What is our cost per job and how is it changing?– How much of our ED costs are paid with leveraged funds --

especially private funds -- and is that improving?– Are we reaching our intended audience?– Compare outcome data to other sources to assess issues

such as the rate of local unemployment, crime reduction in target areas or increases in business or wage taxes


Public services and facilities:– How many persons are we serving annually and how is

that changing over time?– What is our cost per assisted person and how is it

changing?– What are the other demographics of our beneficiaries

and are we reaching our intended audiences?– Compare outcome data to other sources to assess

issues such has the rate of potable water increased or the levels of literacy improved (data to be assessed depends on program type)


Homeless housing– How many units are created annually over time for

homeless persons? Are we creating units for chronically homeless persons?

– What is the mix of permanent housing to temporary shelter and are we meeting our goals?

– What is our cost per unit designated for homeless persons and how is it changing?

– What are the other demographics of our beneficiaries and are we reaching any specifically targeted populations?

– Are we meeting the goals of our Continuum of Care?


Housing For Persons With AIDS– How many units are created annually over time

specifically designated for persons with AIDS?– Are we able to leverage HUD funds and offer associated

services with the housing?– What are the average incomes of our beneficiaries and

how is that changing?– Are we reaching our targeted special populations?– Have we been able to address the identified needs of

our beneficiaries, such as reduction in rent burden or increase in persons living in standard housing?

Next Steps - YouNext Steps - You

Review the forms provided

Prepare to collect data on all activities not completed by 10/1/06

Identify activities that can be completed by 10/1/06– Get completion data in on those activities

Discuss ways to make use of the additional data for local management

Next Steps - UsNext Steps - Us

ConPlan consultation & submission incorporating PM

Next funding round – when and what changes

When written agreements will be revised

When data collection forms will be available

When data reporting required

Wrap UpWrap Up

Thanks for attending!

For more information, contact

introducing the hud outcome measurement system

Documents