florida’s outcome-based evaluation program finding the fit with multitype library cooperatives...

Florida’s Outcome-Based Evaluation Program

Finding the Fit withMultitype Library Cooperatives

Sondra Taylor-FurbeeJune 15, 2002

LSTA and Outcomes

1998 Florida participated in first IMLS pilot project to begin looking at outcomes

Revisited our sub-grant program

LSTA Grants

Application must be developed with anticipated outcomes

Annual and mid-year reports address outcomes

Outcomes are stated in terms of the benefit to customer

Traditional Project Measurement:

INPUTS ACTIVITIES OUTPUTS

Resources Services Products

Funding Training # of classes

Staff Tutoring # of students

Volunteers Scanning # of books

Equipment Installing # of web hits

Outcomes MeasurementINPUTS ACTIVITIES OUTPUTS OUTCOMES

Resources Services Products Change in Client

Funding Training # of classes Knowledge

Staff Tutoring # of students Skills

Volunteers Scanning # of books Behavior

Equipment Installing # of web hits Condition

Categories for LSTA Grants

Access for Persons Having Difficulty Using Libraries

Library Technology Connectivity and Services

Sample Common Outcomes

Public uses technology to get information

Public learns to use technology

Eligible Types of Libraries

Public Libraries Academic Libraries Special Libraries School Libraries Multitype Library Cooperatives

Central Florida Library Cooperative Northeast Florida Library Information

Network Panhandle Library Access Network Southeast Florida Library Information

Network Southwest Florida Library Network Tampa Bay Library Consortium

MLC Membership

Total Membership: 358 Libraries* 121 Academic* 106 Public* 87 Special* 44 School

Operating Incomeby Source

Local 39% State 23% Federal 38%

LSTA OUTCOMES PLANProject Name _____________________________ _ Library______________________

Project Summary/Program Purpose:

Inputs Activities Outputs Outcomes Indicators Sources/Methods

LSTA Grant from CFLC:Technology Training for Central Florida Libraries

Purpose: Provide technology training to the staff of member libraries to assist in service to the public.

Activities

Hire Continuing Education Coordinator Develop and update curriculum Schedule workshops Develop offsite training facilities Conduct workshops

Outcomes:

Library staff is able to use technology to assist patrons to obtain information

Library staff is able to use technology to assist patrons in operating computers

Indicators:

75% staff attending workshops increase technology knowledge and comfort level of working with patrons

Evaluation

Sample outputs – Number of classes– Number of participants

For outcome:– Training workshop evaluations– Trainer observation– Follow up survey

Midyear Report:

Developed 2 new workshops More training opportunities Developed trainers observation

checklist Developing follow-up survey Developing automated evaluations

for classes

TBLC Anytime Anywhere Library

Brings together resources of Tampa Bay libraries for access by anyone, at anytime, from anywhere, via the Internet.

Pilot regional virtual library including ILL.

http://alleycat.tblc.org/

Outcomes

Public uses technology to get information

Participants learn to use technology

Activities Create virtual library umbrella web site

for use by the public Expand pilot regional virtual catalog and

ILL system Enable customers of participating library

to request materials Implement remote authentication for

customers

Evaluation Outputs

– # hits on Alleycat website– # requests for ILL– # training sessions– # content links

Outcome Source Methods:– Email survey to Alleycat users– Training Class evaluation forms

NEFLIN

Digital Imaging of Special Collections – Local history collections from Alachua

County,Putnam County, and Jacksonville University

– User surveys

PLAN

Plan Academy - Technology Training– Evaluation forms– Post training surveys– Anecdotal report

SEFLIN

Has LSTA grant applications online - can see LSTA outcome model http://www.seflin.org/

Mi Servicio de Biblioteca– Access to library services for Spanish-

speaking population– Online survey

SWFLN

Technology Training– Workshop evaluations– Postcard survey

Benefits

Cooperatives have impacts can report to members, potential members, funders

State Library can aggregate changes MLCs have made in Florida

MLC web sites

CFLC http://cflc.net/ NEFLIN http://www.neflin.org/ PLAN http://plan.lib.fl.us/ SEFLIN http://www.seflin.org/ SWFLN http://www.swfln.org/ TBLC http://www.tblc.lib.org/