Far West Laboratory for Educational Research and Development Training Units

Evaluation Proposal to Far West Laboratory for Education Research and Development Submitted by: Evangeline Beaver Consulting Evaluation Solutions Services

1 | P a g e

Introduction Far West Laboratory for Educational and Research Development (FWL) of Boise, Idaho, submitted a Request for Proposal (RFP) to evaluate a training program. This proposal, submitted by Beaver Consulting Evaluation Solutions Services (BSESS), is in response to Far West Laboratory’s request. The purpose of this response is to present both evaluation and recommendations to FWL to assist them in decision-making regarding the training materials, such as whether to move forward with the investment and to expand the DIP training program.

Program Description The program being evaluated, Determining Instructional Purposes (DIP), is a training package developed as a solution for training graduate students and school administrators so they can plan and implement academic programs. It entails three training units:

• Unit 1: Setting Goals (10-15 hours training) • Unit 2: Analyzing Problems (12-18 hours training) • Unit 3: Deriving Objectives (10-15 hours training)

In each unit, the reading materials have four to six modules that include a Coordinator’s Handbook that can be downloaded as a PDF file. In addition, the training package is available in print form (155 to 259 pages). The modules can be used individually or in a small group. Each unit encompasses reading materials, group activities, and achievement feedback. In essence, the training package is projected for use in a short-term workshop or in individual sessions that enable a trainee to focus on specific skills. Training units are available at the following prices:

• Individual units: $8.95 • Three sets: $24.95. • Coordinator’s Handbook per copy: $4.50 (can be purchased separately)

The Coordinator’s Handbook is used for organizing and monitoring the activities of the participants. Each unit can be self-contained or combined with other units. Units may be used in short-term training sessions or individual sessions for several weeks or months. Evaluation Method The purpose of this evaluation is to provide a recommendation for the dissemination of the units. BCESS will gather information on the content of DIP materials and make recommendations to FWL to assist in the decision-making process. In addition, this evaluation will be useful to school administrators who are considering the purchase of the three units. The evaluation is an essential component required to determine if FWL needs to pursue the creation of the DIP training program. Interviews, surveys, and analysis from collecting data will be used to produce a final evaluation report.

In the evaluation, school administrators and graduate students are to take part prior to the training. It is the aim of BCESS to ask all training participants to complete a pre-survey and post-survey to evaluate the effectiveness of training and facilitation. The DIP training program

2 | P a g e

will be evaluated based on several evaluation strategies, which will be discussed below. BCESS will assess the training materials to determine the effectiveness of the instruction. Previous and current practice of the DIP training program will provide valid information about the impact of the program. In addition, the marketing information will be examined to compare prices with competitors. The purpose of evaluating the training and marketing materials is to gather information and align that information with the objectives of the training materials.

The pre-survey will be Likert-type to assess the effectiveness of the training session and identify strengths. Did the participants learn? Did the participants feel the training met expectations? Did the participant horizons expand? The interview will be piloted with all participants. The interview questions will be asked to provide background information concerning the emerging DIP training materials and communicate marketing concerns, such as the target audience, as well as sharing essential information for valuable assessment.

The post-survey will be used to evaluate decision-making based on new knowledge and further growth. The purpose is to find out if participants accomplish the objectives as outlined in the program standards. Did the participants make progress in the training program? Should the FWL market the DIP training program package? To determine the market of the current DIP training program, records will be reviewed in previous and current FWL training, as well as interviews with program coordinators to assess implementation and organize pertinent data for assessment. Financial data will also be reviewed to determine the viability of the overall training programs and collect all information. In essence, this assessment is to determine if the administrators participating in the training find the three units worth investments. The following task schedule highlights the process, whose responsible for completing each task, and deadlines for completion:

3 | P a g e

Task Schedule Task Responsible Deadline Date

1. Meet with FWL

BCESS

August 27, 2012

2. Gather information from FWL Program Coordinator/staff and review the document.

BCESS

August 28, 2012

3. Create pre-survey and post-survey questionnaires for data collection.

BCESS

August 29, 2012

4. Select trainees for the sample population.

BCESS

September 3, 2012

5. Administer survey to the sample population.

BCESS

September 10, 2012

6. Interviews with program coordinators to assess implementation and organize pertinent data for assessment.

BCESS

September 5, 2012

7. Conduct training in the sample population.

BECESS

September 10, 2012

8. Summarize gathered data.

BECESS

September 21, 2012

9. Assess and analyze data from surveys.

BECESS

October 2, 2012

10. Write and submit a final evaluation report to FWL.

BECESS

October 23, 2012

4 | P a g e

Project Personnel Evangeline Beaver, M.E.T. and CEO of Beaver Consulting Evaluation Solution Services will coordinate all assessment standards. Ms. Beaver has been the CEO of BCESS for twenty-two years and continues to lead the BCESS analysis team. In addition, according to personnel policies and procedures, she effectively manages the human resources of the organization, and she has supervised a field assessment of the Refugee Mentoring Program. Her expertise also includes training professionals. BreAnn Sinju Shulsen, senior evaluation coordinator, will create all relevant tools for assessment. Ms. Shulsen has a remarkable proficiency in evaluation design and a master in higher education from Boise State University, Boise, Idaho. The Foundational Studies Program has honored her for her work in comparing Instructional Course Evaluation tools. Jennifer Bauer, administrative assistant to the CEO has a B.A. in communication and business from the University of Idaho, which is located in Moscow, Idaho. Ms. Bauer has worked on thirty projects similar to this proposal and will assist in all areas and demonstrate her expert organizational skills. Ms Bauer will collect data, assist instruction, review and evaluate completed surveys, as well as assist in training sessions during the entire program. She is also the contact person for FWL training participants.

5 | P a g e

Budget Personnel Personnel Rate Days Total

Evangeline Beaver $500 40 $20,000

BreAnn Sinju Shulsen $400 40 $16,000

Jennifer Bauer $210 25 $ 5,250

Total $41,250

Travel-State mileage rate effective Jan. 1, 2009 Travel Rate Miles Total

Evangeline Beaver 45.5.55 cents 1000 $ 455

BreAn Sinju Shulsen 45.5.55 cents 800 $ 364

Jennifer Bauer 45.5.55 cents 500 $ 227.50

Total $1,046.50

Supplies/Materials Supplies/Materials Total

Printing Services $1,000

Office Supplies $ 500

Total $1,500

Total Expenses $43,796.50