Computer Science Course Assessment

Feb 15, 2012 / Dan Duchamp

Purpose

• To improve the quality of education

• To improve instructors

• ABET requires it (for BS-CS program)

• Middle States requires it (for MS programs)

Why do assessment?

Program Outcomes

Each program (i.e., BS major or MS degree) has PROGRAM OUTCOMES

Example program outcome:a program graduate has the “ability

to apply knowledge of computing and mathematics appropriate to the discipline.” (BS-CS outcome A)

Program Outcomes

Outcomes for all CS programs listed at http://www.stevens.edu/compsci/accreditation/prog_out.html

Course Outcomes

Each course has COURSE OUTCOMES

Example course outcome:“Explain how memory is

allocated among multiple resources.”(CS 520 outcome #1)

Course Outcomes

Outcomes for all CS courses listed at http://www.stevens.edu/compsci/undergrad/ugrad_courses.phpand http://www.stevens.edu/compsci/graduate/masters/grad_courses.php

Outcome Mapping

Each program outcome is supported by one or more course outcomes

Course 1 Course 2 Course 3

Program 1

Program 2

Course Outcomes

Mapping of program outcomes to course outcomes listed with program’s outcomes at http://www.stevens.edu/compsci/accreditation/prog_out.html

Example Mapping

Course Assessment

• Direct: measured student performance

• Indirect: student opinions about their performance (ACE survey)

Two kinds of data:

Measuring Student Performance

For each course outcome there is an “assessment instrument” (i.e., graded piece of work)

Example: homework assignment, exam question, project

Course Assessment

1. Compute average performance on each instrument (0-4 scale)2. Enter average onto SPAD form inside ACE system3. Instructor also writes his/her opinions on ICE form inside ACE system4. Produce PDF versions of SPAD & ICE5. Post PDFs at http://www.stevens.edu/compsci/accreditation/forms.php

SPAD Form

ICE Form

Course Improvement

1. Before semester, instructor reads SPAD and ICE forms from previous semesters2. From this data, instructor determines how to improve the course; instructor documents his/her plans on PCR form3. After semester, instructor produces and posts SPAD & ICE forms – for use by future instructors

PCR Form

Important Web Sites

ACE system (to produce SPAD and ICE forms): https://www.stevens/assess

CS forms page (to get PCR form, save PCR, SPAD, ICE): http://www.stevens.edu/accreditation/forms.php

ACE

CS Forms Page

Mid-semester Survey

Also … around mid-semester, during class time students fill out very simple “mid-term survey” form

Instructor reads surveys and immediately makes any needed improvements

Mid-term survey forms are not saved

Mid-term Survey

What You Can Do To Help

1. Learn course outcomes2. Discuss with instructor: which instrument will measure each outcome?3. Create grade item in Moodle for each instrument4. For each instrument, compute average, convert to 0-4 scale (e.g., 79% = 3.16/4)5. Report instrument averages to instructor for entry onto SPAD