Slide 1

Online Student Evaluations Paper or Plastic? Archie George Kathy Dean Jason Mayer* University of Idaho *now with Information Technology Services Slide 2 Outline Brief history of course evaluations at the University of Idaho The new evaluation form The student portion The faculty portion The report portion Problems/Solutions Future Design Slide 3 History of Course Evaluations at the University of Idaho Same paper form for 12 years Over 32,000 forms scanned every term Hardware/software support Five weeks of time to sort, scan, compile and distribute reports Accuracy issues Open-ended responses not recorded Confidentiality issues Off-campus courses not consistently surveyed Slide 4 Why Change New dynamic form No data entry Online accessibility Larger time frame to complete evaluation Demographics gathering capability Instant online access to reports Student confidentiality Save time and $$$ Slide 5 Student Component Process Email notices to students links to system included Login to system using standard student access procedure Choose course/instructor to evaluate Fill out online form Click submit button Repeat process for each course/instructor evaluation Slide 6 Student Component Advantages Student has time to think about responses Can complete evaluations at students convenience Systematic method of measurement same for all Accurate data collection Slide 7 Student Component Disadvantages Perception that students are not a captive audience as in classroom Some students have difficulty using the technology Slide 8 Slide 9 Slide 10 Slide 11 Instructor Component Process Automated email at beginning of semester Instructors customize their own forms Automated email during evaluation period Instructors encourage students to use the system Slide 12 Instructor Component Advantages Standard questions for comparison purposes Instructors get to choose their own items Delete/view form capability Can revise form multiple times before first evaluation is done Slide 13 Instructor Component Disadvantages Some faculty not comfortable with the technology Delete/view form capability is inflexible; Need edit and save capability Difficult to deal with special cases System does not allow for department items to be added Slide 14 Slide 15 Slide 16 Slide 17 Slide 18 Slide 19 Reporting Component Process Reports for current semester are made available after grades are submitted Available online to instructors and administrators No instructor level reporting for courses with less than 5 students enrolled Slide 20 Reporting Component Components Detailed report (reports each students response) Summary report (reports aggregated summary for Likert-type items only) Department Summaries College Summaries University Summaries Slide 21 Reporting Component Multiple levels of access Administrator access Course instructors access Student access (not a part of online system) Slide 22 Slide 23 Slide 24 Slide 25 Slide 26 Slide 27 Slide 28 Slide 29 Slide 30 Slide 31 Slide 32 Slide 33 Problems and Solutions Response rates Abnormal course begin/end dates Faculty buy-in Student log-in/PIN Washington State University students Technology ( i.e. Internet access, browser type/version) Slide 34 Future Design Standard, customizable report templates Form save option Form edit feature Downloadable spreadsheet for results Slide 35 http://www.webs.uidaho.edu/ipb/studentevals Slide 36 Comments/Questions? Kathy Dean University of Idaho kdean@uidaho.edu