trinity college course evaluations · best practices for trinity college course evaluations...

45
Trinity College Course Evaluations OFFICE OF ASSESSMENT, TRINITY COLLEGE DUKE UNIVERSITY

Upload: others

Post on 07-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Trinity CollegeCourse EvaluationsOFFICE OF ASSESSMENT, TRINITY COLLEGE

DUKE UNIVERSITY

Page 2: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Topics for today’s meetingCourse evaluation administration

-Department responsibilities

-Faculty responsibilities

-Fall 2017 dates

Changes to course evaluation questionnaire -New student form

SACES updates-How to opt-in to SACES

-SACES reports

Accessing and navigating reports in Tableau-Logging in

-Available Reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 2

Page 3: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Course Evaluation Administration

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 3

Page 4: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Responsibilities

Review and approve list of eligible courses for Fall 2017

Encourage instructors to follow best practices

Notify instructors of important dates

Support instructors use of Tableau CE reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 4

Page 5: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Responsibilities

Review and approve list of eligible courses for Fall 2017

Encourage instructors to follow best practices

Notify instructors of important dates

Support instructors use of Tableau CE reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 5

• Email sent to departments on October 5th

• Email includes list and instructions for review

• List returned to OATC by October 20th

Page 6: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Are all courses that your department would like to have evaluated listed on your course list worksheet?

Should any courses be eliminated from the evaluation list? *As a rule: do not remove any crosslistedcourses*

Is the correct instructor listed for each course? Do any courses have blank fields or missing entries?

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 6

Review and Approve List of Eligible Courses:

Page 7: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Review and Approve List of Eligible Courses:

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 7

Page 8: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Best Practices for Trinity College Course EvaluationsCommunicate to students the value of course evaluations

Share access instructions with students (OATC website or available PDF)

Set aside a few minutes in class to let students get started

Check return rate monitor in Duke Hub

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 8

Page 9: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Best Practices for Trinity College Course EvaluationsCommunicate to students the value of course evaluations

Share access instructions with students (OATC website or available PDF)

Set aside a few minutes in class to let students get started

Check return rate monitor in Duke Hub

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 9

• Messaging from departments and instructors to students can

help boost return rates

• Share ways in which course evaluation results inform

decisions in the classroom and in your department

Page 10: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Important Dates – Fall 2017October 20th

◦ Return reviewed list of eligible courses to OATC

November 1st

◦ Notifications and instructional memos sent to departments

November 21st

◦ 12:01AM – Trinity College course evaluations open

◦ Notifications sent to students and instructors

December 11th

◦ 11:59PM – Trinity College course evaluations close

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 10

Page 11: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Important Dates – Fall 2017Week of December 18th

◦ Publish Course Evaluation Reports in Tableau

December 20th

◦ Trinity College course evaluations close for GEO courses

Early January◦ OATC holds office hours to support departments

use of Course Evaluations reports in Tableau

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 11

Page 12: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Important Dates – Fall 2017Week of December 18th

◦ Publish Course Evaluation Reports in Tableau

December 20th

◦ Trinity College course evaluations close for GEO courses

Early January◦ OATC holds office hours to support departments

use of Course Evaluations reports in Tableau

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 12

• Can’t publish reports until critical mass of grades have been

reported

• Encourage your faculty to get grades published ASAP

Page 13: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Updates to Trinity College Course Evaluation Questionnaire

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 13

Page 14: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

What’s new?

Single form-Student form only

-No faculty form

Shorter form-No Mode of Inquiry questions

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 14

Page 15: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

What’s the same?

Department review of eligible course list

Students complete questionnaire through Duke Hub

Trinity Learning outcomes

Reports published in Tableau

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 15

Page 16: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Trinity College Course Evaluation Questionnaire

Overall rating 1 2 3 4 5

The course has clearly defined

student learning objectives

Strongly disagree Disagree Neither agree or disagree

Agree Strongly agree

The course had clear expectations for assignments and

other work

Strongly disagree Disagree Neither agree or disagree

Agree Strongly Agree

Overall the course was:

Poor Marginal Average Very Good Excellent

Overall the instructor (Instructor 1) was:

Poor Marginal Average Very Good Excellent

Overall the instructor (Instructor 2) was:

Poor Marginal Average Very Good Excellent

Overall the instructor (Instructor 3) was:

Poor Marginal Average Very Good Excellent

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 16

Page 17: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Trinity College Course Evaluation Questionnaire

Trinity College learning

objectives

1 2 3 4 5

This course helped me gain factual knowledge

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me understand fundamental concepts and principles

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me learn to apply knowledge, concepts,

principles, or theories to a specific situation or problem

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me learn to analyze ideas, arguments, and

points of view

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me learn to synthesize and integrate

knowledge

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me learn to conduct inquiry through methods

in the field

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me learn to evaluate the merits of ideas and

competing claims

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me to effectively communicate ideas

orally

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

This course helped me to effectively communicate ideas in

writing

Strongly disagree Disagree Neither agree or disagree Agree Strongly agree

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 17

Page 18: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Trinity College Course Evaluation Questionnaire

Course

Dynamics

1 2 3 4 5

The course had a welcoming and

inclusive classroom environment

Strongly disagree Disagree Neither agree or disagree

Agree Strongly agree

Compared to the requirements of other classes of this type, please characterize the course difficulty

Very low Low Moderate High Very High

How much did you learn from this

course

Nothing A little A moderate amount

A lot A great deal

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 18

Page 19: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Trinity College Course Evaluation Questionnaire

Student

Engagement

1 2 3 4 5 6 7 8 9 10

How many hours per week on

average did you spend on this

course (outside of class

meetings)? Examples include

study groups, attending office hours, reading,

writing, working on practice

problems, etc.

1 Hour 2 Hours 3 Hours 4 Hours 5 Hours 6 Hours 7 Hours 8 Hours 9 Hours 10 Hours

About what percent of the class meetings

(including discussions, labs,

etc.) did you attend in person?

10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 19

Page 20: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Trinity College Course Evaluation Questionnaire

What would you like to say about this course to a student who is considering taking it in the future?

Would you like to provide any other comments about this course?

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 20

Page 21: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Student Accessible Course Evaluation System

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 21

Page 22: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Student Accessible Course Evaluation System

Student access to quantitative results

Written comments not shared

Instructor must opt-in to make data available

Encourage and support instructors in joining SACES

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 22

Page 23: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Student Accessible Course Evaluation System

Student access to quantitative results

Written comments not shared

Instructor must opt-in to make data available

Encourage and support instructors in joining SACES

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 23

• Students want to know what their peers are saying!

• SACES provides a platform for sharing this feedback that is more

representative of the overall course experience.

Page 24: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Accessing SACES reportsAccessed via a hyperlink in DukeHub’s course search function

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 24

Page 25: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Accessing SACES reportsAccessed through the OATC website

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 25

Page 26: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Accessing SACES reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 26

Page 27: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Accessing SACES reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 27

Page 28: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Accessing SACES reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 28

Page 29: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

How to opt-in to SACESWebform available within Instructor Tableau Reports

Webform available on OATC website

Encourage instructors to opt-in immediately following the publication of reports

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 29

Page 30: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Navigating Course Evaluation Reports in Tableau

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 30

Page 31: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Tableau Reports – Log In

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 31

To access Tableau go to:Tableau.oit.duke.edu

Page 32: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Tableau Reports - Workbooks

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 32

Page 33: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Tableau Reports - Workbooks

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 33

Page 34: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Tableau Reports – Department View

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 34

Page 35: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – Courses Evaluated

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 35

Page 36: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – Basic Report

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 36

Page 37: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – Course with Comparisons

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 37

Page 38: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – Department Overall

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 38

Page 39: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – Written Comments

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 39

Page 40: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – Means by Course

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 40

Page 41: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Department Report – APT

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 41

Page 42: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Tableau Reports – Resources Tableau Quick Start Guide

◦ http://assessment.trinity.duke.edu/tableau-quick-start-guide

Tableau Users Guide◦ http://assessment.trinity.duke.edu/tableau-user-guide

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 42

Page 43: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Upcoming EventsMaking use of the information you already have (or have access to)

Tuesday, October 24, 2017 – 10:00am – Perkins 217◦ Report examples include COFHE enrolled student and senior surveys, Tableau program informational

reports, course evaluations.

◦ Participants will identify and report the types of data they’re already collecting.

◦ Participants will be become familiar with other types/sources of data (course, program and college wide) they already have access to.

◦ Participants will brainstorm the ways in which these data sources support the program’s student learning outcomes.

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 43

Page 44: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Questions?

How is your department using course evaluation data?

Do you feel comfortable supporting faculty in your department with their course evaluations?

Have you reviewed your list of eligible course for Fall 2017?

OFFICE OF ASSESSMENT, DUKE UNIVERSITY © 2017 44

Page 45: Trinity College Course Evaluations · Best Practices for Trinity College Course Evaluations Communicate to students the value of course evaluations ... Tableau program informational

Thank you for the work you do to support student learning assessment in your department!P L EA S E CO N TAC T T H E O F F I C E O F A S S ES S M E N T, T R I N I T Y CO L L EG E W I T H A N Y Q U EST I O N S :

A S S ES S M E N T @D U K E .ED U