practical innovations with rubrics: if you build it, they will grade!
TRANSCRIPT
1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015
2ExamSoft Assessment Conference | #ASSESS2015
Danielle Birch, BAConnie Remsberg, Pharm. D., Ph.D.
Washington State University College of Pharmacy
3ExamSoft Assessment Conference | #ASSESS2015
Who are We & What do We do?
Washington State University College of Pharmacy
• Danielle Birch: Program Coordinator for Assessment• Connie Remsberg: Director, Advancement of Teaching and
Learning Excellence
4ExamSoft Assessment Conference | #ASSESS2015
Overview
• Rubrics for Knowledge Based Assessments
• Rubrics for Skills Based Assessments– Patient counseling example
• Interactive rubrics lesson• Challenges and benefits• Questions & answer
5ExamSoft Assessment Conference | #ASSESS2015
Let’s hear from you!
6ExamSoft Assessment Conference | #ASSESS2015
Learning Objectives
1. Develop and use rubrics for essay grading
2. Assign multiple rubrics to one assessment
3. Assign multiple graders to specific students
4. Utilize checklist in rubric format to evaluate skills based activities
5. Identify challenges and benefits of adopting computerized rubric technology to assess skills-based assessments
7ExamSoft Assessment Conference | #ASSESS2015
Competency Based• Competency based grading system• Honors- Satisfactory-Fail (H-S-F)• Block Testing
– 3 attempts allotted to reach competency• Test• Retest• ELE
• Rubric Terminology • Longitudinal Reports
8ExamSoft Assessment Conference | #ASSESS2015
Appendix D/ Accreditation
• Accreditation Council for Pharmacy Education (ACPE)
• Longitudinal reporting of Appendix D
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%85.98%
98.83%
58.88%
90.06%84.96%88.65%97.43%
85.90%85.03%82.14%85.51%91.41%
Group Average
9ExamSoft Assessment Conference | #ASSESS2015
Interactive Rubrics LessonTake out your laptops!
(if you haven’t already)
10ExamSoft Assessment Conference | #ASSESS2015
Login• Google: WSU ExamSoft• Email: [email protected]• Password: harrypotter
11ExamSoft Assessment Conference | #ASSESS2015
How to Build A Rubric
12ExamSoft Assessment Conference | #ASSESS2015
Knowledge Based Performance
(essays)
Skills Based Performance
(compounding, patient
counseling)
Rubrics
13ExamSoft Assessment Conference | #ASSESS2015
Rubrics for
Knowledge Based Performance
14ExamSoft Assessment Conference | #ASSESS2015
Assign a Rubric (or 2!) to an Essay
• Post the test, then add the rubric!
Learning Objective #1: Develop and use rubrics for essay grading
Learning Objective #2: Assign multiple rubrics to one assessment
Pg. 1, 11
15ExamSoft Assessment Conference | #ASSESS2015
Learning Objective #1: Develop and use rubrics for essay grading
16ExamSoft Assessment Conference | #ASSESS2015
Assigning Multiple Graders
p.4
17ExamSoft Assessment Conference | #ASSESS2015
Assign Multiple Graders
Learning Objective #3: Assign multiple graders to specific students
Pg. 4
18ExamSoft Assessment Conference | #ASSESS2015
Detailed Grader Report
Learning Objective #3: Assign multiple graders to specific students
19ExamSoft Assessment Conference | #ASSESS2015
Rubrics for
Skills Based Performance
20ExamSoft Assessment Conference | #ASSESS2015
Compounding Lab• Use of rubrics to assess the following
– Compounding products– Compounding records– Professionalism grades
21ExamSoft Assessment Conference | #ASSESS2015
Patient Counseling Assessment
• https://tegr.it/y/1iz1u
22ExamSoft Assessment Conference | #ASSESS2015
23ExamSoft Assessment Conference | #ASSESS2015
Application
• Page 3 of your packet: accessing your assigned rubric• https://www.youtube.com/watch?v=hVb_dXfK44E
Learning Objective #4:Utilize checklist in rubric format to evaluate skills based activities
24ExamSoft Assessment Conference | #ASSESS2015
Review: Challenges and BenefitsChallenges• The move from paper-based to computer-based• Combining multiple rubrics• Half points• Releasing results (delay in registering in the portal)• Cannot preview what the students will seeBenefits• Faculty Collaboration• Efficiency• Much faster• Tracking outcomes• Evaluate grader tendencies• Score quickly and write comments
Learning Objective #5: Identify challenges and benefits of adopting computerized rubric technology to assess skills-based assessments
25ExamSoft Assessment Conference | #ASSESS2015
Bad Example• Ron Swanson Turkey Burger• https://www.youtube.com/watch?v=tq2CwGgz73Q
26ExamSoft Assessment Conference | #ASSESS2015
Q&AI can’t wait to grade
more efficiently!
I loved switching from paper to computer
based rubrics!
This is not my best jump.
I love saving time by assigning multiple
graders!