joe chihade - cherry danielson ellen iverson hhmi assessment workshop
TRANSCRIPT
![Page 1: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/1.jpg)
J O E C H I H A D E - C H E R RY DA N I E L S O N E L L E N I V E R S O N
HHMI ASSESSMENT WORKSHOP
![Page 2: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/2.jpg)
INTRODUCTIONS
WelcomeWhy are we here?
Introductions with Grant Projects
![Page 3: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/3.jpg)
LEARNING OUTCOMES
Goals• You will identify the student learning
goals/outcomes for your grant project• What do you want your students to be able to do
or demonstrate when they have finished your course/module?
![Page 4: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/4.jpg)
CHARACTERISTICS OF LEARNING OUTCOMES
• What things do you want your students to gain from their learning experience? • Knowledge• Skills• Attitudes• Behaviors
• Also, do these outcomes make sense considering the time you have available? • To what degree do you think you can affect them?
![Page 5: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/5.jpg)
REVIEW OUTCOMES
• Can you tell what the learning goals are?• Is the range of specificity appropriate? • (Too broad? or too narrow?)• How could it be made clearer?• What would you add or subtract?
![Page 6: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/6.jpg)
LEARNING GOALS
• What types of things did you find helpful from your reviewer?• What difficulties or confusion still exists in your
mind regarding learning goals or outcomes?
![Page 7: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/7.jpg)
LEARNING OUTCOMES
![Page 8: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/8.jpg)
THE LEARNING ENVIRONMENT
Goals• You will identify a collection of environmental
Aspects that will undergird your innovative curricular project.• You will identify teaching methods that you will
use. • You will understand the use of paired survey
instruments.
![Page 9: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/9.jpg)
THE LEARNING ENVIRONMENT
Understanding what the environment will be like
for your curricular innovation relative to student learning.
![Page 10: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/10.jpg)
ASPECTS OF THE LEARNING ENVIRONMENT
• What makes a strong teaching activity?• Research/Literature based list• 4 Groups represent the whole student• Looking for gaps
![Page 11: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/11.jpg)
DOT AND POST-IT ACTIVITY
Learning Environment List
Highlight • PINK – Primary aspects you intend to use
• YELLOW – Less frequent aspects you intend to use
Cam’s Example
![Page 12: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/12.jpg)
DOT AND POST-IT ACTIVITY
Dots –• Put your initials on the dots • Place dots on posters matching each highlighted
area on the learning environment list
Post-its –• Write a brief description of what the primary
aspects will look like in your course/module. • Put your initials on each post-it.
Cam’s example
![Page 13: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/13.jpg)
THE POST-ITS ACTIVITY INTENTIONS
• Help Faculty see where their own methods map onto the framework
• Help us flesh out the instrument with new items that fit into one or more of the categories.
![Page 14: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/14.jpg)
THE BIG PICTURE
Goal• You will appreciate how innovative course
development sits within the learning environment of your class/course module and how it relates to the goals of the HHMI grant.
![Page 15: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/15.jpg)
HHMI 7 – INTEGRATED SCIENCE AND MATH EDUCATION
• Curricular development that builds explicit linkages between specific pairs or sets of courses• Cohort programs that support the persistence of students in
science and math• Incorporating authentic research experiences into
coursework, and enhancing student-faculty research experiences• Providing opportunities for students to engage in
community-based learning and community-based research, where student apply their learning in a real-world context• Providing opportunities for students to review, deepen, and
integrate their previous learning by teaching others at Carleton and in the community
![Page 16: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/16.jpg)
![Page 17: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/17.jpg)
A3 A2
3 LEVELS OF ASSESSMENT
A
A
A
A
![Page 18: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/18.jpg)
CAT #1
• To what degree did the Dot and Post-its Activity help you to see where your methods map onto the framework?
• What is the muddiest point of that exercise?
![Page 19: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/19.jpg)
DAY 2
Recap Yesterday’s Activities
![Page 20: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/20.jpg)
CAT #1
• To what degree did the Dot and Post-its Activity help you to see where your methods map onto the framework?
• What is the muddiest point of that exercise?
![Page 21: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/21.jpg)
CAT #1
5
4
3
1
Response Categories
Useful FrameworkExplicitNormOther Methods
![Page 22: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/22.jpg)
MUDDIEST POINT
3
33
1
11
1
Muddiest Responses
Edu-speak PickingPremature Didn't GraspDifferent understand-ings
"how" or "what"
Nothing
![Page 23: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/23.jpg)
A TIMELINE OF ASSESSMENT
Goals• Draft a project timeline that plots your own
learning outcomes, learning environment, and assessments.• Understand the value of positioning assessments
among the learning elements to scaffold learning.
![Page 24: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/24.jpg)
QUALITIES OF ASSESSMENT
• Formative and summative
• Direct and indirect
• Graded and not graded
• Group and individual
• Measurement or an indicator (proxy)
• Linked to a particular outcome
• Covers at least some of the dimensions of the learning outcome
• 51 CATs – Angelo and Cross
• SERC - Website
![Page 25: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/25.jpg)
A TIMELINE FOR ASSESSMENTTHE CONCEPT
Across the time of your project/course/module.
• Find the strategic timing for: • activities and assignments that scaffold
learning• learning environment pedagogy• using assessments to reinforce learning or
inform next steps
• asking students to demonstrate learning
![Page 26: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/26.jpg)
TIMELINE KEY
1. Learning Outcomes
2. Course Activities/Assignments
3. Learning Environment
4. Formative Assessments
5. Summative Assessments
![Page 27: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/27.jpg)
TIMELINE OF ASSESSMENT
1 2 3 4 5 6 7 8 9 10
![Page 28: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/28.jpg)
GEO EXAMPLE
Materials:• Mary Savina’s Geo Course Description & Schedule• Mineral Resources – Activity • Drinking Water – Assignment and writing prompt• Natural Hazards – Assignment and writing prompt• One-Minute papers (2)• Think like a Geologist Prompt• Rubric for final exam/writing
![Page 29: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/29.jpg)
SMALL GROUPS
• Read – GEO Course Description & Schedule
• Draw the timeline arrow across a10-wk term• Mark off the 10 weeks• Mark the mid-term
• Write two outcomes at the end of the term.
![Page 30: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/30.jpg)
LEARNING ENVIRONMENT
• Acquaint yourself with other course materials• Place course activities on timeline
• Identify the learning environment • Highlight Pink and Yellow aspects
• Place learning environment aspects on the timeline
![Page 31: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/31.jpg)
USING FORMATIVE AND SUMMATIVE ASSESSMENTS
• Identify places in the term where you can support student learning with formative assessments• Place the formative assessments on the timeline
• Identify how and when will students demonstrate that they have achieved the outcomes?• Place summative assessment on the timeline.
![Page 32: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/32.jpg)
LARGE GROUP DISCUSSION
• Discuss the GEO Example
• What are the sticking points in this exercise?
![Page 33: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/33.jpg)
INDIVIDUAL PROJECT TIMELINES
Create a timeline for your project Plot these elements of your project
• Learning Outcomes
• Learning Environment
• Assessments
• 1 hour
![Page 34: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/34.jpg)
SHARE
• With grant partners or pairs
• Large Group
![Page 35: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/35.jpg)
INNOVATIVE PROBLEM SOLVING DISCUSSION
• A good term?
• A better term?
• Common understanding?
• Measurable?
![Page 36: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/36.jpg)
CLOSING DISCUSSION
• What would reporting look like that would help you and help us?
• What prompt should we give you?
![Page 37: JOE CHIHADE - CHERRY DANIELSON ELLEN IVERSON HHMI ASSESSMENT WORKSHOP](https://reader035.vdocument.in/reader035/viewer/2022081504/5697bf771a28abf838c81500/html5/thumbnails/37.jpg)
LUNCH AND EVALUATIONS
Please complete a workshop evaluation
before you leave.
Questions?Contact:
Joe, Ellen, Cherry