Download - Evaluation and Feedback
![Page 1: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/1.jpg)
Evaluation and Feedback
Christina Surawicz, MD, MACGUniversity of Washington School of Medicine
With thanks to Dr. Eileen Klein and the UW teaching scholars 2005-06
![Page 2: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/2.jpg)
Learning Objectives
1. Understand the importance of feedback
2. Learn techniques for giving feedback
3. Lean how to receive feedback
![Page 3: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/3.jpg)
Definition of Evaluation
Measure of knowledge and/or skillsAlso called
• Assessment • Appraisal
Compared to • Peers • Absolute standards
![Page 4: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/4.jpg)
Feedback vs Evaluation
Evaluation•Scheduled•Summative•Formal•Judgment based on comparison to peers or norms •Example: middle or end of rotation
Feedback•Brief•Formative•Nonjudgmental, specific, and descriptive•Focus on behaviors learner can modify•Example: right after clinical presentation
![Page 5: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/5.jpg)
Evaluation of Fellows - Parameters
• Cognitive
• Procedures
• Communication
• Professionalism
![Page 6: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/6.jpg)
How to Measure Professionalism
1. 360° evaluation - labor intensive
2. Two questions on evaluationThis individual treated me with
respectScale of 1 - 5
This individual treated others with respect
Scale of 1 - 5
![Page 7: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/7.jpg)
Coaching and Feedback
Feedback is a term coined by the flight engineers to describe adirectional system that provides information to a rocket about its course and causes it to correct
![Page 8: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/8.jpg)
Why is Feedback Important
for Trainees?
for Trainer?
![Page 9: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/9.jpg)
Why Feedback is Important - Trainee
•Opportunity to improve
•Insight into their behavior
•Allows them to reach goals
![Page 10: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/10.jpg)
Why Feedback is Important - Trainer
•Demonstrates interest and caring
•Allows one to see progress
•You are doing the right thing (personal fulfillment)
![Page 11: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/11.jpg)
Providing feedback strongly correlated with students’ perceptions of effective teaching
(Elnicki & Cooper, JGIM 2005)
![Page 12: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/12.jpg)
Important for the Profession
• Competent physiciansCorrect mistakes
• Underscores importance of feedback
• Underscores necessity for self-evaluation
![Page 13: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/13.jpg)
Without Feedback: Silence
Assume approval – no news is good news
Assume disapproval – they probably all think I am hopeless
![Page 14: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/14.jpg)
4 Generations Practicing Now
BornTraditionalists 1922 – 1945
Boomers 1946 – 1964
Generation X 1965 – 1979
Generation Y (Millennials) 1980 - 1994
![Page 15: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/15.jpg)
Boomers
• Workaholic• Service oriented • Optimistic• Personal gratification• Technology
NiceNot necessary
![Page 16: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/16.jpg)
Millennials
• Current trainees
• Culturally diverse
• Technology necessary
• Civic-minded
![Page 17: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/17.jpg)
Giving and Receiving Feedback - Boomers
• Give “Once a year with documentation”
• Receives “I want to know how I’m doing”
![Page 18: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/18.jpg)
Giving and Receiving Feedback – Generation X
• Give “Here it is now and it’s honest”
• Receives “I want to know now and often”
![Page 19: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/19.jpg)
Giving and Receiving Feedback - Millennials
• Give “I’ll explain if something’s wrong”
• Receives “Whenever I want it, at the push
of a button”
![Page 20: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/20.jpg)
Giving Feedback to Trainees
• Set up the expectation for feedback
• Be more concerned about the learner than yourself (Boomers)
• Feedback should have meaning (Millennials)
![Page 21: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/21.jpg)
What are Barriers to Feedback?
![Page 22: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/22.jpg)
Barriers to Feedback
• Not enough time• Not worth it- doesn’t work anyway• Prior negative experience• Unclear expectations• Effect on teacher-learner relationship• Lack of training!!!
![Page 23: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/23.jpg)
Feedback - Three Strategies
• Pendleton’s Rules
• SETGO
• Ask - Tell – Ask – Act/Follow up
![Page 24: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/24.jpg)
Pendleton’s Rules
1. What did you do well today?
2. What I think you did well
3. What could you do differently next time?
4. What I think you could do differently next time
![Page 25: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/25.jpg)
Feedback Techniques: SET GO
• What I SAW (Describe what you saw)• What ELSE did you see? (What happened
next)• What do you THINK? (Learner reflection)• What GOALS are we trying to achieve?• OFFER suggestions on how to achieve goals.
Chowdhury, R. Learning to Give Feedback in Medical Education. The Obstetrician and Gynecologist, 2004; 6:243-7
![Page 26: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/26.jpg)
Ask – Tell - Ask• Ask – How are things going?
Be specific – How did rounds go today?
• Tell – I observedBe specific
• Ask – how can you improve?
• Act/Follow up
![Page 27: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/27.jpg)
Feedback Basics – Do’s
• Clarify situation
• Describe behavior
• Deliver impact
![Page 28: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/28.jpg)
Useful Questions
• What are your goals?• How do you think it’s going?• What has gone well so far?• What could be improved?• What will you do next time?• What changes can you make?
![Page 29: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/29.jpg)
Useful Phrases
• When you said . . . I was concerned because. . .• This is my suggestion . . .• Let’s reframe this issue . . .• Let’s reflect about what happened . . .• Let’s talk about this when the time and
location may be more appropriate. • Suggest a time/place or ask the learner to pick a
time and place • We all want what’s best for the patient
![Page 30: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/30.jpg)
Feedback – Don’ts
• Be vague
• Be judgmentalYou always. . .
• Accuse
• Psychoanalyze
![Page 31: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/31.jpg)
Role Play
Faculty or Attendees?
![Page 32: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/32.jpg)
Let’s Practice - Case 1
It is a busy day on consult service, you have one fellow seeing consults. On rounds, the presentations are disorganized, incomplete, for example, an evaluation of a patient with rectal bleeding does not mention patient has abnormal LFT’s.
![Page 33: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/33.jpg)
When? Where?• When to evaluate?
On rounds?After rounds?Next day?
• Where to evaluate?Outside patient’s room?Team room?Empty endoscopy room?
![Page 34: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/34.jpg)
Ask
How do you think rounds went today?
![Page 35: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/35.jpg)
Tell
You seemed unprepared to present the patients thoroughly; for example, the presentation on patient x did not mention her abnormal liver tests.
![Page 36: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/36.jpg)
Ask
Is there anything that can help you see and evaluate these complex patients more efficiently?
![Page 37: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/37.jpg)
Act/Follow Up
• Some suggestions for evaluation- ask the fellow to provide them!
• Let’s follow-up in 2 days
![Page 38: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/38.jpg)
Case 2
![Page 39: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/39.jpg)
Attending Perspective
You have been on service for a couple days and you are not pleased with the fellow you are working with. Their presentations lack detail and you are worried they are not getting enough history to implement adequate plans. You also do not believe the consult notes are not clear enough.
You make a list of areas in which the fellow can improve and give it to the fellow.
![Page 40: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/40.jpg)
Trainee Perspective
This is the first time you have been on service with this attending. They are very compulsive and seem to be involved in every detail of care. You are very thorough in your history taking and speak at length in person to the team about your recommendations of care for the patients you consult.
You believe the list of areas in need of improvement is not accurate.
![Page 41: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/41.jpg)
What are the issues and how can they be remedied?
![Page 42: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/42.jpg)
Issues
• Expectations not set up ahead of time• Do not fully understand each others
perspective• Feedback not requested/permitted• Feedback not in person• Solutions identified by attending without
eliciting information from fellow and before discussion
![Page 43: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/43.jpg)
Case 3
![Page 44: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/44.jpg)
Fellow Perspective
Another busy day on service and you are running to your next consult. On your way you have been stopped in the hall four times by residents to answer “quick” questions about their patients. You politely do so in every case and are able to finish all of your work before afternoon rounds. You are proud of your thoroughness, efficiency and professionalism.
![Page 45: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/45.jpg)
Attending Perspective
Just prior to afternoon rounds you hear about advice given regarding the care of a patient with recurrent C. difficile colitis. No formal consult was done and you are frustrated that the fellow would give advice on this case without a formal consult.
You mention this to the fellow on rounds and are surprised they are not more receptive to you.
![Page 46: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/46.jpg)
Optimizing Feedback• Pick the time and place• Non-judgmental• Attending – Ask the fellow their perspective– Ask the fellow to come up with solutions
• Fellow – Ask to give your perspective– Offer solutions
![Page 47: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/47.jpg)
![Page 48: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/48.jpg)
Tips for Receiving Feedback
“Negative feedback is hard to take when given by a friend, relative or stranger”
Anonymous
But remember that Change is not possible without some element of conflict
![Page 49: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/49.jpg)
Receiving Feedback
If you are a leader, you may need to ask for it especially form juniors
How to ask?3:13 things I am doing well1 thing I can improve
![Page 50: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/50.jpg)
Receiving Feedback• Being open/approachable
ListenBody language
• RespondingReflect
• Don’tsArgueDefendGive excuses
• Reply? Later!!• Thank them for giving feedback
![Page 51: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/51.jpg)
Questions?
![Page 52: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/52.jpg)
Summary
1. Know the elements of evaluation for trainees
2. Understand the importance of feedback
3. Learn techniques for giving feedback
4. Lean how to receive feedback
![Page 53: Evaluation and Feedback](https://reader035.vdocument.in/reader035/viewer/2022062518/56814be4550346895db8bc6a/html5/thumbnails/53.jpg)
To Do’s at Home
• Commit to giving feedback regularly and often
• Commit to asking for feedback -“what can I do better?”
You will be a great role model