what is a key features problem? - mums.ac.ir · 2013. 6. 18. · synthesis. bloom’s...
TRANSCRIPT
![Page 1: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/1.jpg)
![Page 2: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/2.jpg)
![Page 3: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/3.jpg)
WHO?
WHAT?
![Page 4: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/4.jpg)
Analysis
Application
Comprehension
Recall
Evaluation
Synthesis
![Page 5: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/5.jpg)
Bloom’s categorization Associated thinking skills
Knowledge acquisition Memorization
Comprehension Question, discuss, explanation,
Abstraction and transfer
Application Doing a task
Analysis Categorizing, characterization,
comparison, contrast
Synthesis Collating, creating
Evaluation Relevancy, ordering, prioritizing,
judgment
![Page 6: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/6.jpg)
Knows
Shows how
Knows how
Does
Knows Factual tests:MCQ, essay type, oral…..
Knows how(Clinical) Context based tests:
MCQ, essay type, oral…..
Shows howPerformance assessment in vitro:
OSCE, SP-based test…..
DoesPerformance assessment in vivo:Undercover SPs, Video, Logs…..
![Page 7: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/7.jpg)
Knowledgeassessment
Problem-solvingassessment
Clinical skillsassessment
Practiceassessment
Professional or clinical
Authenticity
1960 2000
(adapted from van der Vleuten 2000)
![Page 8: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/8.jpg)
What is a key features problem?
What are the conceptual and measurementissues underlying the design of key featureproblems?
What is the process for writing a key featuresproblem?
![Page 9: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/9.jpg)
A clinical problem, with age & clinical situation specified (e.g., Severe, life-threatening respiratory distress in an infant)
A case scenario typically followed by 2 or 3 questions
Questions assess clinical decisions and actions (not underlying knowledge or reasoning)
Questions are asked only in relation to the most important steps/challenges in the resolution of the problem – i.e., the problem‟s “key features”
![Page 10: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/10.jpg)
Case Specificity
(Arthritis , Anemia, Diabetes) =Key Features (KFs)
Problem solving for
each problem not a general skill
![Page 11: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/11.jpg)
![Page 12: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/12.jpg)
The critical or essential steps in the
resolution of the problem.
Steps, actions most likely to lead to error.
Most difficult aspects of problem
identification and management in practice.
![Page 13: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/13.jpg)
Assess only the key steps/decisions (2- 4), in the resolution of a clinical problem (not reasoning)
…best discriminators
Assess effectiveness, not thoroughness
Permit wide sampling of problems to address “case specificity”
![Page 14: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/14.jpg)
Reliability – “Focused" problems -- better sampling, more accurate assessment
Content Validity – assessing the most important clinical decisions within (a representative sample of) problems
“Bottom-up” thinking – assessing knowledge application and what clinicians do in real life!
What about “fidelity/authenticity”?
Higher “Fidelity” increased discriminating power More effective identification of weaker candidates
![Page 15: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/15.jpg)
1.Select a Clinical Problem
2.Select a Clinical Situation
3.Define the problem's Key Features
4.Select a Case to represent the Problem
5. Develop Questions to test only the key features
6.Select the Format for the questions
7.Prepare Scoring Keys
![Page 16: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/16.jpg)
Only score responses that relate to the Key Features
Each key feature should be scored out of „1‟. Partial scores can be assigned to multiple correct answers (e.g., .5 and .5). Key feature scores within a problem should be averaged to produce a problem score
A key feature score of „0‟ can be assigned if a student chooses too many options or harmful actions (e.g., doing a catheterization when uncalled for)
![Page 17: What is a key features problem? - mums.ac.ir · 2013. 6. 18. · Synthesis. Bloom’s categorization Associated thinking skills Knowledge acquisition Memorization Comprehension Question,](https://reader035.vdocument.in/reader035/viewer/2022071405/60faca47dd82b874580a11f5/html5/thumbnails/17.jpg)
مه کو ره یافتم بو گنج حسه بی پایان دوست
صد گدای ىمچو خود را بعد از ایه قارون کنم