university of california, san francisco

school of medicine

Concept Mapping for Assessment in Medical

Education

Arianne Teherani

Creative Commons LicenseAttribution-NonCommercial-Share Alike 3.0 Unported

You are free:• to Share — to copy, distribute and transmit the work • to Remix — to adapt the work Under the following conditions:• Attribution. You must give the original authors credit (but not in any

way that suggests that they endorse you or your use of the work).• Noncommercial. You may not use this work for commercial purposes. • Share Alike. If you alter, transform, or build upon this work, you may

distribute the resulting work only under a license identical to this one.

See http://creativecommons.org/licenses/by-nc-sa/3.0/ for full license.

university of california, san francisco

school of medicine Overview

• Provide an overview of:– What a concept map is– Uses of a concept map– Concept maps for assessment

(knowledge and attitudes)• Considerations• Scoring • Benefits and limitations

university of california, san francisco

school of medicine

What is a concept map?

university of california, san francisco

school of medicine Background

• What does it mean when a learner says “I understand’ or “I believe”

• Does it mean the same thing to him/her than it does to you or another learner?

• How can a learner demonstrate their understanding/beliefs

university of california, san francisco

school of medicine Concept Map is:

• Tangible way to display how your mind “sees” a topic

• Reflect on what you know

• Nodes = Rectangles/circles

• Arrows/lines

• Linking = Word/phrase on arrows

university of california, san francisco

school of medicine

Criteria for Concept Maps

Proposition (semantic units)

HierarchiesCross linksExamples

Novak and Gowin

university of california, san francisco

school of medicine

Constructing a Concept Map

1. Brainstorm and list (5 mins)2. Organize and group (10 mins)3. Layout (5 mins)4. Link (5 mins)5. Finalize (5 mins)

• Accuracy • Organization• Appearance• Creativity

university of california, san francisco

school of medicine

Concept Mapping Exercise 2

Read through case.

Each group place their concept map on their map on the board

university of california, san francisco

school of medicine

Concept Mapping for:

•Teaching

•Learning

•Assessment

university of california, san francisco

school of medicine Directedness

university of california, san francisco

school of medicine Scoring

• Number (Structural i.e. counting propositions)

• Accuracy (Quality of propositions)

• Strength and significance of nodes and linking (Quality and importance of propositions)

university of california, san francisco

school of medicine

Design & Scoring

• High vs. low directed maps– Explicit context– Concepts and sub-concepts– Rubric

• Quality and quantity• Pre and post (or interval) measures• Key vs. related terms• Criterion/Expert map• Reliability• Concept maps and other measures

university of california, san francisco

school of medicine Benefits

• Train-to-use easy• Raters introduce no error in

variability• Clear concept domain• Consistent and appropriate

ranking• Proportion of valid propositions

university of california, san francisco

school of medicine Limitations

• Decision for type of concept map used is critical

• Linear and non-visual thinkers

• Time required to attain computer skills