i nternational d atabase for e nhanced a ssessments & l earning hk ng, c. hazlett, j ware, s....

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

HK Ng, C. Hazlett, J Ware, S. Yip

I D E A L

Additionally, some basic medical science teachers have difficulty assessing their students’ reasoning abilities within a clinically relevant context

R-type selected response items (also referred to as Extended Matching Questions [EMQ]) are particularly suitable for measuring medical students’ scientific & clinical reasoning abilities

However, some teachers find that composing an R-type item is difficult and/or time-consuming

Background

I D E A L

The R-type item writing wizard is designed to assist basic & clinical science teachers composing well designed R-Type items more easily & quickly

Objective & Purpose

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

Using the Wizard

to

Create an R-type Item

I D E A L

Select or Compose an Appropriate Lead-In Question

Select or Compose an Appropriate Lead-In Question

I D E A L

Next, compose a relevant, appropriate

scientific or clinical scenario

Next, compose a relevant, appropriate

scientific or clinical scenario

Two yr-old boy is brought to clinic complaining of generalized rash & fever for 1 day. Rash initially appeared on face & trunk then spread to limbs. Intensity of rash in axilla & groin region has recently increased. Skin feels like sand-paper & there is also circumoral pallor. Throat is congested & examination is otherwise uneventful.

I D E A L

Vignette can be composed within the wizard or copied &

pasted from Word Pad or another source except MS Word

I D E A L

Specify the Option Which is the Correct AnswerSpecify the Option Which is the Correct Answer

I D E A L

Compose Relevant Feedback for StudentsCompose Relevant Feedback for Students

Feedback can be provided to the students after the assessment for formative purposes

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

If another clinical scenario is relevant

for the same option set, compose a 2nd

vignette

I D E A L

Example of a 2nd Scenario Applicable

for the Same Option Set

Example of a 2nd Scenario Applicable

for the Same Option Set

Six yr-old girl, who has had cold & fever for 3 days, is sent

home from school because she is feeling so poorly. Later in the

same day she develops a maculopapular rash on her face &

trunk. She does not want to get out of bed, preferring the

bedroom curtains to be closed. On examination, there is

grayish spot on the mucous membrane of her mouth.

I D E A L

Click button ‘Add Scenario’Click button ‘Add Scenario’

I D E A L

2nd Scenario is Added2nd Scenario is Added

Sequential position of this scenario is indicated

I D E A L

By default the feedback from the previous (first) scenario is included

By default the feedback from the previous (first) scenario is included

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

Several vignettes can be generated under the

same option set

I D E A L

Example of a 3rd ScenarioExample of a 3rd Scenario

One yr-old boy is admitted to the A&E department due to

high fever & generalized rash. His mother claims that the

boy was still playful a few hours ago & his condition has

deteriorated very quickly. On examination, the rash is

non-blanching , irregular in size, with a necrotic centre.

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

Transferring the R-Type Item(s)

to MS Word

I D E A L

If one has finished entering all scenarios for a particular set of options, but wishes to also generate other R-type items, click the button ‘Export and Continue’

If one has finished entering all scenarios for a particular set of options, but wishes to also generate other R-type items, click the button ‘Export and Continue’

Using this protocol, the exported item will be displayed in MS Word only after all the other R-type items have been created

I D E A L

When one has finished generating all R-type items click button “Export and Exit”

When one has finished generating all R-type items click button “Export and Exit”

Using this protocol, the wizard will close & a MS Word document will appear (see next slide)

Example of an R-type Item Displayed in MS Word Example of an R-type Item Displayed in MS Word

After item(s) is (are)

displayed in MS Word,

go to Word’s menu bar

- click View

- select Print Layout

I D E A L

If no appropriate option set is presently available in the Wizard, add a new option set for use now & for the future

how to achieve this is explained in the following slides

The Wizard can Increase in its Capability

I D E A L

Click the Tab ‘Input/Edit Option Set(s)’ Click the Tab ‘Input/Edit Option Set(s)’

I D E A L

Select an existing DisciplineSelect an existing TopicSelect an existing Theme

Select an existing DisciplineSelect an existing TopicSelect an existing Theme

I D E A L

Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the

button ‘Add’

Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the

button ‘Add’

The options will be added to above option set text box

I D E A L

An Example of a New Option Set for the Theme of ‘Chest Pain’

An Example of a New Option Set for the Theme of ‘Chest Pain’

Asthma

Costochondritis (Tietze Syndrome)

Conversion Disorder

Esophagitis

Foreign Body

Myocarditis

Muscle strain

Pericarditis

Pneumonia

Pneumothorax

Precordial Catch Syndrome

Supraventricular Tachycardia

I D E A L

Generating the New Option Set Generating the New Option Set

Click ‘Create New Option Set’ button & the new option set is added to the wizard & its total number of option sets is appropriately increased (e.g., 271)

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

Wizard also enables one to add additional sets

of

Disciplines / Topics / Themes

I D E A L

Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’

Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’

I D E A L

Similarly type in a new topic & theme in relevant text box

& click the button ‘Add Topic/Theme’

Similarly type in a new topic & theme in relevant text box

& click the button ‘Add Topic/Theme’

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

Saving the changes made to

Discipline / Topic / Theme

I D E A L

Click button ‘Save Changes Permanently’Click button ‘Save Changes Permanently’

I D E A LI D E A LI D E A LI D E A L

International Database for Enhanced Assessments & LearningInternational Database for Enhanced Assessments & Learning

R-type Intranet Wizard

I D E A L

The R-type Wizard Intranet Version has all the same features as the PC Version.

and in addition, items created with the Intranet Wizard can be saved to the IDEAL non-restricted item bank if this item bank is being kept on the same server as the wizard

I D E A L

To enter the item into the non-restricted IDEAL

bank, click button ‘Save Item and Continue Edit’

To enter the item into the non-restricted IDEAL

bank, click button ‘Save Item and Continue Edit’