digital and digging it: the case of virtual microscopy (vm) and computer-based exams (cbe) at busm...
TRANSCRIPT
Digital and Digging It:The Case of Virtual Microscopy (VM)
and Computer-Based Exams (CBE)at BUSM
CEIT Workshop March 26, 2012
Debbie Vaughan and Jana BradyBoston University School of Medicine
PRESENTATION
Virtual Microscopy (VM) Our journey to VMDemo: virtual microscopyPedagogical enhancements made possible by VMSummary of Why VM? Pedagogical Advantages, Disadvantages,
Student opinions
ExamSoft® Computer-based Exams (CBE)Our journey to CBEWhat can it do? and How do we do it?
(with sample screenshots; Demo available)Summary of Why CBE? Pedagogical Advantages, Disadvantages,
Student opinions/ourcomes
BUSM histology laboratory in the early 20th century
Traditional order:lecture
laboratory
Our Histology laboratory in the late 20th century
Improved order:laboratory
lecture
History of Virtual Microscopy (VM)
at BUSM
Fall 2007
Fall 2008
Fall 2009
Fall 2010
Fall 2011
Fall 2012
Summer 2006 Begin investigation of Bacus™ VM system
Bacus™ VM begins-teaching modified-sessions held in library computer classrooms
Pilot VM with laptops
BUSM students required to have laptops -L2 classrooms remodeled and designed for laptop use
-students use laptops for Bacus™ VM
Replaced Bacus™ VM system with NDP VM system
Preparation (servers, contract, $$, selection, syllabus,…)
Preparation for NDP VM (feasibility, negotiations, contracts,…)
Fall 2007
After less than five years with the Bacus™ VM system,
we had to replace it.
Demonstration: http://busmnz.bumc.bu.edu
vm
Digitized Images: • can be viewed at 9 levels of magnification • can be dragged along the x- and y- axes,
and sometimes ‘focused’ along the z-axis
Fall 2007: VM permits desirable pedagogical enhancements
:Laboratory(self-study)
Discussion Session(interactive)
Lecture
Current teachingsequence:
BUSM computer lab: Students can easily work together.
SmartBoard Interactive Whiteboard encourages student presentation and participation.
SmartSync
permits the synchronization of computers.
Other Instructional Technologies:
Turning Point® ARS quiz assures the self-study is completed before Discussion.
Spring 2010: pilot VM with laptops in model computer classroom
Interactive small group Discussion Sessions are encouraged in medical
school.
Fall 2010: all BUSM students required to have laptop computer
Histology Discussion Sessions: L2 classrooms designed for laptop use
L2 classrooms can be opened for exams
Practical Exams: students view annotated slides (questions) in NDPand enter answers in Blackboard 8
Virtual Microscopy
Why?• Inadequate glass slide collection• Increasing expense of materials distribution and upkeep• Limited availability of microscopes and slide sets
Student feedback:• Value study anywhere and anytime where internet available (incl. iPad)• Efficient and effective system for group study• Can capture images and label for review, consultation, and study
Pedagogical advantages:• Improved histological material• Students continue to develop ability to analyze and interpret
material• Learning curve for interpreting material faster without microscope• Ability to divide laboratory exercises into self-study followed by
interactive discussion sessions
Disadvantages:• Histological material is identical for all students• Students do not use microscopes
PRESENTATION
Virtual Microscopy (VM) Our journey to VMDemo: virtual microscopyPedagogical enhancements made possible by VMSummary of Why VM? Pedagogical Advantages, Disadvantages,
Student opinions
ExamSoft® Computer-based Exams (CBE)Our journey to CBEWhat can it do? and How do we do it?
(with sample screenshots; Demo available)Summary of Why CBE? Pedagogical Advantages, Disadvantages,
Student opinions/ourcomes
History of CBE at BUSM
Fall 2009
Fall 2010
Fall 2011
Fall 2012
Discover ExamSoft® at AAMC annual meeting
BUSM students required to have laptops
Use ExamSoft® in four BUSM I courses
on-going preparation with MED administration and faculty
Most BUSM I and II courses will use ExamSoft® CBE
Preparation (due diligence; explore vendors; contracts; $$...)
Pilot ExamSoft® with GMS Histology students
ExamSoft® Computer based Exams:• Exams may be secure or not secure• Variety of questions—MCQ,T/F, essay, Fill-in-blanks—are possible• Questions, and MCQ choices, can be completely or partially randomized• High quality images and video can be included and can be manipulated• Time limit is set for each exam; elapsed time and time warnings can be set• Navigation panel shows which questions answered and unanswered• Examtakers can cross out choices
About
SofTest: the exam (exam taker’s view)• exam takers download software that is automatically updated • exam takers download encrypted exam• with password, computer enters secure mode with access only to
exam• at completion of exam, answers are automatically uploaded with
internet connection
SofTeach-Web: exam construction• database of questions to use in the exam; variety of question
types• questions tagged by customizable categories: e.g., topic,
cognitive level, author, USMLE category, clinical type, etc.• construct exam• set security levels, details of release, and other controls• email communication with exam takers
SofScore Web: scoring exam• statistics: by exam taker, by category, by exam, by question• grading• customize released results; can email to students
Home Page: register students; monitor students and exams; email options
About
SofTest: the exam (exam taker’s view)• exam takers download software that is automatically updated • exam takers download encrypted exam• with password, computer enters secure mode with access only to
exam• at completion of exam, answers are automatically uploaded with
internet connection
SofTeach-Web: exam construction• database of questions to use in the exam; variety of question
types• questions tagged by customizable categories: e.g., topic,
cognitive level, author, USMLE category, clinical type, etc.• construct exam• set security levels, details of release, and other controls• email communication with exam takers
SofScore Web: scoring exam• statistics: by exam taker, by category, by exam, by question• grading• customize released results; can email to students
Home Page: register students; monitor students and exams; email options
Exam screen:MCQ with high resolution image that can be moved or resized
and navigation panel.
Exam screen:MCQ illustrating cross-out function, and “alarm” panel for timing
About
SofTest: the exam (exam taker’s view)• exam takers download software that is automatically updated • exam takers download encrypted exam• with password, computer enters secure mode with access only to
exam• at completion of exam, answers are automatically uploaded with
internet connection
SofTeach-Web: exam construction• database of questions to use in the exam; variety of question
types• questions tagged by customizable categories: e.g., topic,
cognitive level, author, USMLE category, clinical type, etc.• construct exam• set security levels, details of release, and other controls• email communication with exam takers
SofScore Web: scoring exam• statistics: by exam taker, by category, by exam, by question• grading• customize released results; can email to students
Home Page: register students; monitor students and exams; email options
Database of entered questions: Questions categorized by topic folder, item description, categories, creator, type, and if previously used, by biserial score, date used, and difficulty.
Create an exam
…and added to the exam being created.
Open folder
Two unused questions
are selected…
About
SofTest: the exam (exam taker’s view)• exam takers download software that is automatically updated • exam takers download encrypted exam• with password, computer enters secure mode with access only to
exam• at completion of exam, answers are automatically uploaded with
internet connection
SofTeach-Web: exam construction• database of questions to use in the exam; variety of question
types• questions tagged by customizable categories: e.g., topic,
cognitive level, author, USMLE category, clinical type, etc.• construct exam• set security levels, details of release, and other controls• email communication with exam takers
SofScore Web: scoring exam• statistics: by exam taker, by category, by exam, by question• grading• customize released results; can email to students
Home Page: register students; monitor students and exams; email options
Sofscore: item analysis statistics
question #1
Sofscore: Exam Takers’ results can be customized for reports, and release
ExamSoft Computer-Based Exams
Why?• All professional exams (e.g., USMLE exams) are computer-based• Sustainability: reduce paper use• Cost basis is per student, not per exam
Student feedback:• Most students see value of CBE• Students appreciate ability to track performance by categories• Generally students prefer ExamSoft to paper exams
Pedagogical advantages:• Ability to track student performance by categories, such as
topic, cognitive level, type of question• Ability to track question stats and design exam by various
categories you set yourself• No apparent negative effect on grades
Disadvantages:• Initial software glitches• Space for giving exams to class of 180 students
“ExamSoft was easy to use”
%
“I prefer ExamSoft to paper and pencil exams”
%
BUSM Students: fall/winter feedback(2011-2012)
Thank you for your attention!
NDP: busmnz.bumc.bu.edu
ExamSoft: www.examsoft.com
Deborah W. Vaughan, PhDDepartment of Anatomy and Neurobiology, BUSM
&
Jana Brady, MSEducation Technologist, BUSM
Topics: presented step-wise in the course syllabus
