does the rate of achieving competency on simulated laparoscopy training programs predict actual...
TRANSCRIPT
![Page 1: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/1.jpg)
Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in
Performing Laparoscopic Cholecystectomy?
Warren D. Widmann, MD Mark A. Hardy, MD, Nancy Hogle, RN, MS, Akuezunkpa O. Ude, MD, and Dennis Fowler, MD
New York Presbyterian Hospital, Columbia CampusColumbia University College of Physicians and Surgeons
New York, New York
![Page 2: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/2.jpg)
LapSim®
LapSim® Basic Skills
Camera Navigation Instrument Navigation
Coordination Grasping
Lifting and Grasping Cutting
Clip Applying
![Page 3: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/3.jpg)
Global Operative Assessment of Laparoscopic Skill
GOALS
• depth perception
• bimanual dexterity
• efficiency
• tissue handling
• overall competence
![Page 4: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/4.jpg)
Protocol
• 21 PGY1 residents
• All PGY1residents performed a laparoscopic cholecystectomy in a pig after minimal training; performance evaluated by skilled laparoscopic surgeons using GOALS
• 10 of the group trained to competency on the LapSim® • All 21 PGY1 residents again performed laparoscopic
cholecystectomies on pigs; performance evaluated by skilled laparoscopic surgeons using GOALS
![Page 5: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/5.jpg)
Results
• Baseline scores, untrained, experimental group of residents 2.18/5
• Baseline scores, untrained, control
group of residents 2.05/5
![Page 6: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/6.jpg)
Results
• Baseline scores, untrained, experimental group of residents 2.18/5
Scores after training 2.77/5
• Baseline scores, untrained, control
group of residents 2.05/5
Scores w/o training 2.24/5
![Page 7: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/7.jpg)
Results
• Baseline scores, untrained, experimental group of residents 2.18/5 2.77– Time to complete training varied from 73 to
242 minutes
• Baseline scores, untrained, control
group of residents 2.05/5 2.24
![Page 8: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/8.jpg)
Results
• Baseline scores, untrained, experimental group of residents 2.18/5 2.77 Time to complete training varied from
73 to 242 minutes
• Baseline scores, untrained, control group of residents 2.05/5 2.24
Time to complete later training varied from 60 to 239 minutes
![Page 9: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/9.jpg)
Conclusion
LapSim® training of novices improves the performance of a
cholecystectomy in a pig
![Page 10: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/10.jpg)
Conclusion
LapSim® training improves the performance of a cholecystectomy in a pig by an
untrained novice
Not very surprising—LapSim® training has face validity, construct validity, and
predictive validity
Where do we go from here?
![Page 11: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/11.jpg)
Do residents who learn quickly on a LapSim® program perform better
than residents who learn at a slower rate??
• We looked at the change in scores of the 4 fastest learners, baseline vs retesting after lapsim® competency
Δ .75/5 in pigs• The 4 slowest learners showed
Δ .45/5 in pigs
![Page 12: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/12.jpg)
Things Do Not Look So Good for the Slow Learners
• Have we truly tested for predictive validity in the clinical setting?
• Our model was the pig, our testing was done early in the PGY1 year
Let’s take a look at actual performance when the now trained residents operated on patients during the next 12 months
![Page 13: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/13.jpg)
Method
• Data was collected on 6 PGY1 categorical residents who performed 28 cholecystectomies during their PGY 1 year. Case loads varied from 2-10 per resident
• All were evaluated by skilled laparoscopic surgeons using the GOALS criteria
![Page 14: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/14.jpg)
Results
• Fast Learners
(68-79 minutes)
2.39/5
• Slow Learners
(123-239 minutes)
2.53/5
![Page 15: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/15.jpg)
Results
• Fast Learners(68-79 minutes)
2.39/5
• Slow Learners(123-239 minutes)
2.53/5
How come???
![Page 16: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/16.jpg)
Characteristics of the LearnersPrior Video Game Habit
Time Ever > 3 hrs/wk Current user
Pig Person
68
73
79
123
195
239
Yes
Yes
Yes
Yes
No
No
Yes
No
Yes
Yes
No
No
No
No
No
Yes
No
No
2.6
3.2
2.6
2.6
1.2
1.4
1.96
2.61
2.59
2.83
2.56
2.20
![Page 17: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/17.jpg)
Conclusions
• Slow learners on the LapSim® were naïve gamers
• All residents learned to competency on LapSim®—some took appreciably longer than others
• The rate of learning and achieving competency on the LapSim® predicted performance on the pig early in the PGY1 year
• The rate of learning on the LapSim® failed to predict clinical performance throughout the rest of the PGY1 year
![Page 18: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/18.jpg)
![Page 19: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/19.jpg)
![Page 20: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/20.jpg)
Characteristics of the Best Clinical Performer
Time Ever > 3 hrs/wk Current user
Average GOALS
68
73
79
123
195
239
Yes
Yes
Yes
Yes
No
No
Yes
No
Yes
Yes
No
No
No
No
No
Yes
No
No
1.96
2.61
2.59
2.83
2.56
2.20
![Page 21: Does the Rate of Achieving Competency on simulated Laparoscopy Training Programs Predict Actual Skill in Performing Laparoscopic Cholecystectomy? Warren](https://reader030.vdocument.in/reader030/viewer/2022032703/56649f525503460f94c75b2c/html5/thumbnails/21.jpg)