rock arthroscopy e-poster...

1
Reliability of the ROCK Osteochondri5s Dissecans Knee Arthroscopy Classifica5on System: A Mul5center Valida5on Study INTRODUCTION METHODS RESULTS Osteochondri-s dissecans (OCD) is a focal, idiopathic altera-on of subchondral bone with risk for instability and disrup-on of adjacent ar-cular car-lage that may result in premature osteoarthri-s. Although arthroscopic staging systems exist for OCD 13 , none have been tested for intraobserver and interobserver reliability. Using an expert consensus method, the Research in Osteochondri-s of the Knee (ROCK) study group developed an arthroscopy classifica-on system for OCD of the knee. The purpose of this study was to determine the reliability of this OCD classifica-on system. The ROCK study group developed a classifica-on system for arthroscopic evalua-on of OCD of the knee based on the experience of 13 centers experienced in the care of OCD. The classifica-on system produced 6 arthroscopic categories, as depicted in the center panel. Sample size es-mates for raters and subjects were performed a priori using the principles described by Giraudeau and Mary 4 . In the seRng of 6 categories, 30 representa-ve arthroscopic videos were planned to be evaluated by 10 orthopedic surgeons. Raters did not par-cipate in the video case selec-on or prepara-on. Raters did par-cipate in a training module (including archetypal arthroscopic photos, videos, and line drawings) prior to ra-ng the first round of videos. ATer 4 weeks, the 30 videos were reviewed a second -me in a new, randomly selected order. Interrater reliability assessment was performed using the intraclass correla-on coefficient (ICC) 5 . IMMOBILE LESIONS MOBILE LESIONS The ROCK OCD knee arthroscopy classifica-on system demonstrated very good reliability. Rela-vely rare condi-ons will require mul-center study groups to perform high quality outcome studies. This classifica-on system will facilitate mul- center studies for OCD. CONCLUSIONS The interobserver reliability of this novel arthroscopy classifica-on was es-mated by an ICC of 0.94 (95% CI, 0.91 to 0.97) for the first round and 0.95 (95% CI, 0.93 to 0.98) for the second round. According to the standards for the magnitude of the reliability coefficent of Bland and Altman 6 , these ICCs are very good. CUE BALL: No abnormality detected arthroscopically. SHADOW: Car-lage is intact and subtly Demarcated. WRINKLE: Car-lage is demarcated with a fissure, buckle, and/or wrinkle. LOCKED DOOR: Car-lage fissuring at peri phery, unable to hinge open. TRAP DOOR: Car-lage fissuring at peri phery, able to hinge open. CRATER: Exposed subchondral bone defect. James L. Carey, MD, MPH 1 , Eric J. Wall, MD 2 , Kevin G. Shea, MD 3 , Nathan L. Grimm, BS 4 , Allen F. Anderson, MD 5 , Eric W. Edmonds, MD 6 , Henry G. Chambers, MD 6 , Benton E. Heyworth, MD 7 , Mininder S. Kocher, MD, MPH 7 , Roger M. Lyon, MD 8 , M. Lucas Murnaghan, MD 9 , Greg Myer, PhD 2 , Carl W. Nissen, MD 10 , John Polousky, MD 11 , Jennifer Weiss, MD 12 , Rick W. Wright, MD 13 . . 1 Penn Sports Medicine Center, Philadelphia, PA, USA, 2 Cinncina- Children's Hospital Medical Center, Cincinna-, OH, USA, 3 St. Luke's Health System, Boise, ID, USA, 4 University of Utah School of Medicine, Salt Lake City, UT, USA, 5 Tennessee Orthopaedic Alliance, Nashville, TN, USA, 6 Rady Children's Specialists San Diego, San Diego, CA, USA, 7 Children's Hospital Boston, Boston, MA, USA, 8 Medical College of Wisconsin, Milwaukee, WI, USA, 9 The Hospital for Sick Children, Toronto, ON, Canada, 10 Connec-cut Children's Medical Center, Farmington, CT, USA, 11 Rocky Mountain Youth Sports Medicine Ins-tute, Centennial, CO, USA, 12 Kaiser Permanente Southern California, Los Angeles, CA, USA, 13 Washington University Dept of Orthopaedic Surgery, Saint Louis, MO, USA. BIBLIOGRAPHY 1. Dipaola, J. D., Nelson, D. W. & Colville, M. R. Characterizing osteochondral lesions by magne-c resonance imaging. Arthroscopy 1991;7:1014. 2. Ewing, J. W. & Voto, S. J. Arthroscopic surgical management of osteochondri-s dissecans of the knee. Arthroscopy 1988;4:3740. 3. Guhl JF. Arthroscopic treatment of osteochondri-s dissecans: preliminary report. Orthop Clin North Am 1979;10:67183. 4. Giraudeau, B. & Mary, J. Y. Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 per cent confidence interval of the intraclass correla-on coefficient. Sta4s4cs in Medicine. 2001;20: 320514. 5. Karanicolas, P. J., Bhandari, M., Kreder, H., Moroni, A., Richardson, M., Walter, S. D., Norman, G. R., Guyam, G. H. & Collabora-on for Outcome Assessment in Surgical Trials Musculoskeletal, G. Evalua-ng agreement: conduc-ng a reliability study. J Bone Joint Surg Am. 2009;91 Suppl 3:99106. 6. Bland JM, Altman DG. A note on the use of the intraclass correla-on coefficient in the evalua-on of agreement between two methods of measurement. Comput Biol Med. 1990;20 (5):337 – 340.

Upload: others

Post on 16-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ROCK Arthroscopy e-poster (Final)-1kneeocd.org/.../2014/01/ROCK-Arthroscopy-e-poster-Final2.pdfReliability)of)the)ROCK)Osteochondri5s)Dissecans)Knee)Arthroscopy)Classifica5on)System:))

Reliability  of  the  ROCK  Osteochondri5s  Dissecans  Knee  Arthroscopy  Classifica5on  System:    A  Mul5-­‐center  Valida5on  Study  

INTRODUCTION  

METHODS  

RESULTS    Osteochondri-s  dissecans  (OCD)  is  a  focal,  idiopathic  altera-on  of  subchondral  bone  with  risk  for  instability  and  disrup-on  of  adjacent  ar-cular  car-lage  that  may  result  in  premature  osteoarthri-s.        Although  arthroscopic  staging  systems  exist  for  OCD1-­‐3,  none  have  been  tested  for  intra-­‐observer  and  inter-­‐observer  reliability.    Using  an  expert  consensus  method,  the  Research  in  Osteochondri-s  of  the  Knee  (ROCK)  study  group  developed  an  arthroscopy  classifica-on  system  for  OCD  of  the  knee.    The  purpose  of  this  study  was  to  determine  the  reliability  of  this  OCD  classifica-on  system.  

The  ROCK  study  group  developed  a  classifica-on  system  for  arthroscopic  evalua-on  of  OCD  of  the  knee  based  on  the  experience  of  13  centers  experienced  in  the  care  of  OCD.    The  classifica-on  system  produced  6  arthroscopic  categories,  as  depicted  in  the  center  panel.      Sample  size  es-mates  for  raters  and  subjects  were  performed  a  priori  using  the  principles  described  by  Giraudeau  and  Mary4.    In  the  seRng  of  6  categories,  30  representa-ve  arthroscopic  videos  were  planned  to  be  evaluated  by  10  orthopedic  surgeons.        Raters  did  not  par-cipate  in  the  video  case  selec-on  or  prepara-on.    Raters  did  par-cipate  in  a  training  module  (including  archetypal  arthroscopic  photos,  videos,  and  line  drawings)  prior  to  ra-ng  the  first  round  of  videos.    ATer  4  weeks,  the  30  videos  were  reviewed  a  second  -me  in  a  new,  randomly  selected  order.  Inter-­‐rater  reliability  assessment  was  performed  using  the  intra-­‐class  correla-on  coefficient  (ICC)5.  

IMMOBILE  LESIONS    

MOBILE  LESIONS  

The  ROCK  OCD  knee  arthroscopy  classifica-on  system  demonstrated  very  good  reliability.    Rela-vely  rare  condi-ons  will  require  mul--­‐center  study  groups  to  perform  high  quality  outcome  studies.  This  classifica-on  system  will  facilitate  mul--­‐center  studies  for  OCD.      

CONCLUSIONS  

The  inter-­‐observer  reliability  of  this  novel  arthroscopy  classifica-on  was  es-mated  by  an  ICC  of  0.94  (95%  CI,  0.91  to  0.97)  for  the  first  round  and  0.95  (95%  CI,  0.93  to  0.98)  for  the  second  round.    According  to  the  standards  for  the  magnitude  of  the  reliability  coefficent  of  Bland  and  Altman6,  these  ICCs  are  very  good.      

CUE  BALL:  No  abnormality  detected  arthroscopically.  

SHADOW:  Car-lage  is  intact  and  subtly  Demarcated.  

WRINKLE:  Car-lage  is  demarcated  with  a  fissure,  buckle,  and/or  wrinkle.  

LOCKED  DOOR:  Car-lage  fissuring  at  peri-­‐  phery,  unable  to  hinge    open.    

TRAP  DOOR:  Car-lage  fissuring  at  peri-­‐  phery,  able  to  hinge    open.    

CRATER:  Exposed  subchondral  bone  defect.    

!!!!!

! Allen F. Anderson, MD Nathan L. Grimm, MD(s) M. Lucas Murnaghan, MD, MEd Kevin G. Shea, MD James L. Carey, MD, MPH Benton E. Heyworth, MD Gregory D. Myer, PhD Eric J. Wall, MD Henry G. Chambers, MD Mininder S. Kocher, MD, MPH Carl W. Nissen, MD Jennifer M. Weiss, MD Eric W. Edmonds, MD Tal Laor, MD Mark V. Paterno, PT, PhD, MBA Rick W. Wright, MD Theodore J. Ganley, MD Roger M. Lyon, MD John D. Polousky, MD Andrew M. Zbojniewicz, MD

!!

!!!!! !!

www.osteochondritisdissecans.org

! !

!!!!!

! Allen F. Anderson, MD Nathan L. Grimm, MD(s) M. Lucas Murnaghan, MD, MEd Kevin G. Shea, MD James L. Carey, MD, MPH Benton E. Heyworth, MD Gregory D. Myer, PhD Eric J. Wall, MD Henry G. Chambers, MD Mininder S. Kocher, MD, MPH Carl W. Nissen, MD Jennifer M. Weiss, MD Eric W. Edmonds, MD Tal Laor, MD Mark V. Paterno, PT, PhD, MBA Rick W. Wright, MD Theodore J. Ganley, MD Roger M. Lyon, MD John D. Polousky, MD Andrew M. Zbojniewicz, MD

!!

!!!!! !!

www.osteochondritisdissecans.org

! !

James  L.  Carey,  MD,  MPH1,  Eric  J.  Wall,  MD2,  Kevin  G.  Shea,  MD3,  Nathan  L.  Grimm,  BS4,  Allen  F.  Anderson,  MD5,  Eric  W.  Edmonds,  MD6,  Henry  G.  Chambers,  MD6,  Benton  E.  Heyworth,  MD7,  Mininder  S.  Kocher,  MD,  MPH7,  Roger  M.  Lyon,  MD8,  M.  Lucas  Murnaghan,  MD9,  Greg  Myer,  PhD2,  Carl  W.  Nissen,  MD10,  John  Polousky,  MD11,  Jennifer  Weiss,  MD12,  Rick  W.  Wright,  MD13.    

.  1Penn  Sports  Medicine  Center,  Philadelphia,  PA,  USA,  2Cinncina-  Children's  Hospital  Medical  Center,  Cincinna-,  OH,  USA,  3St.  Luke's  Health  System,  Boise,  ID,  USA,  4University  of  Utah  School  of  Medicine,  Salt  Lake  City,  UT,  USA,  5Tennessee  Orthopaedic  Alliance,  Nashville,  TN,  USA,  6Rady  Children's  Specialists  San  Diego,  San  Diego,  CA,  USA,  7Children's  Hospital  Boston,  Boston,  MA,  USA,  8Medical  College  of  Wisconsin,  Milwaukee,  WI,  USA,  9The  Hospital  for  Sick  Children,  Toronto,  ON,  Canada,  10Connec-cut  Children's  Medical  Center,  Farmington,  CT,  USA,  11Rocky  Mountain  Youth  Sports  Medicine  Ins-tute,  Centennial,  CO,  USA,  12Kaiser  Permanente  Southern  California,  Los  Angeles,  CA,  USA,  13Washington  University  Dept  of  Orthopaedic  Surgery,  Saint  Louis,  MO,  USA.    

BIBLIOGRAPHY  1.  Dipaola,  J.  D.,  Nelson,  D.  W.  &  Colville,  M.  R.  Characterizing  osteochondral  

lesions  by  magne-c  resonance  imaging.  Arthroscopy  1991;7:101-­‐4.    2.  Ewing,  J.  W.  &  Voto,  S.  J.  Arthroscopic  surgical  management  of  osteochondri-s  

dissecans  of  the  knee.  Arthroscopy  1988;4:37-­‐40.    3.  Guhl  JF.  Arthroscopic  treatment  of  osteochondri-s  dissecans:  preliminary  

report.  Orthop  Clin  North  Am  1979;10:671-­‐83.  4.  Giraudeau,  B.  &  Mary,  J.  Y.  Planning  a  reproducibility  study:  how  many  subjects  

and  how  many  replicates  per  subject  for  an  expected  width  of  the  95  per  cent  confidence  interval  of  the  intraclass  correla-on  coefficient.  Sta4s4cs  in  Medicine.  2001;20:  3205-­‐14.  

5.  Karanicolas,  P.  J.,  Bhandari,  M.,  Kreder,  H.,  Moroni,  A.,  Richardson,  M.,  Walter,  S.  D.,  Norman,  G.  R.,  Guyam,  G.  H.  &  Collabora-on  for  Outcome  Assessment  in  Surgical  Trials  Musculoskeletal,  G.  Evalua-ng  agreement:  conduc-ng  a  reliability  study.  J  Bone  Joint  Surg  Am.  2009;91  Suppl  3:99-­‐106.      

6.  Bland  JM,  Altman  DG.  A  note  on  the  use  of  the  intraclass  correla-on  coefficient  in  the  evalua-on  of  agreement  between  two  methods  of  measurement.  Comput  Biol  Med.  1990;20  (5):337  –  340.