Endoscopy 2009; 41(11): 952-958
DOI: 10.1055/s-0029-1215193
Original article

© Georg Thieme Verlag KG Stuttgart · New York

Validation of the second-generation Olympus colonoscopy simulator for skills assessment

A.  V.  Haycock1 , P.  Bassett2 , J.  Bladen3 , S.  Thomas-Gibson1
  • 1Wolfson Unit for Endoscopy, St. Mark’s Hospital, Imperial College London, London, UK
  • 2Statsconsultancy.co.uk, Ruislip, Middlesex, UK
  • 3JSB Medical Ltd, Sheffield, UK
Further Information

Publication History

submitted15 June 2009

accepted after revision20 July 2009

Publication Date:
02 October 2009 (online)

Background and study aims: Simulators have potential value in providing objective evidence of technical skill for procedures within medicine. The aim of this study was to determine face and construct validity for the Olympus colonoscopy simulator and to establish which assessment measures map to clinical benchmarks of expertise.

Patients and methods: Thirty-four participants were recruited: 10 novices with no prior colonoscopy experience, 13 intermediate (trainee) endoscopists with fewer than 1000 previous colonoscopies, and 11 experienced endoscopists with more than 1000 previous colonoscopies. All participants completed three standardized cases on the simulator and experts gave feedback regarding the realism of the simulator. Forty metrics recorded automatically by the simulator were analyzed for their ability to distinguish between the groups.

Results: The simulator discriminated participants by experience level for 22 different parameters. Completion rates were lower for novices than for trainees and experts (37 % vs. 79 % and 88 % respectively, P < 0.001) and both novices and trainees took significantly longer to reach all major landmarks than the experts. Several technical aspects of competency were discriminatory; pushing with an embedded tip (P = 0.03), correct use of the variable stiffness function (P = 0.004), number of sigmoid N-loops (P = 0.02); size of sigmoid N-loops (P = 0.01), and time to remove alpha loops (P = 0.004). Out of 10, experts rated the realism of movement at 6.4, force feedback at 6.6, looping at 6.6, and loop resolution at 6.8.

Conclusions: The Olympus colonoscopy simulator has good face validity and excellent construct validity. It provides an objective assessment of colonoscopic skill on multiple measures and benchmarks have been set to allow its use as both a formative and a summative assessment tool.

References

A. V. Haycock, MRCP 

Wolfson Unit for Endoscopy
St. Mark’s Hospital
Imperial College London

London
UK

Fax: +44-20-84233588

Email: ahaycock@imperial.ac.uk