Open Access
CC BY-NC-ND 4.0 · Endosc Int Open 2022; 10(09): E1218-E1224
DOI: 10.1055/a-1882-4246
Original article

Face validity of a virtual reality simulation platform to improve competency in endoscopy: a prospective observational cohort study

Catherine Eley
1   Health Education and Improvement Wales. Ty Dysgu, Cefn Coed, Nantgarw, UK
,
Neil D Hawkes
2   Royal Glamorgan Hospital. Ynysmaerdy, Pontyclun, UK
,
Richard J Egan
3   Morriston Hospital, Heol Maes Eglwys, Morriston, Swansea, UK
4   Swansea University, Singleton Park, Sketty, Swansea, UK
,
David B Robinson
1   Health Education and Improvement Wales. Ty Dysgu, Cefn Coed, Nantgarw, UK
,
Chris Brown
1   Health Education and Improvement Wales. Ty Dysgu, Cefn Coed, Nantgarw, UK
3   Morriston Hospital, Heol Maes Eglwys, Morriston, Swansea, UK
,
Sam Murray
5   Southmead Hospital, Southmead Road, Bristol, UK
,
Keith Siau
6   Royal Cornwall Hospitals NHS Trust, Truro, UK
,
Wyn Lewis
1   Health Education and Improvement Wales. Ty Dysgu, Cefn Coed, Nantgarw, UK
› Author Affiliations
Preview

Abstract

Background and study aims Virtual reality endoscopic simulation training has the potential to expedite competency development in novice trainees. However, simulation platforms must be realistic and confer face validity. This study aimed to determine the face validity of high-fidelity virtual reality simulation (EndoSim, Surgical Science, Gothenburg), and establish benchmark metrics to guide the development of a Simulation Pathway to Improve Competency in Endoscopy (SPICE).

Methods A pilot cohort of four experts rated simulated exercises (Likert scale score 1–5) and following iterative development, 10 experts completed 13 simulator-based endoscopy exercises amounting to 859 total metric values.

Results Expert metric performance demonstrated equivalence (P = 0.992). In contrast, face validity of each exercise varied among experts (median 4 (interquartile range [IQR] 3–5), P < 0.003) with Mucosal Examination receiving the highest scores (median 5 [IQR 4.5–5], P = 1.000) and Loop Management and Intubation exercises receiving the lowest scores (median 3 [IQR 1–3], P < 0.001, P = 0.004), respectively. The provisional validated SPICE comprised 13 exercises with pass marks and allowance buffers defined by median and IQR expert performance.

Conclusions EndoSim Face Validity was very good related to early scope handling skills, but more advanced competencies and translation of acquired clinical skills require further research within an established training program. The existing training deficit with superadded adverse effects of the COVID pandemic make this initiative an urgent priority.

Supplementary material



Publication History

Received: 20 November 2021

Accepted after revision: 08 June 2022

Article published online:
14 September 2022

© 2022. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany