Download PDF
J Am Acad Audiol 2019; 30(03): 227-234
DOI: 10.3766/jaaa.17114
Articles
Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Face and Content Validity of a Probe Tube Placement Training Simulator

Robert W. Koch
*   Biomedical Engineering Graduate Program, Western University, London, ON, Canada
,
Sheila Moodie
†   National Centre for Audiology, Faculty of Health Sciences, Western University, London, ON, Canada
‡   School of Communication Sciences and Disorders, Western University, London, ON, Canada
,
Paula Folkeard
†   National Centre for Audiology, Faculty of Health Sciences, Western University, London, ON, Canada
,
Susan Scollie
†   National Centre for Audiology, Faculty of Health Sciences, Western University, London, ON, Canada
‡   School of Communication Sciences and Disorders, Western University, London, ON, Canada
,
Conner Janeteas
§   Cimetrix Solutions Inc., Oshawa, ON, Canada
,
Sumit K. Agrawal
*   Biomedical Engineering Graduate Program, Western University, London, ON, Canada
†   National Centre for Audiology, Faculty of Health Sciences, Western University, London, ON, Canada
¶   Department of Otolaryngology, Head and Neck Surgery, Western University, London, ON, Canada
‖   Department of Medical Biophysics, Western University, London, ON, Canada
,
Hanif M. Ladak
*   Biomedical Engineering Graduate Program, Western University, London, ON, Canada
†   National Centre for Audiology, Faculty of Health Sciences, Western University, London, ON, Canada
¶   Department of Otolaryngology, Head and Neck Surgery, Western University, London, ON, Canada
‖   Department of Medical Biophysics, Western University, London, ON, Canada
› Author Affiliations
Further Information

Publication History

Publication Date:
26 May 2020 (online)

   Permissions and Reprints

Abstract

Background:

Probe tube placement is an important skill audiologists must learn to make real-ear measurements in an audiology clinic. With current evidence-based guidelines recommending insertion of the probe tube within 5 mm of the tympanic membrane (TM) for proper acoustical measurements, students must be well trained to ensure they are capable to perform this placement in clinical practice. This is not always the case as it has been found that real-ear measurements are not performed in a clinic as often as required. To address this, a simulator consisting of a 3D-printed ear model and an optical tracking system was developed to provide a training system for students to practice probe tube placement and to provide a method to evaluate competency before starting clinical practicum placements. Two simulators were developed, an adult model and a pediatric model.

Purpose:

To assess the face and content validity of the two probe tube placement simulators (adult and pediatric) and define barriers and facilitators to implementing this system into an educational setting.

Research Design:

Participants followed the setup and operating instructions designed to guide them through each functionality of the simulator. A questionnaire was used to assess face and content validity, applicability to an educational setting, and to determine perceived barriers and facilitators to using the probe tube simulators for training purposes. Five additional probe tube placements with each simulator were performed in which distance-to-TM was recorded.

Study Sample:

Twelve participants with significant probe tube placement experience.

Data Collection and Analysis:

Participants rated each question in the questionnaire from 0% to 100% depending on their level of agreement. Averages and standard deviations (SDs) were compiled and presented for each section (face validity, content validity, and applicability to an educational setting). Final facilitators and barriers for the simulator were compiled and the top answers of each are presented. The five quantitative probe tube placement measurements for each participant were averaged, SDs were calculated, and contacts with the TM while placing the probe tube were recorded.

Results:

The average face validity score over all questions for the adult model was 65% (SD = 18.2) whereas the pediatric model received a score of 64% (16.4). The overall content validity average score was 78.7% (17) and applicability to an educational setting had an average score of 80% (5.33). The average distance-to-TM across all trials and participants was 3.74 mm (1.82) for the adult model and 2.77 mm (0.94) for the pediatric model with only one participant exceeding the recommended maximum of 5 mm. Listed shortcomings of the current simulator included realism of the 3D-printed ear, ease of insertion of an otoscope tip into the ear, ability to visualize the ear canal “landmarks” and the TM, and foam tip insertion experience.

Conclusions:

Results were generally very positive for the simulator, and future iterations will look to improve the flexibility and texture of the ear, as well as the otoscopic view of the ear canal and TM.

Key Words

content validity - education - face validity - hearing aids - probe tube placement - real-ear - simulation - training

Funding for this project was provided through an Ontario Graduate Scholarship (2016/2017) and through the Natural Sciences and Engineering Research Council of Canada.


 

  • REFERENCES

  • Bagatto MP, Seewald RC, Scollie SD, Tharpe AM. 2006; Evaluation of a probe-tube insertion technique for measuring the real-ear-to-coupler difference (RECD) in young infants. J Am Acad Audiol 17 (08) 573-581
    Article in Thieme ConnectPubMedGoogle Scholar
  • Boren MT, Ramey J. 2000; Thinking aloud: reconciling theory and practice. IEEE Trans Prof Commun 43 (03) 261-278
    CrossrefGoogle Scholar
  • Bos EJ, van der Laan K, Helder MN, Mullender MG, Iannuzzi D, van Zuijlen PP. 2017; Noninvasive measurement of ear cartilage elasticity biomechanical information for tissue engineering. Plast Reconstr Surg Glob Open 5: 1-6
    Google Scholar
  • British Society of Audiology (BSA). (2007) Guidance on the use of real ear measurement to verify the fitting of digital signal processing hearing aids. Br Soc Audiol 1–20.
  • Brooke RE, Isherwood S, Herbert NC, Raynor DK, Knapp P. 2012; Hearing aid instruction booklets: employing usability testing to determine effectiveness. Am J Audiol 21 (02) 206-214
    CrossrefPubMedGoogle Scholar
  • Brown DK. 2017; Simulation before clinical practice: the educational advantages. Audiol Today 29 (05) 16-24
    Google Scholar
  • College of Audiologists and Speech-Language Pathologists of Ontario (CASLPO). (2016) Practice standards for the provision of hearing aid services by audiologists. Toronto, ON: CASLPO. http://www.caslpo.com/sites/default/uploads/files/PS_EN_Practice_Standards_for_the_Provision_of_Hearing_Aid_Services_By_Audiologists.pdf
  • Dirks DD, Kincaid GE. 1987; Basic acoustic considerations of ear canal probe measurements. Ear Hear 8 (05) (Suppl) 60S-67S
    CrossrefPubMedGoogle Scholar
  • Gallagher AG, Ritter EM, Satava RM. 2003; Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17 (10) 1525-1529
    CrossrefPubMedGoogle Scholar
  • Gent AN. 1958; On the relation between indentation hardness and Young’s modulus. Trans Inst Rubber Ind 34: 46-57
    Google Scholar
  • Griffin MF, Premakumar Y, Seifalian AM, Szarko M, Butler PEM. 2016; Biomechanical characterisation of the human auricular cartilages; implications for tissue engineering. Ann Biomed Eng 44 (12) 3460-3467
    CrossrefPubMedGoogle Scholar
  • Huang C, Cheng H, Bureau Y, Agrawal SK, Ladak HM. 2015; Face and content validity of a virtual-reality simulator for myringotomy with tube placement. J Otolaryngol Head Neck Surg 44 (01) 1-8
    CrossrefPubMedGoogle Scholar
  • International Standards Organization (ISO). (2001) Acoustics–procedures for the measurement of real-ear acoustical characteristics of hearing aids (ISO 12124:2001).
  • Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, Waugh RA, Brown DD, Safford RR, Gessner IH, Gordon DL, Ewy GA. 1999; Simulation technology for health care professional skills training and assessment. JAMA 282 (09) 861-866
    CrossrefPubMedGoogle Scholar
  • Johnson CM, Johnson TR, Zhang J. 2005; A user-centered framework for redesigning health care interfaces. J Biomed Inform 38 (01) 75-87
    CrossrefPubMedGoogle Scholar
  • Kunkler K. 2006; The role of medical simulation: an overview. Int J Med Robot 2 (03) 203-210
    CrossrefPubMedGoogle Scholar
  • Moodie S, Pietrobon J, Rall E, Lindley G, Eiten L, Gordey D, Davidson L, Moodie KS, Bagatto M, Haluschak MM, Folkeard P, Scollie S. 2016; Using the real-ear-to-coupler difference within the American Academy of Audiology Pediatric Amplification Guideline: protocols for applying and predicting earmold RECDs. J Am Acad Audiol 27 (03) 264-275
    Article in Thieme ConnectPubMedGoogle Scholar
  • Moodie S, Rall E, Eiten L, Lindley G, Gordey D, Davidson L, Bagatto M, Scollie S. 2016; Pediatric audiology in North America: current clinical practice and how it relates to the American Academy of Audiology Pediatric Amplification Guideline. J Am Acad Audiol 27 (03) 166-187
    Article in Thieme ConnectPubMedGoogle Scholar
  • Mueller HG. 2005; Probe-mic measures: hearing aid fitting’s most neglected element. Hear J 58 (10) 21-22 24, 26, 28, 30
    Google Scholar
  • Mueller HG. 2014 20Q: Real-Ear Probe-Microphone Measures—30 Years of Progress?. AudiologyOnline. http://www.audiologyonline.com/articles/20q-probe-mic-measures-12410 . Accessed November 17, 2016
    Google Scholar
  • Mueller HG, Picou E. 2010; Survey examines popularity of real-ear probe-microphone measures. Hear J 63 (05) 27-32
    Google Scholar
  • Nimeskern L, Pleumeekers MM, Pawson DJ, Koevoet WL, Lehtoviita I, Soyka MB, Röösli C, Holzmann D, van Osch GJ, Müller R, Stok KS. 2015; Mechanical and biochemical mapping of human auricular cartilage for reliable assessment of tissue-engineered constructs. J Biomech 48 (10) 1721-1729
    CrossrefPubMedGoogle Scholar
  • Ross T. (2014) Fear and Loathing of Verification. MedRx website. http://medrx-usa.com/Website/pages/medrx-FearLoathing-of-Verification.html . Accessed November 17, 2016.
  • Schout BMA, Hendrikx AJM, Scheele F, Bemelmans BLH, Scherpbier AJJA. 2010; Validation and implementation of surgical simulators: a critical review of present, past, and future. Surg Endosc 24 (03) 536-546
    CrossrefPubMedGoogle Scholar
  • Sonic. (2014) Real Ear Fit: Combining Real Ear Verification with Best Fit Fast. http://www.sonici.com/~/media/Files/Guides/Spotlights%20and%20Tech%20Papers/UK/Spotlight_Real%20Ear%20Fit_UK_6_14.ashx . Accessed April 10, 2017.
  • Vaisberg JM, Macpherson EA, Scollie SD. 2016; Extended bandwidth real-ear measurement accuracy and repeatability to 10 kHz. Int J Audiol 55 (10) 580-586
    CrossrefPubMedGoogle Scholar
  • Valente, M. (2006) Guideline for audiologic management of the adult patient. Audiology Online. https://www.audiologyonline.com/articles/guideline-for-audiologic-management-adult-966 . Accessed November 10, 2016.
  • Wolfe BE. 2013; The value of pilot studies in clinical research: a clinical translation of the research article titled “In search of an adult attachment stress provocation to measure effect on the oxytocin system”. J Am Psychiatr Nurses Assoc 19 (04) 192-194
    CrossrefPubMedGoogle Scholar