Novel artificial intelligence-driven software significantly shortens the time required for annotation in computer vision projects
Background and study aims The contribution of artificial intelligence (AI) to endoscopy is rapidly expanding. Accurate labelling of source data (video frames) remains the rate-limiting step for such projects and is a painstaking, cost-inefficient, time-consuming process. A novel software platform, Cord Vision (CdV) allows automated annotation based on “embedded intelligence.” The user manually labels a representative proportion of frames in a section of video (typically 5 %), to create ‘micro-modelsʼ which allow accurate propagation of the label throughout the remaining video frames. This could drastically reduce the time required for annotation.
Methods We conducted a comparative study with an open-source labelling platform (CVAT) to determine speed and accuracy of labelling.
Results Across 5 users, CdV resulted in a significant increase in labelling performance (P < 0.001) compared to CVAT for bounding box placement.
Conclusions This advance represents a valuable first step in AI-image analysis projects.
Eingereicht: 18. September 2020
Angenommen: 02. Dezember 2020
Artikel online veröffentlicht:
14. April 2021
© 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
- 1 Gulati S, Patel M, Emmanuel A. et al. The future of endoscopy: Advances in endoscopic image innovations. Dig. Endosc 2020; 32: 512-522
- 2 Le Berre C, Sandborn WJ, Aridhi S. et al. Application of Artificial Intelligence to Gastroenterology and Hepatology. Gastroenterology 2020; 158: 76-94.e2
- 3 Yang YJ, Bang CS. Application of artificial intelligence in gastroenterology. World J. Gastroenterol 2019; 25: 1666-1683
- 4 Min JK, Kwak MS, Cha JM. Overview of deep learning in gastrointestinal endoscopy. Gut Liver 2019; 13: 388-393
- 5 Qayyum A, Qadir J, Bilal M. et al. Secure and robust machine learning for healthcare: a survey. IEEE Rev Biomed Eng 2021; 14: 156-180
- 6 Dhar P. The carbon impact of artificial intelligence. Nat Mach Intell 2020; 2: 423-425
- 7 Borgli H, Thambawita V, Smedsrud PH. et al. HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci Data 2020; 7: 16