Subscribe to RSS
DOI: 10.1055/a-2373-3151
Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework
Funding This project was funded through a grant from the Columbia Center for Teaching and Learning. M.R.T. is also funded by National Institute of Nursing Research (NINR) of the National Institutes of Health (NIH). (grant no.: R00NR019124).Abstract
Background Generative artificial intelligence (AI) tools may soon be integrated into health care practice and research. Nurses in leadership roles, many of whom are doctorally prepared, will need to determine whether and how to integrate them in a safe and useful way.
Objective This study aimed to develop and evaluate a brief intervention to increase PhD nursing students' knowledge of appropriate applications for using generative AI tools in health care.
Methods We created didactic lectures and laboratory-based activities to introduce generative AI to students enrolled in a nursing PhD data science and visualization course. Students were provided with a subscription to Chat Generative Pretrained Transformer (ChatGPT) 4.0, a general-purpose generative AI tool, for use in and outside the class. During the didactic portion, we described generative AI and its current and potential future applications in health care, including examples of appropriate and inappropriate applications. In the laboratory sessions, students were given three tasks representing different use cases of generative AI in health care practice and research (clinical decision support, patient decision support, and scientific communication) and asked to engage with ChatGPT on each. Students (n = 10) independently wrote a brief reflection for each task evaluating safety (accuracy, hallucinations) and usability (ease of use, usefulness, and intention to use in the future). Reflections were analyzed using directed content analysis.
Results Students were able to identify the strengths and limitations of ChatGPT in completing all three tasks and developed opinions on whether they would feel comfortable using ChatGPT for similar tasks in the future. All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale.
Conclusion This brief educational intervention supported doctoral nursing students in understanding the appropriate uses of ChatGPT, which may support their ability to appraise and use these tools in their future work.
Keywords
artificial intelligence - nursing informatics - informatics - medical informatics - nursing students - graduate nursing education - nursing education researchProtection of Human and Animal Subjects
The Columbia University IRB approved this study.
Publication History
Received: 01 March 2024
Accepted: 24 July 2024
Accepted Manuscript online:
25 July 2024
Article published online:
16 October 2024
© 2024. Thieme. All rights reserved.
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Jo A. What ChatGPT and generative AI mean for science. Nature 2023 ;614(1). Accessed July 30, 2024 at: https://www.nature.com/articles/d41586-023-00340-6
- 2 Carroll WM. Generative AI in clinical practice and operations. Nurs Manage 2023; 54 (10) 56
- 3 Open AI. Introducing ChatGPT. 2022 . Accessed April 6, 2023 at: https://openai.com/blog/chatgpt
- 4 Owens B. How Nature readers are using ChatGPT. Nature 2023; 615 (7950) 20
- 5 Eysenbach G. The role of ChatGPT, generative language models, and artificial intelligence in medical education: a conversation with ChatGPT and a call for papers. JMIR Med Educ 2023; 9 (01) e46885
- 6 Liu S, Wright AP, Patterson BL. et al. Assessing the value of ChatGPT for clinical decision support optimization. medRxiv (e-pub ahead of print). Published online February 23, 2023 DOI: 10.1101/2023.02.21.23286254
- 7 Rao A, Kim J, Kamineni M, Pang M, Lie W, Prasad AK, Landman A, Dreyer K, Succi MD. Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study. J Med Internet Res 2023; 25: e48659
- 8 Rao A, Kim J, Kamineni M, Pang M, Lie W, Dreyer KJ, Succi MD. Evaluating GPT as an Adjunct for Radiologic Decision Making: GPT-4 versus GPT-3.5 in a breast imaging pilot. J Am Coll Radiol 2023; 20 (10) 990-997
- 9 Moons P, Van Bulck L. ChatGPT: can artificial intelligence language models be of value for cardiovascular nurses and allied health professionals. Eur J Cardiovasc Nurs 2023; 22 (07) e55-e59
- 10 O'Connor S. Open artificial intelligence platforms in nursing education: tools for academic progress or abuse?. Nurse Educ Pract 2023; 66: 103537
- 11 Eddy N. Epic, Microsoft partner to use generative AI for better EHRs. Healthcare IT News. Published April 18, 2023. Accessed April 19, 2023 at: https://www.healthcareitnews.com/news/epic-microsoft-partner-use-generative-ai-better-ehrs?mkt_tok=NDIwLVlOQS0yOTIAAAGLNZIswFNUMzJqPehB6oRzDwlL–b5VSFOyFTrEsy9JOHwqG1T2_zyPjj1MY51LgwY7D73j-X8bvMI2itbo5fy9hRwFH8BuAKLCeYQ_z26kg
- 12 Raza MM, Venkatesh KP, Kvedar JC. Generative AI and large language models in health care: pathways to implementation. NPJ Digit Med 2024; 7 (01) 62
- 13 Morris NS, Wassef ME, Sullivan-Bolyai S, Bova C, Kane AT. Making explicit the development of PhD-prepared nurses to steward the discipline. Nurs Outlook 2021; 69 (01) 50-56
- 14 Grace JT, D'Aoust R. Evidence-based program requirements: evaluation of statistics as a required course. Nurs Educ Perspect 2006; 27 (01) 28-33
- 15 Brennan PF, Bakken S. Nursing needs big data and big data needs nursing. J Nurs Scholarsh 2015; 47 (05) 477-484
- 16 American Association of Colleges of Nursing. The Essentials: Core Competencies for Professional Nursing Education. 2021
- 17 Wing JM. Computational thinking. Commun ACM 2006; 49 (03) 33-35
- 18 Liu J, Liu F, Fang J, Liu S. The application of Chat Generative Pre-trained Transformer in nursing education. Nurs Outlook 2023; 71 (06) 102064
- 19 O'Connor S, Peltonen LM, Topaz M. et al. Prompt engineering when using generative AI in nursing education. Nurse Educ Pract 2024; 74: 103825
- 20 Topaz M, Peltonen LM, Michalowski M. et al. The ChatGPT Effect: nursing education and generative artificial intelligence. J Nurs Educ 2024; 1-4
- 21 Dwivedi YK, Kshetri N, Hughes L. et al. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. Int J Inf Manage 2023; 71: 102642
- 22 O'Connor S, Leonowicz E, Allen B, Denis-Lalonde D. Artificial intelligence in nursing education 1: strengths and weaknesses. Nursing Times. September 11, 2023. Accessed July 30, 2024 at: https://www.nursingtimes.net/roles/nurse-educators/artificial-intelligence-in-nursing-education-1-strengths-and-weaknesses-11-09-2023/
- 23 O'Connor S, Permana AF, Neville S, Denis-Lalonde D. Artificial intelligence in nursing education 2: opportunities and threats. Nursing Times. October 9, 2023. Accessed June 4, 2024 at: https://www.nursingtimes.net/roles/nurse-educators/artificial-intelligence-in-nursing-education-2-opportunities-and-threats-09-10-2023/
- 24 Nurse.org. Top PhD in nursing programs. 2024 . Accessed February 20, 2024 at: https://nurse.org/education/phd-in-nursing-degree/
- 25 Bakewell-Sachs R, Trautman D, Rosseter R. Addressing the nurse faculty shortage. American Nurse. August 3, 2022. Accessed February 20, 2024 at: https://www.myamericannurse.com/addressing-the-nurse-faculty-shortage-2/
- 26 American Association of Colleges of Nursing. Nursing Faculty Shortage Fact Sheet. Accessed February 20, 2024 at: https://www.aacnnursing.org/news-data/fact-sheets/nursing-faculty-shortage
- 27 Mrayyan MT, Abunab HY, Abu Khait A. et al. Competency in nursing practice: a concept analysis. BMJ Open 2023; 13 (06) e067352
- 28 Bloom BS. Taxonomy of Educational Objectives: The Classification of Educational Goals. Longmans, Green & Co.; 1956
- 29 Columbia Center for Teaching and Learning at Columbia University. Accessed February 20, 2024 at: https://ctl.columbia.edu/
- 30 Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare (Basel) 2023; 11 (06) 887
- 31 Durieux B, Davis J, Moons P, Van Bulck L. How to get the most out of ChatGPT? Tips and tricks on prompting. Eur J Cardiovasc Nurs 2024; zvae016
- 32 Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res 1999; 34 (5 Pt 2): 1189-1208
- 33 Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005; 15 (09) 1277-1288
- 34 Ronquillo CE, Peltonen LM, Pruinelli L. et al. Artificial intelligence in nursing: Priorities and opportunities from an international invitational think-tank of the Nursing and Artificial Intelligence Leadership Collaborative. J Adv Nurs 2021; 77 (09) 3707-3717
- 35 Douthit BJ, Walden RL, Cato K. et al. Data science trends relevant to nursing practice: a rapid review of the 2020 literature. Appl Clin Inform 2022; 13 (01) 161-179
- 36 Gosak L, Pruinelli L, Topaz M, Štiglic G. The ChatGPT effect and transforming nursing education with generative AI: discussion paper. Nurse Educ Pract 2024; 75: 103888
- 37 Reed JM, Dodson TM. Generative AI backstories for simulation preparation. Nurse Educ 2024; 49 (04) 184-188
- 38 De Gagne JC. The state of artificial intelligence in nursing education: past, present, and future directions. Int J Environ Res Public Health 2023; 20 (06) 4884
- 39 Long D, Magerko B. What is AI Literacy? Competencies and Design Considerations. Paper presented at: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI '20. Association for Computing Machinery; 2020: 1-16
- 40 Russell RG, Lovett Novak L, Patel M. et al. Competencies for the use of artificial intelligence-based tools by health care professionals. Acad Med 2023; 98 (03) 348-356
- 41 Acar OA. Are Your Students Ready for AI?: A Four-Step Framework to Prepare Learners for a ChatGPT World. Harvard Business School Publishing; 2023. . Accessed February 21, 2024 at: https://kclpure.kcl.ac.uk/portal/en/publications/are-your-students-ready-for-ai-a-four-step-framework-to-prepare-l
- 42 Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Accessed February 21, 2024 at: https://proceedings.neurips.cc/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html
- 43 Open AI. Governance of superintelligence. 2023 . Accessed February 21, 2024 at: https://openai.com/blog/governance-of-superintelligence
- 44 Open AI. Our approach to alignment research. 2022 . Accessed February 21, 2024 at: https://openai.com/blog/our-approach-to-alignment-research
- 45 Zou A, Phan L, Chen S. et al. Representation engineering: A top-down approach to AI transparency. arXiv [csLG]. Published online October 2, 2023. Accessed February 21, 2024 at: https://www.ai-transparency.org/
- 46 Armstrong C. High blood pressure: ACC/AHA Releases Updated Guideline. Am Fam Physician 2018; 97 (06) 413-415