A Bibliometric Analysis of the Rise of ChatGPT in Medical Research

• Published in: Medical sciences (Basel) Vol. 11; no. 3; p. 61
• Main Authors: Barrington, Nikki M., Gupta, Nithin, Musmar, Basel, Doyle, David, Panico, Nicholas, Godbole, Nikhil, Reardon, Taylor, D’Amico, Randy S.
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 17.09.2023; MDPI
• Subjects: Accuracy; Artificial Intelligence; Authorship; Benchmarking; Bibliometrics; Biomedical Research; Chatbots; ChatGPT; Education; Humans; large language models; Medical education; Medical personnel; Medical research; Medical screening; medicine; Medicine, Experimental; Methods; Neural networks; Online databases; Patients; Radiology; Review; Surgery, Plastic; Trends; United States > US; large language models; medicine; ChatGPT; artificial intelligence; research
• ISSN: 2076-3271; 2076-3271
• DOI: 10.3390/medsci11030061

The rapid emergence of publicly accessible artificial intelligence platforms such as large language models (LLMs) has led to an equally rapid increase in articles exploring their potential benefits and risks. We performed a bibliometric analysis of ChatGPT literature in medicine and science to better understand publication trends and knowledge gaps. Following title, abstract, and keyword searches of PubMed, Embase, Scopus, and Web of Science databases for ChatGPT articles published in the medical field, articles were screened for inclusion and exclusion criteria. Data were extracted from included articles, with citation counts obtained from PubMed and journal metrics obtained from Clarivate Journal Citation Reports. After screening, 267 articles were included in the study, most of which were editorials or correspondence with an average of 7.5 +/− 18.4 citations per publication. Published articles on ChatGPT were authored largely in the United States, India, and China. The topics discussed included use and accuracy of ChatGPT in research, medical education, and patient counseling. Among non-surgical specialties, radiology published the most ChatGPT-related articles, while plastic surgery published the most articles among surgical specialties. The average citation number among the top 20 most-cited articles was 60.1 +/− 35.3. Among journals with the most ChatGPT-related publications, there were on average 10 +/− 3.7 publications. Our results suggest that managing the inevitable ethical and safety issues that arise with the implementation of LLMs will require further research exploring the capabilities and accuracy of ChatGPT, to generate policies guiding the adoption of artificial intelligence in medicine and science.