Identification of kidney-related medications using AI from self-captured pill images
Issued Date
2024-12-01
Resource Type
eISSN
15256049
Scopus ID
2-s2.0-85204058419
Pubmed ID
39258385
Journal Title
Renal failure
Volume
46
Issue
2
Rights Holder(s)
SCOPUS
Bibliographic Citation
Renal failure Vol.46 No.2 (2024) , 2402075
Suggested Citation
Sheikh M.S., Dreesman B., Barreto E.F., Thongprayoon C., Miao J., Suppadungsuk S., Mao M.A., Qureshi F., Pham J.H., Craici I.M., Kashani K.B., Cheungpasitporn W. Identification of kidney-related medications using AI from self-captured pill images. Renal failure Vol.46 No.2 (2024) , 2402075. doi:10.1080/0886022X.2024.2402075 Retrieved from: https://repository.li.mahidol.ac.th/handle/20.500.14594/101327
Title
Identification of kidney-related medications using AI from self-captured pill images
Corresponding Author(s)
Other Contributor(s)
Abstract
INTRODUCTION: ChatGPT, a state-of-the-art large language model, has shown potential in analyzing images and providing accurate information. This study aimed to explore ChatGPT-4 as a tool for identifying commonly prescribed nephrology medications across different versions and testing dates. METHODS: 25 nephrology medications were obtained from an institutional pharmacy. High-quality images of each medication were captured using an iPhone 13 Pro Max and uploaded to ChatGPT-4 with the query, 'What is this medication?' The accuracy of ChatGPT-4's responses was assessed for medication name, dosage, and imprint. The process was repeated after 2 weeks to evaluate consistency across different versions, including GPT-4, GPT-4 Legacy, and GPT-4.Ø. RESULTS: ChatGPT-4 correctly identified 22 out of 25 (88%) medications across all versions. However, it misidentified Hydrochlorothiazide, Nifedipine, and Spironolactone due to misreading imprints. For instance, Nifedipine ER 90 mg was mistaken for Metformin Hydrochloride ER 500 mg because 'NF 06' was misread as 'NF 05'. Hydrochlorothiazide 50 mg was confused with the 25 mg version due to imprint errors, and Spironolactone 25 mg was misidentified as Naproxen Sodium or Diclofenac Sodium. Despite these errors, ChatGPT-4 showed 100% consistency when retested, correcting misidentifications after receiving feedback on the correct imprints. CONCLUSION: ChatGPT-4 shows strong potential in identifying nephrology medications from self-captured images, though challenges with difficult-to-read imprints remain. Providing feedback improved accuracy, suggesting ChatGPT-4 could be a valuable tool in digital health for medication identification. Future research should enhance the model's ability to distinguish similar imprints and explore broader integration into digital health platforms.