Evaluating AI performance in nephrology triage and subspecialty referrals
Issued Date
2025-01-27
Resource Type
eISSN
20452322
Scopus ID
2-s2.0-85217188828
Pubmed ID
39870788
Journal Title
Scientific reports
Volume
15
Issue
1
Rights Holder(s)
SCOPUS
Bibliographic Citation
Scientific reports Vol.15 No.1 (2025) , 3455
Suggested Citation
Koirala P., Thongprayoon C., Miao J., Garcia Valencia O.A., Sheikh M.S., Suppadungsuk S., Mao M.A., Pham J.H., Craici I.M., Cheungpasitporn W. Evaluating AI performance in nephrology triage and subspecialty referrals. Scientific reports Vol.15 No.1 (2025) , 3455. doi:10.1038/s41598-025-88074-5 Retrieved from: https://repository.li.mahidol.ac.th/handle/20.500.14594/105293
Title
Evaluating AI performance in nephrology triage and subspecialty referrals
Corresponding Author(s)
Other Contributor(s)
Abstract
Artificial intelligence (AI) has shown promise in revolutionizing medical triage, particularly in the context of the rising prevalence of kidney-related conditions with the aging global population. This study evaluates the utility of ChatGPT, a large language model, in triaging nephrology cases through simulated real-world scenarios. Two nephrologists created 100 patient cases that encompassed various aspects of nephrology. ChatGPT's performance in determining the appropriateness of nephrology consultations and identifying suitable nephrology subspecialties was assessed. The results demonstrated high accuracy; ChatGPT correctly determined the need for nephrology in 99-100% of cases, and it accurately identified the most suitable nephrology subspecialty triage in 96-99% of cases across two evaluation rounds. The agreement between the two rounds was 97%. While ChatGPT showed promise in improving medical triage efficiency and accuracy, the study also identified areas for refinement. This included the need for better integration of multidisciplinary care for patients with complex, intersecting medical conditions. This study's findings highlight the potential of AI in enhancing decision-making processes in clinical workflow, and it can inform the development of AI-assisted triage systems tailored to institution-specific practices including multidisciplinary approaches.