External Validation of Deep Learning Algorithm for Tuberculosis Detection in Thai Population

Abstract

Several studies have been conducted for the automatic detection of tuberculosis on chest X-ray (CXR) images using deep learning. Despite the excellent performance of deep learning algorithms, a major challenge faced by such models is its limited ability to generalize in unseen datasets. Previous works have highlighted the importance of local datasets for building a high-performance deep learning model tailored to a specific region or population, yet model's performance on heterogeneous datasets have not been addressed. In this paper, we present a state-of-the-art model for image-wise classification and lesionwise localization of tuberculosis (TB) in the Thai population. The model was trained on an extensive Thai CXR dataset, which was labeled with feature-specific keywords. Our model demonstrated outstanding performance with an average AUROC of 0.936 and a lesion-wise localization score of 88.18%. The model achieved high sensitivity (83.5%) and specificity (94.6%). When compared with the benchmark model based on EfficientNet, our model obtained excellent performance in terms of both classification and localization. Our model consistently outperformed the benchmark model when validated on multiple independent datasets.