OPG-SHAP: A Dental AI Tool for Explaining Learned Orthopantomogram Image Recognition

Abstract

We propose OPG-SHAP, a tool for extracting insight of the trained deep learning model for an Orthopantomograms (OPGs). The tool allows user to understand the areas that influence the model's predictions through SHAP (SHapley Additive exPlanations) interpretability. The tool automatically identify the regions within the OPG image that influence the model's decision-making through YOLO-based object detection model that trained to detect over 20 classes of dental region in OPGs with an AverageIoU = 0.795, mAP = 0.989, Precision = 0.986, Recall = 0.987, and F1 score = 0.986. When a user inputs an OPG image and model into the OPG-SHAP tool, the output highlights the positions the model considers important for its decision, indicated by positive and negative SHAP values.