Blister Package Classification Using ResNet-101 for Identification of Medication

Abstract

This research aimed to fine-Tune image classification with deep learning techniques to verify the dispensing of prescriptions in hospitals. The proposed approach will be able to help pharmacies reduce the errors that lead to patients receiving the wrong medications. The image classification model uses a double-side transformed image dataset with download from Highlighted Deep Learning (HDL) paper. The dataset collected two-hundred seventy-Two images for types of medicine blister packs, including 72 images of front-side and backside merged with a horizontal cropped background, which were used for training the model. The blister package image dataset uses a deep learning model with a ResNet-101 pre-Trained model from the TensorFlow framework. The experimental results indicated that the TensorFlow framework achieved higher precision, recall, and F1-score than the Caffe framework. A ResNet-101 model with histogram equalization in the front and backside has the highest accuracy at 100 percent.