A deep feature-level fusion model for masked face identity recommendation system
Issued Date
2022-01-01
Resource Type
ISSN
18685137
eISSN
18685145
Scopus ID
2-s2.0-85138799691
Journal Title
Journal of Ambient Intelligence and Humanized Computing
Rights Holder(s)
SCOPUS
Bibliographic Citation
Journal of Ambient Intelligence and Humanized Computing (2022)
Suggested Citation
Thaipisutikul T., Tatiyamaneekul P., Lin C.Y., Tuarob S. A deep feature-level fusion model for masked face identity recommendation system. Journal of Ambient Intelligence and Humanized Computing (2022). doi:10.1007/s12652-022-04380-0 Retrieved from: https://repository.li.mahidol.ac.th/handle/123456789/84365
Title
A deep feature-level fusion model for masked face identity recommendation system
Author(s)
Author's Affiliation
Other Contributor(s)
Abstract
The widespread occurrences of airborne outbreaks (e.g., COVID-19) and pollution (e.g., PM2.5) have urged people in the affected regions to protect themselves by wearing face masks. In certain areas, wearing masks amidst such health-endangering times is even enforced by law. While most people wear masks to guard themselves against airborne substances, some exploit such excuses and use face masks to conceal their identity for criminal purposes such as shoplifting, robbery, drug transport, and assault. While automatic face recognition models have been proposed, most of these models aim to identify clear, unobstructed faces for authentication purposes and cannot effectively handle cases where masks cover most facial areas. To mitigate such a problem, this paper proposes a deep-learning-based feature-fusion framework, FIREC, that combines additional demographic-estimated features such as age, gender, and race into the underlying facial representation to compensate for the information lost due to mask obstruction. Given an image of a masked face, our system recommends a ranked list of potential identities of the person behind the mask. Empirical results show that the best configuration of our proposed framework can recognize bare faces and masked faces with the accuracy of 99.34% and 97.65% in terms of Hit@10, respectively. The proposed framework could greatly benefit high-recall facial identity recognition applications such as identifying potential suspects from CCTV or passers-by’s cameras, especially during crisis times when people commonly cover their faces with protective masks.