Optimizing BERT for Sentiment Classification of Amazon Product Reviews: A Study on Class Imbalance and Misclassification Analysis
Issued Date
2025-01-01
Resource Type
Scopus ID
2-s2.0-105032731380
Journal Title
2025 20th International Joint Symposium on Artificial Intelligence and Natural Language Processing Isai Nlp 2025
Rights Holder(s)
SCOPUS
Bibliographic Citation
2025 20th International Joint Symposium on Artificial Intelligence and Natural Language Processing Isai Nlp 2025 (2025)
Suggested Citation
Korsakpaisarn O., Noraset T., Lapamnuaypol J., Jin'no K. Optimizing BERT for Sentiment Classification of Amazon Product Reviews: A Study on Class Imbalance and Misclassification Analysis. 2025 20th International Joint Symposium on Artificial Intelligence and Natural Language Processing Isai Nlp 2025 (2025). doi:10.1109/iSAI-NLP66160.2025.11320736 Retrieved from: https://repository.li.mahidol.ac.th/handle/123456789/115793
Title
Optimizing BERT for Sentiment Classification of Amazon Product Reviews: A Study on Class Imbalance and Misclassification Analysis
Author(s)
Author's Affiliation
Corresponding Author(s)
Other Contributor(s)
Abstract
This paper presents a custom BERT-based sentiment classification pipeline for Amazon product reviews. Reviews are grouped into three sentiment classes - bad (1-2 stars), normal (3 stars), and good (4-5 stars). Two practical challenges are addressed: the semantic ambiguity of the neutral ('normal') class and skewed class distributions that bias prediction toward majority categories. In particular, the underrepresentation of neutral reviews often yields models that favor the dominant classes, limiting effectiveness in real applications. To mitigate these issues, stratified sampling and class-weighted cross-entropy are applied while fine-tuning bert-base-uncased. A moderate emphasis on the normal class increases its recall and F1 without significantly lowering overall accuracy, according to multi-run trials across four weight settings.