Abstract
Sentiment Analysis (SA) is instrumental in understanding peoples viewpoints facilitating social media monitoring recognizing products and brands and gauging customer satisfaction. Consequently SA has evolved into an active research domain within Natural Language Processing (NLP). Many approaches outlined in the literature devise intricate frameworks aimed at achieving high accuracy, focusing exclusively on either binary sentiment classification or fine-grained sentiment classification. In this paper our objective is to fine-tune the pre-trained BERT model with Bidirectional LSTM (BiLSTM) to enhance both binary and fine-grained SA specifically for movie reviews. Our approach involves conducting sentiment classification for each review followed by computing the overall sentiment polarity across all reviews. We present our findings on binary classification as well as fine-grained classification utilizing benchmark datasets. Additionally we implement and assess two accuracy improvement techniques Synthetic Minority Oversampling Technique (SMOTE) and NLP Augmenter (NLPAUG) to bolster the models generalization in fine-grained sentiment classification. Finally a heuristic algorithm is employed to calculate the overall polarity of predicted reviews from the BERT+BiLSTM output vector. Our approach performs comparably with state-of-the-art (SOTA) techniques in both classifications. For instance in binary classification we achieve 97.67% accuracy surpassing the leading SOTA model NB-weighted-BON+dv-cosine by 0.27% on the renowned IMDb dataset. Conversely for five-class classification on SST-5 while the top SOTA model RoBERTa+large+Self-explaining attains 55.5% accuracy our model achieves 59.48% accuracy surpassing the BERT-large baseline by 3.6%.
Abstract (translated)
情感分析(SA)在理解人们的观点、促进社交媒体监控、识别产品和品牌以及衡量客户满意度方面发挥着重要作用。因此,SA已经成为自然语言处理(NLP)领域内的一个活跃研究方向。文献中提出的许多方法设计了复杂的框架,专注于实现高准确性的二元情感分类或细粒度的情感分类。本文的目标是通过对预训练的BERT模型进行微调,增强其与双向长短时记忆网络(BiLSTM)相结合的能力,以提高电影评论中的二元和细粒度情感分析的效果。我们的方法包括对每个评论进行情感分类,并计算所有评论的整体情感倾向。我们利用基准数据集展示了我们在二元分类以及细粒度分类方面的发现。此外,我们实现了并评估了两种准确性改进技术:合成少数类过采样技术(SMOTE)和自然语言处理增强器(NLPAUG),以提高模型在细粒度情感分析中的泛化能力。最后,我们采用了一种启发式算法来计算BERT+BiLSTM输出向量预测评论的整体倾向性。 我们的方法在这两种分类中都表现出与最先进(SOTA)技术相当的性能。例如,在二元分类中,我们在著名的IMDb数据集上实现了97.67%的准确率,超过了领先的SOTA模型NB-weighted-BON+dv-cosine的0.27%。相比之下,在SST-5上的五类分类任务中,虽然最优秀的SOTA模型RoBERTa+large+Self-explaining达到了55.5%的准确率,但我们的模型实现了59.48%的准确率,超越了BERT-large基线3.6%。 这个研究展示了一种有效的方法来提高电影评论的情感分析性能,并为NLP领域的进一步研究提供了有价值的见解。
URL
https://arxiv.org/abs/2502.20682