Paper Reading AI Learner

Fine-tuning BERT with Bidirectional LSTM for Fine-grained Movie Reviews Sentiment Analysis

2025-02-28 03:30:48
Gibson Nkhata, Susan Gauch, Usman Anjum, Justin Zhan

Abstract

Sentiment Analysis (SA) is instrumental in understanding peoples viewpoints facilitating social media monitoring recognizing products and brands and gauging customer satisfaction. Consequently SA has evolved into an active research domain within Natural Language Processing (NLP). Many approaches outlined in the literature devise intricate frameworks aimed at achieving high accuracy, focusing exclusively on either binary sentiment classification or fine-grained sentiment classification. In this paper our objective is to fine-tune the pre-trained BERT model with Bidirectional LSTM (BiLSTM) to enhance both binary and fine-grained SA specifically for movie reviews. Our approach involves conducting sentiment classification for each review followed by computing the overall sentiment polarity across all reviews. We present our findings on binary classification as well as fine-grained classification utilizing benchmark datasets. Additionally we implement and assess two accuracy improvement techniques Synthetic Minority Oversampling Technique (SMOTE) and NLP Augmenter (NLPAUG) to bolster the models generalization in fine-grained sentiment classification. Finally a heuristic algorithm is employed to calculate the overall polarity of predicted reviews from the BERT+BiLSTM output vector. Our approach performs comparably with state-of-the-art (SOTA) techniques in both classifications. For instance in binary classification we achieve 97.67% accuracy surpassing the leading SOTA model NB-weighted-BON+dv-cosine by 0.27% on the renowned IMDb dataset. Conversely for five-class classification on SST-5 while the top SOTA model RoBERTa+large+Self-explaining attains 55.5% accuracy our model achieves 59.48% accuracy surpassing the BERT-large baseline by 3.6%.

Abstract (translated)

情感分析(SA)在理解人们的观点、促进社交媒体监控、识别产品和品牌以及衡量客户满意度方面发挥着重要作用。因此,SA已经成为自然语言处理(NLP)领域内的一个活跃研究方向。文献中提出的许多方法设计了复杂的框架,专注于实现高准确性的二元情感分类或细粒度的情感分类。本文的目标是通过对预训练的BERT模型进行微调,增强其与双向长短时记忆网络(BiLSTM)相结合的能力,以提高电影评论中的二元和细粒度情感分析的效果。我们的方法包括对每个评论进行情感分类,并计算所有评论的整体情感倾向。我们利用基准数据集展示了我们在二元分类以及细粒度分类方面的发现。此外,我们实现了并评估了两种准确性改进技术:合成少数类过采样技术(SMOTE)和自然语言处理增强器(NLPAUG),以提高模型在细粒度情感分析中的泛化能力。最后,我们采用了一种启发式算法来计算BERT+BiLSTM输出向量预测评论的整体倾向性。 我们的方法在这两种分类中都表现出与最先进(SOTA)技术相当的性能。例如,在二元分类中,我们在著名的IMDb数据集上实现了97.67%的准确率,超过了领先的SOTA模型NB-weighted-BON+dv-cosine的0.27%。相比之下,在SST-5上的五类分类任务中,虽然最优秀的SOTA模型RoBERTa+large+Self-explaining达到了55.5%的准确率,但我们的模型实现了59.48%的准确率,超越了BERT-large基线3.6%。 这个研究展示了一种有效的方法来提高电影评论的情感分析性能,并为NLP领域的进一步研究提供了有价值的见解。

URL

https://arxiv.org/abs/2502.20682

PDF

https://arxiv.org/pdf/2502.20682.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot