Abstract
This work proposes an LSTM-based sentiment classification model with multi-head attention mechanism and TF-IDF optimization. Through the integration of TF-IDF feature extraction and multi-head attention, the model significantly improves text sentiment analysis performance. Experimental results on public data sets demonstrate that the new method achieves substantial improvements in the most critical metrics like accuracy, recall, and F1-score compared to baseline models. Specifically, the model achieves an accuracy of 80.28% on the test set, which is improved by about 12% in comparison with standard LSTM models. Ablation experiments also support the necessity and necessity of all modules, in which the impact of multi-head attention is greatest to performance improvement. This research provides a proper approach to sentiment analysis, which can be utilized in public opinion monitoring, product recommendation, etc.
Abstract (translated)
这项工作提出了一种基于LSTM的情感分类模型,该模型集成了多头注意力机制和TF-IDF优化。通过将TF-IDF特征提取与多头注意力机制相结合,该模型在文本情感分析的性能上有了显著提升。实验结果表明,在公开数据集中,新方法相比基准模型,在关键指标如准确率、召回率以及F1值方面取得了实质性的改进。具体而言,模型在测试集上的准确率为80.28%,相较于标准LSTM模型提高了约12%。消融实验也支持了各模块的必要性,其中多头注意力机制对性能提升的影响最大。这项研究为情感分析提供了一种有效的方法,并可应用于公共舆论监测、产品推荐等领域。
URL
https://arxiv.org/abs/2503.08079