Abstract
Today, Social networks such as Twitter are the most widely used platforms for communication of people. Analyzing this data has useful information to recognize the opinion of people in tweets. Sentiment analysis plays a vital role in NLP, which identifies the opinion of the individuals about a specific topic. Natural language processing in Persian has many challenges despite the adventure of strong language models. The datasets available in Persian are generally in special topics such as products, foods, hotels, etc while users may use ironies, colloquial phrases in social media To overcome these challenges, there is a necessity for having a dataset of Persian sentiment analysis on Twitter. In this paper, we introduce the Exa sentiment analysis Persian dataset, which is collected from Persian tweets. This dataset contains 12,000 tweets, annotated by 5 native Persian taggers. The aforementioned data is labeled in 3 classes: positive, neutral and negative. We present the characteristics and statistics of this dataset and use the pre-trained Pars Bert and Roberta as the base model to evaluate this dataset. Our evaluation reached a 79.87 Macro F-score, which shows the model and data can be adequately valuable for a sentiment analysis system.
Abstract (translated)
如今,像 Twitter 这样的社交网络是人们最常用的沟通平台。分析这些数据可以获取有用的信息来识别人们对推文中的观点。情感分析在自然语言处理(NLP)中扮演着重要角色,它能够识别个人对特定主题的看法。尽管强大的语言模型已经出现,但在波斯语的自然语言处理方面仍然存在许多挑战。可用的数据集通常限于某些特定领域,如产品、食物和酒店等,而用户在社交媒体上可能会使用讽刺或俚语表达情感。 为了解决这些挑战,需要建立一个基于 Twitter 的波斯语情感分析数据集。本文介绍了一个名为 Exa 波斯语情感分析数据集的项目,该数据集是从波斯语推文中收集得来的。此数据集包含 12,000 条推文,并由五名母语为波斯语的人士进行标注。上述数据被标记为三类:积极、中性和消极。 我们介绍了这个数据集的特性和统计信息,并使用预训练的 Pars Bert 和 Roberta 模型作为基础模型来评估该数据集。我们的评估结果显示 Macro F-score 达到了 79.87,表明此模型和数据对于情感分析系统来说具有足够的价值。
URL
https://arxiv.org/abs/2602.20892