Paper Reading AI Learner

Real-Time Sentiment Insights from X Using VADER, DistilBERT, and Web-Scraped Data

2025-04-21 21:33:55
Yanampally Abhiram Reddy, Siddhi Agarwal, Vikram Parashar, Arshiya Arora

Abstract

In the age of social media, understanding public sentiment toward major corporations is crucial for investors, policymakers, and researchers. This paper presents a comprehensive sentiment analysis system tailored for corporate reputation monitoring, combining Natural Language Processing (NLP) and machine learning techniques to accurately interpret public opinion in real time. The methodology integrates a hybrid sentiment detection framework leveraging both rule-based models (VADER) and transformer-based deep learning models (DistilBERT), applied to social media data from multiple platforms. The system begins with robust preprocessing involving noise removal and text normalization, followed by sentiment classification using an ensemble approach to ensure both interpretability and contextual accuracy. Results are visualized through sentiment distribution plots, comparative analyses, and temporal sentiment trends for enhanced interpretability. Our analysis reveals significant disparities in public sentiment across major corporations, with companies like Amazon (81.2) and Samsung (45.8) receiving excellent sentiment scores, while Microsoft (21.7) and Walmart (21.9) exhibit poor sentiment profiles. These findings demonstrate the utility of our multi-source sentiment framework in providing actionable insights regarding corporate public perception, enabling stakeholders to make informed strategic decisions based on comprehensive sentiment analysis.

Abstract (translated)

在社交媒体时代,理解公众对大型企业的情绪对于投资者、政策制定者和研究人员来说至关重要。本文提出了一种全面的情感分析系统,该系统专门用于企业声誉监测,并结合自然语言处理(NLP)和机器学习技术来实时准确地解读公众意见。 本研究的方法论整合了一个混合情感检测框架,利用基于规则的模型(VADER)和基于转换器的深度学习模型(DistilBERT),应用于来自多个平台的社会媒体数据。该系统首先进行强大的预处理步骤,包括去除噪声和文本规范化,然后使用集成方法进行情感分类,以确保可解释性和上下文准确性。结果通过情感分布图、比较分析以及时间趋势来可视化,从而增强其可解释性。 我们的分析揭示了大型企业之间公众情绪的重大差异:亚马逊(81.2)和三星(45.8)获得了出色的情感评分,而微软(21.7)和沃尔玛(21.9)则表现出较低的情绪评分。这些发现证明了我们多源情感框架的实用性,在提供有关公司公共形象可操作见解方面具有重要意义,使利益相关者能够根据全面的情感分析做出明智的战略决策。

URL

https://arxiv.org/abs/2504.15448

PDF

https://arxiv.org/pdf/2504.15448.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot