Paper Reading AI Learner

Bug Destiny Prediction in Large Open-Source Software Repositories through Sentiment Analysis and BERT Topic Modeling

2025-04-22 15:18:14
Sophie C. Pope, Andrew Barovic, Armin Moin

Abstract

This study explores a novel approach to predicting key bug-related outcomes, including the time to resolution, time to fix, and ultimate status of a bug, using data from the Bugzilla Eclipse Project. Specifically, we leverage features available before a bug is resolved to enhance predictive accuracy. Our methodology incorporates sentiment analysis to derive both an emotionality score and a sentiment classification (positive or negative). Additionally, we integrate the bug's priority level and its topic, extracted using a BERTopic model, as features for a Convolutional Neural Network (CNN) and a Multilayer Perceptron (MLP). Our findings indicate that the combination of BERTopic and sentiment analysis can improve certain model performance metrics. Furthermore, we observe that balancing model inputs enhances practical applicability, albeit at the cost of a significant reduction in accuracy in most cases. To address our primary objectives, predicting time-to-resolution, time-to-fix, and bug destiny, we employ both binary classification and exact time value predictions, allowing for a comparative evaluation of their predictive effectiveness. Results demonstrate that sentiment analysis serves as a valuable predictor of a bug's eventual outcome, particularly in determining whether it will be fixed. However, its utility is less pronounced when classifying bugs into more complex or unconventional outcome categories.

Abstract (translated)

这项研究探索了一种新颖的方法,用于预测与软件缺陷相关的关键结果,包括解决时间、修复时间和最终状态。该方法利用了来自Bugzilla Eclipse项目的数据,并且采用了在问题解决之前可用的特征来提高预测准确性。我们的方法采用情感分析技术以得出情感性评分和正负面情绪分类,同时结合使用BERTopic模型提取的优先级和话题作为卷积神经网络(CNN)和多层感知机(MLP)的输入特征。 研究结果表明,将BERTopic与情感分析相结合可以在某些性能指标上提升模型表现。此外,平衡模型输入以增强其实用性虽在大多数情况下会导致准确性显著降低,但这是必要的步骤。为了实现主要目标——预测解决时间、修复时间和缺陷最终状态,我们采用了二元分类和精确时间值预测的方法,并允许对它们的预测效果进行比较评估。 结果表明,情感分析能够作为预测软件缺陷最终结局的有效工具,特别是在确定该问题是否会被修复方面尤其有效。然而,在将缺陷归类为更复杂或非传统的结果类别时,其效用显得相对较低。

URL

https://arxiv.org/abs/2504.15972

PDF

https://arxiv.org/pdf/2504.15972.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot