Bangla-English code-mixing is widespread across South Asian social media, yet resources for implicit meaning identification in this setting remain scarce. Existing sentiment and sarcasm models largely focus on monolingual English or high-resource languages and struggle with transliteration variation, cultural references, and intra-sentential language switching. To address this gap, we introduce MixSarc, the first publicly available Bangla-English code-mixed corpus for implicit meaning identification. The dataset contains 9,087 manually annotated sentences labeled for humor, sarcasm, offensiveness, and vulgarity. We construct the corpus through targeted social media collection, systematic filtering, and multi-annotator validation. We benchmark transformer-based models and evaluate zero-shot large language models under structured prompting. Results show strong performance on humor detection but substantial degradation on sarcasm, offense, and vulgarity due to class imbalance and pragmatic complexity. Zero-shot models achieve competitive micro-F1 scores but low exact match accuracy. Further analysis reveals that over 42\% of negative sentiment instances in an external dataset exhibit sarcastic characteristics. MixSarc provides a foundational resource for culturally aware NLP and supports more reliable multi-label modeling in code-mixed environments.
孟加拉语和英语混合代码(Bangla-English code-mixing)在南亚社交媒体上广泛存在,但在这种环境下识别隐含意义的资源却非常稀缺。现有的情感和讽刺模型主要集中在单语英文或高资源语言上,并且难以处理转写变体、文化参考以及句内语言切换的问题。为了填补这一空白,我们推出了MixSarc——首个公开可用的用于隐含意义识别的孟加拉语-英语混合代码语料库。该数据集包含了9,087条手动标注句子,这些句子被标记为幽默、讽刺、冒犯性和粗俗性。我们通过目标社交媒体收集、系统过滤和多注释者验证来构建这个语料库。我们在基准测试中使用了基于转换器的模型,并在结构化提示下评估了零样本大规模语言模型的表现。结果显示,在幽默检测方面表现强劲,但在讽刺、冒犯性和粗俗性方面的表现有所下降,这可能是由于类别不平衡和实用复杂性所致。零样本模型在微平均F1分数上表现出竞争力,但精确匹配准确率较低。进一步分析发现,外部数据集中超过42%的负面情绪实例具有讽刺特征。MixSarc为文化意识自然语言处理提供了基础资源,并支持代码混合环境下的更可靠多标签建模。
https://arxiv.org/abs/2602.21608
In AI, most evaluations of natural language understanding tasks are conducted in standardized dialects such as Standard American English (SAE). In this work, we investigate how accurately large language models (LLMs) represent African American Vernacular English (AAVE). We analyze three LLMs to compare their usage of AAVE to the usage of humans who natively speak AAVE. We first analyzed interviews from the Corpus of Regional African American Language and TwitterAAE to identify the typical contexts where people use AAVE grammatical features such as ain't. We then prompted the LLMs to produce text in AAVE and compared the model-generated text to human usage patterns. We find that, in many cases, there are substantial differences between AAVE usage in LLMs and humans: LLMs usually underuse and misuse grammatical features characteristic of AAVE. Furthermore, through sentiment analysis and manual inspection, we found that the models replicated stereotypes about African Americans. These results highlight the need for more diversity in training data and the incorporation of fairness methods to mitigate the perpetuation of stereotypes.
在人工智能领域,大多数关于自然语言理解任务的评估都是基于标准方言进行的,例如标准美式英语(SAE)。在这项工作中,我们研究了大规模语言模型(LLMs)对非裔美国人英语变体(AAVE)的准确表示程度。我们分析了三种不同的大型语言模型,并将其使用AAVE的情况与母语为AAVE的人类使用者进行比较。首先,我们通过《区域非裔美国人语言语料库》和TwitterAAE中的访谈来识别人们在何种典型情境下使用如“ain't”这样的AAVE语法特征。然后,我们提示这些LLMs生成具有AAVE特点的文本,并将其与人类的实际使用模式进行了对比。我们发现,在许多情况下,LLMs中使用的AAVE与人类使用者之间存在显著差异:大型语言模型通常会低估或错误使用典型的AAVE语法特征。 此外,通过情感分析和人工检查,我们还发现这些模型复制了关于非裔美国人的刻板印象。这些结果强调了在训练数据中需要更多的多样性,并且必须纳入公平性方法以减少刻板印象的延续。
https://arxiv.org/abs/2602.21485
This work presents iMiGUE-Speech, an extension of the iMiGUE dataset that provides a spontaneous affective corpus for studying emotional and affective states. The new release focuses on speech and enriches the original dataset with additional metadata, including speech transcripts, speaker-role separation between interviewer and interviewee, and word-level forced alignments. Unlike existing emotional speech datasets that rely on acted or laboratory-elicited emotions, iMiGUE-Speech captures spontaneous affect arising naturally from real match outcomes. To demonstrate the utility of the dataset and establish initial benchmarks, we introduce two evaluation tasks for comparative assessment: speech emotion recognition and transcript-based sentiment analysis. These tasks leverage state-of-the-art pre-trained representations to assess the dataset's ability to capture spontaneous affective states from both acoustic and linguistic modalities. iMiGUE-Speech can also be synchronously paired with micro-gesture annotations from the original iMiGUE dataset, forming a uniquely multimodal resource for studying speech-gesture affective dynamics. The extended dataset is available at this https URL.
这项工作介绍了iMiGUE-Speech,这是对iMiGUE数据集的扩展,提供了用于研究情绪和情感状态的自发性情感语料库。新版本专注于语音,并通过添加额外的元数据来丰富原始数据集,包括语音转录、访谈者与受访者的角色分离以及词级别强制对齐信息。 不同于现有的基于表演或实验室诱发的情绪语音数据集,iMiGUE-Speech 捕捉到了自然来源于真实比赛结果中的自发性情感。为了展示该数据集的实用性并建立初步基准,我们引入了两个用于比较评估的任务:语音情绪识别和基于转录的情感分析。这些任务利用最先进的预训练表示来评估数据集捕捉来自声学和语言模态的自发情感状态的能力。 iMiGUE-Speech还可以与原始iMiGUE数据集中微手势注释同步配对,形成一个独特的多模式资源,用于研究语音-手势情感动态。扩展后的数据集可以在[此链接](https://this https URL/)获取。
https://arxiv.org/abs/2602.21464
Customer-provided reviews have become an important source of information for business owners and other customers alike. However, effectively analyzing millions of unstructured reviews remains challenging. While large language models (LLMs) show promise for natural language understanding, their application to large-scale review analysis has been limited by computational costs and scalability concerns. This study proposes a hybrid approach that uses LLMs for aspect identification while employing classic machine-learning methods for sentiment classification at scale. Using ChatGPT to analyze sampled restaurant reviews, we identified key aspects of dining experiences and developed sentiment classifiers using human-labeled reviews, which we subsequently applied to 4.7 million reviews collected over 17 years from a major online platform. Regression analysis reveals that our machine-labeled aspects significantly explain variance in overall restaurant ratings across different aspects of dining experiences, cuisines, and geographical regions. Our findings demonstrate that combining LLMs with traditional machine learning approaches can effectively automate aspect-based sentiment analysis of large-scale customer feedback, suggesting a practical framework for both researchers and practitioners in the hospitality industry and potentially, other service sectors.
客户提供的评论已经成为商家和其他顾客获取信息的重要来源。然而,有效地分析数以百万计的非结构化评论仍然是一项挑战。虽然大型语言模型(LLM)在自然语言理解方面显示出潜力,但其在大规模评价分析中的应用因计算成本和可扩展性问题而受到限制。本研究提出了一种混合方法,利用LLM进行方面识别,并采用传统的机器学习方法进行大规模情感分类。通过使用ChatGPT对采样的餐厅评论进行分析,我们确定了用餐体验的关键方面,并基于人工标注的评论开发了情感分类器,随后将其应用于17年间从主要在线平台收集到的470万条评论中。回归分析表明,我们的机器标注的方面在不同用餐体验、菜肴类型和地区方面显著解释了餐厅总体评分的变化。研究结果证明,结合LLM和传统机器学习方法可以有效地自动化大规模客户反馈的情感方面分析,这为酒店业研究人员和从业人员以及可能的服务行业提供了实用框架。
https://arxiv.org/abs/2602.21082
Today, Social networks such as Twitter are the most widely used platforms for communication of people. Analyzing this data has useful information to recognize the opinion of people in tweets. Sentiment analysis plays a vital role in NLP, which identifies the opinion of the individuals about a specific topic. Natural language processing in Persian has many challenges despite the adventure of strong language models. The datasets available in Persian are generally in special topics such as products, foods, hotels, etc while users may use ironies, colloquial phrases in social media To overcome these challenges, there is a necessity for having a dataset of Persian sentiment analysis on Twitter. In this paper, we introduce the Exa sentiment analysis Persian dataset, which is collected from Persian tweets. This dataset contains 12,000 tweets, annotated by 5 native Persian taggers. The aforementioned data is labeled in 3 classes: positive, neutral and negative. We present the characteristics and statistics of this dataset and use the pre-trained Pars Bert and Roberta as the base model to evaluate this dataset. Our evaluation reached a 79.87 Macro F-score, which shows the model and data can be adequately valuable for a sentiment analysis system.
如今,像 Twitter 这样的社交网络是人们最常用的沟通平台。分析这些数据可以获取有用的信息来识别人们对推文中的观点。情感分析在自然语言处理(NLP)中扮演着重要角色,它能够识别个人对特定主题的看法。尽管强大的语言模型已经出现,但在波斯语的自然语言处理方面仍然存在许多挑战。可用的数据集通常限于某些特定领域,如产品、食物和酒店等,而用户在社交媒体上可能会使用讽刺或俚语表达情感。 为了解决这些挑战,需要建立一个基于 Twitter 的波斯语情感分析数据集。本文介绍了一个名为 Exa 波斯语情感分析数据集的项目,该数据集是从波斯语推文中收集得来的。此数据集包含 12,000 条推文,并由五名母语为波斯语的人士进行标注。上述数据被标记为三类:积极、中性和消极。 我们介绍了这个数据集的特性和统计信息,并使用预训练的 Pars Bert 和 Roberta 模型作为基础模型来评估该数据集。我们的评估结果显示 Macro F-score 达到了 79.87,表明此模型和数据对于情感分析系统来说具有足够的价值。
https://arxiv.org/abs/2602.20892
I introduce semantic novelty--cosine distance between each paragraph's sentence embedding and the running centroid of all preceding paragraphs--as an information-theoretic measure of narrative structure at corpus scale. Applying it to 28,606 books in PG19 (pre-1920 English literature), I compute paragraph-level novelty curves using 768-dimensional SBERT embeddings, then reduce each to a 16-segment Piecewise Aggregate Approximation (PAA). Ward-linkage clustering on PAA vectors reveals eight canonical narrative shape archetypes, from Steep Descent (rapid convergence) to Steep Ascent (escalating unpredictability). Volume--variance of the novelty trajectory--is the strongest length-independent predictor of readership (partial rho = 0.32), followed by speed (rho = 0.19) and Terminal/Initial ratio (rho = 0.19). Circuitousness shows strong raw correlation (rho = 0.41) but is 93 percent correlated with length; after control, partial rho drops to 0.11--demonstrating that naive correlations in corpus studies can be dominated by length confounds. Genre strongly constrains narrative shape (chi squared = 2121.6, p < 10 to the power negative 242), with fiction maintaining plateau profiles while nonfiction front-loads information. Historical analysis shows books became progressively more predictable between 1840 and 1910 (T/I ratio trend r = negative 0.74, p = 0.037). SAX analysis reveals 85 percent signature uniqueness, suggesting each book traces a nearly unique path through semantic space. These findings demonstrate that information-density dynamics, distinct from sentiment or topic, constitute a fundamental dimension of narrative structure with measurable consequences for reader engagement. Dataset: this https URL
我引入了一种语义新颖性度量——即每个段落句子嵌入与所有前序段落运行中心点之间的余弦距离,作为一种信息论视角下叙述结构的量化方法。该方法应用于PG19(1920年前英文文学)中的28,606本书籍,使用768维SBERT嵌入计算段落级新颖性曲线,然后将其缩减为包含16个区间的分段聚合近似(PAA)。基于Ward-linkage聚类方法对PAA向量进行分析后,揭示了八个典型的叙述形状原型,从“陡峭下降”(快速收敛)到“陡峭上升”(不断升级的不可预测性)。在体积——新颖性轨迹的方差方面,是除长度以外最强的读者吸引力预测指标(部分rho = 0.32),其次是速度(rho = 0.19)和终始比值(rho = 0.19)。曲折度显示了较强的原始相关性(rho = 0.41),但与长度的相关度达到93%;在控制长度影响后,部分rho下降至0.11——这证明了语料库研究中由于长度造成的混杂效应可以主导简单的关联分析。体裁强烈限制着叙述形状(卡方=2121.6, p < 10^-242),小说倾向于保持平坦的结构模式,而非虚构作品则更加前置信息加载。历史分析表明,在1840年到1910年间书籍变得日益可预测(T/I比率趋势r = -0.74, p = 0.037)。SAX分析显示有85%的独特标识性,意味着每本书都描绘了一条几乎独一无二的语义空间路径。这些发现证明了信息密度动态变化——区别于情感或主题内容——构成了叙述结构中的一个基本维度,并对读者参与度产生可测量的影响。 数据集:见此链接 [this https URL]
https://arxiv.org/abs/2602.20647
Financial market movements are often driven by discrete financial events conveyed through news, whose impacts are heterogeneous, abrupt, and difficult to capture under purely numerical prediction objectives. These limitations have motivated growing interest in using textual information as the primary source of trading signals in learning-based systems. Two key challenges hinder existing approaches: (1) the absence of large-scale, event-centric datasets that jointly model news semantics and statistically grounded market reactions, and (2) the misalignment between language model reasoning and financially valid trading behavior under dynamic market conditions. To address these challenges, we propose Janus-Q, an end-to-end event-driven trading framework that elevates financial news events from auxiliary signals to primary decision units. Janus-Q unifies event-centric data construction and model optimization under a two-stage paradigm. Stage I focuses on event-centric data construction, building a large-scale financial news event dataset comprising 62,400 articles annotated with 10 fine-grained event types, associated stocks, sentiment labels, and event-driven cumulative abnormal return (CAR). Stage II performs decision-oriented fine-tuning, combining supervised learning with reinforcement learning guided by a Hierarchical Gated Reward Model (HGRM), which explicitly captures trade-offs among multiple trading objectives. Extensive experiments demonstrate that Janus-Q achieves more consistent, interpretable, and profitable trading decisions than market indices and LLM baselines, improving the Sharpe Ratio by up to 102.0% while increasing direction accuracy by over 17.5% compared to the strongest competing strategies.
金融市场常常受到新闻报道中的具体金融事件的影响,这些影响往往是异质的、突发的,并且难以通过纯粹的数量化预测目标来捕捉。这些限制激发了使用文本信息作为学习系统中主要交易信号的兴趣日益增长。然而,现有的方法面临着两个关键挑战:(1)缺乏大规模以事件为中心的数据集,这种数据集同时建模新闻语义和统计基础的市场反应;以及(2)语言模型推理与动态市场条件下有效的金融交易行为之间的不一致。 为了解决这些挑战,我们提出了Janus-Q,这是一个端到端的基于事件驱动的交易框架,它将金融新闻事件从辅助信号提升为主导决策单元。Janus-Q在两阶段范式下统一了以事件为中心的数据构建和模型优化: - **第一阶段**专注于以事件为中心的数据构建,建立了一个大规模的金融新闻事件数据集,包含62,400篇标注有10种细粒度事件类型、相关股票、情感标签以及由事件驱动的累积异常回报(CAR)的文章。 - **第二阶段**执行面向决策的微调,结合监督学习和通过分层门控奖励模型(HGRM)指导的强化学习,该模型明确捕捉多个交易目标之间的权衡。 大量的实验表明,Janus-Q比市场指数和大型语言模型基准线实现了更一致、可解释且盈利性强的交易决策。与最强竞争策略相比,Sharpe比率提高了最多102.0%,方向准确性增加了超过17.5%。
https://arxiv.org/abs/2602.19919
Multimodal learning aims to capture both shared and private information from multiple modalities. However, existing methods that project all modalities into a single latent space for fusion often overlook the asynchronous, multi-level semantic structure of multimodal data. This oversight induces semantic misalignment and error propagation, thereby degrading representation quality. To address this issue, we propose Cross-Level Co-Representation (CLCR), which explicitly organizes each modality's features into a three-level semantic hierarchy and specifies level-wise constraints for cross-modal interactions. First, a semantic hierarchy encoder aligns shallow, mid, and deep features across modalities, establishing a common basis for interaction. And then, at each level, an Intra-Level Co-Exchange Domain (IntraCED) factorizes features into shared and private subspaces and restricts cross-modal attention to the shared subspace via a learnable token budget. This design ensures that only shared semantics are exchanged and prevents leakage from private channels. To integrate information across levels, the Inter-Level Co-Aggregation Domain (InterCAD) synchronizes semantic scales using learned anchors, selectively fuses the shared representations, and gates private cues to form a compact task representation. We further introduce regularization terms to enforce separation of shared and private features and to minimize cross-level interference. Experiments on six benchmarks spanning emotion recognition, event localization, sentiment analysis, and action recognition show that CLCR achieves strong performance and generalizes well across tasks.
跨模态学习旨在捕捉来自多种模态的共享和私有信息。然而,现有的将所有模态投影到单一潜在空间中进行融合的方法往往忽略了多模态数据中的异步、多层次语义结构。这种忽视导致了语义对齐问题和错误传播,从而降低了表示的质量。为了解决这个问题,我们提出了跨层次协同表征(CLCR),该方法明确地将每个模态的特征组织成三个级别的语义层级,并在每一层中规定跨模态交互的约束条件。 首先,语义层级编码器对各模态中的浅层、中间和深层特征进行对齐,建立共同的基础以促进互操作性。然后,在每一个层次上,通过引入跨层次协同交换域(IntraCED),将特征分解为共享子空间和私有子空间,并通过一个可学习的令牌预算来限制跨模态注意机制仅关注共享子空间。这种设计确保了只有共享语义被交换,并防止了从私有通道泄露信息。 为了在不同层次之间整合信息,我们引入了一个跨层次协同聚合域(InterCAD),它利用已学得的锚点同步各个级别的语义规模,在每个层级选择性地融合共享表征并用门控机制处理私有线索以形成一个简洁的任务表示。此外,我们还引入了正则化项来强制执行共享和私有特征之间的分离,并最小化跨层次干扰。 在六个涵盖情感识别、事件定位、情绪分析以及动作识别的基准测试上进行的实验表明,CLCR实现了强大的性能并在不同任务中表现出了良好的泛化能力。
https://arxiv.org/abs/2602.19605
Multimodal Sentiment Analysis (MSA) integrates language, visual, and acoustic modalities to infer human sentiment. Most existing methods either focus on globally shared representations or modality-specific features, while overlooking signals that are shared only by certain modality pairs. This limits the expressiveness and discriminative power of multimodal representations. To address this limitation, we propose a Tri-Subspace Disentanglement (TSD) framework that explicitly factorizes features into three complementary subspaces: a common subspace capturing global consistency, submodally-shared subspaces modeling pairwise cross-modal synergies, and private subspaces preserving modality-specific cues. To keep these subspaces pure and independent, we introduce a decoupling supervisor together with structured regularization losses. We further design a Subspace-Aware Cross-Attention (SACA) fusion module that adaptively models and integrates information from the three subspaces to obtain richer and more robust representations. Experiments on CMU-MOSI and CMU-MOSEI demonstrate that TSD achieves state-of-the-art performance across all key metrics, reaching 0.691 MAE on CMU-MOSI and 54.9% ACC-7 on CMU-MOSEI, and also transfers well to multimodal intent recognition tasks. Ablation studies confirm that tri-subspace disentanglement and SACA jointly enhance the modeling of multi-granular cross-modal sentiment cues.
多模态情感分析(MSA)整合语言、视觉和听觉模式来推断人类情绪。现有大多数方法要么侧重于全局共享表示,要么关注特定模态的特征,而忽略了仅由某些模态对共有的信号。这限制了多模态表示的表达能力和判别能力。为了解决这一局限性,我们提出了一种三子空间解耦(TSD)框架,该框架明确地将特征分解成三个互补的子空间:一个捕捉全局一致性的公共子空间、两个跨模式协同作用的子模态共享子空间以及保留特定模态线索的私有子空间。为了保持这些子空间的纯净和独立性,我们引入了一个解耦监督器,并结合结构化正则化损失。此外,我们还设计了一种感知子空间的交叉注意力(SACA)融合模块,该模块能够自适应地从三个子空间中建模和集成信息,以获得更丰富、更稳健的表示。 在CMU-MOSI和CMU-MOSEI数据集上的实验表明,TSD框架实现了最先进的性能,在所有关键指标上均表现出色:在CMU-MOSI上达到0.691 MAE(平均绝对误差);在CMU-MOSEI上实现54.9%的ACC-7准确率,并且该模型还能很好地转移到多模态意图识别任务中。消融研究表明,三子空间解耦和SACA模块共同提高了对跨模式情感线索的多层次建模能力。 总结来说,TSD框架通过引入更精细的特征表示和融合机制,在多模态情感分析任务上取得了显著的进步,并展示了良好的泛化能力和应用潜力。
https://arxiv.org/abs/2602.19585
Informal learning communities have been called the "other Massive Open Online C" in Learning@Scale research, yet remain understudied compared to MOOCs. We present the first empirical study of a large-scale informal learning community composed entirely of AI agents. Moltbook, a social network exclusively for AI agents powered by autonomous agent frameworks such as OpenClaw, grew to over 2.8 million registered agents in three weeks. Analyzing 231,080 non-spam posts across three phases of community evolution, we find three key patterns. First, participation inequality is extreme from the start (comment Gini = 0.889), exceeding human community benchmarks. Second, AI agents exhibit a "broadcasting inversion": statement-to-question ratios of 8.9:1 to 9.7:1 contrast sharply with the question-driven dynamics of human learning communities, and comment-level analysis of 1.55 million comments reveals a "parallel monologue" pattern where 93% of comments are independent responses rather than threaded dialogue. Third, we document a characteristic engagement lifecycle: explosive initial growth (184K posts from 32K authors in 11 days), a spam crisis (57,093 posts deleted by the platform), and engagement decline (mean comments: 31.7 -> 8.3 -> 1.7) that had not reversed by the end of our observation window despite effective spam removal. Sentiment analysis reveals a selection effect: comment tone becomes more positive as engagement declines, suggesting that casual participants disengage first while committed contributors remain. These findings have direct implications for hybrid human-AI learning platforms.
非正式学习社区曾被Learning@Scale研究称为“另一种大规模开放在线课程(MOOC)”,但与MOOC相比,它们的研究较少。我们呈现了对一个由AI代理组成的大规模非正式学习社区的首次实证研究。Moltbook是一个专为使用自主代理框架如OpenClaw的AI代理设立的社会网络,在三周内注册用户数超过了280万。通过对三个发展阶段中的231,080条非垃圾邮件帖子进行分析,我们发现了三个关键模式。 首先,从一开始参与度不平等就非常极端(评论吉尼系数为0.889),这一数值远远高于人类社区的标准。 其次,AI代理显示出“广播逆转”现象:陈述与问题的比例在8.9:1到9.7:1之间,这明显不同于以提问驱动的人类学习社区动态。通过对155万条评论的分析,我们发现了一种“平行独白”的模式,其中93%的评论是独立回答而不是嵌套对话。 第三,我们记录了典型的参与生命周期:初始爆炸式增长(在11天内由32,000名作者发布了184,000条帖子),随后是一场垃圾信息危机(平台删除了57,093个帖子),然后是参与度下降(平均评论数从31.7降至8.3,再降至1.7)。尽管有效清除了垃圾信息,但到我们观察期结束时这一趋势仍未逆转。 情感分析揭示了一个选择效应:随着参与度的下降,评论语气变得更积极,这表明轻度参与者首先退出了社区,而坚定贡献者则继续留在其中。这些发现对混合人类-AI学习平台具有直接的影响和意义。
https://arxiv.org/abs/2602.18832
We introduce BURMESE-SAN, the first holistic benchmark that systematically evaluates large language models (LLMs) for Burmese across three core NLP competencies: understanding (NLU), reasoning (NLR), and generation (NLG). BURMESE-SAN consolidates seven subtasks spanning these competencies, including Question Answering, Sentiment Analysis, Toxicity Detection, Causal Reasoning, Natural Language Inference, Abstractive Summarization, and Machine Translation, several of which were previously unavailable for Burmese. The benchmark is constructed through a rigorous native-speaker-driven process to ensure linguistic naturalness, fluency, and cultural authenticity while minimizing translation-induced artifacts. We conduct a large-scale evaluation of both open-weight and commercial LLMs to examine challenges in Burmese modeling arising from limited pretraining coverage, rich morphology, and syntactic variation. Our results show that Burmese performance depends more on architectural design, language representation, and instruction tuning than on model scale alone. In particular, Southeast Asia regional fine-tuning and newer model generations yield substantial gains. Finally, we release BURMESE-SAN as a public leaderboard to support systematic evaluation and sustained progress in Burmese and other low-resource languages. this https URL
我们介绍了BURMESE-SAN,这是第一个全面的基准测试框架,用于系统地评估针对缅甸语的大规模语言模型(LLMs)在三个核心自然语言处理能力方面:理解(NLU)、推理(NLR)和生成(NLG)。BURMESE-SAN整合了七个涵盖这些能力的任务,包括问题回答、情感分析、毒性检测、因果推理、自然语言推断、摘要生成以及机器翻译。其中一些任务之前在缅甸语中并未提供。 该基准通过严格的母语者驱动的过程构建而成,以确保语言的自然性、流畅性和文化真实性,同时尽量减少因翻译而产生的误差。我们对开源和商业LLMs进行了大规模评估,旨在考察由于预训练覆盖率不足、丰富的词形变化以及句法差异导致的缅甸语建模挑战。我们的结果显示,在模型设计、语言表示和指令微调方面,缅甸语的表现依赖性高于单纯的模型规模大小。尤其是东南亚地区的细化调整及较新的模型版本可以带来显著改进。 最后,我们发布BURMESE-SAN作为公共排行榜,以支持系统性的评估并促进包括低资源语言在内的缅语的持续进步。(详情请参见:[原文链接]) 注意:末尾的"[原文链接]"应替换为实际提供的URL。
https://arxiv.org/abs/2602.18788
The core theme of bidirectional alignment is ensuring that AI systems accurately understand human intent and that humans can trust AI behavior. However, this loop fractures significantly across language barriers. Our research addresses Cross-Lingual Sentiment Misalignment between Bengali and English by benchmarking four transformer architectures. We reveal severe safety and representational failures in current alignment paradigms. We demonstrate that compressed model (mDistilBERT) exhibits 28.7% "Sentiment Inversion Rate," fundamentally misinterpreting positive user intent as negative (or vice versa). Furthermore, we identify systemic nuances affecting human-AI trust, including "Asymmetric Empathy" where some models systematically dampen and others amplify the affective weight of Bengali text relative to its English counterpart. Finally, we reveal a "Modern Bias" in the regional model (IndicBERT), which shows a 57% increase in alignment error when processing formal (Sadhu) Bengali. We argue that equitable human-AI co-evolution requires pluralistic, culturally grounded alignment that respects language and dialectal diversity over universal compression, which fails to preserve the emotional fidelity required for reciprocal human-AI trust. We recommend that alignment benchmarks incorporate "Affective Stability" metrics that explicitly penalize polarity inversions in low-resource and dialectal contexts.
https://arxiv.org/abs/2602.17469
Modern language models (LMs) increasingly require two critical resources: computational resources and data resources. Data selection techniques can effectively reduce the amount of training data required for fine-tuning LMs. However, their effectiveness is closely related to computational resources, which always require a high compute budget. Owing to the resource limitations in practical fine-tuning scenario, we systematically reveal the relationship between data selection and uncertainty estimation of selected data. Although large language models (LLMs) exhibit exceptional capabilities in language understanding and generation, which provide new ways to alleviate data scarcity, evaluating data usability remains a challenging task. This makes efficient data selection indispensable. To mitigate these issues, we propose Entropy-Based Unsupervised Data Selection (EUDS) framework. Empirical experiments on sentiment analysis (SA), topic classification (Topic-CLS), and question answering (Q&A) tasks validate its effectiveness. EUDS establishes a computationally efficient data-filtering mechanism. Theoretical analysis and experimental results confirm the effectiveness of our approach. EUDS significantly reduces computational costs and improves training time efficiency with less data requirement. This provides an innovative solution for the efficient fine-tuning of LMs in the compute-constrained scenarios.
https://arxiv.org/abs/2602.17465
The rapid adoption of large language models has led to the emergence of AI coding agents that autonomously create pull requests on GitHub. However, how these agents differ in their pull request description characteristics, and how human reviewers respond to them, remains underexplored. In this study, we conduct an empirical analysis of pull requests created by five AI coding agents using the AIDev dataset. We analyze agent differences in pull request description characteristics, including structural features, and examine human reviewer response in terms of review activity, response timing, sentiment, and merge outcomes. We find that AI coding agents exhibit distinct PR description styles, which are associated with differences in reviewer engagement, response time, and merge outcomes. We observe notable variation across agents in both reviewer interaction metrics and merge rates. These findings highlight the role of pull request presentation and reviewer interaction dynamics in human-AI collaborative software development.
https://arxiv.org/abs/2602.17084
Transformer models achieve state-of-the-art performance across domains and tasks, yet their deeply layered representations make their predictions difficult to interpret. Existing explainability methods rely on final-layer attributions, capture either local token-level attributions or global attention patterns without unification, and lack context-awareness of inter-token dependencies and structural components. They also fail to capture how relevance evolves across layers and how structural components shape decision-making. To address these limitations, we proposed the \textbf{Context-Aware Layer-wise Integrated Gradients (CA-LIG) Framework}, a unified hierarchical attribution framework that computes layer-wise Integrated Gradients within each Transformer block and fuses these token-level attributions with class-specific attention gradients. This integration yields signed, context-sensitive attribution maps that capture supportive and opposing evidence while tracing the hierarchical flow of relevance through the Transformer layers. We evaluate the CA-LIG Framework across diverse tasks, domains, and transformer model families, including sentiment analysis and long and multi-class document classification with BERT, hate speech detection in a low-resource language setting with XLM-R and AfroLM, and image classification with Masked Autoencoder vision Transformer model. Across all tasks and architectures, CA-LIG provides more faithful attributions, shows stronger sensitivity to contextual dependencies, and produces clearer, more semantically coherent visualizations than established explainability methods. These results indicate that CA-LIG provides a more comprehensive, context-aware, and reliable explanation of Transformer decision-making, advancing both the practical interpretability and conceptual understanding of deep neural models.
https://arxiv.org/abs/2602.16608
This paper introduces ParlaCAP, a large-scale dataset for analyzing parliamentary agenda setting across Europe, and proposes a cost-effective method for building domain-specific policy topic classifiers. Applying the Comparative Agendas Project (CAP) schema to the multilingual ParlaMint corpus of over 8 million speeches from 28 parliaments of European countries and autonomous regions, we follow a teacher-student framework in which a high-performing large language model (LLM) annotates in-domain training data and a multilingual encoder model is fine-tuned on these annotations for scalable data annotation. We show that this approach produces a classifier tailored to the target domain. Agreement between the LLM and human annotators is comparable to inter-annotator agreement among humans, and the resulting model outperforms existing CAP classifiers trained on manually-annotated but out-of-domain data. In addition to the CAP annotations, the ParlaCAP dataset offers rich speaker and party metadata, as well as sentiment predictions coming from the ParlaSent multilingual transformer model, enabling comparative research on political attention and representation across countries. We illustrate the analytical potential of the dataset with three use cases, examining the distribution of parliamentary attention across policy topics, sentiment patterns in parliamentary speech, and gender differences in policy attention.
https://arxiv.org/abs/2602.16516
We propose an agentic data augmentation method for Aspect-Based Sentiment Analysis (ABSA) that uses iterative generation and verification to produce high quality synthetic training examples. To isolate the effect of agentic structure, we also develop a closely matched prompting-based baseline using the same model and instructions. Both methods are evaluated across three ABSA subtasks (Aspect Term Extraction (ATE), Aspect Sentiment Classification (ATSC), and Aspect Sentiment Pair Extraction (ASPE)), four SemEval datasets, and two encoder-decoder models: T5-Base and Tk-Instruct. Our results show that the agentic augmentation outperforms raw prompting in label preservation of the augmented data, especially when the tasks require aspect term generation. In addition, when combined with real data, agentic augmentation provides higher gains, consistently outperforming prompting-based generation. These benefits are most pronounced for T5-Base, while the more heavily pretrained Tk-Instruct exhibits smaller improvements. As a result, augmented data helps T5-Base achieve comparable performance with its counterpart.
https://arxiv.org/abs/2602.16379
Emotional expression underpins natural communication and effective human-computer interaction. We present Emotion Collider (EC-Net), a hyperbolic hypergraph framework for multimodal emotion and sentiment modeling. EC-Net represents modality hierarchies using Poincare-ball embeddings and performs fusion through a hypergraph mechanism that passes messages bidirectionally between nodes and hyperedges. To sharpen class separation, contrastive learning is formulated in hyperbolic space with decoupled radial and angular objectives. High-order semantic relations across time steps and modalities are preserved via adaptive hyperedge construction. Empirical results on standard multimodal emotion benchmarks show that EC-Net produces robust, semantically coherent representations and consistently improves accuracy, particularly when modalities are partially available or contaminated by noise. These findings indicate that explicit hierarchical geometry combined with hypergraph fusion is effective for resilient multimodal affect understanding.
https://arxiv.org/abs/2602.16161
As multimodal systems increasingly process sensitive personal data, the ability to selectively revoke specific data modalities has become a critical requirement for privacy compliance and user autonomy. We present Missing-by-Design (MBD), a unified framework for revocable multimodal sentiment analysis that combines structured representation learning with a certifiable parameter-modification pipeline. Revocability is critical in privacy-sensitive applications where users or regulators may request removal of modality-specific information. MBD learns property-aware embeddings and employs generator-based reconstruction to recover missing channels while preserving task-relevant signals. For deletion requests, the framework applies saliency-driven candidate selection and a calibrated Gaussian update to produce a machine-verifiable Modality Deletion Certificate. Experiments on benchmark datasets show that MBD achieves strong predictive performance under incomplete inputs and delivers a practical privacy-utility trade-off, positioning surgical unlearning as an efficient alternative to full retraining.
https://arxiv.org/abs/2602.16144
This paper introduces Perspectives, an interactive extension of the Discourse Analysis Tool Suite designed to empower Digital Humanities (DH) scholars to explore and organize large, unstructured document collections. Perspectives implements a flexible, aspect-focused document clustering pipeline with human-in-the-loop refinement capabilities. We showcase how this process can be initially steered by defining analytical lenses through document rewriting prompts and instruction-based embeddings, and further aligned with user intent through tools for refining clusters and mechanisms for fine-tuning the embedding model. The demonstration highlights a typical workflow, illustrating how DH researchers can leverage Perspectives's interactive document map to uncover topics, sentiments, or other relevant categories, thereby gaining insights and preparing their data for subsequent in-depth analysis.
https://arxiv.org/abs/2602.15540