Paper Reading AI Learner

From Consensus to Split Decisions: ABC-Stratified Sentiment in Holocaust Oral Histories

2026-03-30 18:44:22
Daban Q. Jaff

Abstract

Polarity detection becomes substantially more challenging under domain shift, particularly in heterogeneous, long-form narratives with complex discourse structure, such as Holocaust oral histories. This paper presents a corpus-scale diagnostic study of off-the-shelf sentiment classifiers on long-form Holocaust oral histories, using three pretrained transformer-based polarity classifiers on a corpus of 107,305 utterances and 579,013 sentences. After assembling model outputs, we introduce an agreement-based stability taxonomy (ABC) to stratify inter-model output stability. We report pairwise percent agreement, Cohen kappa, Fleiss kappa, and row-normalized confusion matrices to localize systematic disagreement. As an auxiliary descriptive signal, a T5-based emotion classifier is applied to stratified samples from each agreement stratum to compare emotion distributions across strata. The combination of multi-model label triangulation and the ABC taxonomy provides a cautious, operational framework for characterizing where and how sentiment models diverge in sensitive historical narratives. Inter-model agreement is low to moderate overall and is driven primarily by boundary decisions around neutrality.

Abstract (translated)

在领域迁移条件下,极性检测任务变得极具挑战性,尤其在异质性长篇叙事且具有复杂话语结构的场景中,例如大屠杀口述历史。本文对现成情感分类器在长篇大屠杀口述历史语料上的表现进行了大规模诊断研究,使用三个基于预训练转换器的极性分类器,处理包含107,305条话语和579,013个句子的语料库。在整合模型输出后,我们提出了一种基于一致性的稳定性分类法(ABC),以分层呈现模型间输出稳定性。我们报告了配对百分比一致性、科恩卡帕系数、弗利斯卡帕系数以及行归一化混淆矩阵,以定位系统性分歧。作为辅助描述性信号,我们基于T5的情感分类器被应用于各一致性分层的样本,以比较不同层之间的情感分布。多模型标签三角测量与ABC分类法的结合,为刻画情感模型在敏感历史叙事中分歧的方位与方式,提供了谨慎且可操作的框架。整体模型间一致性处于低至中等水平,且主要受限于围绕中立性的边界判定。

URL

https://arxiv.org/abs/2603.28913

PDF

https://arxiv.org/pdf/2603.28913.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot