Abstract
This paper studies whether a lightweight trained aggregator can combine diverse zero-shot large language model judgments into a stronger downstream signal for corporate disclosure classification. Zero-shot LLMs can read disclosures without task-specific fine-tuning, but their predictions often vary across prompts, reasoning styles, and model families. I address this problem with a multi-agent framework in which three zero-shot agents independently read each disclosure and output a sentiment label, a confidence score, and a short rationale. A logistic meta-classifier then aggregates these signals to predict next-day stock return direction. I use a sample of 18,420 U.S. corporate disclosures issued by Nasdaq and S&P 500 firms between 2018 and 2024, matched to next-day stock returns. Results show that the trained aggregator outperforms all single agents, majority vote, confidence-weighted voting, and a FinBERT baseline. Balanced accuracy rises from 0.561 for the best single agent to 0.612 for the trained aggregator, with the largest gains in disclosures combining strong current performance with weak guidance or elevated risk. The results suggest that zero-shot LLM agents capture complementary financial signals and that supervised aggregation can turn cross-agent disagreement into a more useful classification target.
Abstract (translated)
本文研究轻量级训练聚合器能否将多样化的零样本大语言模型判断整合为更强的企业披露分类下游信号。零样本大语言模型无需任务特定微调即可阅读披露文件,但其预测结果常因提示词、推理方式和模型架构不同而产生差异。本文通过多智能体框架解决此问题:三个零样本智能体独立阅读每份披露文件,分别输出情感标签、置信度评分及简要推理依据,随后逻辑回归元分类器聚合这些信号以预测次日股价涨跌方向。研究采用2018至2024年间纳斯达克及标普500企业发布的18,420份美国企业披露文件样本,并与次日股价回报进行匹配。结果表明,训练聚合器表现优于所有单一智能体、多数投票、置信度加权投票及FinBERT基线模型。平衡准确率从最佳单一智能体的0.561提升至训练聚合器的0.612,其中在同时呈现强劲当前业绩与薄弱指引或较高风险的披露文件中提升最为显著。研究证实零样本大语言模型智能体可捕捉互补性金融信号,且监督聚合能将跨智能体分歧转化为更有效的分类目标。
URL
https://arxiv.org/abs/2603.20965