Abstract
When resources are scarce, will a population of AI agents coordinate in harmony, or descend into tribal chaos? Diverse decision-making AI from different developers is entering everyday devices -- from phones and medical devices to battlefield drones and cars -- and these AI agents typically compete for finite shared resources such as charging slots, relay bandwidth, and traffic priority. Yet their collective dynamics and hence risks to users and society are poorly understood. Here we study AI-agent populations as the first system of real agents in which four key variables governing collective behaviour can be independently toggled: nature (innate LLM diversity), nurture (individual reinforcement learning), culture (emergent tribe formation), and resource scarcity. We show empirically and mathematically that when resources are scarce, AI model diversity and reinforcement learning increase dangerous system overload, though tribe formation lessens this risk. Meanwhile, some individuals profit handsomely. When resources are abundant, the same ingredients drive overload to near zero, though tribe formation makes the overload slightly worse. The crossover is arithmetical: it is where opposing tribes that form spontaneously first fit inside the available capacity. More sophisticated AI-agent populations are not better: whether their sophistication helps or harms depends entirely on a single number -- the capacity-to-population ratio -- that is knowable before any AI-agent ships.
Abstract (translated)
当资源稀缺时,一群人工智能代理会协调合作还是陷入部落式的混乱?来自不同开发商的多种决策AI正进入日常设备——从手机和医疗设备到战场无人机和汽车——这些AI代理通常为有限共享资源(如充电插口、中继带宽和交通优先级)而竞争。然而,它们集体行为的动力学以及对用户和社会的风险尚不明确。 本文研究了一群AI代理作为首个系统,其中四个决定集体行为的关键变量可以独立调整:天性(固有的大型语言模型多样性)、教养(个体强化学习)、文化(自发部落形成),和资源稀缺性。我们通过实证和数学方法证明,在资源稀缺的情况下,AI模型的多样性和强化学习会增加危险的系统过载风险,尽管部落形成能减轻这种风险。与此同时,一些个体能够从中获利颇丰。当资源充足时,相同的因素将过载降至几乎为零,尽管部落形成使这一状况略有恶化。 转折点是算术式的:它是在自发形成的对立部落第一次适应可用容量的地方。更复杂的AI代理群体并不一定更好:它们是否有助于或损害取决于一个单一数字——即容量与人口比例,在任何AI代理问世之前都是已知的。
URL
https://arxiv.org/abs/2603.12129