Abstract
When a single pilot is responsible for managing a multi-drone system, the task demands varying levels of autonomy, from direct control of individual UAVs, to group-level coordination, to fully autonomous swarm behaviors for accomplishing high-level tasks. Enabling such flexible interaction requires a framework that supports multiple modes of shared autonomy. As language models continue to improve in reasoning and planning, they provide a natural foundation for such systems, reducing pilot workload by enabling high-level task delegation through intuitive, language-based interfaces. In this paper we present TACOS (Task-Agnostic COordinator of a multi-drone System), a unified framework that enables high-level natural language control of multi-UAV systems through Large Language Models (LLMs). TACOS integrates three key capabilities into a single architecture: a one-to-many natural language interface for intuitive user interaction, an intelligent coordinator for translating user intent into structured task plans, and an autonomous agent that executes plans interacting with the real-world. TACOS allows a LLM to interact with a library of executable APIs, bridging semantic reasoning with real-time multi-robot coordination. We demonstrate the system in real-world multi-drone system and conduct an ablation study to assess the contribution of each module.
Abstract (translated)
当一名飞行员负责管理一个多无人机系统时,任务需要不同级别的自主权,从单独控制每个无人飞行器(UAV),到群体层面的协调,再到为完成高层次任务而采用完全自主的群集行为。为了实现这种灵活互动,需要一个支持多种共享自主模式的框架。随着语言模型在推理和规划方面持续改进,它们提供了此类系统的一个自然基础,通过直观的语言界面实现高级别任务委派,从而减轻飞行员的工作负担。 本文介绍了TACOS(多无人机系统的无任务特异性协调器),这是一个统一框架,它通过大型语言模型(LLMs)使多UAV系统的高层次自然语言控制成为可能。TACOS将三种关键能力整合到一个架构中:一种直观的用户交互的一对多自然语言接口、一位智能协调员用于翻译用户的意图为结构化的任务计划以及一个自主代理执行与现实世界互动的任务规划。TACOS使LLM能够与可执行API库进行交互,连接语义推理和实时多机器人协同作业。 我们通过实际的多无人机系统展示了该系统的应用,并进行了删减研究来评估每个模块对整体性能的贡献。
URL
https://arxiv.org/abs/2510.01869