Paper Reading AI Learner

TACOS: Task Agnostic COordinator of a multi-drone System

2025-10-02 10:21:35
Alessandro Nazzari, Roberto Rubinacci, Marco Lovera

Abstract

When a single pilot is responsible for managing a multi-drone system, the task demands varying levels of autonomy, from direct control of individual UAVs, to group-level coordination, to fully autonomous swarm behaviors for accomplishing high-level tasks. Enabling such flexible interaction requires a framework that supports multiple modes of shared autonomy. As language models continue to improve in reasoning and planning, they provide a natural foundation for such systems, reducing pilot workload by enabling high-level task delegation through intuitive, language-based interfaces. In this paper we present TACOS (Task-Agnostic COordinator of a multi-drone System), a unified framework that enables high-level natural language control of multi-UAV systems through Large Language Models (LLMs). TACOS integrates three key capabilities into a single architecture: a one-to-many natural language interface for intuitive user interaction, an intelligent coordinator for translating user intent into structured task plans, and an autonomous agent that executes plans interacting with the real-world. TACOS allows a LLM to interact with a library of executable APIs, bridging semantic reasoning with real-time multi-robot coordination. We demonstrate the system in real-world multi-drone system and conduct an ablation study to assess the contribution of each module.

Abstract (translated)

当一名飞行员负责管理一个多无人机系统时,任务需要不同级别的自主权,从单独控制每个无人飞行器(UAV),到群体层面的协调,再到为完成高层次任务而采用完全自主的群集行为。为了实现这种灵活互动,需要一个支持多种共享自主模式的框架。随着语言模型在推理和规划方面持续改进,它们提供了此类系统的一个自然基础,通过直观的语言界面实现高级别任务委派,从而减轻飞行员的工作负担。 本文介绍了TACOS(多无人机系统的无任务特异性协调器),这是一个统一框架,它通过大型语言模型(LLMs)使多UAV系统的高层次自然语言控制成为可能。TACOS将三种关键能力整合到一个架构中:一种直观的用户交互的一对多自然语言接口、一位智能协调员用于翻译用户的意图为结构化的任务计划以及一个自主代理执行与现实世界互动的任务规划。TACOS使LLM能够与可执行API库进行交互,连接语义推理和实时多机器人协同作业。 我们通过实际的多无人机系统展示了该系统的应用,并进行了删减研究来评估每个模块对整体性能的贡献。

URL

https://arxiv.org/abs/2510.01869

PDF

https://arxiv.org/pdf/2510.01869.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot