Abstract
The Third Perception Test challenge was organised as a full-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2025. Its primary goal is to benchmark state-of-the-art video models and measure the progress in multimodal perception. This year, the workshop featured 2 guest tracks as well: KiVA (an image understanding challenge) and Physic-IQ (a video generation challenge). In this report, we summarise the results from the main Perception Test challenge, detailing both the existing tasks as well as novel additions to the benchmark. In this iteration, we placed an emphasis on task unification, as this poses a more challenging test for current SOTA multimodal models. The challenge included five consolidated tracks: unified video QA, unified object and point tracking, unified action and sound localisation, grounded video QA, and hour-long video QA, alongside an analysis and interpretability track that is still open for submissions. Notably, the unified video QA track introduced a novel subset that reformulates traditional perception tasks (such as point tracking and temporal action localisation) as multiple-choice video QA questions that video-language models can natively tackle. The unified object and point tracking merged the original object tracking and point tracking tasks, whereas the unified action and sound localisation merged the original temporal action localisation and temporal sound localisation tracks. Accordingly, we required competitors to use unified approaches rather than engineered pipelines with task-specific models. By proposing such a unified challenge, Perception Test 2025 highlights the significant difficulties existing models face when tackling diverse perception tasks through unified interfaces.
Abstract (translated)
第三届感知测试挑战赛作为全天研讨会与IEEE/CVF国际计算机视觉大会（ICCV）2025年会议同期举行。其主要目标是评估当前最先进的视频模型，并衡量跨模态感知技术的进步。今年的研讨会还新增了两个客座赛道：KiVA（图像理解挑战）和Physic-IQ（视频生成挑战）。在这份报告中，我们将总结来自主赛道感知测试挑战赛的结果，详细介绍了现有任务以及基准测试中的新添加内容。在此次迭代中，我们强调了任务统一的重要性，因为这对目前最先进的跨模态模型提出了更具有挑战性的考验。该挑战包括五个整合赛道：统一体视频问答、统一分目标和点跟踪、统一时长动作和声音定位、基于背景的视频问答以及长达一小时的视频问答，还有一个分析与解释性赛道仍在接受提交中。值得注意的是，统一体视频问答赛道引入了一个新颖的子集，它将传统的感知任务（如点跟踪和时间动作定位）重新表述为多选题视频问答问题，视频-语言模型可以原生地处理这些问题。而统一分目标和点跟踪合并了原有的对象跟踪与点跟踪任务，统一时长动作和声音定位则整合了原有的时间动作定位与时长声源定位赛道。因此，我们要求参赛者使用统一的方法而非针对特定任务定制的管道工程解决方案。通过提出这样的统一挑战，感知测试2025突显了现有模型在通过统一接口处理多样化的感知任务时面临的显著困难。
URL
https://arxiv.org/abs/2601.06287
