Caribou across the Arctic has declined in recent decades, motivating scalable and accurate monitoring approaches to guide evidence-based conservation actions and policy decisions. Manual interpretation from this imagery is labor-intensive and error-prone, underscoring the need for automatic and reliable detection across varying scenes. Yet, such automatic detection is challenging due to severe background heterogeneity, dominant empty terrain (class imbalance), small or occluded targets, and wide variation in density and scale. To make the detection model (HerdNet) more robust to these challenges, a weakly supervised patch-level pretraining based on a detection network's architecture is proposed. The detection dataset includes five caribou herds distributed across Alaska. By learning from empty vs. non-empty labels in this dataset, the approach produces early weakly supervised knowledge for enhanced detection compared to HerdNet, which is initialized from generic weights. Accordingly, the patch-based pretrain network attained high accuracy on multi-herd imagery (2017) and on an independent year's (2019) test sets (F1: 93.7%/92.6%, respectively), enabling reliable mapping of regions containing animals to facilitate manual counting on large aerial imagery. Transferred to detection, initialization from weakly supervised pretraining yielded consistent gains over ImageNet weights on both positive patches (F1: 92.6%/93.5% vs. 89.3%/88.6%), and full-image counting (F1: 95.5%/93.3% vs. 91.5%/90.4%). Remaining limitations are false positives from animal-like background clutter and false negatives related to low animal density occlusions. Overall, pretraining on coarse labels prior to detection makes it possible to rely on weakly-supervised pretrained weights even when labeled data are limited, achieving results comparable to generic-weight initialization.
https://arxiv.org/abs/2601.18891
Weakly Supervised Semantic Segmentation (WSSS), which relies only on image-level labels, has attracted significant attention for its cost-effectiveness and scalability. Existing methods mainly enhance inter-class distinctions and employ data augmentation to mitigate semantic ambiguity and reduce spurious activations. However, they often neglect the complex contextual dependencies among image patches, resulting in incomplete local representations and limited segmentation accuracy. To address these issues, we propose the Context Patch Fusion with Class Token Enhancement (CPF-CTE) framework, which exploits contextual relations among patches to enrich feature representations and improve segmentation. At its core, the Contextual-Fusion Bidirectional Long Short-Term Memory (CF-BiLSTM) module captures spatial dependencies between patches and enables bidirectional information flow, yielding a more comprehensive understanding of spatial correlations. This strengthens feature learning and segmentation robustness. Moreover, we introduce learnable class tokens that dynamically encode and refine class-specific semantics, enhancing discriminative capability. By effectively integrating spatial and semantic cues, CPF-CTE produces richer and more accurate representations of image content. Extensive experiments on PASCAL VOC 2012 and MS COCO 2014 validate that CPF-CTE consistently surpasses prior WSSS methods.
弱监督语义分割(WSSS)依赖于图像级别的标签,因其成本效益和可扩展性而引起了广泛关注。现有的方法主要通过增强类间区分度并采用数据增强技术来减轻语义模糊性和减少虚假激活。然而,它们往往忽视了图块之间的复杂上下文依赖关系,导致局部表示不完整且分割精度受限。为解决这些问题,我们提出了带有类别标记增强(CPF-CTE)的上下文图块融合框架,该框架利用图块之间的上下文关系来丰富特征表示并提高分割性能。在核心部分,上下文融合双向长短时记忆模块(Contextual-Fusion BiLSTM, CF-BiLSTM)捕获图块间的空间依赖性,并实现双向信息流动,从而对空间相关性提供更全面的理解。这增强了特征学习和分割的鲁棒性。此外,我们引入了可学习的类别标记,这些标记能够动态编码并细化特定类别的语义信息,提高了判别能力。通过有效整合空间和语义线索,CPF-CTE生成了更加丰富且准确的图像内容表示。 在PASCAL VOC 2012及MS COCO 2014数据集上的大量实验验证表明,CPF-CTE方法始终优于先前的WSSS方法。
https://arxiv.org/abs/2601.14718
Medical image analysis increasingly relies on large vision-language models (VLMs), yet most systems remain single-pass black boxes that offer limited control over reasoning, safety, and spatial grounding. We propose R^4, an agentic framework that decomposes medical imaging workflows into four coordinated agents: a Router that configures task- and specialization-aware prompts from the image, patient history, and metadata; a Retriever that uses exemplar memory and pass@k sampling to jointly generate free-text reports and bounding boxes; a Reflector that critiques each draft-box pair for key clinical error modes (negation, laterality, unsupported claims, contradictions, missing findings, and localization errors); and a Repairer that iteratively revises both narrative and spatial outputs under targeted constraints while curating high-quality exemplars for future cases. Instantiated on chest X-ray analysis with multiple modern VLM backbones and evaluated on report generation and weakly supervised detection, R^4 consistently boosts LLM-as-a-Judge scores by roughly +1.7-+2.5 points and mAP50 by +2.5-+3.5 absolute points over strong single-VLM baselines, without any gradient-based fine-tuning. These results show that agentic routing, reflection, and repair can turn strong but brittle VLMs into more reliable and better grounded tools for clinical image interpretation. Our code can be found at: this https URL
医学图像分析越来越依赖于大型视觉语言模型(VLM),然而,大多数系统仍然是一次性黑盒操作,对推理、安全和空间定位的控制有限。我们提出了R^4框架,这是一个代理框架,将医学成像工作流程分解为四个协调的代理:一个路由器,根据从图像、患者历史记录和元数据中提取的任务和专业信息来配置提示;一个检索器,使用范例记忆和pass@k抽样同时生成自由文本报告和边界框;一个反思者,批评每对草案-边框的关键临床错误模式(否定、侧向性、缺乏支持的主张、矛盾、遗漏发现以及定位错误);以及一个修复者,在有针对性的约束下迭代修订叙述性和空间输出的同时为未来案例策划高质量范例。在胸部X光片分析中使用多个现代VLM后端,并通过报告生成和弱监督检测进行评估,R^4 在不进行任何基于梯度的微调的情况下,相对于强大的单一VLM基线,显著提高了LLM作为裁判(LLM-as-a-Judge)评分约1.7至2.5分,并将mAP50绝对提高了2.5至3.5个点。这些结果表明,代理路由、反思和修复可以将强大但脆弱的VLM转变为更可靠且更好地定位的临床图像解释工具。我们的代码可在以下链接找到:[此URL]
https://arxiv.org/abs/2601.08192
In this work, we present a novel latent diffusion-based pipeline for 3D kidney anomaly detection on contrast-enhanced abdominal CT. The method combines Denoising Diffusion Probabilistic Models (DDPMs), Denoising Diffusion Implicit Models (DDIMs), and Vector-Quantized Generative Adversarial Networks (VQ-GANs). Unlike prior slice-wise approaches, our method operates directly on an image volume and leverages weak supervision with only case-level pseudo-labels. We benchmark our approach against state-of-the-art supervised segmentation and detection models. This study demonstrates the feasibility and promise of 3D latent diffusion for weakly supervised anomaly detection. While the current results do not yet match supervised baselines, they reveal key directions for improving reconstruction fidelity and lesion localization. Our findings provide an important step toward annotation-efficient, generative modeling of complex abdominal anatomy.
在这项工作中,我们提出了一种新颖的基于潜在扩散的管道,用于在增强腹部CT图像上进行3D肾脏异常检测。该方法结合了去噪扩散概率模型(DDPMs)、去噪扩散隐式模型(DDIMs)和向量量化生成对抗网络(VQ-GANs)。与之前的逐片处理方法不同,我们的方法直接针对整个图像体积进行操作,并利用仅基于病例级别的伪标签的弱监督。我们将该方法与最先进的有监督分割和检测模型进行了基准测试。这项研究表明了在弱监督下使用3D潜在扩散技术进行异常检测的可能性和前景。尽管目前的结果尚未达到有监督基线的标准,但它们揭示了提高重建准确性和病灶定位的关键方向。我们的研究为高效注释、复杂腹部解剖结构的生成建模提供了一个重要的步骤。
https://arxiv.org/abs/2601.05852
Malicious image manipulation threatens public safety and requires efficient localization methods. Existing approaches depend on costly pixel-level annotations which make training expensive. Existing weakly supervised methods rely only on image-level binary labels and focus on global classification, often overlooking local edge cues that are critical for precise localization. We observe that feature variations at manipulated boundaries are substantially larger than in interior regions. To address this gap, we propose Semantic-Agnostic Prompt Learning (SAPL) in CLIP, which learns text prompts that intentionally encode non-semantic, boundary-centric cues so that CLIPs multimodal similarity highlights manipulation edges rather than high-level object semantics. SAPL combines two complementary modules Edge-aware Contextual Prompt Learning (ECPL) and Hierarchical Edge Contrastive Learning (HECL) to exploit edge information in both textual and visual spaces. The proposed ECPL leverages edge-enhanced image features to generate learnable textual prompts via an attention mechanism, embedding semantic-irrelevant information into text features, to guide CLIP focusing on manipulation edges. The proposed HECL extract genuine and manipulated edge patches, and utilize contrastive learning to boost the discrimination between genuine edge patches and manipulated edge patches. Finally, we predict the manipulated regions from the similarity map after processing. Extensive experiments on multiple public benchmarks demonstrate that SAPL significantly outperforms existing approaches, achieving state-of-the-art localization performance.
恶意图像篡改威胁到公共安全,需要高效的定位方法。现有方法依赖于昂贵的像素级标注,使得训练成本高昂。现有的弱监督方法仅依靠图级别二进制标签,并专注于全局分类,往往忽视了局部边缘线索对于精确定位至关重要的作用。我们观察到,在被篡改边界上的特征变化远大于内部区域的变化。为解决这一问题,我们在CLIP模型中提出了语义不可知提示学习(SAPL),该方法通过有意编码非语义的边界中心线索来学习文本提示,使CLIP的多模态相似性更能突出篡改边缘而不是高层次的对象语义。SAPL结合了两个互补模块:边缘感知上下文提示学习(ECPL)和分层边缘对比学习(HECL),用于在文本空间和视觉空间中利用边缘信息。 所提出的ECPL通过增强图像特征的边缘,生成可学习的文字提示,并借助注意力机制将语义无关的信息嵌入到文字特征中,引导CLIP关注篡改边缘。而所提出的HECL则提取真实边界片和被篡改边界片,并利用对比学习来提高对真实边界片与被篡改边界片之间的区分能力。 最后,在处理完相似性地图后,我们预测出被篡改的区域。在多个公开基准上的广泛实验表明,SAPL显著优于现有方法,实现了最先进的定位性能。
https://arxiv.org/abs/2601.06222
Video Anomaly Understanding (VAU) extends traditional Video Anomaly Detection (VAD) by not only localizing anomalies but also describing and reasoning about their context. Existing VAU approaches often rely on fine-tuned multimodal large language models (MLLMs) or external modules such as video captioners, which introduce costly annotations, complex training pipelines, and high inference overhead. In this work, we introduce PrismVAU, a lightweight yet effective system for real-time VAU that leverages a single off-the-shelf MLLM for anomaly scoring, explanation, and prompt optimization. PrismVAU operates in two complementary stages: (1) a coarse anomaly scoring module that computes frame-level anomaly scores via similarity to textual anchors, and (2) an MLLM-based refinement module that contextualizes anomalies through system and user prompts. Both textual anchors and prompts are optimized with a weakly supervised Automatic Prompt Engineering (APE) framework. Extensive experiments on standard VAD benchmarks demonstrate that PrismVAU delivers competitive detection performance and interpretable anomaly explanations -- without relying on instruction tuning, frame-level annotations, and external modules or dense processing -- making it an efficient and practical solution for real-world applications.
视频异常理解(Video Anomaly Understanding,简称VAU)在传统的视频异常检测(Video Anomaly Detection,简称VAD)基础上更进一步,不仅定位了异常事件,还描述并解释了这些异常的上下文。现有的VAU方法往往依赖于微调过的多模态大规模语言模型(Multimodal Large Language Models,简称MLLMs)或外部模块如视频字幕生成器,这引入了昂贵的数据标注、复杂的训练流程和高推理成本。 在此项工作中,我们提出了PrismVAU,这是一个轻量级且高效的系统,适用于实时的VAU任务。该系统利用单一现成的多模态大规模语言模型(MLLM)来完成异常评分、解释以及提示优化。PrismVAU通过两个互补阶段实现其功能:(1) 一个粗略的异常评分模块,它计算基于与文本锚点相似度的帧级异常分数;(2) 一个基于多模态大规模语言模型(MLLM)的细化模块,该模块通过系统和用户提示来上下文化异常。这些文本锚点和提示都经过弱监督自动提示工程(Automatic Prompt Engineering, APE)框架进行优化。 在标准VAD基准上的广泛实验表明,PrismVAU能够提供竞争力强的检测性能以及可解释性的异常解释——并且无需依赖指令调优、帧级标注或外部模块及密集处理流程。这使得PrismVAU成为实际应用中一个高效且实用的解决方案。
https://arxiv.org/abs/2601.02927
Recent 3D-aware head generative models based on 3D Gaussian Splatting achieve real-time, photorealistic and view-consistent head synthesis. However, a fundamental limitation persists: the deep entanglement of illumination and intrinsic appearance prevents controllable relighting. Existing disentanglement methods rely on strong assumptions to enable weakly supervised learning, which restricts their capacity for complex illumination. To address this challenge, we introduce HeadLighter, a novel supervised framework that learns a physically plausible decomposition of appearance and illumination in head generative models. Specifically, we design a dual-branch architecture that separately models lighting-invariant head attributes and physically grounded rendering components. A progressive disentanglement training is employed to gradually inject head appearance priors into the generative architecture, supervised by multi-view images captured under controlled light conditions with a light stage setup. We further introduce a distillation strategy to generate high-quality normals for realistic rendering. Experiments demonstrate that our method preserves high-quality generation and real-time rendering, while simultaneously supporting explicit lighting and viewpoint editing. We will publicly release our code and dataset.
近期基于3D高斯点阵的三维感知头部生成模型实现了实时、逼真且视角一致的头部合成。然而,这些模型仍存在一个基本限制:光照与内在外观之间的深度纠缠阻碍了可控重光照的能力。现有的脱耦方法依赖于强烈的假设来实现弱监督学习,这限制了它们处理复杂照明场景的能力。 为了应对这一挑战,我们引入了一种名为HeadLighter的新框架,该框架在头部生成模型中学习了一个物理上合理的外观和光照分解。具体来说,我们设计了一种双分支架构,分别对光照不变的头部属性和基于物理原理的渲染组件进行建模。通过使用多视角图像(这些图像是在具有灯光舞台设置的受控照明条件下捕获的)监督下逐步注入头部外观先验,采用渐进式脱耦训练方法。 此外,我们还引入了一种蒸馏策略来生成高质量的法线图以支持逼真的渲染。实验结果表明,我们的方法在保持高质量生成和实时渲染的同时,也能够支持明确的光照编辑和视角调整。我们将公开发布代码和数据集。
https://arxiv.org/abs/2601.02103
While dense retrieval models have become the standard for state-of-the-art information retrieval, their deployment is often constrained by high memory requirements and reliance on GPU accelerators for vector similarity search. Learned sparse retrieval offers a compelling alternative by enabling efficient search via inverted indices, yet it has historically received less attention than dense approaches. In this report, we introduce LACONIC, a family of learned sparse retrievers based on the Llama-3 architecture (1B, 3B, and 8B). We propose a streamlined two-phase training curriculum consisting of (1) weakly supervised pre-finetuning to adapt causal LLMs for bidirectional contextualization and (2) high-signal finetuning using curated hard negatives. Our results demonstrate that LACONIC effectively bridges the performance gap with dense models: the 8B variant achieves a state-of-the-art 60.2 nDCG on the MTEB Retrieval benchmark, ranking 15th on the leaderboard as of January 1, 2026, while utilizing 71\% less index memory than an equivalent dense model. By delivering high retrieval effectiveness on commodity CPU hardware with a fraction of the compute budget required by competing models, LACONIC provides a scalable and efficient solution for real-world search applications.
虽然密集检索模型已成为最先进的信息检索标准,但它们的部署通常受到高内存需求和对GPU加速器进行向量相似度搜索依赖性的限制。相比之下,通过逆向索引实现高效搜索的学习稀疏检索提供了一种有吸引力的替代方案,尽管在过去它比密集方法得到了较少的关注。 在本报告中,我们介绍了LACONIC,这是一个基于Llama-3架构(1B、3B和8B)的系列学习稀疏检索器。我们提出了一项简化的两阶段训练课程:首先通过弱监督预微调将因果LLM适应为双向上下文化;其次使用精心挑选的硬负样本进行高信号微调。我们的结果显示,LACONIC有效地缩小了与密集模型之间的性能差距:其8B变体在MTEB检索基准上实现了60.2 nDCG的最佳状态,截至2026年1月1日,在排行榜上排名第15位,并且相比等效的密集模型减少了71%的索引内存使用量。通过仅使用竞争模型所需计算预算的一小部分,LACONIC就能在普通CPU硬件上实现高检索效率,从而为现实世界的搜索应用提供了可扩展和高效的解决方案。
https://arxiv.org/abs/2601.01684
Cross-resolution land cover mapping aims to produce high-resolution semantic predictions from coarse or low-resolution supervision, yet the severe resolution mismatch makes effective learning highly challenging. Existing weakly supervised approaches often struggle to align fine-grained spatial structures with coarse labels, leading to noisy supervision and degraded mapping accuracy. To tackle this problem, we propose DDTM, a dual-branch weakly supervised framework that explicitly decouples local semantic refinement from global contextual reasoning. Specifically, DDTM introduces a diffusion-based branch to progressively refine fine-scale local semantics under coarse supervision, while a transformer-based branch enforces long-range contextual consistency across large spatial extents. In addition, we design a pseudo-label confidence evaluation module to mitigate noise induced by cross-resolution inconsistencies and to selectively exploit reliable supervisory signals. Extensive experiments demonstrate that DDTM establishes a new state-of-the-art on the Chesapeake Bay benchmark, achieving 66.52\% mIoU and substantially outperforming prior weakly supervised methods. The code is available at this https URL.
跨分辨率地表覆盖制图旨在从粗略或低分辨率监督中生成高分辨率的语义预测,但由于严重的分辨率不匹配,有效的学习变得极具挑战性。现有的弱监督方法往往难以将细粒度的空间结构与粗糙标签对齐,导致嘈杂的监督信息和映射精度下降。为了解决这个问题,我们提出了DDTM,这是一种双分支弱监督框架,明确地解耦了局部语义细化和全局上下文推理。 具体而言,DDTM引入了一个基于扩散的方法分支,在粗略监督下逐步精炼细尺度的局部语义,而一个基于变压器的方法分支则强制在整个大空间范围内保持长期的上下文一致性。此外,我们设计了一种伪标签置信度评估模块来减轻由跨分辨率不一致引起的噪声,并选择性地利用可靠的监督信号。 广泛的实验表明,DDTM在切萨皮克湾基准测试上建立了新的最先进的性能,达到了66.52%的mIoU(平均交并比),远远优于以前的弱监督方法。代码可在提供的链接获取。
https://arxiv.org/abs/2512.19990
Multiple Instance Learning (MIL) has enabled weakly supervised analysis of whole-slide images (WSIs) in computational pathology. However, traditional MIL approaches often lose crucial contextual information, while transformer-based variants, though more expressive, suffer from quadratic complexity and redundant computations. To address these limitations, we propose HookMIL, a context-aware and computationally efficient MIL framework that leverages compact, learnable hook tokens for structured contextual aggregation. These tokens can be initialized from (i) key-patch visual features, (ii) text embeddings from vision-language pathology models, and (iii) spatially grounded features from spatial transcriptomics-vision models. This multimodal initialization enables Hook Tokens to incorporate rich textual and spatial priors, accelerating convergence and enhancing representation quality. During training, Hook tokens interact with instances through bidirectional attention with linear complexity. To further promote specialization, we introduce a Hook Diversity Loss that encourages each token to focus on distinct histopathological patterns. Additionally, a hook-to-hook communication mechanism refines contextual interactions while minimizing redundancy. Extensive experiments on four public pathology datasets demonstrate that HookMIL achieves state-of-the-art performance, with improved computational efficiency and interpretability. Codes are available at this https URL.
多实例学习(Multiple Instance Learning,MIL)已经在计算病理学中的全滑片图像(Whole-Slide Images,WSIs)的弱监督分析中发挥了重要作用。然而,传统的MIL方法常常会丢失关键的上下文信息,而基于Transformer的方法虽然更加表达丰富,但面临着二次方复杂度和冗余计算的问题。为了克服这些限制,我们提出了一种名为HookMIL的框架,这是一种具有上下文感知能力和计算效率的多实例学习框架。该框架利用紧凑且可学习的hook令牌进行结构化上下文聚合。 这些钩子令牌可以从以下三种方式之一初始化:(i)关键补丁视觉特征;(ii)来自视觉-语言病理学模型的文本嵌入;以及(iii)空间转录组学-视觉模型的空间定位特征。这种多模态初始化使Hook Tokens能够整合丰富的文本和空间先验信息,从而加速收敛并提高表示质量。 在训练过程中,Hook令牌通过线性复杂度的双向注意力与实例进行互动。为进一步促进专业化,我们引入了一种钩子多样性损失(Hook Diversity Loss),鼓励每个钩子令牌专注于不同的组织病理学模式。此外,一个hook-to-hook通信机制细化了上下文交互,并减少了冗余。 在四个公开的病理数据集上进行了广泛的实验,结果表明HookMIL达到了最先进的性能,在计算效率和可解释性方面都有所提升。代码可在上述链接获得。
https://arxiv.org/abs/2512.22188
Weakly Supervised Semantic Segmentation (WSSS) with image level labels aims to produce pixel level predictions without requiring dense annotations. While recent approaches have leveraged generative models to augment existing data, they remain dependent on real world training samples. In this paper, we introduce a novel direction, Zero Shot Weakly Supervised Semantic Segmentation (ZSWSSS), and propose SynthSeg Agents, a multi agent framework driven by Large Language Models (LLMs) to generate synthetic training data entirely without real images. SynthSeg Agents comprises two key modules, a Self Refine Prompt Agent and an Image Generation Agent. The Self Refine Prompt Agent autonomously crafts diverse and semantically rich image prompts via iterative refinement, memory mechanisms, and prompt space exploration, guided by CLIP based similarity and nearest neighbor diversity filtering. These prompts are then passed to the Image Generation Agent, which leverages Vision Language Models (VLMs) to synthesize candidate images. A frozen CLIP scoring model is employed to select high quality samples, and a ViT based classifier is further trained to relabel the entire synthetic dataset with improved semantic precision. Our framework produces high quality training data without any real image supervision. Experiments on PASCAL VOC 2012 and COCO 2014 show that SynthSeg Agents achieves competitive performance without using real training images. This highlights the potential of LLM driven agents in enabling cost efficient and scalable semantic segmentation.
弱监督语义分割(WSSS)使用图像级标签的目标是无需密集注释就能生成像素级别的预测。尽管最近的研究已经利用了生成模型来增强现有数据,但它们仍然依赖于真实世界的训练样本。在本文中,我们提出了一种新颖的方向——零样本弱监督语义分割(ZSWSSS),并提出了SynthSeg Agents,这是一个由大型语言模型(LLMs)驱动的多代理框架,用于完全不使用真实图像生成合成训练数据。SynthSeg Agents 包括两个关键模块:自我优化提示代理和图像生成代理。 **自我优化提示代理**自主地通过迭代细化、记忆机制以及基于CLIP相似性和最近邻多样性过滤的提示空间探索来创建多样且语义丰富的图像提示。 这些提示随后传递给**图像生成代理**,该代理利用视觉语言模型(VLMs)合成候选图像。一个冻结的CLIP评分模型被用来选择高质量样本,并通过训练一个基于ViT的分类器进一步为整个合成数据集重新标记,以提高语义精度。 我们的框架能够在没有任何真实图像监督的情况下产生高质量的训练数据。在PASCAL VOC 2012和COCO 2014上的实验表明,SynthSeg Agents 在不使用任何实际训练图像的情况下也达到了竞争性的性能水平。这突显了LLM驱动代理在实现低成本且可扩展语义分割中的潜力。
https://arxiv.org/abs/2512.15310
Deep learning for decoding EEG signals has gained traction, with many claims to state-of-the-art accuracy. However, despite the convincing benchmark performance, successful translation to real applications is limited. The frequent disconnect between performance on controlled BCI benchmarks and its lack of generalisation to practical settings indicates hidden overfitting problems. We introduce Disentangled Decoding Decomposition (D3), a weakly supervised method for training deep learning models across EEG datasets. By predicting the place in the respective trial sequence from which the input window was sampled, EEG-D3 separates latent components of brain activity, akin to non-linear ICA. We utilise a novel model architecture with fully independent sub-networks for strict interpretability. We outline a feature interpretation paradigm to contrast the component activation profiles on different datasets and inspect the associated temporal and spatial filters. The proposed method reliably separates latent components of brain activity on motor imagery data. Training downstream classifiers on an appropriate subset of these components prevents hidden overfitting caused by task-correlated artefacts, which severely affects end-to-end classifiers. We further exploit the linearly separable latent space for effective few-shot learning on sleep stage classification. The ability to distinguish genuine components of brain activity from spurious features results in models that avoid the hidden overfitting problem and generalise well to real-world applications, while requiring only minimal labelled data. With interest to the neuroscience community, the proposed method gives researchers a tool to separate individual brain processes and potentially even uncover heretofore unknown dynamics.
深度学习在解码脑电图(EEG)信号方面取得了显著进展,并且有许多研究声称达到了最先进的准确性。然而,尽管这些方法在基准测试中的表现令人信服,但在实际应用中却效果有限。控制良好的脑机接口(BCI)基准性能与其实用场景下泛化能力的脱节表明存在隐藏的过拟合问题。为此,我们引入了分解解码分解法(Disentangled Decoding Decomposition, D3),这是一种跨EEG数据集训练深度学习模型的弱监督方法。通过预测输入窗口在相应试验序列中的位置,EEG-D3能够分离大脑活动的潜在成分,类似于非线性独立成分分析(ICA)。我们利用了一种全新的模型架构,该架构具有完全独立的子网络以严格保证可解释性。此外,我们还概述了一套特征解析范式,用于对比不同数据集上的组件激活模式,并检查相关的时间和空间滤波器。 所提出的方法能够可靠地分离运动想象数据中的大脑活动潜在成分。在下游分类器上使用这些成分的适当子集进行训练,可以防止由任务相关的伪迹造成的隐性过拟合,这种问题严重影响了端到端分类器的表现。我们进一步利用线性可分的潜在空间来进行有效的少量样本学习(few-shot learning),应用于睡眠分期分类。 区分大脑活动的真实组成部分与虚假特征的能力使模型能够避免隐藏过拟合的问题,并在实际应用中表现出良好的泛化能力,同时仅需要极少量标记数据。对于神经科学界而言,所提出的方法为研究人员提供了一种工具来分离个体的大脑过程,并有可能揭示此前未知的动力学机制。
https://arxiv.org/abs/2512.13806
Tuberculosis (TB) remains one of the leading causes of mortality worldwide, particularly in resource-limited countries. Chest X-ray (CXR) imaging serves as an accessible and cost-effective diagnostic tool but requires expert interpretation, which is often unavailable. Although machine learning models have shown high performance in TB classification, they often depend on spurious correlations and fail to generalize. Besides, building large datasets featuring high-quality annotations for medical images demands substantial resources and input from domain specialists, and typically involves several annotators reaching agreement, which results in enormous financial and logistical expenses. This study repurposes knowledge distillation technique to train CNN models reducing spurious correlations and localize TB-related abnormalities without requiring bounding-box annotations. By leveraging a teacher-student framework with ResNet50 architecture, the proposed method trained on TBX11k dataset achieve impressive 0.2428 mIOU score. Experimental results further reveal that the student model consistently outperforms the teacher, underscoring improved robustness and potential for broader clinical deployment in diverse settings.
结核病(TB)仍然是全球死亡的主要原因之一,特别是在资源有限的国家。胸部X光片(CXR)成像是一个可获取且成本效益高的诊断工具,但需要专家解读,而这在许多地方并不容易获得。尽管机器学习模型在结核病分类方面表现出色,但它们往往依赖于虚假的相关性,并且难以泛化到不同的场景中去。此外,构建包含高质量标注的大型医学图像数据集需要大量的资源和领域专家的参与,并通常涉及多个注释者达成一致意见的过程,这带来了巨大的财务和后勤成本。 本研究重新利用了知识蒸馏技术来训练卷积神经网络(CNN)模型,以减少虚假相关性并定位结核病相关的异常情况,而无需边界框标注。通过使用基于ResNet50架构的教师-学生框架,在TBX11k数据集上训练的模型取得了令人印象深刻的mIOU评分为0.2428(假设这是一个合理的性能指标表述)。实验结果进一步显示,学生模型在多种情况下均优于教师模型,这表明了其改进后的鲁棒性以及在不同临床环境中更广泛部署的应用潜力。
https://arxiv.org/abs/2512.11057
Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the data. We propose TranSamba, a hybrid Transformer-Mamba architecture designed to capture 3D context for weakly supervised volumetric medical segmentation. TranSamba augments a standard Vision Transformer backbone with Cross-Plane Mamba blocks, which leverage the linear complexity of state space models for efficient information exchange across neighboring slices. The information exchange enhances the pairwise self-attention within slices computed by the Transformer blocks, directly contributing to the attention maps for object localization. TranSamba achieves effective volumetric modeling with time complexity that scales linearly with the input volume depth and maintains constant memory usage for batch processing. Extensive experiments on three datasets demonstrate that TranSamba establishes new state-of-the-art performance, consistently outperforming existing methods across diverse modalities and pathologies. Our source code and trained models are openly accessible at: this https URL.
弱监督语义分割为训练体积医学影像的分割模型提供了一种标签高效的解决方案。然而,现有方法通常依赖于二维编码器,忽视了数据本身的三维特性。我们提出了一种混合Transformer-Mamba架构——TranSamba,专门用于捕捉弱监督体积医学分割中的三维上下文信息。TranSamba在标准视觉变压器主干网络的基础上增加了Cross-Plane Mamba块,利用状态空间模型的线性复杂度来实现相邻切片之间高效的信息交换。这种信息交换增强了由Transformer块计算出的片内成对自注意力机制,直接贡献于目标定位的注意图中。 TranSamba能够有效地建模体积数据,并且时间复杂度随着输入体深度呈线性增长,同时保持了批量处理中的常量内存使用率。在三个数据集上的广泛实验表明,TranSamba建立了新的最先进技术性能,在不同模式和病理条件下始终优于现有方法。 我们的源代码和训练模型可在以下网址公开访问:[此处插入实际URL]。
https://arxiv.org/abs/2512.10353
Weakly supervised semantic segmentation (WSSS) in histopathology relies heavily on classification backbones, yet these models often localize only the most discriminative regions and struggle to capture the full spatial extent of tissue structures. Vision-language models such as CONCH offer rich semantic alignment and morphology-aware representations, while modern segmentation backbones like SegFormer preserve fine-grained spatial cues. However, combining these complementary strengths remains challenging, especially under weak supervision and without dense annotations. We propose a prototype learning framework for WSSS in histopathological images that integrates morphology-aware representations from CONCH, multi-scale structural cues from SegFormer, and text-guided semantic alignment to produce prototypes that are simultaneously semantically discriminative and spatially coherent. To effectively leverage these heterogeneous sources, we introduce text-guided prototype initialization that incorporates pathology descriptions to generate more complete and semantically accurate pseudo-masks. A structural distillation mechanism transfers spatial knowledge from SegFormer to preserve fine-grained morphological patterns and local tissue boundaries during prototype learning. Our approach produces high-quality pseudo masks without pixel-level annotations, improves localization completeness, and enhances semantic consistency across tissue types. Experiments on BCSS-WSSS datasets demonstrate that our prototype learning framework outperforms existing WSSS methods while remaining computationally efficient through frozen foundation model backbones and lightweight trainable adapters.
在组织病理学中,弱监督语义分割(WSSS)主要依赖于分类骨干模型。然而,这些模型通常只能定位最具判别力的区域,并且难以捕捉到组织结构的整体空间范围。视觉-语言模型如CONCH提供了丰富的语义对齐和形态感知表示,而现代分割骨架如SegFormer则保留了精细的空间线索。但是,在弱监督条件下以及缺乏密集注释的情况下,将这些互补优势结合在一起仍然存在挑战。 我们提出了一种用于组织病理图像WSSS的原型学习框架,该框架整合了来自CONCH的形态感知表示、SegFormer的多尺度结构提示和文本引导语义对齐,以生成同时具有判别性和空间一致性的原型。为了有效利用这些异质资源,我们引入了基于病理描述的文本引导原型初始化方法,从而生成更加完整且语义准确的伪掩膜(pseudo-masks)。此外,一种结构蒸馏机制从SegFormer中传输空间知识,在原型学习过程中保留细粒度形态模式和局部组织边界。我们的方法能够在没有像素级注释的情况下生成高质量的伪掩膜,提高定位完整性,并增强不同组织类型之间的语义一致性。 在BCSS-WSSS数据集上的实验表明,与现有的WSSS方法相比,我们提出的原型学习框架不仅性能更优,而且由于冻结了基础模型骨干和轻量可训练适配器的应用,使其计算效率更高。
https://arxiv.org/abs/2512.10316
Weakly supervised semantic segmentation (WSSS) in histopathology seeks to reduce annotation cost by learning from image-level labels, yet it remains limited by inter-class homogeneity, intra-class heterogeneity, and the region-shrinkage effect of CAM-based supervision. We propose a simple and effective prototype-driven framework that leverages vision-language alignment to improve region discovery under weak supervision. Our method integrates CoOp-style learnable prompt tuning to generate text-based prototypes and combines them with learnable image prototypes, forming a dual-modal prototype bank that captures both semantic and appearance cues. To address oversmoothing in ViT representations, we incorporate a multi-scale pyramid module that enhances spatial precision and improves localization quality. Experiments on the BCSS-WSSS benchmark show that our approach surpasses existing state-of-the-art methods, and detailed analyses demonstrate the benefits of text description diversity, context length, and the complementary behavior of text and image prototypes. These results highlight the effectiveness of jointly leveraging textual semantics and visual prototype learning for WSSS in digital pathology.
弱监督语义分割(WSSS)在组织病理学中的目标是通过从图像级别标签学习来减少标注成本,但目前仍受限于类别间的同质性、类别内的异质性以及基于类激活映射(CAM)的监督导致的区域缩小效应。我们提出了一种简单而有效的原型驱动框架,该框架利用视觉-语言对齐以在弱监督下改进区域发现过程。我们的方法整合了CoOp风格的学习提示调整技术来生成文本基元,并将它们与可学习的图像基元相结合,形成了一个双模态基元库,能够捕捉语义和外观线索。为了缓解ViT表示中的过度平滑问题,我们引入了一个多尺度金字塔模块,以增强空间精度并提高定位质量。 在BCSS-WSSS基准上的实验表明,我们的方法超越了现有的最先进技术,并且详细的分析展示了文本描述多样性、上下文长度以及文本与图像基元互补行为的益处。这些结果突显了联合利用文字语义和视觉原型学习对于数字病理学中WSSS的有效性。
https://arxiv.org/abs/2512.10314
Weakly supervised oriented object detection (WS-OOD) has gained attention as a cost-effective alternative to fully supervised methods, providing both efficiency and high accuracy. Among weakly supervised approaches, horizontal bounding box (HBox)-supervised OOD stands out for its ability to directly leverage existing HBox annotations while achieving the highest accuracy under weak supervision settings. This paper introduces adaptive bounding box scaling and symmetry-prior-based orientation prediction, called ABBSPO, a framework for WS-OOD. Our ABBSPO addresses limitations of previous HBox-supervised OOD methods, which compare ground truth (GT) HBoxes directly with the minimum circumscribed rectangles of predicted RBoxes, often leading to inaccurate scale estimation. To overcome this, we propose: (i) Adaptive Bounding Box Scaling (ABBS), which appropriately scales GT HBoxes to optimize for the size of each predicted RBox, ensuring more accurate scale prediction; and (ii) a Symmetric Prior Angle (SPA) loss that exploits inherent symmetry of aerial objects for self-supervised learning, resolving issues in previous methods where learning collapses when predictions for all three augmented views (original, rotated, and flipped) are consistently incorrect. Extensive experimental results demonstrate that ABBSPO achieves state-of-the-art performance, outperforming existing methods.
弱监督定向目标检测(WS-OOD)作为一种成本效益高的完全监督方法的替代方案,因其效率和高精度而受到关注。在各种弱监督方法中,水平边界框(HBox)监督定向目标检测因能够直接利用现有的HBox注释,并在弱监督设置下达到最高准确性而脱颖而出。本文提出了一种名为ABBSPO的框架,该框架结合了自适应边界框缩放和基于对称先验的角度预测,以解决WS-OOD中的问题。 我们的ABBSPO方法解决了之前HBox监督定向目标检测方法中存在的限制,这些方法直接比较地面真实(GT)HBoxes与预测矩形框(RBoxes)的最小外接矩形,通常会导致不准确的比例估计。为了解决这个问题,我们提出了以下两个方案: (i) 自适应边界框缩放 (ABBS),该方案适当地调整GT HBox以优化每个预测RBox的大小,从而确保更精确的比例预测; (ii) 对称先验角度(SPA)损失,利用空中物体固有的对称性进行自监督学习,解决了先前方法中当三个增强视图(原始、旋转和翻转)的所有预测均不正确时导致的学习崩溃问题。 通过广泛的实验结果表明,ABBSPO在WS-OOD任务上实现了最先进的性能,并且超过了现有的所有方法。
https://arxiv.org/abs/2512.10031
Accurate segmentation of vertebral metastasis in CT is clinically important yet difficult to scale, as voxel-level annotations are scarce and both lytic and blastic lesions often resemble benign degenerative changes. We introduce a weakly supervised method trained solely on vertebra-level healthy/malignant labels, without any lesion masks. The method combines a Diffusion Autoencoder (DAE) that produces a classifier-guided healthy edit of each vertebra with pixel-wise difference maps that propose candidate lesion regions. To determine which regions truly reflect malignancy, we introduce Hide-and-Seek Attribution: each candidate is revealed in turn while all others are hidden, the edited image is projected back to the data manifold by the DAE, and a latent-space classifier quantifies the isolated malignant contribution of that component. High-scoring regions form the final lytic or blastic segmentation. On held-out radiologist annotations, we achieve strong blastic/lytic performance despite no mask supervision (F1: 0.91/0.85; Dice: 0.87/0.78), exceeding baselines (F1: 0.79/0.67; Dice: 0.74/0.55). These results show that vertebra-level labels can be transformed into reliable lesion masks, demonstrating that generative editing combined with selective occlusion supports accurate weakly supervised segmentation in CT.
在CT图像中对椎体转移瘤进行精确分割具有重要的临床意义,但这一过程难以规模化实施,因为像素级标注稀缺,并且溶骨性和成骨性病变往往与良性退行性改变相似。我们引入了一种仅基于椎体级别健康/恶性标签训练的弱监督方法,无需任何病灶掩码。该方法结合了扩散自动编码器(DAE),它根据分类器指导对每个椎体进行健康编辑,并生成像素级差异图来提出候选病变区域。为了确定哪些区域真正反映了恶性肿瘤特征,我们引入了“Hide-and-Seek Attribution”:逐个揭示每个候选区,同时隐藏所有其他区域,在用DAE将修改后的图像投影回数据流形后,通过潜在空间分类器量化被孤立的恶性成分贡献。得分较高的区域形成最终的溶骨性或成骨性分割结果。 在独立于放射科医生注释的数据集上,尽管没有病灶掩码监督,我们实现了出色的成骨/溶骨性能(F1: 0.91/0.85;Dice: 0.87/0.78),超过了基准方法(F1: 0.79/0.67;Dice: 0.74/0.55)。这些结果表明,椎体级别标签可以转换为可靠的病变掩码。结合生成编辑与选择性遮挡支持在CT图像中进行准确的弱监督分割。
https://arxiv.org/abs/2512.06849
Deploying video anomaly detection in practice is hampered by the scarcity and collection cost of real abnormal footage. We address this by training without any real abnormal videos while evaluating under the standard weakly supervised split, and we introduce PA-VAD, a generation-driven approach that learns a detector from synthesized pseudo-abnormal videos paired with real normal videos, using only a small set of real normal images to drive synthesis. For synthesis, we select class-relevant initial images with CLIP and refine textual prompts with a vision-language model to improve fidelity and scene consistency before invoking a video diffusion model. For training, we mitigate excessive spatiotemporal magnitude in synthesized anomalies by an domain-aligned regularized module that combines domain alignment and memory usage-aware updates. Extensive experiments show that our approach reaches 98.2% on ShanghaiTech and 82.5% on UCF-Crime, surpassing the strongest real-abnormal method on ShanghaiTech by +0.6% and outperforming the UVAD state-of-the-art on UCF-Crime by +1.9%. The results demonstrate that high-accuracy anomaly detection can be obtained without collecting real anomalies, providing a practical path toward scalable deployment.
在实践中部署视频异常检测时,由于真实异常视频的稀缺性和收集成本问题而面临挑战。为了解决这个问题,我们提出了一种方法,在训练时不使用任何真实的异常视频,并且评估是在标准弱监督数据集划分下进行的。为此,我们引入了PA-VAD(Pseudo-Anomaly Video Anomaly Detection),这是一种生成驱动的方法,通过从合成的伪异常视频和真实正常视频对中学习检测器来工作。此方法仅需使用少量的真实正常图像作为驱动力来进行合成。 在生成阶段,我们首先利用CLIP选择与特定类别相关的初始图像,并且使用视觉-语言模型优化文本提示以提高生成内容的保真度和场景一致性,在此基础上调用视频扩散模型进行具体生成过程。 为了训练我们的模型并减少合成异常中过度的空间时间量级问题,我们在PA-VAD中引入了一个结合领域对齐和内存感知更新策略的模块。这个域对准正则化模块旨在减轻由于数据不足而产生的不自然或过度放大的异常效果。 经过广泛的实验验证,在上海科技大学的数据集上我们的方法达到了98.2%的准确率,并在UCF-Crime数据集中实现了82.5%,分别比最强的真实异常方法在上海科技大学的数据集上的性能高出0.6%,以及在UCF-Crime数据集上的UVAD最新成果高出了1.9%。 这些结果表明,通过不依赖于收集真实的异常视频样本,仍可以实现高准确率的异常检测。这为大规模部署提供了一条切实可行的道路。
https://arxiv.org/abs/2512.06845
Shearography is an interferometric technique sensitive to surface displacement gradients, providing high sensitivity for detecting subsurface defects in safety-critical components. A key limitation to industrial adoption is the lack of high-quality annotated datasets, since manual labeling remains labor-intensive, subjective, and difficult to standardize. We introduce an automated workflow that generates defect annotations from shearography measurements using deep learning, producing high-resolution segmentation and bounding-box labels. Evaluation against expert-labeled data demonstrates sufficient accuracy to enable weakly supervised training, reducing manual effort and supporting scalable dataset creation for robust defect detection.
剪切光度学是一种干涉测量技术,对表面位移梯度敏感,因此能够以高灵敏度检测安全关键部件中的亚表面缺陷。该技术在工业应用中面临的一个主要限制是缺乏高质量的标注数据集,因为手动标注工作既费时又主观,并且难以标准化。我们介绍了一种自动工作流程,利用深度学习技术从剪切光度测量结果生成缺陷标注,能够产出高分辨率分割和边界框标签。通过与专家标注的数据进行对比评估,证明了其准确性足以支持弱监督训练的实施,从而减少手动劳动强度并为稳健的缺陷检测提供可扩展数据集创建的支持。
https://arxiv.org/abs/2512.06171