Weakly supervised semantic segmentation (WSSS) in histopathology reduces pixel-level labeling by learning from image-level labels, but it is hindered by inter-class homogeneity, intra-class heterogeneity, and CAM-induced region shrinkage (global pooling-based class activation maps whose activations highlight only the most distinctive areas and miss nearby class regions). Recent works address these challenges by constructing a clustering prototype bank and then refining masks in a separate stage; however, such two-stage pipelines are costly, sensitive to hyperparameters, and decouple prototype discovery from segmentation learning, limiting their effectiveness and efficiency. We propose a cluster-free, one-stage learnable-prototype framework with diversity regularization to enhance morphological intra-class heterogeneity coverage. Our approach achieves state-of-the-art (SOTA) performance on BCSS-WSSS, outperforming prior methods in mIoU and mDice. Qualitative segmentation maps show sharper boundaries and fewer mislabels, and activation heatmaps further reveal that, compared with clustering-based prototypes, our learnable prototypes cover more diverse and complementary regions within each class, providing consistent qualitative evidence for their effectiveness.
弱监督语义分割(WSSS)在组织病理学中通过从图像级别标签学习来减少像素级标注,但该方法受到类内异质性、类间同质性和CAM诱导的区域收缩等问题的影响。最近的研究通过构建聚类原型库并在独立阶段进行掩码细化来解决这些问题;然而,这类两阶段管道成本高,对超参数敏感,并且将原型发现与分割学习解耦,限制了其有效性和效率。我们提出了一种无需集群的一阶段可学习原型框架,并采用多样性正则化以增强形态类内异质性的覆盖范围。我们的方法在BCSS-WSSS数据集上达到了最先进的(SOTA)性能,在mIoU和mDice指标上超越了以前的方法。定性分割图显示出了更清晰的边界并且错误标注较少,而激活热图进一步揭示了相比于基于聚类的原型,我们的可学习原型能够覆盖每个类别内更多样化且互补的区域,提供了其有效性的持续证据。
https://arxiv.org/abs/2512.05922
Synthesizing high-fidelity frozen 3D scenes from monocular Mannequin-Challenge (MC) videos is a unique problem distinct from standard dynamic scene reconstruction. Instead of focusing on modeling motion, our goal is to create a frozen scene while strategically preserving subtle dynamics to enable user-controlled instant selection. To achieve this, we introduce a novel application of dynamic Gaussian splatting: the scene is modeled dynamically, which retains nearby temporal variation, and a static scene is rendered by fixing the model's time parameter. However, under this usage, monocular capture with sparse temporal supervision introduces artifacts like ghosting and blur for Gaussians that become unobserved or occluded at weakly supervised timestamps. We propose Splannequin, an architecture-agnostic regularization that detects two states of Gaussian primitives, hidden and defective, and applies temporal anchoring. Under predominantly forward camera motion, hidden states are anchored to their recent well-observed past states, while defective states are anchored to future states with stronger supervision. Our method integrates into existing dynamic Gaussian pipelines via simple loss terms, requires no architectural changes, and adds zero inference overhead. This results in markedly improved visual quality, enabling high-fidelity, user-selectable frozen-time renderings, validated by a 96% user preference. Project page: this https URL
合成高保真度的冻结3D场景,这是从单目Mannequin-Challenge(MC)视频中提取的独特问题,这个问题与标准动态场景重建不同。在我们的目标中,并非专注于建模运动本身,而是要创建一个静止场景,同时战略性地保留微妙的动力学现象,以实现用户控制的即时选择。为了实现这一目标,我们引入了一种新型的动态高斯点绘制应用:通过动态模型来保持附近的时间变化,并通过固定模型的时间参数来渲染静态场景。然而,在这种使用方式下,单目捕捉加上稀疏时间监督会在Gaussians(在弱监督时间戳处未被观察到或被遮挡)中引入如幽灵和模糊等伪影。 我们提出了Splannequin——一种与架构无关的正则化方法,它可以检测高斯元素的两种状态:隐藏态和缺陷态,并应用时间锚定。在主要向前移动摄像头的情况下,隐藏的状态会被锚定到其最近且观察良好的过去状态,而缺陷的状态则被锚定到未来监督更强烈的状态。 我们的方法通过简单的损失项融入现有的动态高斯管道中,无需架构更改,并且不会增加任何推理开销。这导致了显著的视觉质量改进,能够实现高保真度、用户可选择的时间冻结渲染,经验证据是96%的用户偏好。项目页面:[此处插入链接](请根据实际情况添加正确的URL)。
https://arxiv.org/abs/2512.05113
Multi-view crowd counting can effectively mitigate occlusion issues that commonly arise in single-image crowd counting. Existing deep-learning multi-view crowd counting methods project different camera view images onto a common space to obtain ground-plane density maps, requiring abundant and costly crowd annotations and camera calibrations. Hence, calibration-free methods are proposed that do not require camera calibrations and scene-level crowd annotations. However, existing calibration-free methods still require expensive image-level crowd annotations for training the single-view counting module. Thus, in this paper, we propose a weakly-supervised calibration-free multi-view crowd counting method (WSCF-MVCC), directly using crowd count as supervision for the single-view counting module rather than density maps constructed from crowd annotations. Instead, a self-supervised ranking loss that leverages multi-scale priors is utilized to enhance the model's perceptual ability without additional annotation costs. What's more, the proposed model leverages semantic information to achieve a more accurate view matching and, consequently, a more precise scene-level crowd count estimation. The proposed method outperforms the state-of-the-art methods on three widely used multi-view counting datasets under weakly supervised settings, indicating that it is more suitable for practical deployment compared with calibrated methods. Code is released in this https URL.
多视角人群计数可以有效缓解单图像人群计数中常见的遮挡问题。现有的基于深度学习的多视角人群计数方法将不同摄像头视角的图像投影到一个公共空间,以获取地面密度图,这需要大量的且成本高昂的人群标注和相机校准工作。因此,有人提出了无需相机校准和场景级人群注释的方法(即无校准方法)。然而,现有的无校准方法仍然需要昂贵的图像级别的人群注释来训练单视角计数模块。为此,在本文中,我们提出了一种弱监督下的无校准多视角人群计数方法(WSCF-MVCC),直接使用人群数量作为单视角计数模块的监督信号,而不是基于人群标注构建的密度图。相反,该方法利用了自监督排序损失来增强模型的感知能力,并且无需额外的注释成本,该损失函数利用多尺度先验信息。此外,所提出的模型还借助语义信息实现了更准确的视角匹配,并因此得出了更为精确的场景级别人群计数估计。在三个广泛使用的多视图计数组数据集上,在弱监督设置下,提出的方法超过了现有方法的表现,这表明与校准方法相比,该方法更适合实际部署。代码发布在此链接:[此URL](请将此处的实际内容替换为正确的URL)。
https://arxiv.org/abs/2512.02359
In recent years, Contrastive Language-Image Pretraining (CLIP) has been widely applied to Weakly Supervised Semantic Segmentation (WSSS) tasks due to its powerful cross-modal semantic understanding capabilities. This paper proposes a novel Semantic and Spatial Rectification (SSR) method to address the limitations of existing CLIP-based weakly supervised semantic segmentation approaches: over-activation in non-target foreground regions and background areas. Specifically, at the semantic level, the Cross-Modal Prototype Alignment (CMPA) establishes a contrastive learning mechanism to enforce feature space alignment across modalities, reducing inter-class overlap while enhancing semantic correlations, to rectify over-activation in non-target foreground regions effectively; at the spatial level, the Superpixel-Guided Correction (SGC) leverages superpixel-based spatial priors to precisely filter out interference from non-target regions during affinity propagation, significantly rectifying background over-activation. Extensive experiments on the PASCAL VOC and MS COCO datasets demonstrate that our method outperforms all single-stage approaches, as well as more complex multi-stage approaches, achieving mIoU scores of 79.5% and 50.6%, respectively.
近年来,对比语言-图像预训练(CLIP)由于其强大的跨模态语义理解能力,在弱监督语义分割(WSSS)任务中得到了广泛应用。本文提出了一种新颖的语义和空间矫正(SSR)方法,以解决现有基于 CLIP 的弱监督语义分割方法中存在的问题:非目标前景区域和背景区域中的过度激活现象。 具体来说,在语义层面,跨模态原型对齐(CMPA)建立了一个对比学习机制,强制不同模式之间的特征空间对齐,减少类间重叠并增强语义相关性,从而有效矫正非目标前景区域的过度激活;在空间层面上,超像素引导校正(SGC)利用基于超像素的空间先验知识,在亲和力传播过程中精确过滤掉非目标区域的影响,显著减少了背景的过度激活。 通过 PASCAL VOC 和 MS COCO 数据集上的大量实验表明,我们的方法超越了所有单阶段方法,并且在性能上优于更为复杂的多阶段方法,分别取得了 79.5% 和 50.6% 的 mIoU 分数。
https://arxiv.org/abs/2512.01701
Analyzing underwater fish imagery is critical for ecological monitoring but remains difficult due to visual degradation and costly annotations. We introduce FishDetector-R1, a unified MLLM-based framework for fish detection, segmentation, and counting under weak supervision. On the DeepFish dataset, our framework achieves substantial gains over baselines, improving AP by 20% and mIoU by 10%, while reducing MAE by 30% and GAME by 35%. These improvements stem from two key components: a novel detect-to-count prompt that enforces spatially consistent detections and counts, and Reinforcement Learning from Verifiable Reward (RLVR) with a complementary scalable paradigm leveraging sparse point labels. Ablation studies further validate the effectiveness of this reward design. Moreover, the improvement generalizes well to other underwater datasets, confirming strong cross-domain robustness. Overall, FishDetector-R1 provides a reliable and scalable solution for accurate marine visual understanding via weak supervision. The project page for FishDetector-R1 is this https URL.
分析水下鱼类图像对于生态监测至关重要,但由于视觉退化和高昂的标注成本,这一过程依然充满挑战。为此,我们提出了FishDetector-R1,这是一个基于多模态大型语言模型(MLLM)的统一框架,用于在弱监督条件下进行鱼类检测、分割和计数。 在DeepFish数据集上,我们的框架相较于基线方法实现了显著改进:平均精度(AP)提高了20%,平均交并比(mIoU)提升了10%,绝对平均误差(MAE)减少了30%,以及全局平均误差(GAME)降低了35%。这些改进主要归功于两个关键组成部分: - 一种新颖的检测至计数提示,该提示强制执行空间一致的检测和计数; - 基于可验证奖励的强化学习(RLVR),并采用了一种补充的大规模范式,利用稀疏点标签。 消融实验进一步证实了这种奖赏设计的有效性。此外,改进还很好地推广到了其他水下数据集上,确认了强大的跨域鲁棒性。 总体而言,FishDetector-R1为通过弱监督实现准确的海洋视觉理解提供了一个可靠且可扩展的解决方案。有关FishDetector-R1项目的更多信息,请访问此项目页面:[https URL](请将链接替换为您实际提供的URL)。
https://arxiv.org/abs/2512.05996
Monocular 3D object detection is a fundamental yet challenging task in 3D scene understanding. Existing approaches heavily depend on supervised learning with extensive 3D annotations, which are often acquired from LiDAR point clouds through labor-intensive labeling processes. To tackle this problem, we propose VSRD++, a novel weakly supervised framework for monocular 3D object detection that eliminates the reliance on 3D annotations and leverages neural-field-based volumetric rendering with weak 2D supervision. VSRD++ consists of a two-stage pipeline: multi-view 3D autolabeling and subsequent monocular 3D detector training. In the multi-view autolabeling stage, object surfaces are represented as signed distance fields (SDFs) and rendered as instance masks via the proposed instance-aware volumetric silhouette rendering. To optimize 3D bounding boxes, we decompose each instance's SDF into a cuboid SDF and a residual distance field (RDF) that captures deviations from the cuboid. To address the geometry inconsistency commonly observed in volume rendering methods applied to dynamic objects, we model the dynamic objects by including velocity into bounding box attributes as well as assigning confidence to each pseudo-label. Moreover, we also employ a 3D attribute initialization module to initialize the dynamic bounding box parameters. In the monocular 3D object detection phase, the optimized 3D bounding boxes serve as pseudo labels for training monocular 3D object detectors. Extensive experiments on the KITTI-360 dataset demonstrate that VSRD++ significantly outperforms existing weakly supervised approaches for monocular 3D object detection on both static and dynamic scenes. Code is available at this https URL
单目三维物体检测是三维场景理解中的一个基本但具有挑战性的任务。现有的方法依赖于监督学习,需要大量的三维标注数据,这些标注通常通过耗时的激光雷达点云标记过程获得。为了解决这个问题,我们提出了一种名为VSRD++的新颖弱监督框架,用于单目三维物体检测,该框架消除了对3D注释的依赖,并利用基于神经场的体渲染技术,仅使用2D弱标注进行训练。 VSRD++包含一个两阶段管道:多视图3D自动标记和随后的单目3D检测器训练。在多视图自动标签阶段中,物体表面被表示为符号距离场(SDFs),并通过提出的实例感知体轮廓渲染方法将其渲染成实例掩模。为了优化三维边界框,我们将每个实例的SDF分解为一个立方体SDF和一个残差距离场(RDF),后者捕捉偏离立方体的距离偏差。 此外,针对体积渲染方法应用于动态对象时常见的几何不一致性问题,我们通过将速度纳入边界盒属性以及为每一个伪标签分配置信度来对动态物体进行建模。同时,我们也采用了3D属性初始化模块来初始化动态边框参数。 在单目三维物体检测阶段中,优化后的三维边界框被用作训练单目三维物体检测器的伪标签。在KITTI-360数据集上的广泛实验表明,VSRD++显著优于现有的弱监督方法,在静态和动态场景下的性能均领先于其他方法。 代码可以在提供的链接中获取(原文中的“this https URL”)。
https://arxiv.org/abs/2512.01178
Micro-facial expressions are brief and involuntary facial movements that reflect genuine emotional states. While most prior work focuses on classifying discrete micro-expression categories, far fewer studies address the continuous evolution of intensity over time. Progress in this direction is limited by the lack of frame-level intensity labels, which makes fully supervised regression impractical. We propose a unified framework for continuous micro-expression intensity estimation using only weak temporal labels (onset, apex, offset). A simple triangular prior converts sparse temporal landmarks into dense pseudo-intensity trajectories, and a lightweight temporal regression model that combines a ResNet18 encoder with a bidirectional GRU predicts frame-wise intensity directly from image sequences. The method requires no frame-level annotation effort and is applied consistently across datasets through a single preprocessing and temporal alignment pipeline. Experiments on SAMM and CASME II show strong temporal agreement with the pseudo-intensity trajectories. On SAMM, the model reaches a Spearman correlation of 0.9014 and a Kendall correlation of 0.7999, outperforming a frame-wise baseline. On CASME II, it achieves up to 0.9116 and 0.8168, respectively, when trained without the apex-ranking term. Ablation studies confirm that temporal modeling and structured pseudo labels are central to capturing the rise-apex-fall dynamics of micro-facial movements. To our knowledge, this is the first unified approach for continuous micro-expression intensity estimation using only sparse temporal annotations.
微面部表情是短暂且不由自主的面部运动,反映的是真实的情感状态。以往的研究大多集中在离散的微表情分类上,而关注其随时间变化连续强度演变的研究则较少。由于缺乏帧级别的强度标签,使得完全监督下的回归方法难以实施,限制了这一领域的进展。我们提出了一种统一框架,仅使用稀疏的时间标签(起始点、峰值点和结束点)来进行连续微表情强度估计。 该方法包含两个关键部分:首先,通过简单的三角形先验将稀疏的时间地标转换为密集的伪强度轨迹;其次,结合 ResNet18 编码器与双向 GRU 的轻量级时间回归模型直接从图像序列中预测帧级别的强度。这种方法不需要对每个帧进行标注,并且可以通过统一的数据预处理和时间对齐管道在不同的数据集中一致地应用。 实验结果表明,在 SAMM 和 CASME II 数据集上,伪强度轨迹与真实值的时间一致性得到了显著提升。具体而言,在 SAMM 上,模型达到了 0.9014 的斯皮尔曼相关系数以及 0.7999 的肯德尔相关系数,并且优于帧级别基线模型的表现;在 CASME II 数据集上,当训练过程中不包括峰值排序项时,分别取得了最高为 0.9116 和 0.8168 的表现。消融研究表明时间建模和结构化伪标签对于捕捉微面部运动的上升-顶峰-下降动态至关重要。 据我们所知,这是第一个仅使用稀疏的时间标注来实现连续微表情强度估计的统一方法。
https://arxiv.org/abs/2512.01145
Cutmix-based data augmentation, which uses a cut-and-paste strategy, has shown remarkable generalization capabilities in deep learning. However, existing methods primarily consider global semantics with image-level constraints, which excessively reduces attention to the discriminative local context of the class and leads to a performance improvement bottleneck. Moreover, existing methods for generating augmented samples usually involve cutting and pasting rectangular or square regions, resulting in a loss of object part information. To mitigate the problem of inconsistency between the augmented image and the generated mixed label, existing methods usually require double forward propagation or rely on an external pre-trained network for object centering, which is inefficient. To overcome the above limitations, we propose LGCOAMix, an efficient context-aware and object-part-aware superpixel-based grid blending method for data augmentation. To the best of our knowledge, this is the first time that a label mixing strategy using a superpixel attention approach has been proposed for cutmix-based data augmentation. It is the first instance of learning local features from discriminative superpixel-wise regions and cross-image superpixel contrasts. Extensive experiments on various benchmark datasets show that LGCOAMix outperforms state-of-the-art cutmix-based data augmentation methods on classification tasks, {and weakly supervised object location on CUB200-2011.} We have demonstrated the effectiveness of LGCOAMix not only for CNN networks, but also for Transformer networks. Source codes are available at this https URL.
基于Cutmix的数据增强方法,利用剪切和粘贴策略,在深度学习中表现出卓越的泛化能力。然而,现有的方法主要关注全局语义与图像级别的约束条件,这极大地减少了对类别鉴别性局部上下文的关注,并导致性能改进瓶颈。此外,现有生成增强样本的方法通常涉及切割和粘贴矩形或正方形区域,从而导致物体部分信息丢失。为解决增强图像与其生成的混合标签之间的一致性问题,现有的方法通常需要双向前传播或者依赖外部预训练网络进行目标定位,这在效率上显得不足。 为了克服上述限制,我们提出了LGCOAMix,这是一种高效且具备上下文感知和对象部件感知能力的超像素网格融合数据增强方法。据我们所知,这是首次提出使用超像素注意机制来改进基于Cutmix的数据增强策略的方法。它也是第一次尝试从有区分性的超像素级区域中学习局部特征并利用跨图像的超像素对比度。 在多个基准数据集上的广泛实验表明,LGCOAMix在分类任务上优于现有的最先进的基于Cutmix的数据增强方法,并且在CUB200-2011弱监督目标定位方面也表现出色。我们已经证明了LGCOAMix不仅适用于CNN网络,还适用于Transformer网络。源代码可以在[提供链接的位置]获取。 请注意,上述文本中的“{and weakly supervised object location on CUB200-2011.}”可能是一个格式或引用错误,我假设您希望这段信息包含在最终的翻译中,并因此将其直接译出。如果有其他特定需求,请告知调整。
https://arxiv.org/abs/2512.00130
Weakly supervised learning has emerged as a practical alternative to fully supervised learning when complete and accurate labels are costly or infeasible to acquire. However, many existing methods are tailored to specific supervision patterns -- such as positive-unlabeled (PU), unlabeled-unlabeled (UU), complementary-label (CLL), partial-label (PLL), or similarity-unlabeled annotations -- and rely on post-hoc corrections to mitigate instability induced by indirect supervision. We propose a principled, unified framework that bypasses such post-hoc adjustments by directly formulating a stable surrogate risk grounded in the structure of weakly supervised data. The formulation naturally subsumes diverse settings -- including PU, UU, CLL, PLL, multi-class unlabeled, and tuple-based learning -- under a single optimization objective. We further establish a non-asymptotic generalization bound via Rademacher complexity that clarifies how supervision structure, model capacity, and sample size jointly govern performance. Beyond this, we analyze the effect of class-prior misspecification on the bound, deriving explicit terms that quantify its impact, and we study identifiability, giving sufficient conditions -- most notably via supervision stratification across groups -- under which the target risk is recoverable. Extensive experiments show consistent gains across class priors, dataset scales, and class counts -- without heuristic stabilization -- while exhibiting robustness to overfitting.
https://arxiv.org/abs/2511.22823
Image manipulation localization (IML) faces a fundamental trade-off between minimizing annotation cost and achieving fine-grained localization accuracy. Existing fully-supervised IML methods depend heavily on dense pixel-level mask annotations, which limits scalability to large datasets or real-world this http URL contrast, the majority of existing weakly-supervised IML approaches are based on image-level labels, which greatly reduce annotation effort but typically lack precise spatial localization. To address this dilemma, we propose BoxPromptIML, a novel weakly-supervised IML framework that effectively balances annotation cost and localization performance. Specifically, we propose a coarse region annotation strategy, which can generate relatively accurate manipulation masks at lower cost. To improve model efficiency and facilitate deployment, we further design an efficient lightweight student model, which learns to perform fine-grained localization through knowledge distillation from a fixed teacher model based on the Segment Anything Model (SAM). Moreover, inspired by the human subconscious memory mechanism, our feature fusion module employs a dual-guidance strategy that actively contextualizes recalled prototypical patterns with real-time observational cues derived from the input. Instead of passive feature extraction, this strategy enables a dynamic process of knowledge recollection, where long-term memory is adapted to the specific context of the current image, significantly enhancing localization accuracy and robustness. Extensive experiments across both in-distribution and out-of-distribution datasets show that BoxPromptIML outperforms or rivals fully-supervised models, while maintaining strong generalization, low annotation cost, and efficient deployment characteristics.
https://arxiv.org/abs/2511.20359
Weakly supervised semantic segmentation (WSSS) must learn dense masks from noisy, under-specified cues. We revisit the SegFormer decoder and show that three small, synergistic changes make weak supervision markedly more effective-without altering the MiT backbone or relying on heavy post-processing. Our method, CrispFormer, augments the decoder with: (1) a boundary branch that supervises thin object contours using a lightweight edge head and a boundary-aware loss; (2) an uncertainty-guided refiner that predicts per-pixel aleatoric uncertainty and uses it to weight losses and gate a residual correction of the segmentation logits; and (3) a dynamic multi-scale fusion layer that replaces static concatenation with spatial softmax gating over multi-resolution features, optionally modulated by uncertainty. The result is a single-pass model that preserves crisp boundaries, selects appropriate scales per location, and resists label noise from weak cues. Integrated into a standard WSSS pipeline (seed, student, and EMA relabeling), CrispFormer consistently improves boundary F-score, small-object recall, and mIoU over SegFormer baselines trained on the same seeds, while adding minimal compute. Our decoder-centric formulation is simple to implement, broadly compatible with existing SegFormer variants, and offers a reproducible path to higher-fidelity masks from image-level supervision.
https://arxiv.org/abs/2511.19765
Autonomous driving systems benefit from high-definition (HD) maps that provide critical information about road infrastructure. The online construction of HD maps offers a scalable approach to generate local maps from on-board sensors. However, existing methods typically rely on costly 3D map annotations for training, which limits their generalization and scalability across diverse driving environments. In this work, we propose MapRF, a weakly supervised framework that learns to construct 3D maps using only 2D image labels. To generate high-quality pseudo labels, we introduce a novel Neural Radiance Fields (NeRF) module conditioned on map predictions, which reconstructs view-consistent 3D geometry and semantics. These pseudo labels are then iteratively used to refine the map network in a self-training manner, enabling progressive improvement without additional supervision. Furthermore, to mitigate error accumulation during self-training, we propose a Map-to-Ray Matching strategy that aligns map predictions with camera rays derived from 2D labels. Extensive experiments on the Argoverse 2 and nuScenes datasets demonstrate that MapRF achieves performance comparable to fully supervised methods, attaining around 75% of the baseline while surpassing several approaches using only 2D labels. This highlights the potential of MapRF to enable scalable and cost-effective online HD map construction for autonomous driving.
https://arxiv.org/abs/2511.19527
Open-Vocabulary Object Detection (OVOD) aims to generalize object recognition to novel categories, while Weakly Supervised OVOD (WS-OVOD) extends this by combining box-level annotations with image-level labels. Despite recent progress, two critical challenges persist in this setting. First, existing semantic prototypes, even when enriched by LLMs, are static and limited, failing to capture the rich intra-class visual variations induced by different object states (e.g., a cat's pose). Second, the standard pseudo-box generation introduces a semantic mismatch between visual region proposals (which contain context) and object-centric text embeddings. To tackle these issues, we introduce two complementary prototype enhancement strategies. To capture intra-class variations in appearance and state, we propose the State-Enhanced Semantic Prototypes (SESP), which generates state-aware textual descriptions (e.g., "a sleeping cat") to capture diverse object appearances, yielding more discriminative prototypes. Building on this, we further introduce Scene-Augmented Pseudo Prototypes (SAPP) to address the semantic mismatch. SAPP incorporates contextual semantics (e.g., "cat lying on sofa") and utilizes a soft alignment mechanism to promote contextually consistent visual-textual representations. By integrating SESP and SAPP, our method effectively enhances both the richness of semantic prototypes and the visual-textual alignment, achieving notable improvements.
https://arxiv.org/abs/2511.18012
Deformable image registration (DIR) remains a fundamental yet challenging problem in medical image analysis, largely due to the prohibitively high-dimensional deformation space of dense displacement fields and the scarcity of voxel-level supervision. Existing reinforcement learning frameworks often project this space into coarse, low-dimensional representations, limiting their ability to capture spatially variant deformations. We propose MorphSeek, a fine-grained representation-level policy optimization paradigm that reformulates DIR as a spatially continuous optimization process in the latent feature space. MorphSeek introduces a stochastic Gaussian policy head atop the encoder to model a distribution over latent features, facilitating efficient exploration and coarse-to-fine refinement. The framework integrates unsupervised warm-up with weakly supervised fine-tuning through Group Relative Policy Optimization, where multi-trajectory sampling stabilizes training and improves label efficiency. Across three 3D registration benchmarks (OASIS brain MRI, LiTS liver CT, and Abdomen MR-CT), MorphSeek achieves consistent Dice improvements over competitive baselines while maintaining high label efficiency with minimal parameter cost and low step-level latency overhead. Beyond optimizer specifics, MorphSeek advances a representation-level policy learning paradigm that achieves spatially coherent and data-efficient deformation optimization, offering a principled, backbone-agnostic, and optimizer-agnostic solution for scalable visual alignment in high-dimensional settings.
https://arxiv.org/abs/2511.17392
The study of terrain and landform classification through UAV remote sensing diverges significantly from ground vehicle patrol tasks. Besides grappling with the complexity of data annotation and ensuring temporal consistency, it also confronts the scarcity of relevant data and the limitations imposed by the effective range of many technologies. This research substantiates that, in aerial positioning tasks, both the mean Intersection over Union (mIoU) and temporal consistency (TC) metrics are of paramount importance. It is demonstrated that fully labeled data is not the optimal choice, as selecting only key data lacks the enhancement in TC, leading to failures. Hence, a teacher-student architecture, coupled with key frame selection and key frame updating algorithms, is proposed. This framework successfully performs weakly supervised learning and TC knowledge distillation, overcoming the deficiencies of traditional TC training in aerial tasks. The experimental results reveal that our method utilizing merely 30\% of labeled data, concurrently elevates mIoU and temporal consistency ensuring stable localization of terrain objects. Result demo : this https URL
https://arxiv.org/abs/2511.16343
Parkinson's disease (PD) is a neurodegenerative disorder associated with the accumulation of misfolded alpha-synuclein aggregates, forming Lewy bodies and neuritic shape used for pathology diagnostics. Automatic analysis of immunohistochemistry histopathological images with Deep Learning provides a promising tool for better understanding the spatial organization of these aggregates. In this study, we develop an automated image processing pipeline to segment and classify these aggregates in whole-slide images (WSIs) of midbrain tissue from PD and incidental Lewy Body Disease (iLBD) cases based on weakly supervised segmentation, robust to immunohistochemical labelling variability, with a ResNet50 classifier. Our approach allows to differentiate between major aggregate morphologies, including Lewy bodies and neurites with a balanced accuracy of $80\%$. This framework paves the way for large-scale characterization of the spatial distribution and heterogeneity of alpha-synuclein aggregates in brightfield immunohistochemical tissue, and for investigating their poorly understood relationships with surrounding cells such as microglia and astrocytes.
https://arxiv.org/abs/2511.16268
In unsupervised or weakly-supervised approaches for speech dereverberation, the target clean (dry) signals are considered to be unknown during training. In that context, evaluating to what extent information can be retrieved from the sole knowledge of reverberant (wet) speech becomes critical. This work investigates the role of the reverberant (wet) phase in the time-frequency domain. Based on Statistical Wave Field Theory, we show that late reverberation perturbs phase components with white, uniformly distributed noise, except at low frequencies. Consequently, the wet phase carries limited useful information and is not essential for weakly supervised dereverberation. To validate this finding, we train dereverberation models under a recent weak supervision framework and demonstrate that performance can be significantly improved by excluding the reverberant phase from the loss function.
https://arxiv.org/abs/2511.17346
Recent progress in self- and weakly supervised occupancy estimation has largely relied on 2D projection or rendering-based supervision, which suffers from geometric inconsistencies and severe depth bleeding. We thus introduce ShelfOcc, a vision-only method that overcomes these limitations without relying on LiDAR. ShelfOcc brings supervision into native 3D space by generating metrically consistent semantic voxel labels from video, enabling true 3D supervision without any additional sensors or manual 3D annotations. While recent vision-based 3D geometry foundation models provide a promising source of prior knowledge, they do not work out of the box as a prediction due to sparse or noisy and inconsistent geometry, especially in dynamic driving scenes. Our method introduces a dedicated framework that mitigates these issues by filtering and accumulating static geometry consistently across frames, handling dynamic content and propagating semantic information into a stable voxel representation. This data-centric shift in supervision for weakly/shelf-supervised occupancy estimation allows the use of essentially any SOTA occupancy model architecture without relying on LiDAR data. We argue that such high-quality supervision is essential for robust occupancy learning and constitutes an important complementary avenue to architectural innovation. On the Occ3D-nuScenes benchmark, ShelfOcc substantially outperforms all previous weakly/shelf-supervised methods (up to a 34% relative improvement), establishing a new data-driven direction for LiDAR-free 3D scene understanding.
https://arxiv.org/abs/2511.15396
Computational cytology faces two major challenges: i) instance-level labels are unreliable and prohibitively costly to obtain, ii) witness rates are extremely low. We propose SLAM-AGS, a Slide-Label-Aware Multitask pretraining framework that jointly optimizes (i) a weakly supervised similarity objective on slide-negative patches and (ii) a self-supervised contrastive objective on slide-positive patches, yielding stronger performance on downstream tasks. To stabilize learning, we apply Adaptive Gradient Surgery to tackle conflicting task gradients and prevent model collapse. We integrate the pretrained encoder into an attention-based Multiple Instance Learning aggregator for bag-level prediction and attention-guided retrieval of the most abnormal instances in a bag. On a publicly available bone-marrow cytology dataset, with simulated witness rates from 10% down to 0.5%, SLAM-AGS improves bag-level F1-Score and Top 400 positive cell retrieval over other pretraining methods, with the largest gains at low witness rates, showing that resolving gradient interference enables stable pretraining and better performance on downstream tasks. To facilitate reproducibility, we share our complete implementation and evaluation framework as open source: this https URL.
https://arxiv.org/abs/2511.14639
Center-aligned regression remains dominant in LiDAR-based 3D object detection, yet it suffers from fundamental instability: object centers often fall in sparse or empty regions of the bird's-eye-view (BEV) due to the front-surface-biased nature of LiDAR point clouds, leading to noisy and inaccurate bounding box predictions. To circumvent this limitation, we revisit bounding box representation and propose corner-aligned regression, which shifts the prediction target from unstable centers to geometrically informative corners that reside in dense, observable regions. Leveraging the inherent geometric constraints among corners and image 2D boxes, partial parameters of 3D bounding boxes can be recovered from corner annotations, enabling a weakly supervised paradigm without requiring complete 3D labels. We design a simple yet effective corner-aware detection head that can be plugged into existing detectors. Experiments on KITTI show our method improves performance by 3.5% AP over center-based baseline, and achieves 83% of fully supervised accuracy using only BEV corner clicks, demonstrating the effectiveness of our corner-aware regression strategy.
https://arxiv.org/abs/2511.17619