Paper Reading AI Learner

MMDEW: Multipurpose Multiclass Density Estimation in the Wild

2025-10-02 16:57:29
Villanelle O'Reilly, Jonathan Cox, Georgios Leontidis, Marc Hanheide, Petra Bosilj, James Brown

Abstract

Density map estimation can be used to estimate object counts in dense and occluded scenes where discrete counting-by-detection methods fail. We propose a multicategory counting framework that leverages a Twins pyramid vision-transformer backbone and a specialised multi-class counting head built on a state-of-the-art multiscale decoding approach. A two-task design adds a segmentation-based Category Focus Module, suppressing inter-category cross-talk at training time. Training and evaluation on the VisDrone and iSAID benchmarks demonstrates superior performance versus prior multicategory crowd-counting approaches (33%, 43% and 64% reduction to MAE), and the comparison with YOLOv11 underscores the necessity of crowd counting methods in dense scenes. The method's regional loss opens up multi-class crowd counting to new domains, demonstrated through the application to a biodiversity monitoring dataset, highlighting its capacity to inform conservation efforts and enable scalable ecological insights.

Abstract (translated)

密度图估计可以用来估算在密集且遮挡场景中的物体数量,这种情况下离散的检测计数方法会失效。我们提出了一种多类别计数框架,该框架利用了Twins金字塔视觉变换器骨干网络以及一种基于最先进的多尺度解码方法构建的专业化多类计数头部。通过添加一个基于分割的Category Focus模块(任务二),设计成两阶段的任务架构可以在训练期间抑制跨类别间的相互干扰。 在VisDrone和iSAID基准数据集上的训练和评估显示,相比之前的多类别人群计数方法,该框架表现出更优越的性能(平均绝对误差(MAE)分别降低了33%,43%和64%)。与YOLOv11的比较进一步强调了在密集场景中采用人群计数方法的重要性。 此外,该方法引入的区域损失函数为多类别人群计数打开了新的应用领域。这一优势通过将其应用于一个生物多样性监测数据集得以展示,突显了其在指导保护工作和促进可扩展生态学洞察方面的能力。

URL

https://arxiv.org/abs/2510.02213

PDF

https://arxiv.org/pdf/2510.02213.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot