检索结果-内蒙古大学图书馆

Dual-AI: Dual-path Actor Interaction Learning for Group Activity recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Han, Mingfei Zhang, David Junhao Wang, Yali Yan, Rui Yao, Lina Chang, Xiaojun Qiao, Yu ReLER AAII UTS United States National University of Singapore Singapore ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China RMIT University Australia University of New South Wales Australia Shanghai AI Laboratory Shanghai China

Learning spatial-temporal relation among multiple actors is crucial for group activity recognition. Different group activities often show the diversified interactions between actors in the video. Hence, it is often difficult to model complex group activities from a single view of spatial-temporal actor evolution. To tackle this problem, we propose a distinct Dual-path Actor Interaction (Dual-AI) framework, which flexibly arranges spatial and temporal transformers in two complementary orders, enhancing actor relations by integrating merits from different spatiotemporal paths. Moreover, we introduce a novel Multi-scale Actor Contrastive Loss (MAC-Loss) between two interactive paths of Dual-AI. Via self-supervised actor consistency in both frame and video levels, MAC-Loss can effectively distinguish individual actor representations to reduce action confusion among different actors. Consequently, our Dual-AI can boost group activity recognition by fusing such discriminative features of different actors. To evaluate the proposed approach, we conduct extensive experiments on the widely used benchmarks, including Volleyball [24], Collective Activity [12], and NBA datasets [56]. The proposed Dual-AI achieves state-of-the-art performance on all these datasets. It is worth noting the proposed Dual-AI with 50% training data outperforms a number of recent approaches with 100% training data. This confirms the generalization power of Dual-AI for group activity recognition, even under the challenging scenarios of limited supervision. Copyright © 2022, The Authors. All rights reserved.

关键词： Machine learning

Revisiting the Generalization Problem of Low-level vision Models Through the Lens of Image Deraining

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Hu, Jinfan You, Zhiyuan Gu, Jinjin Zhu, Kaiwen Xue, Tianfan Dong, Chao Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China University of Chinese Academy of Sciences Beijing100049 China The Chinese University of Hong Kong 999077 Hong Kong The University of Sydney NSW2006 Australia Shanghai Jiao Tong University Shanghai200240 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China Shenzhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China Shenzhen University of Advanced Technology Shenzhen518055 China

Generalization remains a significant challenge for low-level vision models, which often struggle with unseen degradations in real-world scenarios despite their success in controlled benchmarks. In this paper, we revisit the generalization problem in low-level vision models. Image deraining is selected as a case study due to its well-defined and easily decoupled structure, allowing for more effective observation and analysis. Through comprehensive experiments, we reveal that the generalization issue is not primarily due to limited network capacity but rather the failure of existing training strategies, which lead networks to overfit specific degradation patterns. Our findings show that guiding networks to focus on learning the underlying image content, rather than the degradation patterns, is key to improving generalization. We demonstrate that balancing the complexity of background images and degradations in the training data helps networks better fit the image distribution. Furthermore, incorporating content priors from pre-trained generative models significantly enhances generalization. Experiments on both image deraining and image denoising validate the proposed strategies. We believe the insights and solutions will inspire further research and improve the generalization of low-level vision models. Copyright © 2025, The Authors. All rights reserved.

关键词： Image denoising

Abstract: Learning to avoid poor images: towards task-aware c-arm cone-beam ct trajectories

学校读者我要写书评

暂无评论

Abstract: Learning to avoid poor images: towards task-aware ...

International workshop on Algorithmen - Systeme - Anwendungen, 2020

作者： Zaech, Jan-Nico Gao, Cong Bier, Bastian Taylor, Russell Maier, Andreas Navab, Nassir Unberath, Mathias Laboratory for Computational Sensing and Robotics Johns Hopkins University Baltimore United States Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Computer Vision Laboratory Eidgenössische Technische Hochschule Zürich Zürich Germany

ISBN: (纸本)9783658292669

Metal artifacts in computed tomography (CT) arise from a mismatch between physics of image formation and idealized assumptions during tomographic reconstruction. These artifacts are particularly strong around metal implants, inhibiting widespread adoption of 3D cone-beam CT (CBCT) despite clear opportunity for intra-operative verification of implant positioning, e. g. in spinal fusion surgery. On synthetic and real data, we demonstrate that much of the artifact can be avoided by acquiring better data for reconstruction in a task-aware and patient-specific manner, and describe the first step towards the envisioned task-aware CBCT protocol. © Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature 2020.

关键词： computerized tomography

Machine Learning and computer vision Techniques in Continuous Beehive Monitoring Applications: A Survey

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Bilik, Simon Zemcik, Tomas Kratochvila, Lukas Ricanek, Dominik Richter, Miloslav Zambanini, Sebastian Horak, Karel Department of Control and Instrumentation Faculty of Electrical Engineering and Communication Brno University of Technology Technická 3058/10 Brno61600 Czech Republic Computer Vision and Pattern Recognition Laboratory Department of Computational Engineering Lappeenranta-Lahti University of Technology LUT Yliopistonkatu 34 Lappeenranta53850 Finland Computer Vision Lab Institute of Visual Computing & Human-Centered Technology Faculty of Informatics TU Wien Favoritenstr. 9/193-1 ViennaA-1040 Austria

Wide use and availability of machine learning and computer vision techniques allows development of relatively complex monitoring systems in many domains. Besides the traditional industrial domain, new applications appears also in biology and agriculture, where they may be used to detect infections, parasites and weeds, but also for automated monitoring and early warning systems. This goes in concordance with the introduction of the easily accessible hardware and development kits such as the Arduino, or RaspberryPi families. In this paper, we survey 50 papers focusing on the methods of automated beehive monitoring using computer vision techniques. Particularly on the pollen and Varroa mite detection together with the bee traffic monitoring. Such systems could also be used for monitoring of honeybee colonies and for the inspection of their health state, which could potentially identify dangerous states before the situation is critical, or to better plan periodic bee colony inspections and therefore save significant costs. Further on, we also include analysis of the research trends in this application field and we outline the possible directions of new development. Our paper is also aimed at veterinary and apidology professionals and experts, who may not be familiar with machine learning to introduce them to its capabilities, hence each family of techniques is prefaced by a brief theoretical introduction and motivation related to its base method. We hope that this paper will inspire other scientists to use machine learning techniques for other applications in beehive monitoring. © 2022, CC BY.

关键词： computer vision

EfficientFCN: Holistically-Guided Decoding for Semantic Segmentation 1

学校读者我要写书评

暂无评论

16th European Conference on computer vision, ECCV 2020

作者： Liu, Jianbo He, Junjun Zhang, Jiawei Ren, Jimmy S. Li, Hongsheng CUHK-SenseTime Joint Laboratory The Chinese University of Hong Kong Shatin Hong Kong Shenzhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Beijing China SenseTime Research Beijing China

ISBN: (数字)9783030585747

ISBN: (纸本)9783030585730

Both performance and efficiency are important to semantic segmentation. State-of-the-art semantic segmentation algorithms are mostly based on dilated Fully Convolutional Networks (dilatedFCN), which adopt dilated convolutions in the backbone networks to extract high-resolution feature maps for achieving high-performance segmentation performance. However, due to many convolution operations are conducted on the high-resolution feature maps, such dilatedFCN-based methods result in large computational complexity and memory consumption. To balance the performance and efficiency, there also exist encoder-decoder structures that gradually recover the spatial information by combining multi-level feature maps from the encoder. However, the performances of existing encoder-decoder methods are far from comparable with the dilatedFCN-based methods. In this paper, we propose the EfficientFCN, whose backbone is a common ImageNet pretrained network without any dilated convolution. A holistically-guided decoder is introduced to obtain the high-resolution semantic-rich feature maps via the multi-scale features from the encoder. The decoding task is converted to novel codebook generation and codeword assembly task, which takes advantages of the high-level and low-level features from the encoder. Such a framework achieves comparable or even better performance than state-of-the-art methods with only 1/3 of the computational cost. Extensive experiments on PASCAL Context, PASCAL VOC, ADE20K validate the effectiveness of the proposed EfficientFCN. © 2020, Springer Nature Switzerland AG.

关键词： Semantic Segmentation

VideoPipe 2022 Challenge: Real-World Video Understanding for Urban Pipe Inspection

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Liu, Yi Zhang, Xuan Li, Ying Liang, Guixin Jiang, Yabing Qiu, Lixia Tang, Haiping Xie, Fei Yao, Wei Dai, Yi Qiao, Yu Wang, Yali ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institute of Advanced Technology Chinese Academy of Sciences China Shenzhen Bwell Technology Co. Ltd China Shenzhen Longhua Drainage Co. Ltd China Shanghai AI Laboratory Shanghai China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China

Video understanding is an important problem in computer vision. Currently, the well-studied task in this research is human action recognition, where the clips are manually trimmed from the long videos, and a single class of human action is assumed for each clip. However, we may face more complicated scenarios in the industrial applications. For example, in the real-world urban pipe system, anomaly defects are fine-grained, multi-labeled, domain-relevant. To recognize them correctly, we need to understand the detailed video content. For this reason, we propose to advance research areas of video understanding, with a shift from traditional action recognition to industrial anomaly analysis. In particular, we introduce two high-quality video benchmarks, namely QV-Pipe and CCTV-Pipe, for anomaly inspection in the real-world urban pipe systems. Based on these new datasets, we will host two competitions including (1) Video Defect Classification on QV-Pipe and (2) Temporal Defect Localization on CCTV-Pipe. In this report, we describe the details of these benchmarks, the problem definitions of competition tracks, the evaluation metric, and the result summary. We expect that, this competition would bring new opportunities and challenges for video understanding in smart city and beyond. The details of our VideoPipe challenge can be found in https://***. Copyright © 2022, The Authors. All rights reserved.

关键词： Defects

HIVE-Net: Centerline-Aware HIerarchical View-Ensemble Convolutional Network for Mitochondria Segmentation in EM Images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Yuan, Zhimin Ma, Xiaofen Yi, Jiajin Luo, Zhengrong Peng, Jialin College of Computer Science and Technology Huaqiao University Xiamen361021 China Department of Medical Imaging Guangdong Second Provincial General Hospital Guangzhou510317 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen361021 China

Background and objective: With the advancement of electron microscopy (EM) imaging technology, neuroscientists can investigate the function of various intracellular organelles, e.g, mitochondria, at nano-scale. Semantic segmentation of electron microscopy (EM) is an essential step to efficiently obtain reliable morphological statistics. Despite the great success achieved using deep convolutional neural networks (CNNs), they still produce coarse segmentations with lots of discontinuities and false positives for mitochondria segmentation. Methods: In this study, we introduce a centerline-aware multitask network by utilizing centerline as an intrinsic shape cue of mitochondria to regularize the segmentation. Since the application of 3D CNNs on large medical volumes is usually hindered by their substantial computational cost and storage overhead, we introduce a novel hierarchical view-ensemble convolution (HVEC), a simple alternative of 3D convolution to learn 3D spatial contexts using more efficient 2D convolutions. The HVEC enables both decomposing and sharing multi-view information, leading to increased learning capacity. Results: Extensive validation results on two challenging benchmarks show that, the proposed method performs favorably against the state-of-the-art methods in accuracy and visual quality but with a greatly reduced model size. Moreover, the proposed model also shows significantly improved generalization ability, especially when training with quite limited amount of training data. Detailed sensitivity analysis and ablation study have also been conducted, which show the robustness of the proposed model and effectiveness of the proposed modules. Conclusions: The experiments highlighted that the proposed architecture enables both simplicity and efficiency leading to increased capacity of learning spatial contexts. Moreover, incorporating shape cues such as centerline information is a promising approach to improve the performance of mitochondria segmentati

关键词： Convolution

UniFormer: Unifying Convolution and Self-attention for Visual recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Kunchang Wang, Yali Zhang, Junhao Gao, Peng Song, Guanglu Liu, Yu Li, Hongsheng Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China University of Chinese Academy of Sciences Beijing100049 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China National University of Singapore Singapore Shanghai Artificial Intelligence Laboratory China SenseTime Research China The Chinese University of Hong Kong Hong Kong

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have been two dominant frameworks in the past few years. Though CNNs can efficiently decrease local redundancy by convolution within a small neighborhood, the limited receptive field makes it hard to capture global dependency. Alternatively, ViTs can effectively capture long-range dependency via self-attention, while blind similarity comparisons among all the tokens lead to high redundancy. To resolve these problems, we propose a novel Unified transFormer (UniFormer), which can seamlessly integrate the merits of convolution and self-attention in a concise transformer format. Different from the typical transformer blocks, the relation aggregators in our UniFormer block are equipped with local and global token affinity respectively in shallow and deep layers, allowing tackling both redundancy and dependency for efficient and effective representation learning. Finally, we flexibly stack our blocks into a new powerful backbone, and adopt it for various vision tasks from image to video domain, from classification to dense prediction. Without any extra training data, our UniFormer achieves 86.3 top-1 accuracy on ImageNet-1K classification task. With only ImageNet-1K pre-training, it can simply achieve state-of-the-art performance in a broad range of downstream tasks. It obtains 82.9/84.8 top-1 accuracy on Kinetics-400/600, 60.9/71.2 top-1 accuracy on Something-Something V1/V2 video classification tasks, 53.8 box AP and 46.4 mask AP on COCO object detection task, 50.8 mIoU on ADE20K semantic segmentation task, and 77.4 AP on COCO pose estimation task. Moreover, we build an efficient UniFormer with a concise hourglass design of token shrinking and recovering, which achieves 2-4× higher throughput than the recent lightweight models. Code is av

关键词： Convolution

Periodic Action Temporal Localization Method Based on Two-Path Architecture for Product Counting in Sewing Video 15th

学校读者我要写书评

暂无评论

Periodic Action Temporal Localization Method Based on Two-Pa...

15th International Conference on Intelligent Computing, ICIC 2019

作者： Huang, Jin-Long Zhang, Hong-Bo Du, Ji-Xiang Zheng, Jian-Feng Peng, Xiao-Xiao Department of Computer Science and Technology Huaqiao University Xiamen China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen China

ISBN: (纸本)9783030267650

Automatically product counting in the handmade process plays a vital role in the manufacturing industry, especially at the sewing industry. Nevertheless, there is currently a few methods to count the product number in the hand sewing process from surveillance video automatically. Due to the sewing procedure is a cyclical action, the product counting in hand sewing process is regarded as periodic action temporal localization and counting problem. In this paper, in order to solve this problem, we propose a novel two-path method, based on pose estimation and region-based convolutional neural network. The pose estimation method is used to obtain the trajectory information of human joint points, and the periodic action is located by detecting the periodic changes in joint trajectory. An effective two-threshold method is proposed to locate each action and count the number of periodic action from the trajectory information. To more accurately localization, we use a convolutional neural network to predict whether the workbench is empty or not. We fuse the results of joint trajectory and the status of the workbench to adjust the final periodic action localization and counting the number. To verify the proposed method, we built a new video database collected in the real sewing industry. The experimental results show that the proposed method is effective and constructive at periodic action localization and counting in the video for the sewing industry. © 2019, Springer Nature Switzerland AG.

关键词： Neural networks