检索结果-内蒙古大学图书馆

NTIRE 2023 Image Shadow Removal Challenge Report

学校读者我要写书评

暂无评论

NTIRE 2023 Image Shadow Removal Challenge Report

2023 IEEE/CVF Conference on computer vision and Pattern Recognition Workshops, CVPRW 2023

作者： Vasluianu, Florin-Alexandru Seizinger, Tim Timofte, Radu Cui, Shuhao Huang, Junshi Tian, Shuman Fan, Mingyuan Zhang, Jiaqi Zhu, Li Wei, Xiaoming Wei, Xiaolin Luo, Ziwei Gustafsson, Fredrik K. Zhao, Zheng Sjölund, Jens Schön, Thomas B. Dong, Xiaoyi Zhang, Xi Sheryl Li, Chenghua Leng, Cong Yeo, Woon-Ha Oh, Wang-Taek Lee, Yeo-Reum Ryu, Han-Cheol Luo, Jinting Jiang, Chengzhi Han, Mingyan Wu, Qi Lin, Wenjie Yu, Lei Li, Xinpeng Jiang, Ting Fan, Haoqiang Liu, Shuaicheng Xu, Shuning Song, Binbin Chen, Xiangyu Zhang, Shile Zhou, Jiantao Zhang, Zhao Zhao, Suiyi Zheng, Huan Gao, Yangcheng Wei, Yanyan Wang, Bo Ren, Jiahuan Luo, Yan Kondo, Yuki Miyata, Riku Yasue, Fuma Naruki, Taito Ukita, Norimichi Chang, Hua-En Yang, Hao-Hsiang Chen, Yi-Chung Chiang, Yuan-Chun Huang, Zhi-Kai Chen, Wei-Ting Chen, I-Hsiang Hsieh, Chia-Hsuan Kuo, Sy-Yen Xianwei, Li Fu, Huiyuan Liu, Chunlin Ma, Huadong Fu, Binglan He, Huiming Wang, Mengjia She, Wenxuan Liu, Yu Nathan, Sabari Kansal, Priya Zhang, Zhongjian Yang, Huabin Wang, Yan Zhang, Yanru Phutke, Shruti S. Kulkarni, Ashutosh Khan, Md Raqib Murala, Subrahmanyam Vipparthi, Santosh Kumar Ye, Heng Liu, Zixi Yang, Xingyi Liu, Songhua Wu, Yinwei Jing, Yongcheng Yu, Qianhao Zheng, Naishan Huang, Jie Long, Yuhang Yao, Mingde Zhao, Feng Zhao, Bowen Ye, Nan Shen, Ning Cao, Yanpeng Xiong, Tong Xia, Weiran Li, Dingwen Xia, Shuchen Computer Vision Lab Ifi Caidas University of Würzburg Germany Computer Vision Lab Eth Zürich Switzerland Meituan Group China Department of Information Technology Uppsala University Sweden Institute of Automation Chinese Academy of Sciences Beijing China Nanjing China Maicro Nanjing China Department of Artificial Intelligence Convergence Sahmyook University Seoul Korea Republic of Megvii Technology China University of Electronic Science and Technology of China China University of Macau China China Toyota Technological Institute Japan Graduate Institute of Electronics Engineering National Taiwan University Taiwan Department of Electrical Engineering National Taiwan University Taiwan Graduate Institute of Communication Engineering National Taiwan University Taiwan ServiceNow United States Beijing University of Post and Teleconmunication Beijing China Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education China Couger Inc. Computer Vision and Pattern Recognition Lab Indian Institute of Technology Ropar Punjab Rupnagar India Research Institute Singapore National University of Singapore Singapore Research Institute Singapore University of Sydney Australia Brain-Inspired Vision Laboratory Information Science and Technology Institution University of Science and Technology of China China State Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou310027 China Key Laboratory of Advanced Manufacturing Technology of Zhejiang Province School of Mechanical Engineering Zhejiang University Hangzhou310027 China South China University of Technology China

ISBN: (纸本)9798350302493

This work reviews the results of the NTIRE 2023 Challenge on Image Shadow Removal. The described set of solutions were proposed for a novel dataset, which captures a wide range of object-light interactions. It consists of 1200 roughly pixel aligned pairs of real shadow free and shadow affected images, captured in a controlled environment. The data was captured in a white-box setup, using professional equipment for lights and data acquisition sensors. The challenge had a number of 144 participants registered, out of which 19 teams were compared in the final ranking. The proposed solutions extend the work on shadow removal, improving over the performance level describing state-of-the-art methods. © 2023 IEEE.

关键词： Data acquisition

Sequential 3D Human Pose and Shape Estimation From Point Clouds

学校读者我要写书评

暂无评论

Sequential 3D Human Pose and Shape Estimation From Point Clo...

Conference on computer vision and Pattern Recognition (CVPR)

作者： Kangkan Wang Jin Xie Guofeng Zhang Lei Liu Jian Yang Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology China State Key Laboratory of CAD&CG Zhejiang University China ZJU-SenseTime Joint Lab of 3D Vision

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

This work addresses the problem of 3D human pose and shape estimation from a sequence of point clouds. Existing sequential 3D human shape estimation methods mainly focus on the template model fitting from a sequence of depth images or the parametric model regression from a sequence of RGB images. In this paper, we propose a novel sequential 3D human pose and shape estimation framework from a sequence of point clouds. Specifically, the proposed framework can regress 3D coordinates of mesh vertices at different resolutions from the latent features of point clouds. Based on the estimated 3D coordinates and features at the low resolution, we develop a spatial-temporal mesh attention convolution (MAC) to predict the 3D coordinates of mesh vertices at the high resolution. By assigning specific attentional weights to different neighboring points in the spatial and temporal domains, our spatial-temporal MAC can capture structured spatial and temporal features of point clouds. We further generalize our framework to the real data of human bodies with a weakly supervised fine-tuning method. The experimental results on SURREAL, Human3.6M, DFAUST and the real detailed data demonstrate that the proposed approach can accurately recover the 3D body model sequence from a sequence of point clouds.

关键词： Three-dimensional displays Solid modeling Shape Biological system modeling Estimation Spatial resolution Feature extraction

Evolving multi-resolution pooling CNN for monaural singing voice separation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Yuan, Weitao Dong, Bofei Wang, Shengbei Unoki, Masashi Wang, Wenwu Tianjin Key Laboratory of Autonomous Intelligence Technology and Systems School of Computer Science and Technology Tianjin Polytechnic University Tianjin China School of Information Science Japan Advanced Institute of Science and Technology Japan Centre for Vision Speech and Signal Processing University of Surrey Guildford United Kingdom

Monaural Singing Voice Separation (MSVS) is a challenging task and has been studied for decades. Deep neural networks (DNNs) are the current state-of-the-art methods for MSVS. However, the existing DNNs are often designed manually, which is time-consuming and error-prone. In addition, the network architectures are usually pre-defined, and not adapted to the training data. To address these issues, we introduce a Neural Architecture Search (NAS) method to the structure design of DNNs for MSVS. Specifically, we propose a new multi-resolution Convolutional Neural Network (CNN) framework for MSVS namely Multi-Resolution Pooling CNN (MRP-CNN), which uses various-size pooling operators to extract multi-resolution features. Based on the NAS, we then develop an evolving framework namely Evolving MRP-CNN (E-MRP-CNN), by automatically searching the effective MRP-CNN structures using genetic algorithms, optimized in terms of a single-objective considering only separation performance, or multi-objective considering both the separation performance and the model complexity. The multiobjective E-MRP-CNN gives a set of Pareto-optimal solutions, each providing a trade-off between separation performance and model complexity. Quantitative and qualitative evaluations on the MIR-1K and DSD100 datasets are used to demonstrate the advantages of the proposed framework over several recent baselines. Copyright © 2020, The Authors. All rights reserved.

关键词： Deep neural networks

LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-Resolution

学校读者我要写书评

暂无评论

LMR: A Large-Scale Multi-Reference Dataset for Reference-bas...

International Conference on computer vision (ICCV)

作者： Lin Zhang Xin Li Dongliang He Fu Li Errui Ding Zhaoxiang Zhang University of Chinese Academy of Sciences Institute of Automation Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems School of Future Technology UCAS Department of Computer Vision Technology (VIS) Baidu Inc. Center for Artificial Intelligence and Robotics HKISI_CAS

It is widely agreed that reference-based super-resolution (RefSR) achieves superior results by referring to similar high quality images, compared to single image super-resolution (SISR). Intuitively, the more references, the better performance. However, previous RefSR methods have all focused on single-reference image training, while multiple reference images are often available in testing or practical applications. The root cause of such training-testing mismatch is the absence of publicly available multi-reference SR training datasets, which greatly hinders research efforts on multi-reference super-resolution. To this end, we construct a large-scale, multi-reference super-resolution dataset, named LMR. It contains 112, 142 groups of 300×300 training images, which is 10× of the existing largest RefSR dataset. The image size is also some times larger. More importantly, each group is equipped with 5 reference images with different similarity levels. Furthermore, we propose a new baseline method for multi-reference super-resolution: MRefSR, including a Multi-Reference Attention Module (MAM) for feature fusion of an arbitrary number of reference images, and a Spatial Aware Filtering Module (SAFM) for the fused feature selection. The proposed MRefSR achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations. Our code and data are available at: https://***/wdmwhh/MRefSR.

关键词：

Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yu, Lu Tao, Zhe Yao, Hantao Van de Weijer, Joost Xu, Changsheng School of Computer Science and Engineering Tianjin University of Technology 300384 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China Computer Vision Center Universitat Au-tonoma de Barcelona Barcelona08193 Spain School of Artificial Intelligence University of the Chinese Academy of Sciences Beijing100049 China

Deep neural networks (DNNs) excel on fixed datasets but struggle with incremental and shifting data in real-world scenarios. Continual learning addresses this challenge by allowing models to learn from new data while retaining previously learned knowledge. Existing methods mainly rely on visual features, often neglecting the rich semantic information encoded in text. The semantic knowledge available in the label information of the images, offers important semantic information that can be related with previously acquired knowledge of semantic classes. Consequently, effectively leveraging this information throughout continual learning is expected to be beneficial. To address this, we propose integrating semantic guidance within and across tasks by capturing semantic similarity using text embeddings. We start from a pre-trained CLIP model, employ the Semantically-guided Representation Learning (SG-RL) module for a soft-assignment towards all current task classes, and use the Semantically-guided Knowledge Distillation (SG-KD) module for enhanced knowledge transfer. Experimental results demonstrate the superiority of our method on general and fine-grained datasets. Our code can be found in https://***/aprilsveryown/semantically-guided-continual-learning. © 2024, CC BY-NC-ND.

关键词： Contrastive Learning

Factual Serialization Enhancement: A key Innovation for Chest X-ray Report Generation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Kang Ma, Zhuoqi Liu, Mengmeng Jiao, Zhicheng Kang, Xiaolu Miao, Qiguang Xie, Kun The School of Computer Science and Technology Xidian University Shaanxi Xi’an710071 China The Xi'an Key Laboratory of Big Data and Intelligent Vision Shaanxi Xi’an710071 China The Key Laboratory of Collaborative Intelligence Systems Ministry of Education Xidian University Xi’an710071 China The School of Artificial Intelligence Xidian University Xi’an710071 China The Department of Diagnostic Imaging Brown University ProvidenceRI02903-4923 United States

A radiology report comprises presentation-style vocabulary, which ensures clarity and organization, and factual vocabulary, which provides accurate and objective descriptions based on observable findings. While manually writing these reports is time-consuming and labor-intensive, automatic report generation offers a promising alternative. A critical step in this process is to align radiographs with their corresponding reports. However, existing methods often rely on complete reports for alignment, overlooking the impact of presentation-style vocabulary. To address this issue, we propose FSE, a two-stage Factual Serialization Enhancement method. In Stage 1, we introduce factuality-guided contrastive learning for visual representation by maximizing the semantic correspondence between radiographs and corresponding factual descriptions. In Stage 2, we present evidence-driven report generation that enhances diagnostic accuracy by integrating insights from similar historical cases structured as factual serialization. Experiments on MIMIC-CXR and IU X-ray datasets across specific and general scenarios demonstrate that FSE outperforms state-of-the-art approaches in both natural language generation and clinical efficacy metrics. Ablation studies further emphasize the positive effects of factual serialization in Stage 1 and Stage 2. The code is available at https://***/mk-runner/FSE. Copyright © 2024, The Authors. All rights reserved.

关键词： Report generators

Multi-view face detection based on real Adaboost algorithm

学校读者我要写书评

暂无评论

Jisuanji Yanjiu yu Fazhan/computer Research and Development 2005年第9期42卷 1612-1621页

作者： Wu, Bo Huang, Chang Ai, Haizhou Lao, Shihong State Key Laboratory of Intelligent Technology and Systems Department of Computer Science and Technology Tsinghua University Beijing 100084 China Sensing Technology Laboratory Vision Sensing Technology Group Omron Corporation Kyoto 619-0283 Japan

In this paper, a multi-view face detection method based on real Adaboost algorithm is presented. Human faces are divided into several viewpoint categories according to their poses in 3D, and for each of these categories a form of weak classifiers in look-up-table (LUT) type is designed using Haar-like features that have confidences in real values as their outputs, and correspondingly its space of weak classifiers is constructed, from which the cascade face detector is learnt by using real Adaboost algorithm. For speed up, multi-resolution searching and pose prediction strategies are introduced. For frontal face detection, the experiments on CMU + MIT frontal face test set result in a correct rate of 94.5% with 57 false alarms;for multi-view face detection, the experiments on CMU profile face test set result in a correct rate of 89.8% with 221 false alarms. The average processing time on a PIV 2.4 GHz PC is about 80 ms for a 320 × 240-pixel image. It can be seen that the proposed method is very efficient and has significant value in application.

关键词： Haar-like feature LUT weak classifier Multi-view face detection Pose estimation Real Adaboost

RDA: An Accelerated Collision Free Motion Planner for Autonomous Navigation in Cluttered Environments

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Han, Ruihua Wang, Shuai Wang, Shuaijun Zhang, Zeqing Zhang, Qianru Eldar, Yonina C. Hao, Qi Pan, Jia The Department of Computer Science and Engineering Southern University of Science and Technology Guangdong Shenzhen China The Department of Computer Science The University of Hong Kong Hong Kong Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China The Department of Computer Science and Engineering Harbin Institute of Technology Guangdong Shenzhen China The Weizmann Institute of Science Rehovot Israel The Department of Computer Science and Engineering The Shenzhen Key Laboratory of Robotics and Computer Vision The Sifakis Research Institute for Trustworthy Autonomous Systems Southern University of Science and Technology Guangdong Shenzhen China

Autonomous motion planning is challenging in multi-obstacle environments due to nonconvex collision avoidance constraints. Directly applying numerical solvers to these nonconvex formulations fails to exploit the constraint structures, resulting in excessive computation time. In this paper, we present an accelerated collision-free motion planner, namely regularized dual alternating direction method of multipliers (RDADMM or RDA for short), for the model predictive control (MPC) based motion planning problem. The proposed RDA addresses nonconvex motion planning via solving a smooth biconvex reformulation via duality and allows the collision avoidance constraints to be computed in parallel for each obstacle to reduce computation time significantly. We validate the performance of the RDA planner through path-tracking experiments with car-like robots in both simulation and real-world settings. Experimental results show that the proposed method generates smooth collision-free trajectories with less computation time compared with other benchmarks and performs robustly in cluttered environments. The source code is available at https://***/hanruihua/ RDA_planner. Copyright © 2022, The Authors. All rights reserved.

关键词： Motion planning

Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Kang Ma, Zhuoqi Kang, Xiaolu Zhong, Zhusi Jiao, Zhicheng Baird, Grayson Bai, Harrison Miao, Qiguang School of Computer Science and Technology Xidian University Xi’an China Xi’an Key Laboratory of Big Data and Intelligent Vision Xi’an China Key Laboratory of Collaborative Intelligence Systems Ministry of Education Xidian University Xi’an China Warren Alpert Medical School Brown University Providence United States School of Electronic Engineering Xidian University Xi’an China Department of Radiology and Radiological Sciences Johns Hopkins University School of Medicine Baltimore United States

The automated generation of imaging reports proves invaluable in alleviating the workload of radiologists. A clinically applicable reports generation algorithm should demonstrate its effectiveness in producing reports that accurately describe radiology findings and attend to patient-specific indications. In this paper, we introduce a novel method, Structural Entities extraction and patient indications Incorporation (SEI) for chest X-ray report generation. Specifically, we employ a structural entities extraction (SEE) approach to eliminate presentation-style vocabulary in reports and improve the quality of factual entity sequences. This reduces the noise in the following cross-modal alignment module by aligning X-ray images with factual entity sequences in reports, thereby enhancing the precision of cross-modal alignment and further aiding the model in gradient-free retrieval of similar historical cases. Subsequently, we propose a cross-modal fusion network to integrate information from X-ray images, similar historical cases, and patient-specific indications. This process allows the text decoder to attend to discriminative features of X-ray images, assimilate historical diagnostic information from similar cases, and understand the examination intention of patients. This, in turn, assists in triggering the text decoder to produce high-quality reports. Experiments conducted on MIMIC-CXR validate the superiority of SEI over state-of-the-art approaches on both natural language generation and clinical efficacy metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Extraction