检索结果-内蒙古大学图书馆

Non-local recurrent regularization networks for multi-view stereo

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Xu, Qingshan Oswald, Martin R. Tao, Wenbing Pollefeys, Marc Cui, Zhaopeng National Key Laboratory of Science and Technology on Multispectral Information Processing School of Artifical Intelligence and Automation Huazhong University of Science and Technology China Computer Vision and Geometry Group ETH Zurich Switzerland State Key Lab of CAD & CG Zhejiang University China Microsoft Artificial Intelligence and Mixed Reality Lab Zurich Switzerland

In deep multi-view stereo networks, cost regularization is crucial to achieve accurate depth estimation. Since 3D cost volume filtering is usually memory-consuming, recurrent 2D cost map regularization has recently become popular and has shown great potential in reconstructing 3D models of different scales. However, existing recurrent methods only model the local dependencies in the depth domain, which greatly limits the capability of capturing the global scene context along the depth dimension. To tackle this limitation, we propose a novel non-local recurrent regularization network for multi-view stereo, named NR2-Net. Specifically, we design a depth attention module to capture non-local depth interactions within a sliding depth block. Then, the global scene context between different blocks is modeled in a gated recurrent manner. This way, the long-range dependencies along the depth dimension are captured to facilitate the cost regularization. Moreover, we design a dynamic depth map fusion strategy to improve the algorithm robustness. Our method achieves state-of-the-art reconstruction results on both DTU and Tanks and Temples datasets. Copyright © 2021, The Authors. All rights reserved.

关键词： Three dimensional computer graphics

The SARAS endoscopic surgeon action detection (ESAD) dataset: Challenges and methods

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Bawa, Vivek Singh Singh, Gurkirt Kaping'a, Francis Skarga-Bandurova, Inna Oleari, Elettra Leporini, Alice Landolfo, Carmela Zhao, Pengfei Xiang, Xi Luo, Gongning Wang, Kuanquan Li, Liangzhi Wang, Bowen Zhao, Shang Li, Li Stabile, Armando Setti, Francesco Muradore, Riccardo Cuzzolin, Fabio Visual Artificial Intelligence Laboratory Oxford Brookes University United Kingdom Computer Vision Lab ETH Zurich Switzerland San Raffaele Hospital Milan Italy University of Verona Italy Harbin Institute of Technology China George Washington University United States Osaka University Japan

For an autonomous robotic system, monitoring surgeon actions and assisting the main surgeon during a procedure can be very challenging. The challenges come from the peculiar structure of the surgical scene, the greater similarity in appearance of actions performed via tools in a cavity compared to, say, human actions in unconstrained environments, as well as from the motion of the endoscopic camera. This paper presents ESAD, the first large-scale dataset designed to tackle the problem of surgeon action detection in endoscopic minimally invasive surgery. ESAD aims at contributing to increase the effectiveness and reliability of surgical assistant robots by realistically testing their awareness of the actions performed by a surgeon. The dataset provides bounding box annotation for 21 action classes on real endoscopic video frames captured during prostatectomy, and was used as the basis of a recent MIDL 2020 challenge. We also present an analysis of the dataset conducted using the baseline model which was released as part of the challenge, and a description of the top performing models submitted to the challenge together with the results they obtained. This study provides significant insight into what approaches can be effective and can be extended further. We believe that ESAD will serve in the future as a useful benchmark for all researchers active in surgeon action detection and assistive robotics at large. © 2021, CC BY-NC-ND.

关键词： Urology

NTIRE 2023 Image Shadow Removal Challenge Report

学校读者我要写书评

暂无评论

NTIRE 2023 Image Shadow Removal Challenge Report

2023 IEEE/CVF Conference on computer vision and Pattern Recognition Workshops, CVPRW 2023

作者： Vasluianu, Florin-Alexandru Seizinger, Tim Timofte, Radu Cui, Shuhao Huang, Junshi Tian, Shuman Fan, Mingyuan Zhang, Jiaqi Zhu, Li Wei, Xiaoming Wei, Xiaolin Luo, Ziwei Gustafsson, Fredrik K. Zhao, Zheng Sjölund, Jens Schön, Thomas B. Dong, Xiaoyi Zhang, Xi Sheryl Li, Chenghua Leng, Cong Yeo, Woon-Ha Oh, Wang-Taek Lee, Yeo-Reum Ryu, Han-Cheol Luo, Jinting Jiang, Chengzhi Han, Mingyan Wu, Qi Lin, Wenjie Yu, Lei Li, Xinpeng Jiang, Ting Fan, Haoqiang Liu, Shuaicheng Xu, Shuning Song, Binbin Chen, Xiangyu Zhang, Shile Zhou, Jiantao Zhang, Zhao Zhao, Suiyi Zheng, Huan Gao, Yangcheng Wei, Yanyan Wang, Bo Ren, Jiahuan Luo, Yan Kondo, Yuki Miyata, Riku Yasue, Fuma Naruki, Taito Ukita, Norimichi Chang, Hua-En Yang, Hao-Hsiang Chen, Yi-Chung Chiang, Yuan-Chun Huang, Zhi-Kai Chen, Wei-Ting Chen, I-Hsiang Hsieh, Chia-Hsuan Kuo, Sy-Yen Xianwei, Li Fu, Huiyuan Liu, Chunlin Ma, Huadong Fu, Binglan He, Huiming Wang, Mengjia She, Wenxuan Liu, Yu Nathan, Sabari Kansal, Priya Zhang, Zhongjian Yang, Huabin Wang, Yan Zhang, Yanru Phutke, Shruti S. Kulkarni, Ashutosh Khan, Md Raqib Murala, Subrahmanyam Vipparthi, Santosh Kumar Ye, Heng Liu, Zixi Yang, Xingyi Liu, Songhua Wu, Yinwei Jing, Yongcheng Yu, Qianhao Zheng, Naishan Huang, Jie Long, Yuhang Yao, Mingde Zhao, Feng Zhao, Bowen Ye, Nan Shen, Ning Cao, Yanpeng Xiong, Tong Xia, Weiran Li, Dingwen Xia, Shuchen Computer Vision Lab Ifi Caidas University of Würzburg Germany Computer Vision Lab Eth Zürich Switzerland Meituan Group China Department of Information Technology Uppsala University Sweden Institute of Automation Chinese Academy of Sciences Beijing China Nanjing China Maicro Nanjing China Department of Artificial Intelligence Convergence Sahmyook University Seoul Korea Republic of Megvii Technology China University of Electronic Science and Technology of China China University of Macau China China Toyota Technological Institute Japan Graduate Institute of Electronics Engineering National Taiwan University Taiwan Department of Electrical Engineering National Taiwan University Taiwan Graduate Institute of Communication Engineering National Taiwan University Taiwan ServiceNow United States Beijing University of Post and Teleconmunication Beijing China Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education China Couger Inc. Computer Vision and Pattern Recognition Lab Indian Institute of Technology Ropar Punjab Rupnagar India Research Institute Singapore National University of Singapore Singapore Research Institute Singapore University of Sydney Australia Brain-Inspired Vision Laboratory Information Science and Technology Institution University of Science and Technology of China China State Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou310027 China Key Laboratory of Advanced Manufacturing Technology of Zhejiang Province School of Mechanical Engineering Zhejiang University Hangzhou310027 China South China University of Technology China

ISBN: (纸本)9798350302493

This work reviews the results of the NTIRE 2023 Challenge on Image Shadow Removal. The described set of solutions were proposed for a novel dataset, which captures a wide range of object-light interactions. It consists of 1200 roughly pixel aligned pairs of real shadow free and shadow affected images, captured in a controlled environment. The data was captured in a white-box setup, using professional equipment for lights and data acquisition sensors. The challenge had a number of 144 participants registered, out of which 19 teams were compared in the final ranking. The proposed solutions extend the work on shadow removal, improving over the performance level describing state-of-the-art methods. © 2023 IEEE.

关键词： Data acquisition

Fast and accurate single-image depth estimation on mobile devices, mobile AI 2021 challenge: Report

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Ignatov, Andrey Malivenko, Grigory Plowman, David Shukla, Samarth Timofte, Radu Zhang, Ziyu Wang, Yicheng Huang, Zilong Luo, Guozhong Yu, Gang Fu, Bin Wang, Yiran Li, Xingyi Shi, Min Xian, Ke Cao, Zhiguo Du, Jin-Hua Wu, Pei-Lin Ge, Chao Yao, Jiaoyang Tu, Fangwen Li, Bo Yoo, Jung Eun Seo, Kwanggyoon Xu, Jialei Li, Zhenyu Liu, Xianming Jiang, Junjun Chen, Wei-Chi Joya, Shayan Fan, Huanhuan Kang, Zhaobing Li, Ang Feng, Tianpeng Liu, Yang Sheng, Chuannan Yin, Jian Benavides, Fausto T. Computer Vision Lab ETH Zurich Switzerland Ltd AI Witchlabs Switzerland Tencent GY-Lab China Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Nanjing Artificial Intelligence Chip Research Institute of Automation Chinese Academy of Sciences China Black Sesame Technologies Inc. Singapore Singapore Visual Media Lab KAIST Korea Republic of Harbin Institute of Technology China Peng Cheng Laboratory China Multimedia and Computer Vision Laboratory National Cheng Kung University Taiwan Samsung Research UK United Kingdom OPPO Research Institute China ETH Zurich Switzerland

Depth estimation is an important computer vision problem with many practical applications to mobile devices. While many solutions have been proposed for this task, they are usually very computationally expensive and thus are not applicable for on-device inference. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based depth estimation solutions that can demonstrate a nearly real-time performance on smartphones and IoT platforms. For this, the participants were provided with a new large-scale dataset containing RGB-depth image pairs obtained with a dedicated stereo ZED camera producing high-resolution depth maps for objects located at up to 50 meters. The runtime of all models was evaluated on the popular Raspberry Pi 4 platform with a mobile ARM-based Broadcom chipset. The proposed solutions can generate VGA resolution depth maps at up to 10 FPS on the Raspberry Pi 4 while achieving high fidelity results, and are compatible with any Android or Linux-based mobile devices. A detailed description of all models developed in the challenge is provided in this paper. Copyright © 2021, The Authors. All rights reserved.

关键词： computer operating systems

Self-supervised linear motion deblurring

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Liu, Peidong Janai, Joel Pollefeys, Marc Sattler, Torsten Geiger, Andreas Computer Vision and Geometry Group Department of Computer Science ETH Zürich Switzerland Autonomous Vision Group Max Planck Institute for Intelligent Systems Univeristy of Tübingen Tübingen Germany Microsoft Mixed Reality and Artificial Intelligence Lab Zürich Switzerland Computer Vision and Medical Image Analysis Group Chalmers University of Technology Sweden

Motion blurry images challenge many computer vision algorithms, e.g., feature detection, motion estimation, or object recognition. Deep convolutional neural networks are state-of-the-art for image deblurring. However, obtaining training data with corresponding sharp and blurry image pairs can be difficult. In this paper, we present a differentiable reblur model for self-supervised motion deblurring, which enables the network to learn from real-world blurry image sequences without relying on sharp images for supervision. Our key insight is that motion cues obtained from consecutive images yield sufficient information to inform the deblurring task. We therefore formulate deblurring as an inverse rendering problem, taking into account the physical image formation process: we first predict two deblurred images from which we estimate the corresponding optical flow. Using these predictions, we re-render the blurred images and minimize the difference with respect to the original blurry inputs. We use both synthetic and real dataset for experimental evaluations. Our experiments demonstrate that self-supervised single image deblurring is really feasible and leads to visually compelling results. Both the code and datasets are available at https://***/ethliup/SelfDeblur. Copyright © 2020, The Authors. All rights reserved.

关键词： Image enhancement

Object finding in cluttered scenes using interactive perception

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Novkovic, Tonci Pautrat, Remi Furrer, Fadri Breyer, Michel Siegwart, Roland Nieto, Juan Autonomous Systems Lab ETH Zurich8092 Switzerland Computer Vision and Geometry Group ETH Zurich8092 Switzerland

Object finding in clutter is a skill that requires both perception of the environment and in many cases physical interaction. In robotics, interactive perception defines a set of algorithms that leverage actions to improve the perception of the environment, and vice versa use perception to guide the next action. Scene interactions are difficult to model, therefore, most of the current systems use predefined heuristics. This limits their ability to efficiently search for the target object in a complex environment. In order to remove heuristics and the need for explicit models of the interactions, in this work we propose a reinforcement learning based active and interactive perception system for scene exploration and object search. We evaluate our work both in simulated and in real world experiments using a robotic manipulator equipped with an RGB and a depth camera, and compared our system to two baselines. The results indicate that our approach, trained in simulation only, transfers smoothly to reality and can solve the object finding task efficiently and with more than 90% success rate. Copyright © 2019, The Authors. All rights reserved.

关键词： Robotics

NTIRE 2020 Challenge on Video Quality Mapping: Methods and Results

学校读者我要写书评

暂无评论

NTIRE 2020 Challenge on Video Quality Mapping: Methods and R...

IEEE computer Society Conference on computer vision and Pattern Recognition Workshops (CVPRW)

作者： Dario Fuoli Zhiwu Huang Martin Danelljan Radu Timofte Hua Wang Longcun Jin Dewei Su Jing Liu Jaehoon Lee Michal Kudelski Lukasz Bala Dmitry Hrybov Marcin Mozejko Muchen Li Siyao Li Bo Pang Cewu Lu Chao Li Dongliang He Fu Li Shilei Wen Computer Vision Lab ETH Zurich Switzerland School of Software Engineering South China University of Technology Guangdong China Multimedia and Computer Vision Lab East China Normal University Shanghai China Department of Electronics and Computer Engineering Hanyang University Seoul Korea TCL Research Europe Warsaw Poland Machine Vision and Intelligence Group Department of Computer Science Shanghai Jiao Tong University Shanghai China Department of Computer Vision Technology (VIS) Baidu Inc. Beijing China

ISBN: (数字)9781728193601

ISBN: (纸本)9781728193618

This paper reviews the NTIRE 2020 challenge on video quality mapping (VQM), which addresses the issues of quality mapping from source video domain to target video domain. The challenge includes both a supervised track (track 1) and a weakly-supervised track (track 2) for two benchmark datasets. In particular, track 1 offers a new Internet video benchmark, requiring algorithms to learn the map from more compressed videos to less compressed videos in a supervised training manner. In track 2, algorithms are required to learn the quality mapping from one device to another when their quality varies substantially and weakly- aligned video pairs are available. For track 1, in total 7 teams competed in the final test phase, demonstrating novel and effective solutions to the problem. For track 2, some existing methods are evaluated, showing promising solutions to the weakly-supervised video quality mapping problem.

关键词： Video recording Quality assessment Generative adversarial networks Target tracking Training Cameras Image coding

Event-based robotic grasping detection with neuromorphic vision sensor and event-stream dataset

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Li, Bin Cao, Hu Qu, Zhongnan Hu, Yingbai Wang, Zhenke Liang, Zichen JingDong Group Beijing China Tongji University Shanghai China Chair of Robotics Artificial Intelligence and Real-time Systems Technische Universität München München Germany Computer Eng. and Networks Lab ETH Zurich Switzerland

Robotic grasping plays an important role in the field of robotics. The current state-of-the-art robotic grasping detection systems are usually built on the conventional vision, such as RGB-D camera. Compared to traditional frame-based computer vision, neuromorphic vision is a small and young community of research. Currently, there are limited event-based datasets due to the troublesome annotation of the asynchronous event stream. Annotating large scale vision dataset often takes lots of computation resources, especially the troublesome data for video-level annotation. In this work, we consider the problem of detecting robotic grasps in a moving camera view of a scene containing objects. To obtain more agile robotic perception, a neuromorphic vision sensor (DAVIS) attaching to the robot gripper is introduced to explore the potential usage in grasping detection. We construct a robotic grasping dataset named Event-Stream Dataset with 91 objects. A spatio-temporal mixed particle filter (SMP Filter) is proposed to track the led-based grasp rectangles which enables video-level annotation of a single grasp rectangle per object. As leds blink at high frequency, the Event-Stream dataset is annotated in a high frequency of 1 kHz. Based on the Event-Stream dataset, we develop a deep neural network for grasping detection which consider the angle learning problem as classification instead of regression. The method performs high detection accuracy on our Event-Stream dataset with 93% precision at object-wise level. This work provides a large-scale and well-annotated dataset, and promotes the neuromorphic vision applications in agile robot. Copyright © 2020, The Authors. All rights reserved.

关键词： Cameras

Large-Scale, Real-Time visual-Inertial localization revisited

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Lynen, Simon Zeisl, Bernhard Aiger, Dror Bosse, Michael Hesch, Joel Pollefeys, Marc Siegwart, Roland Sattler, Torsten Google Switzerland Zurich Switzerland Google Israel Tel Aviv Israel Autonomous Systems Lab ETH Zurich Computer Vision and Geometry Group Department of Computer Science ETH Zurich Department of Microsoft Department of Electrical Engineering Chalmers University of Technology

The overarching goals in image-based localization are scale, robustness and speed. In recent years, approaches based on local features and sparse 3D point-cloud models have both dominated the benchmarks and seen successful realworld deployment. They enable applications ranging from robot navigation, autonomous driving, virtual and augmented reality to device geo-localization. Recently end-to-end learned localization approaches have been proposed which show promising results on small scale datasets. However the positioning accuracy, scalability, latency and compute & storage requirements of these approaches remain open challenges. We aim to deploy localization at global-scale where one thus relies on methods using local features and sparse 3D models. Our approach spans from offline model building to real-time client-side pose fusion. The system compresses appearance and geometry of the scene for efficient model storage and lookup leading to scalability beyond what what has been previously demonstrated. It allows for low-latency localization queries and efficient fusion run in real-time on mobile platforms by combining server-side localization with real-time visual-inertial-based camera pose tracking. In order to further improve efficiency we leverage a combination of priors, nearest neighbor search, geometric match culling and a cascaded pose candidate refinement step. This combination outperforms previous approaches when working with large scale models and allows deployment at unprecedented scale. We demonstrate the effectiveness of our approach on a proof-of-concept system localizing 2.5 million images against models from four cities in different regions on the world achieving query latencies in the 200ms range. Copyright © 2019, The Authors. All rights reserved.

关键词： Nearest neighbor search