检索结果-内蒙古大学图书馆

Learning Unsupervised Hierarchical Part Decomposition of 3D Objects from a Single RGB Image

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Paschalidou, Despoina van Gool, Luc Geiger, Andreas Max Planck Institute for Intelligent Systems Tübingen University of Tübingen Computer Vision Lab ETH Zürich KU Leuven Max Planck ETH Center for Learning Systems

Humans perceive the 3D world as a set of distinct objects that are characterized by various low-level (geometry, reflectance) and high-level (connectivity, adjacency, symmetry) properties. Recent methods based on convolutional neural networks (CNNs) demonstrated impressive progress in 3D reconstruction, even when using a single 2D image as input. However, the majority of these methods focuses on recovering the local 3D geometry of an object without considering its part-based decomposition or relations between parts. We address this challenging problem by proposing a novel formulation that allows to jointly recover the geometry of a 3D object as a set of primitives as well as their latent hierarchical structure without part-level supervision. Our model recovers the higher level structural decomposition of various objects in the form of a binary tree of primitives, where simple parts are represented with fewer primitives and more complex parts are modeled with more components. Our experiments on the ShapeNet and D-FAUST datasets demonstrate that considering the organization of parts indeed facilitates reasoning about 3D geometry. Copyright © 2020, The Authors. All rights reserved.

关键词： Geometry

Learning Unsupervised Hierarchical Part Decomposition of 3D Objects From a Single RGB Image

学校读者我要写书评

暂无评论

Learning Unsupervised Hierarchical Part Decomposition of 3D ...

Conference on computer vision and Pattern Recognition (CVPR)

作者： Despoina Paschalidou Luc Van Gool Andreas Geiger Max Planck Institute for Intelligent Systems Tübingen Computer Vision Lab ETH Zürich Max Planck ETH Center for Learning Systems KU Leuven University of Tübingen

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

关键词： Shape Three-dimensional displays Geometry Image reconstruction Neural networks Solid modeling Two dimensional displays

Binding in hippocampal-entorhinal circuits enables compositionality in cognitive maps 24

学校读者我要写书评

暂无评论

Binding in hippocampal-entorhinal circuits enables compositi...

Proceedings of the 38th International Conference on Neural Information Processing systems

作者： Christopher J. Kymn Sonia Mazelet Anthony Thomas Denis Kleyko E. Paxon Frady Friedrich T. Sommer Bruno A. Olshausen Redwood Center for Theoretical Neuroscience Helen Wills Neuroscience Institute UC Berkeley Berkeley Redwood Center for Theoretical Neuroscience Helen Wills Neuroscience Institute UC Berkeley Berkeley and Université Paris-Saclay ENS Paris-Saclay Gif-sur-Yvette France Redwood Center for Theoretical Neuroscience Helen Wills Neuroscience Institute UC Berkeley Berkeley and Department of Electrical and Computer Engineering UC Davis Davis Centre for Applied Autonomous Sensor Systems Örebro University Örebro Sweden and Intelligent Systems Lab Research Institutes of Sweden Kista Sweden Intel Labs Santa Clara Redwood Center for Theoretical Neuroscience Helen Wills Neuroscience Institute UC Berkeley Berkeley and Intel Labs Santa Clara Redwood Center for Theoretical Neuroscience Helen Wills Neuroscience Institute UC Berkeley Berkeley and Herbert Wertheim School of Optometry & Vision Science UC Berkeley Berkeley

ISBN: (纸本)9798331314385

We propose a normative model for spatial representation in the hippocampal formation that combines optimality principles, such as maximizing coding range and spatial information per neuron, with an algebraic framework for computing in distributed representation. Spatial position is encoded in a residue number system, with individual residues represented by high-dimensional, complex-valued vectors. These are composed into a single vector representing position by a similarity-preserving, conjunctive vector-binding operation. Self-consistency between the representations of the overall position and of the individual residues is enforced by a modular attractor network whose modules correspond to the grid cell modules in entorhinal cortex. The vector binding operation can also associate different contexts to spatial representations, yielding a model for entorhinal cortex and hippocampus. We show that the model achieves normative desiderata including superlinear scaling of patterns with dimension, robust error correction, and hexagonal, carry-free encoding of spatial position. These properties in turn enable robust path integration and association with sensory inputs. More generally, the model formalizes how compositional computations could occur in the hippocampal formation and leads to testable experimental predictions. Code is available at https://***/SoniaMaz8/Hippocampal_enthorinal_circuit

关键词：

Self-supervised linear motion deblurring

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Liu, Peidong Janai, Joel Pollefeys, Marc Sattler, Torsten Geiger, Andreas Computer Vision and Geometry Group Department of Computer Science ETH Zürich Switzerland Autonomous Vision Group Max Planck Institute for Intelligent Systems Univeristy of Tübingen Tübingen Germany Microsoft Mixed Reality and Artificial Intelligence Lab Zürich Switzerland Computer Vision and Medical Image Analysis Group Chalmers University of Technology Sweden

Motion blurry images challenge many computer vision algorithms, e.g., feature detection, motion estimation, or object recognition. Deep convolutional neural networks are state-of-the-art for image deblurring. However, obtaining training data with corresponding sharp and blurry image pairs can be difficult. In this paper, we present a differentiable reblur model for self-supervised motion deblurring, which enables the network to learn from real-world blurry image sequences without relying on sharp images for supervision. Our key insight is that motion cues obtained from consecutive images yield sufficient information to inform the deblurring task. We therefore formulate deblurring as an inverse rendering problem, taking into account the physical image formation process: we first predict two deblurred images from which we estimate the corresponding optical flow. Using these predictions, we re-render the blurred images and minimize the difference with respect to the original blurry inputs. We use both synthetic and real dataset for experimental evaluations. Our experiments demonstrate that self-supervised single image deblurring is really feasible and leads to visually compelling results. Both the code and datasets are available at https://***/ethliup/SelfDeblur. Copyright © 2020, The Authors. All rights reserved.

关键词： Image enhancement

NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Results

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Xiaoning Wu, Zongwei Li, Ao Vasluianu, Florin Zhang, Yulun Gu, Shuhang Zhang, Le Zhu, Ce Timofte, Radu Jin, Zhi Wu, Hongjun Wang, Chenxi Ling, Haitao Cai, Yuanhao Bian, Hao Zheng, Yuxin Lin, Jing Yuille, Alan Shao, Ben Guo, Jin Liu, Tianli Wu, Mohao Feng, Yixu Hou, Shuo Lin, Haotian Zhu, Yu Wu, Peng Dong, Wei Sun, Jinqiu Zhang, Yanning Yan, Qingsen Zou, Wenbin Yang, Weipeng Li, Yunxiang Wei, Qiaomu Ye, Tian Chen, Sixiang Zhang, Zhao Zhao, Suiyi Wang, Bo Luo, Yan Zuo, Zhichao Wang, Mingshen Wang, Junhu Wei, Yanyan Sun, Xiaopeng Gao, Yu Huang, Jiancheng Chen, Hongming Chen, Xiang Tang, Hui Chen, Yuanbin Zhou, Yuanbo Dai, Xinwei Qiu, Xintao Deng, Wei Gao, Qinquan Tong, Tong Li, Mingjia Hu, Jin He, Xinyu Guo, Xiaojie Sabarinathan Uma, K. Sasithradevi, A. Sathya Bama, B. Mohamed Mansoor Roomi, S. Srivatsav, V. Wang, Jinjuan Sun, Long Chen, Qiuying Shao, Jiahong Zhang, Yizhi Conde, Marcos V. Feijoo, Daniel Benito, Juan C. García, Alvaro Lee, Jaeho Kim, Seongwan Sharif, S.M.A. Khujaev, Nodirkhuja Tsoy, Roman Murtaza, Ali Khairuddin, Uswah Faudzi, Ahmad'Athif Mohd Malagi, Sampada Joshi, Amogh Akalwadi, Nikhil Desai, Chaitra Tabib, Ramesh Ashok Mudenagudi, Uma Lian, Wenyi Lian, Wenjing Kalyanshetti, Jagadeesh Aralikatti, Vijayalaxmi Ashok Yashaswini, Palani Upasi, Nitish Hegde, Dikshit Patil, Ujwala Sujata, C. Yan, Xingzhuo Hao, Wei Fu, Minghan Choksy, Pooja Sarvaiya, Anjali Upla, Kishor Raja, Kiran Yan, Hailong Zhang, Yunkai Li, Baiang Zhang, Jingyi Zheng, Huan University of Electronic Science and Technology of China China Computer Vision Lab University of Würzburg Germany Shanghai Jiao Tong University China Computer Vision Lab ETH Zurich Switzerland School of Intelligent Systems Engineering Sun Yat-sen University Shenzhen Campus Guangdong Shenzhen518107 China Guangdong Provincial Key Laboratory of Fire Science and Technology Guangzhou510006 China Johns Hopkins University United States Tsinghua University China Zhejiang Dahua Technology Co. Ltd. China School of Computer Science Northwestern Polytechnical University China School of Software Northwestern Polytechnical University China School of Computer Science Xi'an University of Architecture and Technology China South China University of Technology China Fuzhou University China Chengdu University of Information Technology China Hong Kong University of Science and Technology Guangzhou China Hefei University of Technology China Individual Researcher Shenyang Aerospace University China Nanjing University of Science and Technology China Fuzhou University Fuzhou China Imperial Vision Technology Fuzhou China Tianjin University China Couger Inc Japan Sasi Institute of Technology & Engineering India Vellore Institute of Technology India Thiagarajar college of engineering India Coventry University United Kingdom Cidaut AI CVLab University of Wuerzburg Germany Opt-AI University Teknologi Malaysia Kuala Lumpur Malaysia Universiti Teknologi Malaysia Kuala Lumpur Malaysia KLE Technological University Karnataka Hubballi India School of Electronics and Communication Engineering KLE Technological University Karnataka Hubballi India School of Computer Science and Engineering KLE Technological University Karnataka Hubballi India Uppsala University Sweden Northeastern University United States Bosch Investment Ltd. China Fortinet Inc. University of Saskatchewan Canada Sardar Vallabhbhai National Institute of Technology India Norwegian University of Science and Technolog

This paper reviews the NTIRE 2024 low light image enhancement challenge, highlighting the proposed solutions and results. The aim of this challenge is to discover an effective network design or solution capable of generating brighter, clearer, and visually appealing results when dealing with a variety of conditions, including ultra-high resolution (4K and beyond), non-uniform illumination, backlighting, extreme darkness, and night scenes. A notable total of 428 participants registered for the challenge, with 22 teams ultimately making valid submissions. This paper meticulously evaluates the state-of-the-art advancements in enhancing low-light images, reflecting the significant progress and creativity in this field. © 2024, CC BY.

关键词： Image enhancement

A mobile robot hand-arm teleoperation system by vision and IMU

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Li, Shuang Jiang, Jiaxi Ruppel, Philipp Liang, Hongzhuo Ma, Xiaojian Hendrich, Norman Sun, Fuchun Zhang, Jianwei Department of Informatics Universität Hamburg Department of Computer Science RWTH Aachen University Center for Vision Cognition Learning and Autonomy Department of Statistics University of California Los Angeles United States State Key Lab on Intelligent Technology and Systems Department of Computer Science and Technology Tsinghua University

In this paper, we present a multimodal mobile teleoperation system that consists of a novel vision-based hand pose regression network (Transteleop) and an IMU-based arm tracking method. Transteleop observes the human hand through a low-cost depth camera and generates not only joint angles but also depth images of paired robot hand poses through an image-to-image translation process. A keypoint-based reconstruction loss explores the resemblance in appearance and anatomy between human and robotic hands and enriches the local features of reconstructed images. A wearable camera holder enables simultaneous hand-arm control and facilitates the mobility of the whole teleoperation system. Network evaluation results on a test dataset and a variety of complex manipulation tasks that go beyond simple pick-and-place operations show the efficiency and stability of our multimodal teleoperation system. Copyright © 2020, The Authors. All rights reserved.

关键词： Robotic arms

RayNet: Learning volumetric 3d reconstruction with ray potentials

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Paschalidou, Despoina Ulusoy, Ali Osman Schmitt, Carolin Van Gool, Luc Geiger, Andreas Autonomous Vision Group MPI for Intelligent Systems Tübingen Microsoft Computer Vision Lab ETH Zürich KU Leuven Computer Vision and Geometry Group ETH Zürich Max Planck ETH Center for Learning Systems

In this paper, we consider the problem of reconstructing a dense 3D model using images captured from different views. Recent methods based on convolutional neural networks (CNN) allow learning the entire task from data. However, they do not incorporate the physics of image formation such as perspective geometry and occlusion. Instead, classical approaches based on Markov Random Fields (MRF) with ray-potentials explicitly model these physical processes, but they cannot cope with large surface appearance variations across different viewpoints. In this paper, we propose RayNet, which combines the strengths of both frameworks. RayNet integrates a CNN that learns view-invariant feature representations with an MRF that explicitly encodes the physics of perspective projection and occlusion. We train RayNet end-to-end using empirical risk minimization. We thoroughly evaluate our approach on challenging real-world datasets and demonstrate its benefits over a piece-wise trained baseline, hand-crafted models as well as other learning-based approaches. Copyright © 2019, The Authors. All rights reserved.

关键词： Image reconstruction

The quaternion-based anisotropic gradient for the color images 17

学校读者我要写书评

暂无评论

The quaternion-based anisotropic gradient for the color imag...

17th Image Processing: Algorithms and systems Conference, IPAS 2019

作者： Voronin, V. Zelensky, A. Agaian, S. Don State Technical University Lab. «Mathematical Methods of Image Processing and Computer Vision Intelligent Systems» Gagarina 1 Rostov on Don Russia Moscow State University of Technology"STANKIN" Moscow Russia CUNY College of Staten Island Dept. of Computer Science New York United States

Image gradient, as a preprocessing step is an essential tool in image processing in many research areas such as edge detection, segmentation, smoothing, inpainting, etc. In the present paper, we develop a new gradient by integrated the quaternion framework with LPA-ICI (local polynomial approximation - the intersection of confidence intervals) based on anisotropic gradient concepts for the color image processing applications. computer simulations on the Berkeley Segmentation Dataset show that the new quaternion anisotropic gradient exhibits fewer color artifacts compared to state-of-the-art techniques including well-knowledge gradient operators. © 2019, Society for Imaging Science and Technology.

关键词： Polynomial approximation

Feedback alfa-rooting algorithm for medical image enhancement 17

学校读者我要写书评

暂无评论

Feedback alfa-rooting algorithm for medical image enhancemen...

17th Image Processing: Algorithms and systems Conference, IPAS 2019

作者： Voronin, V. Zelensky, A. Agaian, S. Don State Technical University Lab. «Mathematical Methods of Image Processing and Computer Vision Intelligent Systems» Gagarina 1 Rostov on Don Russia Moscow State University of Technology "STANKIN" Moscow Russia CUNY/ College of Staten Island Dept. of Computer Science New York United States

This paper presents a new combined local and global transform domain-based feedback image enhancement algorithm for medical diagnosis, treatment, and clinical research. The basic idea in using local alfa-rooting method is to apply it to different disjoint blocks with different sizes. The block size and alfa-rooting parameters driven through optimization using the Agaian's cost function (image enhancement non-reference quality measure). The presented new approach allows enhancing MRI and CT images with uneven lighting and brightness gradient by preserving the local image features/details. Extensive computer simulations (CS) on real medical images are offered to gage the presented method. CS shows that our method improves the contrast and enhances the details of the medical images effectively compared with the current state-of-art methods. © 2019, Society for Imaging Science and Technology.

关键词： Clinical research