检索结果-内蒙古大学图书馆

UniTSFace: unified threshold integrated sample-to-sample loss for face recognition 23

学校读者我要写书评

暂无评论

UniTSFace: unified threshold integrated sample-to-sample los...

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Qiufu Li Xi Jia Jiancan Zhou Linlin Shen Jinming Duan National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China and Computer Vision Institute Shenzhen University China and SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China and Computer Vision Institute Shenzhen University China and School of Computer Science University of Birmingham UK National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China and Computer Vision Institute Shenzhen University China and Aqara Lumi United Technology Co. Ltd China School of Computer Science University of Birmingham UK and Alan Turing Institute UK

Sample-to-class-based face recognition models can not fully explore the cross-sample relationship among large amounts of facial images, while sample-to-sample-based models require sophisticated pairing processes for training. Furthermore, neither method satisfies the requirements of real-world face verification applications, which expect a unified threshold separating positive from negative facial pairs. In this paper, we propose a unified threshold integrated sample-to-sample based loss (USS loss), which features an explicit unified threshold for distinguishing positive from negative pairs. Inspired by our USS loss, we also derive the sample-to-sample based softmax and BCE losses, and discuss their relationship. Extensive evaluation on multiple benchmark datasets, including MFR, IJB-C, LFW, CFP-FP, AgeDB, and MegaFace, demonstrates that the proposed USS loss is highly efficient and can work seamlessly with sample-to-class-based losses. The embedded loss (USS and sample-to-class Softmax loss) overcomes the pitfalls of previous approaches and the trained facial model UniTSFace exhibits exceptional performance, outperforming state-of-the-art methods, such as CosFace, ArcFace, VPL, AnchorFace, and UNPG. Our code is available at https://***/CVI-SZU/UniTSFace.

关键词：

Scalable temporal interest points for abstraction and classification of video events

学校读者我要写书评

暂无评论

Scalable temporal interest points for abstraction and classi...

IEEE International Conference on Multimedia and Expo (ICME)

作者： Seung-Hoon Han ln-So Kweon Digital Media R&D Center Samsung Electronics Company Limited South Korea Robotics and Computer Vision Laboratory Division of Electrical Engineering Department of EECS Korea Advanced Institute of Science and Technology South Korea

The image sequence of a static scene includes similar or redundant information over time. Hence, motion-discontinuous instants can efficiently characterize a video shot or event. However, such instants (key frames) are differently identified according to the change of velocity and acceleration of motion, and such scales of change might be different on each sequence of the same event. In this paper, we present a scalable video abstraction in which the key frames are obtained by the maximum curvature of camera motion at each temporal scale. The scalability means dealing with the velocity and acceleration change of motion. In the temporal neighborhood determined by the scale, the scene features (motion, color, and edge) can be used to index and classify the video events. Therefore, those key frames provide temporal interest points (TIPs) for the abstraction and classification of video events.

关键词： Layout Acceleration Cameras Humans Research and development Robot vision systems computer vision Laboratories Image sequences Scalability

Calibrated and partially calibrated semi-generalized homographies

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Bhayani, Snehal Sattler, Torsten Barath, Daniel Beliansky, Patrik Heikkilä, Janne Kukelova, Zuzana Center for Machine Vision and Signal Analysis University of Oulu Finland Czech Institute of Informatics Robotics and Cybernetics Czech Technical University in Prague Computer Vision and Geometry Group Department of Computer Science ETH Zürich Faculty of Mathematics and Physics Charles University Prague Czech Republic Visual Recognition Group Faculty of Electrical Engineering Czech Technical University in Prague

In this paper, we propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera. The proposed solvers use five 2D-2D image point correspondences induced by a scene plane. One group of solvers assumes the perspective camera to be fully calibrated, while the other estimates the unknown focal length together with the absolute pose parameters. This setup is particularly important in structurefrom-motion and visual localization pipelines, where a new camera is localized in each step with respect to a set of known cameras and 2D-3D correspondences might not be available. Thanks to a clever parametrization and the elimination ideal method, our solvers only need to solve a univariate polynomial of degree five or three, respectively a system of polynomial equations in two variables. All proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments. Copyright © 2021, The Authors. All rights reserved.

关键词： Cameras

Exploiting Aggregation and Segregation of Representations for Domain Adaptive Human Pose Estimation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Peng, Qucheng Zheng, Ce Ding, Zhengming Wang, Pu Chen, Chen Center for Research in Computer Vision University of Central Florida Orlando United States Robotics Institute Carnegie Mellon University Pittsburgh United States Department of Computer Science Tulane University New Orleans United States University of North Carolina at Charlotte Charlotte United States

Human pose estimation (HPE) has received increasing attention recently due to its wide application in motion analysis, virtual reality, healthcare, etc. However, it suffers from the lack of labeled diverse real-world datasets due to the time- and labor-intensive annotation. To cope with the label deficiency issue, one common solution is to train the HPE models with easily available synthetic datasets (source) and apply them to real-world data (target) through domain adaptation (DA). Unfortunately, prevailing domain adaptation techniques within the HPE domain remain predominantly fixated on effecting alignment and aggregation between source and target features, often sidestepping the crucial task of excluding domain-specific representations. To rectify this, we introduce a novel framework that capitalizes on both representation aggregation and segregation for domain adaptive human pose estimation. Within this framework, we address the network architecture aspect by disentangling representations into distinct domain-invariant and domain-specific components, facilitating aggregation of domain-invariant features while simultaneously segregating domain-specific ones. Moreover, we tackle the discrepancy measurement facet by delving into various keypoint relationships and applying separate aggregation or segregation mechanisms to enhance alignment. Extensive experiments on various benchmarks, e.g., Human3.6M, LSP, H3D, and FreiHand, show that our method consistently achieves state-of-the-art performance. The project is available at https: //***/davidpengucf/EPIC. © 2024, CC BY.

关键词： Virtual reality

Benchmarking Classical and Learning-Based Multibeam Point Cloud Registration

学校读者我要写书评

暂无评论

Benchmarking Classical and Learning-Based Multibeam Point Cl...

IEEE International Conference on robotics and Automation (ICRA)

作者： Li Ling Jun Zhang Nils Bore John Folkesson Anna Wåhlin Division of Robotics Perception and Learning (RPL) KTH Royal Institute of Technology Stockholm Sweden Institute of Computer Graphics and Vision (ICGV) TU Graz Austria Ocean Infinity Västra Frölunda Sweden Department of Marine Sciences University of Gothenburg Sweden

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

Deep learning has shown promising results for multiple 3D point cloud registration datasets. However, in the underwater domain, most registration of multibeam echo-sounder (MBES) point cloud data are still performed using classical methods in the iterative closest point (ICP) family. In this work, we curate and release DotsonEast Dataset, a semi-synthetic MBES registration dataset constructed from an autonomous underwater vehicle in West Antarctica. Using this dataset, we systematically benchmark the performance of 2 classical and 4 learning-based methods. The experimental results show that the learning-based methods work well for coarse alignment, and are better at recovering rough transforms consistently at high overlap (20-50%). In comparison, GICP (a variant of ICP) performs well for fine alignment and is better across all metrics at extremely low overlap (10%). To the best of our knowledge, this is the first work to benchmark both learning-based and classical registration methods on an AUV-based MBES dataset. To facilitate future research, both the code and data are made available online. 1

关键词： Point cloud compression Learning systems Measurement Three-dimensional displays Simultaneous localization and mapping Iterative closest point algorithm Transforms

A New Dynamic Routing Network for Monocular Depth Estimation 12

学校读者我要写书评

暂无评论

A New Dynamic Routing Network for Monocular Depth Estimation

12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems, CYBER 2022

作者： Luo, Zhehao Luo, Sijin Liang, Guoyuan Wu, Xinyu Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Province Shenzhen China University of Chinese Academy of Sciences Beijing China Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems Chinese Academy of Sciences Guangdong Province Shenzhen China Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Province Shenzhen China

ISBN: (数字)9781665472678

ISBN: (纸本)9781665472678

Depth estimation is an essential task for understanding the geometry of 3D scenes. Compared with multi-view-based methods, monocular depth estimation is more challenging for the requirement of integrating not only global information but also local cues from various parts. Recently, numerous Convolutional Neural Networks (CNNs) based approaches relying on pre-defined static architectures have been reported. Although many of them have achieved remarkable improvements in accuracy, there remains problem with the generality of the static model when it comes to diverse scenes. In this paper, a novel deep network with dynamic routing architecture is proposed with a dynamically adjustable structure with respect to different inputs, therefore leading to not only improvements on both accuracy and generality but also decrease of the model parameters. Extensive experiments of monocular depth estimation have been conducted on two well-known challenging datasets (i.e., NYUD-v2 and Make3D) as well as the mixed dataset, and have verified the effectiveness of the proposed dynamic framework. © 2022 IEEE.

关键词： Deep neural networks

Sparus II AUV as a Sensor Suite for Underwater Archaeology: Falconera Cave Experiments

学校读者我要写书评

暂无评论

Sparus II AUV as a Sensor Suite for Underwater Archaeology: ...

Symposium on Autonomous Underwater Vehicle Technology (AUV)

作者： Guillem Vallicrosa Manuel J. Fumas Florian Huber Pere Ridao Computer Vision and Robotics Institute (VICOROB) Universitat de Girona Girona Spain International School of Doctorate in Marine Studies (EIDEMAR) Universidad de Cádiz Cádiz Spain Scientific Diving Operations (Submaris) Kiel Germany

ISBN: (数字)9781728187570

ISBN: (纸本)9781728187587

The present work tries to improve the topographical and prospective methodology applied to underwater archaeology, as well as the different technical tools used in the study of submerged caves, using as a experimental site one of the most contaminated and dangerous submerged caves in Europe called Falconera Cave (Sitges, Barcelona). The results have shown that the application of traditional procedures together with the use of the Sparus II Autonomous Underwater Vehicle (AUV) equipped with a multibeam echosounder represent the best technical solution for georeferencing in this submerged archaeological contexts.

关键词： Meters Surfaces Robot sensing systems Water pollution Trajectory Sea measurements Europe

Lidar Panoptic Segmentation in an Open World

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chakravarthy, Anirudh S. Ganesina, Meghana Reddy Hu, Peiyun Leal-Taixé, Laura Kong, Shu Ramanan, Deva Osep, Aljosa Robotics Institute Carnegie Mellon University United States Dynamic Vision and Learning TU Munich Germany Faculty of Science and Technology University of Macau China Department of Computer Science and Engineering Texas A&M University United States

Addressing Lidar Panoptic Segmentation (LPS) is crucial for safe deployment of autnomous vehicles. LPS aims to recognize and segment lidar points w.r.t. a pre-defined vocabulary of semantic classes, including thing classes of countable objects (e.g., pedestrians and vehicles) and stuff classes of amorphous regions (e.g., vegetation and road). Importantly, LPS requires segmenting individual thing instances (e.g., every single vehicle). Current LPS methods make an unrealistic assumption that the semantic class vocabulary is fixed in the real open world, but in fact, class ontologies usually evolve over time as robots encounter instances of novel classes that are considered to be unknowns w.r.t. thepre-defined class vocabulary. To address this unrealistic assumption, we study LPS in the Open World (LiPSOW): we train models on a dataset with a pre-defined semantic class vocabulary and study their generalization to a larger dataset where novel instances of thing and stuff classes can appear. This experimental setting leads to interesting conclusions. While prior art train class-specific instance segmentation methods and obtain state-of-the-art results on known classes, methods based on classagnostic bottom-up grouping perform favorably on classes outside of the initial class vocabulary (i.e., unknown classes). Unfortunately, these methods do not perform on-par with fully data-driven methods on known classes. Our work suggests a middle ground: we perform class-agnostic point clustering and over-segment the input cloud in a hierarchical fashion, followed by binary point segment classification, akin to Region Proposal Network [1]. We obtain the final point cloud segmentation by computing a cut in the weighted hierarchical tree of point segments, independently of semantic classification. Remarkably, this unified approach leads to strong performance on both known and unknown classes. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantics

WaveCNet: Wavelet integrated CNNs to suppress aliasing effect for noise-robust image classification

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Qiufu Shen, Linlin Guo, Sheng Lai, Zhihui Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China MyBank Ant Group Hangzhou310012 China

Though widely used in image classification, convolutional neural networks (CNNs) are prone to noise interruptions, i.e. the CNN output can be drastically changed by small image noise. To improve the noise robustness, we try to integrate CNNs with wavelet by replacing the common down-sampling (maxpooling, strided-convolution, and average pooling) with discrete wavelet transform (DWT). We firstly propose general DWT and inverse DWT (IDWT) layers applicable to various orthogonal and biorthogonal discrete wavelets like Haar, Daubechies, and Cohen, etc., and then design wavelet integrated CNNs (WaveCNets) by integrating DWT into the commonly used CNNs (VGG, ResNets, and DenseNet). During the down-sampling, WaveCNets apply DWT to decompose the feature maps into the low-frequency and high-frequency components. Containing the main information including the basic object structures, the low-frequency component is transmitted into the following layers to generate robust high-level features. The high-frequency components are dropped to remove most of the data noises. The experimental results show that WaveCNets achieve higher accuracy on ImageNet than various vanilla CNNs. We have also tested the performance of WaveCNets on the noisy version of ImageNet, ImageNet-C and six adversarial attacks, the results suggest that the proposed DWT/IDWT layers could provide better noise-robustness and adversarial robustness. When applying WaveCNets as backbones, the performance of object detectors (i.e., faster R-CNN and RetinaNet) on COCO detection dataset are consistently improved. We believe that suppression of aliasing effect, i.e. separation of low frequency and high frequency information, is the main advantages of our approach. The code of our DWT/IDWT layer and differentWaveCNets are available at https://***/CVISZU/ WaveCNet. © 2021, CC BY.

关键词： Signal sampling