检索结果-内蒙古大学图书馆

HPPS: A Hierarchical Progressive Perception System for Luggage Trolley Detection and Localization at Airports

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sun, Zhirui Zhang, Zhe Zhao, Jieting Ye, Hanjing Wang, Jiankun Shenzhen Key Laboratory of Robotics Perception and Intelligence Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Jiaxing Research Institute Southern University of Science and Technology Jiaxing China Shenzhen Key Laboratory of Robotics and Computer Vision Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The robotic autonomous luggage trolley collection system employs robots to gather and transport scattered luggage trolleys at airports. However, existing methods for detecting and locating these luggage trolleys often fail when they are not fully visible. To address this, we introduce the Hierarchical Progressive Perception System (HPPS), which enhances the detection and localization of luggage trolleys under partial occlusion. The HPPS processes the luggage trolley’s position (x, y) and orientation (θ) separately, which requires only RGB images for labeling and training, eliminating the need for 3D coordinates and alignment. The HPPS can accurately determine the position of the luggage trolley with just one well-detected keypoint and estimate the luggage trolley’s orientation when it is partially occluded. Once the luggage trolley’s initial pose is detected, HPPS updates this information continuously to refine its accuracy until the robot begins grasping. The experiments on detection and localization demonstrate that HPPS is more reliable under partial occlusion compared to existing methods. Its effectiveness and robustness have also been confirmed through practical tests in actual luggage trolley collection tasks. A website about this work is available at HPPS. Copyright © 2024, The Authors. All rights reserved.

关键词： robotics

Uncertainty-Estimation With Normalized Logits For Out-of-distribution Detection

学校读者我要写书评

暂无评论

Uncertainty-Estimation With Normalized Logits For Out-of-dis...

2023 International Conference on computer, Artificial Intelligence, and Control Engineering, CAICE 2023

作者： Huang, Mouxiao Qiao, Yu The Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China

ISBN: (纸本)9781510665040

Out-of-distribution (OOD) detection is critical for preventing deep learning models from making incorrect predictions, especially in safety-critical applications such as medical diagnosis and autonomous driving. However, neural networks often suffer from overconfidence, making high confidence predictions for OOD data that are never seen during training and may be irrelevant to training data. Determining the reliability of the prediction is still a difficult and challenging task. To address this challenge, we propose a new method called Uncertainty-Estimation with Normalized Logits (UE-NL) for robust learning and OOD detection. The method has three main benefits: (1) Neural networks with UE-NL treat every in-distribution (ID) sample equally by predicting the uncertainty score of input data and the uncertainty is added into softmax function to adjust the learning strength of easy and hard samples during training phase, making the model learn robustly and accurately. (2) UE-NL enforces a constant vector norm on the logits to decouple the effect of the increasing output’s norm from optimization process, which causes the overconfidence issue to some extent. (3) UE-NL provides a new metric, the magnitude of uncertainty score, to detect OOD data. Experiments demonstrate that UE-NL outperforms existing methods on common OOD benchmarks and is more robust to noisy ID data that may be misjudged as OOD data by other methods. © 2023 SPIE.

关键词： Forecasting

Towards High-resolution 3D Anomaly Detection via Group-Level Feature Contrastive Learning 24

学校读者我要写书评

暂无评论

Towards High-resolution 3D Anomaly Detection via Group-Level...

32nd ACM International Conference on Multimedia, MM 2024

作者： Zhu, Hongze Xie, Guoyang Hou, Chengbin Dai, Tao Gao, Can Wang, Jinbao Shen, Linlin National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Department of Computer Science City University of Hong Kong Hong Kong Hong Kong Department of Intelligent Manufacturing CATL Ningde China Fuzhou Fuyao Institute for Advanced Study Fuyao University of Science and Technology Fuzhou China College of Computer Science and Software Engineering Shenzhen University Shenzhen China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen China Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China

ISBN: (纸本)9798400706868

High-resolution point clouds (HRPCD) anomaly detection (AD) plays a critical role in precision machining and high-end equipment manufacturing. Despite considerable 3D-AD methods that have been proposed recently, they still cannot meet the requirements of the HRPCD-AD task. There are several challenges: i) It is difficult to directly capture HRPCD information due to large amounts of points at the sample level;ii) The advanced transformer-based methods usually obtain anisotropic features, leading to degradation of the representation;iii) The proportion of abnormal areas is very small, which makes it difficult to characterize. To address these challenges, we propose a novel group-level feature-based network, called Group3AD, which has a significantly efficient representation ability. First, we design an Intercluster Uniformity Network (IUN) to present the mapping of different groups in the feature space as several clusters, and obtain a more uniform distribution between clusters representing different parts of the point clouds in the feature space. Then, an Intracluster Alignment Network (IAN) is designed to encourage groups within the cluster to be distributed tightly in the feature space. In addition, we propose an Adaptive Group-Center Selection (AGCS) based on geometric information to improve the pixel density of potential anomalous regions during inference. The experimental results verify the effectiveness of our proposed Group3AD, which surpasses Reg3D-AD by the margin of 5% in terms of object-level AUROC on Real3D-AD. We provide the code and supplementary information on our website: https://***/M-3LAB/Group3AD. © 2024 ACM.

关键词： Contrastive Learning

FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Models

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Tang, Chao Huang, Dehao Dong, Wenlong Xu, Ruinian Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Institute for Robotics and Intelligent Machines Georgia Institute of Technology Atlanta United States

Task-oriented grasping (TOG), which refers to synthesizing grasps on an object that are configurationally compatible with the downstream manipulation task, is the first milestone towards tool manipulation. Analogous to the activation of two brain regions responsible for semantic and geometric reasoning during cognitive processes, modeling the intricate relationship between objects, tasks, and grasps necessitates rich semantic and geometric prior knowledge about these elements. Existing methods typically restrict the prior knowledge to a closed-set scope, limiting their generalization to novel objects and tasks out of the training set. To address such a limitation, we propose FoundationGrasp, a foundation model-based TOG framework that leverages the open-ended knowledge from foundation models to learn generalizable TOG skills. Extensive experiments are conducted on the contributed Language and vision Augmented TaskGrasp (LaViA-TaskGrasp) dataset, demonstrating the superiority of FoundationGrasp over existing methods when generalizing to novel object instances, object classes, and tasks out of the training set. Furthermore, the effectiveness of FoundationGrasp is validated in real-robot grasping and manipulation experiments on a 7-DoF robotic arm. Our code, data, appendix, and video are publicly available at https://***/view/foundationgrasp. Copyright © 2024, The Authors. All rights reserved.

关键词： Robotic arms

Polarization-controlled dual resonant lattice Kerker effects

学校读者我要写书评

暂无评论

Nano Research 2023年第2期16卷 3195-3200页

作者： Lei Xiong Xueqian Zhao Xiang Du Shuai Chen Yuanfu Lu Hongwei Ding Guangyuan Li School of Information Science and Engineering Yunnan UniversityKunming 650500China CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen 518055China School of Computer Electronic and InformationGuangxi UniversityNanning 530004China College of Physics and Electronic Technology Anhui Normal UniversityWuhu 241000China Tianjin H-Chip Technology Group Corporation Tianjin 300467China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for SocietyShenzhen 518055China

The generalized Kerker effects have attracted increasing interests in recent years due to their abilities to manipulate the far-field properties of ***,the dual-polarized generalized Kerker effect enabling different tailoring of orthogonally-polarized electromagnetic waves has not yet been ***,we demonstrate polarization-controlled dual resonant lattice Kerker effects in periodic silicon *** varying the incident angle,the electric dipole and magnetic dipole surface lattice resonances can spectrally overlap,causing zero reflectance and unitary transmittance,i.e.,the resonant lattice Kerker *** incident angle for achieving this effect can be tuned differently for s-and p-polarizations over large regions by varying the nanodisk size or the lattice *** proposed dual-polarized resonant lattice Kerker effects open up avenues for polarization-controlled manipulation of the phase and wavefront of light with metasurfaces.

关键词： Kerker effect surface lattice resonances dual-polarized silicon metasurface

Human Orientation Estimation Under Partial Observation

学校读者我要写书评

暂无评论

Human Orientation Estimation Under Partial Observation

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Jieting Zhao Hanjing Ye Yu Zhan Hao Luan Hong Zhang Department of Electronic and Electrical Engineering SUSTech Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology (SUSTech) Department of Computer Science School of Computing National University of Singapore

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Reliable Human Orientation Estimation (HOE) from a monocular image is critical for autonomous agents to understand human intention. Significant progress has been made in HOE under full observation. However, the existing methods easily make a wrong prediction under partial observation and give it an unexpectedly high confidence. To solve the above problems, this study first develops a method called Part-HOE that estimates orientation from the visible joints of a target person so that it is able to handle partial observation. Subsequently, we introduce a confidence-aware orientation estimation method, enabling more accurate orientation estimation and reasonable confidence estimation under partial observation. The effectiveness of our method is validated on both public and custom-built datasets, and it shows great accuracy and reliability improvement in partial observation scenarios. In particular, we show in real experiments that our method can benefit the robustness and consistency of the Robot Person Following (RPF) task.

关键词： Accuracy Filtering Estimation Robustness Autonomous agents Intelligent robots

Efficient Object Rearrangement via Multi-view Fusion

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Huang, Dehao Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The prospect of assistive robots aiding in object organization has always been compelling. In an image-goal setting, the robot rearranges the current scene to match the single image captured from the goal scene. The key to an image-goal rearrangement system is estimating the desired placement pose of each object based on the single goal image and observations from the current scene. In order to establish sufficient associations for accurate estimation, the system should observe an object from a viewpoint similar to that in the goal image. Existing image-goal rearrangement systems, due to their reliance on a fixed viewpoint for perception, often require redundant manipulations to randomly adjust an object’s pose for a better perspective. Addressing this inefficiency, we introduce a novel object rearrangement system that employs multi-view fusion. By observing the current scene from multiple viewpoints before manipulating objects, our approach can estimate a more accurate pose without redundant manipulation times. A standard visual localization pipeline at the object level is developed to capitalize on the advantages of multi-view observations. Simulation results demonstrate that the efficiency of our system outperforms existing single-view systems. The effectiveness of our system is further validated in a physical experiment. Copyright © 2023, The Authors. All rights reserved.

关键词：

Fingerprint Presentation Attack Detector Using Global-Local Model

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Haozhe Zhang, Wentian Liu, Feng Wu, Haoqian Shen, Linlin The Computer Vision Institute College of Computer Science and Software Engineering SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society The National Engineering Laboratory for Big Data System Computing Technology The Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China

The vulnerability of automated fingerprint recognition systems (AFRSs) to presentation attacks (PAs) promotes the vigorous development of PA detection (PAD) technology. However, PAD methods have been limited by information loss and poor generalization ability, resulting in new PA materials and fingerprint sensors. This paper thus proposes a global-local model-based PAD (RTK-PAD) method to overcome those limitations to some extent. The proposed method consists of three modules, called: 1) the global module;2) the local module;and 3) the rethinking module. By adopting the cut-out-based global module, a global spoofness score predicted from nonlocal features of the entire fingerprint images can be achieved. While by using the texture in-painting-based local module, a local spoofness score predicted from fingerprint patches is obtained. The two modules are not independent but connected through our proposed rethinking module by localizing two discriminative patches for the local module based on the global spoofness score. Finally, the fusion spoofness score by averaging the global and local spoofness scores is used for PAD. Our experimental results evaluated on LivDet 2017 show that the proposed RTK-PAD can achieve an average classification error (ACE) of 2.28% and a true detection rate (TDR) of 91.19% when the false detection rate (FDR) equals 1.0%, which significantly outperformed the state-of-the-art methods by ∼10% in terms of TDR (91.19% versus 80.74%). Copyright © 2024, The Authors. All rights reserved.

关键词： Supervised learning

Efficient Image Super-Resolution Using Vast-Receptive-Field Attention 17th

学校读者我要写书评

暂无评论

Efficient Image Super-Resolution Using Vast-Receptive-Field ...

17th European Conference on computer vision, ECCV 2022

作者： Zhou, Lin Cai, Haoming Gu, Jinjin Li, Zheyuan Liu, Yingqi Chen, Xiangyu Qiao, Yu Dong, Chao ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen China Shanghai AI Laboratory Shanghai China The University of Sydney Sydney Australia University of Macau Zhuhai China

ISBN: (纸本)9783031250620

The attention mechanism plays a pivotal role in designing advanced super-resolution (SR) networks. In this work, we design an efficient SR network by improving the attention mechanism. We start from a simple pixel attention module and gradually modify it to achieve better super-resolution performance with reduced parameters. The specific approaches include: (1) increasing the receptive field of the attention branch, (2) replacing large dense convolution kernels with depthwise separable convolutions, and (3) introducing pixel normalization. These approaches paint a clear evolutionary roadmap for the design of attention mechanisms. Based on these observations, we propose VapSR, the Vast-receptive-field Pixel attention network. Experiments demonstrate the superior performance of VapSR. VapSR outperforms the present lightweight networks with even fewer parameters. And the light version of VapSR can use only 21.68% and 28.18% parameters of IMDB and RFDN to achieve similar performances to those networks. The code and models are available at https://***/zhoumumu/VapSR. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Convolution