检索结果-内蒙古大学图书馆

Event-aided Semantic Scene Completion

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Guo, Shangwei Shi, Hao Wang, Song Yin, Xiaoting Yang, Kailun Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China School of Robotics the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China College of Computer Science and Technology Zhejiang University Hangzhou310027 China

Autonomous driving systems rely on robust 3D scene understanding. Recent advances in Semantic Scene Completion (SSC) for autonomous driving underscore the limitations of RGB-based approaches, which struggle under motion blur, poor lighting, and adverse weather. Event cameras, offering high dynamic range and low latency, address these challenges by providing asynchronous data that complements RGB inputs. We present DSEC-SSC, the first real-world benchmark specifically designed for event-aided SSC, which includes a novel 4D labeling pipeline for generating dense, visibility-aware labels that adapt dynamically to object motion. Our proposed RGB-Event fusion framework, EvSSC, introduces an Event-aided Lifting Module (ELM) that effectively bridges 2D RGB-Event features to 3D space, enhancing view transformation and the robustness of 3D volume construction across SSC models. Extensive experiments on DSEC-SSC and simulated SemanticKITTI-E demonstrate that EvSSC is adaptable to both transformer-based and LSS-based SSC architectures. Notably, evaluations on SemanticKITTI-C demonstrate that EvSSC achieves consistently improved prediction accuracy across five degradation modes and both In-domain and Out-of-domain settings, achieving up to a 52.5% relative improvement in mIoU when the image sensor partially fails. Additionally, we quantitatively and qualitatively validate the superiority of EvSSC under motion blur and extreme weather conditions, where autonomous driving is challenged. The established datasets and our codebase will be made publicly at https://***/Pandapan01/EvSSC. Copyright © 2025, The Authors. All rights reserved.

关键词： Image enhancement

A Pattern-Generation Algorithm for the One-Dimensional Cutting Problem with Pattern Reduction

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Liang, Qiaokang Xiao, Haihua Long, Jianyong Xiao, Suhua Nie, Gangzhuo Qin, Hai College of Electrical and Information Engineering Hunan University Changsha410082 China National Engineering Laboratory for Robot Vision Perception and Control Changsha410082 China College of Electromechanical Engineering Guangdong Polytechnic Normal University Guangzhou510635 China Aluminum Corporation of China Beijing100000 China

The one-dimensional cutting stock problem with pattern reduction (CSPPR) is to find a solution with the minimum material cost and minimum number of different cutting patterns (setups). The primary objective is to minimize material cost. In practice, a common auxiliary objective is to reduce the number of setups. In this paper, we develop a bi-objective integer linear programming model for the CSPPR and propose a variable-to-constant (VTC) approach combined with a column generation technique (VTCCG) to generate the pattern set. Three sets of instances are tested in a computational experiment. The results of some instances show a 22.22% material cost saving and a 46.15% pattern reduction compared to the classical column generation technique. Moreover, for some practical instances, our solution can compete with several state-of-the-art heuristics. © 2023, The Authors. All rights reserved.

关键词： Multiobjective optimization

Semi-supervised Cloud Edge Collaborative Power Transmission Line Insulator Anomaly Detection Framework 11th

学校读者我要写书评

暂无评论

Semi-supervised Cloud Edge Collaborative Power Transmission ...

11th International Conference on Image and Graphics, ICIG 2021

作者： Yang, Yanqing Mao, Jianxu Zhang, Hui Chen, Yurong Zhong, Hang Huang, Zhihong Wang, Yaonan National Engineering Laboratory of Robot Visual Perception and Control Technology Hunan University Hunan Changsha China State Grid Hunan Electric Power Corporation Limited Research Institute Hunan Changsha China

ISBN: (纸本)9783030873547

The widely deployed power transmission line expedites developing the age of electricity. Thus, it is necessary to maintain a power system with a great quantity of manpower and material resources, especially for crucial equipment, such as insulator string. However, the current main inspection method relies on artificial with the problem of time-consuming and labor-intensive. There is a trend of utilizing deep learning techniques on unmanned aerial vehicles (UAVs) to accomplish the inspection task, but its development is restricted by the limitation of energy. In this paper, we propose a semi-supervised cloud edge collaborative insulator string anomaly detection framework. Specifically, an anchor-free object detector is deployed on the edge device for locating the insulator. On the cloud side, we propose a generative insulator defect detection model based on the autoencoder (AE) with a generator-discriminator pattern. Particularly, we introduce the variational memory encoder-decoder architecture to model defect-free insulator data distribution. Furthermore, the adversarial strategy is employed to regularize the generated data space with input data space. In the end, the anomaly can be detected if its data space is an outlier of training defect-free distribution. Comprehensive experiments demonstrate that our method can effectively reduce the computational load, meanwhile archiving superior performance, including accuracy (0.968) and recall (0.985), for defect recognition using a standard insulator data set. © 2021, Springer Nature Switzerland AG.

关键词： Deep learning

Towards Single-Lens controllable Depth-of-Field Imaging via Depth-Aware Point Spread Functions

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Qian, Xiaolong Jiang, Qi Gao, Yao Gao, Shaohua Yi, Zhonghua Sun, Lei Wei, Kai Li, Haifeng Yang, Kailun Wang, Kaiwei Bai, Jian State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China School of Robotics Hunan University Changsha410012 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China

controllable Depth-of-Field (DoF) imaging commonly produces amazing visual effects based on heavy and expensive high-end lenses. However, confronted with the increasing demand for mobile scenarios, it is desirable to achieve a lightweight solution with Minimalist Optical Systems (MOS). This work centers around two major limitations of MOS, i.e., the severe optical aberrations and uncontrollable DoF, for achieving single-lens controllable DoF imaging via computational methods. A Depth-aware controllable DoF Imaging (DCDI) framework is proposed equipped with All-in-Focus (AiF) aberration correction and monocular depth estimation, where the recovered image and corresponding depth map are utilized to produce imaging results under diverse DoFs of any high-end lens via patch-wise convolution. To address the depth-varying optical degradation, we introduce a Depth-aware Degradation-adaptive Training (DA2T) scheme. At the dataset level, a Depth-aware Aberration MOS (DAMOS) dataset is established based on the simulation of Point Spread Functions (PSFs) under different object distances. Additionally, we design two plug-and-play depth-aware mechanisms to embed depth information into the aberration image recovery for better tackling depth-aware degradation. Furthermore, we propose a storage-efficient Omni-Lens-Field model to represent the 4D PSF library of various lenses. With the predicted depth map, recovered image, and depth-aware PSF map inferred by Omni-Lens-Field, single-lens controllable DoF imaging is achieved. To the best of our knowledge, we are the first to explore the single-lens controllable DoF imaging solution. Comprehensive experimental results demonstrate that the proposed framework enhances the recovery performance, and attains impressive single-lens controllable DoF imaging results, providing a seminal baseline for this field. The source code and the established dataset will be publicly available at https://***/XiaolongQian/DCDI. Copyright © 2024, The A

关键词： Optical transfer function

Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Jiao, Jianbin Cheng, Xina Chen, Weijie Yin, Xiaoting Shi, Hao Yang, Kailun School of Artificial Intelligence Xidian University China State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer interaction, scene understanding, and rehabilitation training. Due to the challenges in data collection, mainstream datasets of 3D human pose estimation are primarily composed of multi-view video data collected in laboratory environments, which contains rich spatial-temporal correlation information besides the image frame content. Given the remarkable self-attention mechanism of transformers, capable of capturing the spatial-temporal correlation from multi-view video datasets, we propose a multi-stage framework for 3D sequence-to-sequence (seq2seq) human pose detection. Firstly, the spatial module represents the human pose feature by intra-image content, while the frame-image relation module extracts temporal relationships and 3D spatial positional relationship features between the multi-perspective images. Secondly, the self-attention mechanism is adopted to eliminate the interference from non-human body parts and reduce computing resources. Our method is evaluated on Human3.6M, a popular 3D human pose detection dataset. Experimental results demonstrate that our approach achieves state-of-the-art performance on this dataset. The source code will be available at https://***/WUJINHUAN/3D-human-pose. Copyright © 2024, The Authors. All rights reserved.

关键词： Human computer interaction

Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers

学校读者我要写书评

暂无评论

Towards Precise 3D Human Pose Estimation with Multi-Perspect...

International Joint Conference on Neural Networks (IJCNN)

作者： Jianbin Jiao Xina Cheng Weijie Chen Xiaoting Yin Hao Shi Kailun Yang School of Artificial Intelligence Xidian University China State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as humancomputer interaction, scene understanding, and rehabilitation training. Due to the challenges in data collection, mainstream datasets of 3D human pose estimation are primarily composed of multi-view video data collected in laboratory environments, which contains rich spatial-temporal correlation information besides the image frame content. Given the remarkable selfattention mechanism of transformers, capable of capturing the spatial-temporal correlation from multi-view video datasets, we propose a multi-stage framework for 3D sequence-to-sequence (seq2seq) human pose detection. Firstly, the spatial module represents the human pose feature by intra-image content, while the frame-image relation module extracts temporal relationships and 3D spatial positional relationship features between the multiperspective images. Secondly, the self-attention mechanism is adopted to eliminate the interference from non-human body parts and reduce computing resources. Our method is evaluated on Human3.6M, a popular 3D human pose detection dataset. Experimental results demonstrate that our approach achieves stateof-the-art performance on this dataset. The source code will be available at https://***/WUJINHUAN/3D-human-pose.

关键词： Training Three-dimensional displays Correlation Computational modeling Source coding Pose estimation Video sequences

Learning to Learn Transferable Generative Attack for Person Re-Identification

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Bian, Yuan Liu, Min Wang, Xueping Ma, Yunfeng Wang, Yaonan The College of Electrical and Information Engineering Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology Hunan Changsha China The College of Information Science and Engineering Hunan Normal University Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing Hunan Changsha China

Deep learning-based person re-identification (re-id) models are widely employed in surveillance systems and inevitably inherit the vulnerability of deep networks to adversarial attacks. Existing attacks merely consider cross-dataset and cross-model transferability, ignoring the cross-test capability to perturb models trained in different domains. To powerfully examine the robustness of real-world re-id models, the Meta Transferable Generative Attack (MTGA) method is proposed, which adopts meta-learning optimization to promote the generative attacker producing highly transferable adversarial examples by learning comprehensively simulated transfer-based cross-model&dataset&test black-box meta attack tasks. Specifically, cross-model&dataset black-box attack tasks are first mimicked by selecting different re-id models and datasets for meta-train and meta-test attack processes. As different models may focus on different feature regions, the Perturbation Random Erasing module is further devised to prevent the attacker from learning to only corrupt model-specific features. To boost the attacker learning to possess cross-test transferability, the Normalization Mix strategy is introduced to imitate diverse feature embedding spaces by mixing multi-domain statistics of target models. Extensive experiments show the superiority of MTGA, especially in cross-model&dataset and cross-model&dataset&test attacks, our MTGA outperforms the SOTA methods by 21.5% and 11.3% on mean mAP drop rate, respectively. The code of MTGA will be released after the paper is accepted. Copyright © 2024, The Authors. All rights reserved.

关键词： Generative adversarial networks

Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systems

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Gao, Yao Jiang, Qi Gao, Shaohua Sun, Lei Yang, Kailun Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China School of Robotics Hunan University Changsha410012 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China

Recently, joint design approaches that simultaneously optimize optical systems and downstream algorithms through data-driven learning have demonstrated superior performance over traditional separate design approaches. However, current joint design approaches heavily rely on the manual identification of initial lenses, posing challenges and limitations, particularly for compound lens systems with multiple potential starting points. In this work, we present Quasi-Global Search Optics (QGSO) to automatically design compound lens based computational imaging systems through two parts: (i) Fused Optimization Method for Automatic Optical Design (OptiFusion), which searches for diverse initial optical systems under certain design specifications;and (ii) Efficient Physic-aware Joint Optimization (EPJO), which conducts parallel joint optimization of initial optical systems and image reconstruction networks with the consideration of physical constraints, culminating in the selection of the optimal solution in all search results. Extensive experimental results illustrate that QGSO serves as a transformative end-to-end lens design paradigm for superior global search ability, which automatically provides compound lens based computational imaging systems with higher imaging quality compared to existing paradigms. The source code will be made publicly available at https://***/LiGpy/QGSO. Copyright © 2024, The Authors. All rights reserved.

关键词： Imaging systems

Reinforcement Learning-based Fault-Tolerant control for Unmanned Aerial Vehicles

学校读者我要写书评

暂无评论

Reinforcement Learning-based Fault-Tolerant Control for Unma...

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Guoqi Wang Xudong Wang Yang Li Ziwei Gao Zhaoke Ning National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China State Key Laboratory of Advanced Design and Manufacturing Technology for Vehicle College of Mechanical and Vehicle Engineering Hunan University Changsha China School of Aeronautics and Astronautics Sichuan University Chengdu China

ISBN: (数字)9798350379228

ISBN: (纸本)9798350390780

This paper focuses on the fault-tolerant control (FTC) problem for unmanned aerial vehicles (UAVs) subject to possible multiple actuator failures, which is a tough problem to solve with traditional FTC methods since they usually require accurate mathematical models. To address the limitation of traditional FTC methods, a model-free FTC approach is proposed based on reinforcement learning (RL). Subsequently, the proposed approach is applied to construct fault-tolerant controller for UAVs without any knowledge of the quadrotor dynamic information. Then, an end-to-end control policy that can tolerant actuator failures is obtained, which can map the state of the UAVs directly to the control commands of the four rotors after learning. Finally, the effectiveness of the proposed fault-tolerant approach is demonstrated by using the flexible modular quadrotor simulator.

关键词： Fault tolerance Actuators Trajectory tracking Fault tolerant systems Autonomous aerial vehicles Stability analysis Mathematical models