检索结果-内蒙古大学图书馆

Video Stabilization via Prediction with Time-Series Network and Image Inpainting with Pyramid Fusion

Chinese Journal of Electronics 2021年第6期30卷 1103-1110页

作者： CHENG Keyang LI Shichao RONG Lan WANG Wenshan SHI Wenxi ZHAN Yongzhao School of Computer Science and Communication Engineering Jiangsu University Jiangsu Province Big Data Ubiquitous Perception and Intelligent Agricultural Application Engineering Research Center Cyber Space Security Academy of Jiangsu University National Engineering Laboratory for Public Safety Risk Perception and Control by Big Data Xinjiang Lianhaichuangzhi Information Technology Co. Ltd.

Due to the poor filling effect of the video image defect commonly used in the video stabilization field, the video is seemed still unstable after the image stabilization process, which seriously affects the visual effect. To solve this problem, we improve a video stabilization method based on time-series network prediction and pyramid fusion restoration is proposed to optimize the visual effect after image *** flow of the proposed method is as follows: First,it is adaptive to determine whether the defect of the corresponding frame at the current time needs padding inpainting. Then, for the frame that needs to be inpainting,the frames generated before the current moment are sent to the model combining the convolutional neural networks and the gate recurrent unit to predict the part to be filled. Next the current defect image and the complete image to be filled are brought into the Laplacian pyramid reconstruction, and the improved weighted optimal suture is introduced for splicing during the fusion. Finally, the video frame is cut after reconstruction. The method is tested on a data set composed of videos commonly used in the field of video stabilization. The experimental results show that the average peak signal to noise ratio of the method is 2 to 5 d B higher than that of the comparison algorithm, and the average structural similarity index is improved by about 2% to 7% compared with the contrast algorithm.

关键词： image restoration image sequences video frame cutting improved weighted optimal suture gate recurrent unit video signal processing video stabilization method image fusion Laplacian pyramid reconstruction padding inpainting image resolution neural nets convolutional neural networks video image defect pyramid fusion restoration image inpainting visual effect optimization image reconstruction time-series network prediction image stabilization process

来源：评论

学校读者我要写书评

暂无评论

Resilient Formation control Based on Watermarks for Networked Quadrotors under Deception Attacks

引用

IEEE Transactions on Vehicular technology 2025年

作者： Zhan, Weiwei Miao, Zhiqiang Zeng, Jianxin Chen, Yanjie Wu, Zheng-Guang He, Wei Wang, Yaonan Hunan University College of Electrical and Information Engineering Changsha410082 China Fuzhou University School of Mechanical Engineering and Automation Fuzhou350108 China National Engineering Research Center of Robot Visual Perception and Control Technology Changsha410082 China Zhejiang University Institute of Cyber-Systems and Control Hangzhou310027 China University of Science and Technology Beijing Key Laboratory of Intelligent Bionic Unmanned Systems Ministry of Education School of Intelligence Science and Technology Institute of Artificial Intelligence Beijing100083 China

This article addresses the problem of formation control of networked UAVs under deception attacks. A lightweight resilient formation control framework based on watermarks is proposed to achieve the desired formation configuration without extra monitoring attack status. Since deception attacks are covert, the shared information is watermarked before transmission to establish the protocol among networked UAVs. To facilitate the resilient formation controller design, a decoder is first developed to decipher the inverse transformation of deception attacks, where the watermark is the criterion for approximating the inverse transformation. The Gauss error function is introduced to eliminate some unrealistic input commands under deception attacks, obtaining the predefined input performance. Then, a resilient formation controller is developed to guarantee the global boundedness of all signals within the inner-loop and outerloop system, while the formation error converges to a small neighborhood of zero by solving the linear matrix inequality. Two challenging deception attack examples in simulations and experiments are conducted to verify the effectiveness and performance of the proposed resilient formation control framework. © 1967-2012 IEEE.

关键词： Inverse transforms

来源：评论

学校读者我要写书评

暂无评论

PanoVpr: Towards Unified Perspective-to-Equirectangular visual Place Recognition via Sliding Windows Across the Panoramic View

PanoVpr: Towards Unified Perspective-to-Equirectangular Visu...

引用

International Conference on Intelligent Transportation

作者： Ze Shi Hao Shi Kailun Yang Zhe Yin Yining Lin Kaiwei Wang State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China Shanghai SUPREMIND Technology Co. Ltd Shanghai China National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China

visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose PanoVPR, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at PanoVPR.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Bridging on-line systems modeling with fault detection for a class of unknown nonlinear distributed parameter systems

引用

IFAC-PapersOnLine 2022年第6期55卷 228-233页

作者： Yun Feng Yaonan Wang Yazhi Zhang College of Electrical and Information Engineering Hunan University Changsha 410082 China National Engineering Research Center for Robot Visual Perception and Control Technology Hunan University Changsha 410082 China College of Electric and Information Engineering Hunan Institute of Engineering Xiangtan 411104 China

Different from the traditional model-based fault diagnosis paradigm which is established upon the well-known observer design and analysis, a novel data-driven framework is proposed by combing systems modeling with fault detection for a class of 1-D unknown distributed parameter systems. The key idea is to transfer the on-line modeling error into the residual signal for fault detection. The proposed methodology only utilizes the I/O data and does not require extra knowledge of the system model, which increases its usability at large. Numerical simulations on a commonly used benchmark are presented for method validation.

关键词： AI FDI methods Neural approximations for optimal control estimation FDI for nonlinear Systems Distributed parameter systems

来源：评论

学校读者我要写书评

暂无评论

E-3DGS: Gaussian Splatting with Exposure and Motion Events

arXiv

引用

arXiv 2024年

作者： Yin, Xiaoting Shi, Hao Bao, Yuhan Bing, Zhenshan Liao, Yiyi Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University China School of Robotics National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China College of Information Science and Electronic Engineering Zhejiang University China The Chair of Robotics AI and Real-Time Systems Technical University of Munich Germany

Estimating Neural Radiance Fields (NeRFs) from images captured under optimal conditions has been extensively explored in the vision community. However, robotic applications often face challenges such as motion blur, insufficient illumination, and high computational overhead, which adversely affect downstream tasks like navigation, inspection, and scene visualization. To address these challenges, we propose E-3DGS, a novel event-based approach that partitions events into motion (from camera or object movement) and exposure (from camera exposure), using the former to handle fast-motion scenes and using the latter to reconstruct grayscale images for high-quality training and optimization of event-based 3D Gaussian Splatting (3DGS). We introduce a novel integration of 3DGS with exposure events for high-quality reconstruction of explicit scene representations. Our versatile framework can operate on motion events alone for 3D reconstruction, enhance quality using exposure events, or adopt a hybrid mode that balances quality and effectiveness by optimizing with initial exposure events followed by high-speed motion events. We also introduce EME-3D, a real-world 3D dataset with exposure events, motion events, camera calibration parameters, and sparse point clouds. Our method is faster and delivers better reconstruction quality than event-based NeRF while being more cost-effective than NeRF methods that combine event and RGB data by using a single event sensor. By combining motion and exposure events, E-3DGS sets a new benchmark for event-based 3D reconstruction with robust performance in challenging conditions and lower hardware demands. The source code and dataset will be available at https://***/MasterHow/E-3DGS. Copyright © 2024, The Authors. All rights reserved.

关键词： Gaussian distribution

来源：评论

学校读者我要写书评

暂无评论

Multi-Agent Path Finding Using Imitation-Reinforcement Learning with Transformer

Multi-Agent Path Finding Using Imitation-Reinforcement Learn...

引用

IEEE International Conference on robotics and Biomimetics

作者： Lin Chen Yaonan Wang Zhiqiang Miao Yang Mo Mingtao Feng Zhen Zhou School of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Technology Changsha China School of Computer Science and Technology Xidian University Xian China

ISBN: (纸本)9781665481106

Multi-Agent Path Finding is a problem of finding the optimal set of paths for multiple agents from the starting position to the goal without conflict, which is essential to large-scale robotic systems. Imitation and reinforcement learning are applied to solve the MAPF problem and have achieved certain results, which provides a feasible solution for the path planning problem of large-scale robot systems. The current method improves the performance of distributed strategy-guided agent planning paths in complex environments by introducing the communication between graph neural networks and agents but dramatically reduces the system's robustness. This paper develops a novel imitation reinforcement learning framework by introducing Transformer, which enables algorithms to perform well in complex environments without relying on communication between agents. Compared with its counterparts, experiments show that the policy trained by our method guides the agent to drive from the initial position to the goal without collision and achieve better performance.

关键词： Learning systems robot kinematics Biomimetics Reinforcement learning Transformers Robustness Path planning

来源：评论

学校读者我要写书评

暂无评论

HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priors

arXiv

引用

arXiv 2025年

作者： Li, Siyu Cao, Yihong Shi, Hao Zang, Yongsheng He, Xuan Yang, Kailun Li, Zhiyong School of Robotics the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China College of Computer Science and Electronic Engineering Hunan University Changsha410082 China Hunan Vanguard Group Corporation Limited Changsha410100 China

The exploration of Bird’s-Eye View (BEV) mapping technology has driven significant innovation in visual perception technology for autonomous driving. BEV mapping models need to be applied to the unlabeled real world, making the study of unsupervised domain adaptation models an essential path. However, research on unsupervised domain adaptation for BEV mapping remains limited and cannot perfectly accommodate all BEV mapping tasks. To address this gap, this paper proposes HierDAMap, a universal and holistic BEV domain adaptation framework with hierarchical perspective priors. Unlike existing research that solely focuses on image-level learning using prior knowledge, this paper explores the guiding role of perspective prior knowledge across three distinct levels: global, sparse, and instance levels. With these priors, HierDA consists of three essential components, including Semantic-Guided Pseudo Supervision (SGPS), Dynamic-Aware Coherence Learning (DACL), and Cross-Domain Frustum Mixing (CDFM). SGPS constrains the cross-domain consistency of perspective feature distribution through pseudo labels generated by vision foundation models in 2D space. To mitigate feature distribution discrepancies caused by spatial variations, DACL employs uncertainty-aware predicted depth as an intermediary to derive dynamic BEV labels from perspective pseudo-labels, thereby constraining the coarse BEV features derived from corresponding perspective features. CDFM, on the other hand, leverages perspective masks of view frustum to mix multi-view perspective images from both domains, which guides cross-domain view transformation and encoding learning through mixed BEV labels. Furthermore, this paper introduces intra-domain feature exchange data augmentation to enhance the efficiency of domain adaptation learning. The proposed method is verified on multiple BEV mapping tasks, such as BEV semantic segmentation, high-definition semantic, and vectorized mapping. It demonstrates competitive perfo

关键词： Birds

来源：评论

学校读者我要写书评

暂无评论

An insulator feature-enhanced segmentation method based on the residual-type attention mechanism

An insulator feature-enhanced segmentation method based on t...

引用

IEEE Advanced Information Management,Communicates,Electronic and Automation control Conference (IMCEC)

作者： Xin Tang Jianxu Mao Junfei Yi Ziming Tao Zhenyu He College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Vision Perception and Control Technology Changsha China

ISBN: (纸本)9781665479691

As an crucial component of power line, the timely check for the state of insulator is necessary for the normal running of transmission lines. In view of debasement of insulator segmentation accuracy in current transmission line caused by complex background, low contrast, and the quality of images is not guaranteed, we improve U-Net by combining attention mechanism and residual connection. Residual connection is added to the encoder part to improve the extraction of low-level semantic information, and the attention mechanism is added to the decoder part for integrating high and low level features better and reduce the error between them. We confirm the effectiveness of the improved module through experiments, while the results showing that the improved U-Net model segmentation performance on insulator dataset is improved from 0.875 to 0.912. And our method also outperforms previous segmentation work on insulator dataset.

关键词： Image segmentation Power transmission lines Automation Semantics Insulators Feature extraction Information management

来源：评论

学校读者我要写书评

暂无评论

Power Grid Fastener Defect Detection Based on Dual Context Information Fusion

Power Grid Fastener Defect Detection Based on Dual Context I...

引用

IEEE Advanced Information Management,Communicates,Electronic and Automation control Conference (IMCEC)

作者： Liu Qingxian Mao Jianxu Yi Junfei Tao Ziming Yu Junlong College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Vision Perception and Control Technology Changsha China

ISBN: (纸本)9781665479691

The working state of fasteners is closely related to the safe and stable operation of the power grid. However, the performance of the existing fastener defect detection models is not enough to meet the requirements, because the size of object is small, the environment is complex, the sample size is unbalanced and so on. Therefore, we design a simple but effective feature fusion method, called Double Context Information Enhancement Module. The model can fully learn the features of fasteners by expanding the receptive field of the feature map during the construction of the feature pyramid, and the feature expression ability of fasteners can be enhanced by learning the features of adjacent layers after the construction of the feature pyramid. Through experiments, we proved that DCEM can improve about 8.8AP compared with the original model, and at the same time, the effectiveness and advancement of DCEM are proved by comparing with SOTA.

关键词： Correlation Automation Aggregates Fasteners Feature extraction Power grids Information management

来源：评论

学校读者我要写书评

暂无评论

Decentralized Multi-robot Navigation Coupled with Spatial-Temporal RetNet Based on Deep Reinforcement Learning

Decentralized Multi-Robot Navigation Coupled with Spatial-Te...

引用

IEEE/RSJ International Conference on Intelligent robots and Systems (IROS)

作者： Lin Chen Yaonan Wang Zhiqiang Miao Mingtao Feng Yuanzhe Wang Yang Mo Zhen Zhou Hesheng Wang Danwei Wang School of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Technology Changsha China School of Artificial Intelligence Xidian University Xian China School of Electrical and Electrical Engineering Nanyang Technological University Nanyang Avenue Singapore Department of Automation Shanghai Jiao Tong University Shanghai China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Navigating robots through dynamic multi-robot environments, avoiding collisions with both other robots and obstacles, has emerged as a central challenge in robotics. The existing approaches fall short in allowing the policy network to effectively capture spatial-temporal reciprocal collision avoidance in multi-robot environments, comprising both static and dynamic obstacles, resulting in inadequate safety and efficiency in directing robot movement. In this study, we introduce a novel policy neural network called Spatial-Temporal RetNet (STR), designed to encode reciprocal collision avoidance states between robots in spatial and temporal dimensions. The goal is to improve the safety and efficacy of the policy neural network in directing robots to complete assigned tasks. The spatial state encoder module is built upon a parallel RetNet structure, which strengthens the neural network's capacity in extracting reciprocal collision avoidance states between robots in spatial dimensions. This module addresses the limitations of position encoding in transformer-based multi-robot navigation policy neural networks. We design a temporal state encoder utilizing a recurrent RetNet structure. This innovation bolsters the multi-robot navigation policy neural network's capability to capture features in the temporal dimension of multi-robot movements. It addresses the limitations of transformer-based multi-robot navigation policy neural networks, particularly in recurrently inferring information across time dimensions. Simulation experiments were conducted to showcase the superior safety and effectiveness of our proposed method compared to previous state-of-the-art approaches in guiding robots to accomplish tasks.

关键词： Training Technological innovation Navigation Neural networks Transformers Feature extraction Encoding Safety Collision avoidance robots

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：