检索结果-内蒙古大学图书馆

Key Technologies for Machine vision for Picking robots:Review and Benchmarking

Machine Intelligence Research 2025年第1期22卷 2-16页

作者： Xu Xiao Yiming Jiang Yaonan Wang College of Electrical and Information Engineering Hunan UniversityChangsha 410082China National Engineering Research Center for Robot Vision Perception and Control Technology Hunan UniversityChangsha 410082China

The increase in precision agriculture has promoted the development of picking robot technology,and the visual recognition system at its core is crucial for improving the level of agricultural *** paper reviews the progress of visual recognition tech-nology for picking robots,including image capture technology,target detection algorithms,spatial positioning strategies and scene *** article begins with a description of the basic structure and function of the vision system of the picking robot and em-phasizes the importance of achieving high-efficiency and high-accuracy recognition in the natural agricultural ***-sequently,various image processing techniques and vision algorithms,including color image analysis,three-dimensional depth percep-tion,and automatic object recognition technology that integrates machine learning and deep learning algorithms,were *** the same time,the paper also highlights the challenges of existing technologies in dynamic lighting,occlusion problems,fruit maturity di-versity,and real-time processing *** paper further discusses multisensor information fusion technology and discusses methods for combining visual recognition with a robot control system to improve the accuracy and working rate of *** the same time,this paper also introduces innovative research,such as the application of convolutional neural networks(CNNs)for accurate fruit detection and the development of event-based vision systems to improve the response speed of the *** the end of this paper,the future development of visual recognition technology for picking robots is predicted,and new research trends are proposed,including the refinement of algorithms,hardware innovation,and the adaptability of technology to different agricultural *** purpose of this paper is to provide a comprehensive analysis of visual recognition technology for researchers and practitioners in the field of agricul-tural rob

关键词： Picking robot visual system perception technology image processing machine learning deep learning.

来源：评论

学校读者我要写书评

暂无评论

E-3DGS: 3D Gaussian splatting with exposure and motion events

引用

Applied Optics 2025年第14期64卷 3897-3908页

作者： Yin, Xiaoting Shi, Hao Bao, Yuhan Bing, Zhenshan Liao, Yiyi Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China The Chair of Robotics AI and Real-Time Systems Technical University of Munich Munich Germany College of Information Science and Electronic Engineering Zhejiang University Hangzhou China School of Robotics and National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China

Achieving 3D reconstruction from images captured under optimal conditions has been extensively studied in the vision and imaging fields. However, in real-world scenarios, challenges such as motion blur and insufficient illumination often limit the performance of standard frame-based cameras in delivering high-quality images. To address these limitations, we incorporate a transmittance adjustment device at the hardware level, enabling event cameras to capture both motion and exposure events for diverse 3D reconstruction scenarios. Motion events (triggered by camera or object movement) are collected in fast-motion scenarios when the device is inactive, while exposure events (generated through controlled camera exposure) are captured during slower motion to reconstruct grayscale images for high-quality training and optimization of event-based 3D Gaussian splatting (3DGS). Our framework supports three modes: high-quality reconstruction using exposure events, fast reconstruction relying on motion events, and balanced hybrid optimizing with initial exposure events followed by high-speed motion events. On the EventNeRF dataset, we demonstrate that exposure events significantly improve fine detail reconstruction compared to motion events and outperform frame-based cameras under challenging conditions such as low illumination and overexposure. Furthermore, we introduce EME-3D, a real-world 3D dataset with exposure events, motion events, camera calibration parameters, and sparse point clouds. Our method achieves faster and higher-quality reconstruction than event-based NeRF and is more cost-effective than methods combining event and RGB data. By combining motion and exposure events, E-3DGS sets a new benchmark for event-based 3D reconstruction with robust performance in challenging conditions and lower hardware demands. The source code and dataset are available on GitHub. © 2025 Optica Publishing Group.

关键词： Exposure controls

来源：评论

学校读者我要写书评

暂无评论

An Efficient Generative Intelligent Multiobjective Grasping Model for Kitchen Waste Sorting

引用

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Deng, Songyun Pei, Ruiyuan Zhou, Li Qin, Hai Sun, Wei Liang, Qiaokang Hunan University College of Electrical and Information Engineering Changsha410082 China Hunan University National Engineering Laboratory for Robot Vision Perception and Control College of Electrical and Information Engineering Changsha410082 China

The key challenge in automated kitchen waste sorting on conveyor belts is how robots execute grasping tasks. Current methods, dependent on object detection, struggle to adopt generative architectures due to data scarcity and algorithmic inefficiency. To solve these issues, this article proposes solutions in three aspects: dataset construction, annotation data processing, and generative model lightweighting. First, we built the KWG2024 dataset, which includes 3116 RGB-D images, 18231 standard annotations, and three new evaluation metrics. Second, we proposed two novel annotation processing methods to address the issue of excessive and incorrect grasps generated by generative networks in single-attempt grasp planning of multiobjects. Third, we constructed an efficient network with classification capabilities, AMI-LiteNet, by integrating the advantages of PP-LiteSeg and AMI-NanoNet. On the public Cornell dataset, AMI-LiteNet achieved a grasping accuracy of 98.3% and an efficiency of 118 frames per second (FPS). In extensive comparative experiments on KWG2024, our model reached a leading computational efficiency compared with recent state-of-the-art methods. It acquired a grasp planning generation accuracy of 87.96% while only requiring a computational effort of 2.79 GFLOPs. Finally, our model was deployed on an edge computing device and achieved a maximum grasping accuracy of 90.91% and a classification accuracy (CA) of 97.48% in our actual robotic system. To our knowledge, this is the first time that a generative grasp method has been applied independently to kitchen waste sorting tasks on a conveyor belt. © 1963-2012 IEEE.

关键词： Belt conveyors

来源：评论

学校读者我要写书评

暂无评论

RGB-Based Category-Level Object Pose Estimation via Depth Recovery and Adaptive Refinement

引用

IEEE robotics and Automation Letters 2025年第6期10卷 5377-5384页

作者： Yang, Hui Sun, Wei Liu, Jian Zheng, Jin Zeng, Zhiwen Mian, Ajmal Hunan University National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering Changsha410082 China Hunan University State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Changsha410082 China Central South University School of Architecture and Art Changsha410082 China University of Western Australia Department of Computer Science and Software Engineering CrawleyWA6009 Australia

Category-level pose estimation methods have received widespread attention as they can be generalized to intra-class unseen objects. Although RGB-D-based category-level methods have made significant progress, reliance on depth image limits practical application. RGB-based methods offer a more practical and cost-effective solution. However, current RGB-based methods struggle with object geometry perception, leading to inaccurate pose estimation. We propose depth recovery and adaptive refinement for category-level object pose estimation from a single RGB image. We leverage DINOv2 to reconstruct the coarse scene-level depth from the input RGB image and propose an adaptive refinement network based on an encoder-decoder architecture to dynamically improve the predicted coarse depth and reduce its gap from the ground truth. We introduce a 2D–3D consistency loss to ensure correspondence between the point cloud obtained from depth projection and the objects in the 2D image. This consistency supervision enables the model to maintain alignment between the depth image and the point cloud. Finally, we extract features from the refined point cloud and feed them into two confidence-aware rotation regression branches and a translation and size prediction residual branch for end-to-end training. Decoupling the rotation matrix provides a more direct representation, which facilitates parameter optimization and gradient propagation. Extensive experiments on the REAL275 and CAMERA25 datasets demonstrate the superior performance of our method. Real-world estimation and robotic grasping experiments demonstrate our model robustness to occlusion, clutter environments, and low-textured objects. Our code and robotic grasping video are available at DA-Pose. © 2016 IEEE.

关键词： Depth perception

来源：评论

学校读者我要写书评

暂无评论

Prior Distribution and perception Radius Are Important: Learning 3-D Object Detector for Autonomous Driving

引用

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Tao, Ziming Mao, Jianxu Peng, Weixing Wang, Yaonan Yi, Junfei Zhang, Hui Hunan University National Engineering Laboratory of Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan Changsha410082 China Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology College of Robotics Hunan Changsha410082 China

This article proposes an efficient 3-D object detection algorithm for LiDAR point clouds in the field of autonomous driving. Currently, despite significant performance improvements in 3-D LiDAR object detection methods, there are still problems that have impact on 3-D detection accuracy. Typically, since the sampling process and grouping process introduced background points, the final regression step in the detection task would be greatly affected. To address this problem, a method named PR-SSD is proposed to retain more important foreground points during the training pipeline, improving detection accuracy. Specifically, the proposed approach utilizes prior information to guide semantic sampling, referred to as prior distributed semantic sampling (PDSS). This mechanism encourages the network to prioritize foreground targets in regression. In addition, a module named radius-aware attention multiscale grouping (RAMSG) is designed to dynamically reassign grouping weights for multiscale features. In other words, the network has adaptive detection capabilities for targets of different scales. Furthermore, PR-SSD is a single-stage detector which can be trained end-to-end. Finally, extensive experiments and evaluations on large-scale benchmarks KITTI demonstrate that our proposed method significantly enhanced 3-D object detector. In KITTI testing set, PR-SSD achieves 89.69%, 45.08%, and 80.01% detection performance for cars, pedestrians, and cyclists. © 1963-2012 IEEE.

关键词： Vehicle detection

来源：评论

学校读者我要写书评

暂无评论

DDH-Net:A Dual Dynamic Head Network for Transmission Line Inspection

引用

IEEE Transactions on Instrumentation and Measurement 2025年

作者： Yu, Junlong Mao, Jianxu Wang, Yaonan He, Zhenyu Yi, Junfei Tao, Ziming Zhang, Hui Wang, Shaoyuan Hunan University College of Electrical and Information Engineering Hunan Changsha410012 China Hunan University National Engineering Laboratory of Robot Visual Perception and Control Technology College of Robotics Hunan Changsha410082 China

Transmission lines are a critical component of an electrical grid, and ensuring their effective detection is of utmost importance. However, problems such as fine-grained identification, target occlusion, and background complexity in aerial transmission line images challenge existing transmission line detection methods. This paper presents a dual dynamic head network (DDH-Net) to address the aforementioned issues. This network incorporates a dual dynamic head (DDH) composed of a multifeature fusion module (MFFM) and deformable convolution. DDH leverages deformable convolution to enhance the network's focus on the target of interest. Subsequently, the MFFM enhances the feature representation capabilities for individual targets, leading to discriminative feature extraction and improving the network's accuracy in detecting similar targets. Furthermore, we introduce the wise area intersection over union (WAIoU) loss, which reduces the network's attention on detection boxes that contain only partial target content through the adaptive allocation of loss weights to anchor boxes to mitigate occlusion-induced interference. Additionally, we incorporate area as a constraint to further enhance the network's localization accuracy. Finally, extensive experiments were conducted on a power transmission line dataset. The results demonstrated the superiority of the proposed module over other state-of-the-art (SOTA) methods. © 1963-2012 IEEE.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

SMA-MVS: Segmentation-Guided Multi-Scale Anchor Deformation Patch Multi-View Stereo

引用

IEEE Transactions on Circuits and Systems for Video technology 2025年

作者： Yin, Yufeng Liu, Xiaoyan Zhang, Zichao Hunan University National Engineering Laboratory for Robot Visual Perception and Control Technology College of Electrical and Information Engineering Changsha410082 China Innovation Institute of Industrial Design and Machine Intelligence Quanzhou-Hunan University Quanzhou362006 China

Multi-view stereo aims to recover the 3D model of a scene from a set of images. However, low-textured areas in the scene have always been a challenge in 3D reconstruction. In this work, we propose a segmentation-guided multi-scale anchor deformation patch multi-view stereo. Specifically, we use the Segment Anything Model to distinguish different instances in the scene, and propose an anchor deformation strategy guided by segmentation to adaptively generate a multi-scale anchor patch, so that the depth can be refined from coarse to fine scales. To propagate a better hypothesis for low-textured areas where photometric consistency is unreliable, we propose a non-local adaptive propagation scheme by using the segmented mask as a propagation domain. In order to reduce the interference of illumination on reconstruction completeness, we propose an outlier depth cost refinement guided by reliable points that improves the performance of depth estimation in unevenly illuminated areas. As a result, our method achieves state-of-the-art performance among traditional methods and exhibits better generalization capabilities on the ETH3D, Tanks and Temples, and DTU datasets. © 1991-2012 IEEE.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

An Improved Dual Neural Network Method Based on Levy Flight for Multi-robot Cooperative Area Coverage Search in 3D Unknown Environments

引用

IEEE Transactions on Cognitive and Developmental Systems 2025年

作者： Zhang, Fangfang Wang, Yongqi Wang, Wenhao Xin, Jianbin Peng, Jinzhu Wang, Yaonan Zhengzhou University School of Electrical and Information Engineering Zhengzhou450001 China State Key Laboratory of Intelligent Agricultural Power Equipment Luoyang471039 China National Engineering Laboratory of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha410082 China

The research on multi-robot collaborative search in unknown 3D environments, based on bio-inspired neural networks, holds significant value and ***, challenges arise in 3D environments, including excessive turning and vertical movement, as well as the potential for collisions between robots. In response, we propose an improved Glasius Bio-Inspired Neural Network(GBNN) that mitigates decision conflicts among robots and considers the impact of turning and vertical movement on robot decision-making. Furthermore, to address the issue of robots getting trapped in local deadlocks during the search process, we present a dual neural network algorithm based on Levy flights. In the method Dual Glasius Bio-Inspired Neural Network based on Levy Flight(LF-DUAL-GBNN) proposed in this paper, robots obtain random target points through Levy flights and are then guided by a dual neural network to navigate to the vicinity of the target points, thus breaking free from local deadlock states. Finally, we conducted simulation experiments to validate the algorithm's effectiveness. © 2016 IEEE.

关键词： Microrobots

来源：评论

学校读者我要写书评

暂无评论

EgoEvGesture: Gesture Recognition Based on Egocentric Event Camera

arXiv

引用

arXiv 2025年

作者： Wang, Luming Shi, Hao Yin, Xiaoting Yang, Kailun Wang, Kaiwei Bai, Jian State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

Egocentric gesture recognition is a pivotal technology for enhancing natural human-computer interaction, yet traditional RGB-based solutions suffer from motion blur and illumination variations in dynamic scenarios. While event cameras show distinct advantages in handling high dynamic range with ultra-low power consumption, existing RGB-based architectures face inherent limitations in processing asynchronous event streams due to their synchronous frame-based nature. Moreover, from an egocentric perspective, event cameras record data that includes events generated by both head movements and hand gestures, thereby increasing the complexity of gesture recognition. To address this, we propose a novel network architecture specifically designed for event data processing, incorporating (1) a lightweight CNN with asymmetric depthwise convolutions to reduce parameters while preserving spatiotemporal features, (2) a plug-and-play state-space model as context block that decouples head movement noise from gesture dynamics, and (3) a parameter-free Bins-Temporal Shift Module (BSTM) that shifts features along bins and temporal dimensions to fuse sparse events efficiently. We further establish the EgoEvGesture dataset, the first large-scale dataset for egocentric gesture recognition using event cameras. Experimental results demonstrate that our method achieves 62.7% accuracy tested on unseen subjects with only 7M parameters, 3.1% higher than state-of-the-art approaches. Notable misclassifications in freestyle motions stem from high interpersonal variability and unseen test patterns differing from training data. Moreover, our approach achieved a remarkable accuracy of 97.0% on the DVS128 Gesture, demonstrating the effectiveness and generalization capability of our method on public datasets. The dataset and models are made available at https://***/3190105222/EgoEv_Gesture. Copyright © 2025, The Authors. All rights reserved.

关键词： Gesture recognition

来源：评论

学校读者我要写书评

暂无评论

Learning to Learn Transferable Generative Attack for Person Re-Identification

引用

IEEE Transactions on Image Processing 2025年 PP卷 PP页

作者： Bian, Yuan Liu, Min Wang, Xueping Ma, Yunfeng Wang, Yaonan Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan Changsha China Hunan Normal University Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing College of Information Science and Engineering Hunan Changsha China

Deep learning-based person re-identification (reid) models are widely employed in surveillance systems and inevitably inherit the vulnerability of deep networks to adversarial attacks. Existing attacks merely consider cross-dataset and cross-model transferability, ignoring the cross-test capability to perturb models trained in different domains. To powerfully examine the robustness of real-world re-id models, the Meta Transferable Generative Attack (MTGA) method is proposed, which adopts meta-learning optimization to promote the generative attacker producing highly transferable adversarial examples by learning comprehensively simulated transfer-based crossmodel&dataset&test black-box meta attack tasks. Specifically, cross-model&dataset black-box attack tasks are first mimicked by selecting different re-id models and datasets for meta-train and meta-test attack processes. As different models may focus on different feature regions, the Perturbation Random Erasing module is further devised to prevent the attacker from learning to only corrupt model-specific features. To boost the attacker learning to possess cross-test transferability, the Normalization Mix strategy is introduced to imitate diverse feature embedding spaces by mixing multi-domain statistics of target models. Extensive experiments show the superiority of MTGA, especially in cross-model&dataset and cross-model&dataset&test attacks, our MTGA outperforms the SOTA methods by 20.0% and 11.3% on mean mAP drop rate, respectively. © 1992-2012 IEEE.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：