检索结果-内蒙古大学图书馆

arXiv 2022年

作者： Liu, Ruiping Yang, Kailun Roitberg, Alina Zhang, Jiaming Peng, Kunyu Liu, Huayao Wang, Yaonan Stiefelhagen, Rainer The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The School of Robotics The National Engineering Laboratory of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Artificial Intelligence The University of Stuttgart Stuttgart70569 Germany The Institute for Visual Computing ETH Zurich Zurich8092 Switzerland NIO Shanghai201804 China

Semantic segmentation benchmarks in the realm of autonomous driving are dominated by large pre-trained transformers, yet their widespread adoption is impeded by substantial computational costs and prolonged training durations. To lift this constraint, we look at efficient semantic segmentation from a perspective of comprehensive knowledge distillation and aim to bridge the gap between multi-source knowledge extractions and transformer-specific patch embeddings. We put forward the Transformer-based Knowledge Distillation (TransKD) framework which learns compact student transformers by distilling both feature maps and patch embeddings of large teacher transformers, bypassing the long pre-training process and reducing the FLOPs by >85.0%. Specifically, we propose two fundamental modules to realize feature map distillation and patch embedding distillation, respectively: (1) Cross Selective Fusion (CSF) enables knowledge transfer between cross-stage features via channel attention and feature map distillation within hierarchical transformers;(2) Patch Embedding Alignment (PEA) performs dimensional transformation within the patchifying process to facilitate the patch embedding distillation. Furthermore, we introduce two optimization modules to enhance the patch embedding distillation from different perspectives: (1) Global-Local Context Mixer (GL-Mixer) extracts both global and local information of a representative embedding;(2) Embedding Assistant (EA) acts as an embedding method to seamlessly bridge teacher and student models with the teacher’s number of channels. Experiments on Cityscapes, ACDC, NYUv2, and Pascal VOC2012 datasets show that TransKD outperforms state-of-the-art distillation frameworks and rivals the time-consuming pre-training method. The source code is publicly available at https://***/RuipingL/TransKD. Copyright © 2022, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Design, analysis, and manufacturing of a glass-plastic hybrid minimalist aspheric panoramic annular lens

arXiv

引用

arXiv 2024年

作者： Gao, Shaohua Jiang, Qi Liao, Yiqi Qiu, Yi Ying, Wanglei Yang, Kailun Wang, Kaiwei Zhang, Benhao Bai, Jian State Key Laboratory of Extreme Photonics and Instrumentation College of Optical Science and Engineering Zhejiang University Hangzhou310027 China Ningbo Lian Technology Co. Ltd Ningbo Lian Ningbo315500 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Intelligent Optics & Photonics Research Center Jiaxing Research Institute Zhejiang University Jiaxing314031 China Central Research Institue of Sunny Optical Technology Sunny Optical Technology Hangzhou311215 China

We propose a high-performance glass-plastic hybrid minimalist aspheric panoramic annular lens (ASPAL) to solve several major limitations of the traditional panoramic annular lens (PAL), such as large size, high weight, and complex system. The field of view (FoV) of the ASPAL is 360◦×(35◦∼110◦) and the imaging quality is close to the diffraction limit. This large FoV ASPAL is composed of only 4 lenses. Moreover, we establish a physical structure model of PAL using the ray tracing method and study the influence of its physical parameters on compactness ratio. In addition, for the evaluation of local tolerances of annular surfaces, we propose a tolerance analysis method suitable for ASPAL. This analytical method can effectively analyze surface irregularities on annular surfaces and provide clear guidance on manufacturing tolerances for ASPAL. Benefiting from high-precision glass molding and injection molding aspheric lens manufacturing techniques, we finally manufactured 20 ASPALs in small batches. The weight of an ASPAL prototype is only 8.5 g. Our framework provides promising insights for the application of panoramic systems in space and weight-constrained environmental sensing scenarios such as intelligent security, micro-UAVs, and micro-robots. Copyright © 2024, The Authors. All rights reserved.

关键词： Optical design

来源：评论

学校读者我要写书评

暂无评论

Learning compliant grasping and manipulation by teleoperation with adaptive force control

arXiv

引用

arXiv 2021年

作者： Zeng, Chao Li, Shuang Jiang, Yiming Li, Qiang Chen, Zhaopeng Yang, Chenguang Zhang, Jianwei Department of Informatics Universiẗat Hamburg Germany National Engineering Laboratory for Robot Visual Perception and Control Hunan University China Center for Cognitive Interaction Technology Bielefeld University Germany Bristol Robotics Laboratory University of the West of England United Kingdom

In this work, we focus on improving the robot's dexterous capability by exploiting visual sensing and adaptive force control. TeachNet, a vision-based teleoperation learning framework, is exploited to map human hand postures to a multifingered robot hand. We augment TeachNet, which is originally based on an imprecise kinematic mapping and position-only servoing, with a biomimetic learning-based compliance control algorithm for dexterous manipulation tasks. This compliance controller takes the mapped robotic joint angles from TeachNet as the desired goal, computes the desired joint torques. It is derived from a computational model of the biomimetic control strategy in human motor learning, which allows adapting the control variables (impedance and feedforward force) online during the execution of the reference joint angle trajectories. The simultaneous adaptation of the impedance and feedforward profiles enables the robot to interact with the environment in a compliant manner. Our approach has been verified in multiple tasks in physics simulation, i.e., grasping, opening-a-door, turning-a-cap, and touching-a-mouse, and has shown more reliable performances than the existing position control and the fixed-gain-based force control approaches. Copyright © 2021, The Authors. All rights reserved.

关键词： Remote control

来源：评论

学校读者我要写书评

暂无评论

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey

arXiv

引用

arXiv 2024年

作者： Liu, Jian Sun, Wei Yang, Hui Zeng, Zhiwen Liu, Chongpei Zheng, Jin Liu, Xingyu Rahmani, Hossein Sebe, Nicu Mian, Ajmal The National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering the State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha410082 China The School of Architecture and Art Central South University Changsha410082 China The Department of Automation Tsinghua University Beijing100084 China The School of Computing and Communications Lancaster University LA1 4YW United Kingdom The Department of Information Engineering and Computer Science University of Trento Trento38123 Italy The Department of Computer Science The University of Western Australia WA6009 Australia

Object pose estimation is a fundamental computer vision problem with broad applications in augmented reality and robotics. Over the past decade, deep learning models, due to their superior accuracy and robustness, have increasingly supplanted conventional algorithms reliant on engineered point pair features. Nevertheless, several challenges persist in contemporary methods, including their dependency on labeled training data, model compactness, robustness under challenging conditions, and their ability to generalize to novel unseen objects. A recent survey discussing the progress made on different aspects of this area, outstanding challenges, and promising future directions, is missing. To fill this gap, we discuss the recent advances in deep learning-based object pose estimation, covering all three formulations of the problem, i.e., instance-level, category-level, and unseen object pose estimation. Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks, providing the readers with a holistic understanding of this field. Additionally, it discusses training paradigms of different domains, inference modes, application areas, evaluation metrics, and benchmark datasets, as well as reports the performance of current state-of-the-art methods on these benchmarks, thereby facilitating the readers in selecting the most suitable method for their application. Finally, the survey identifies key challenges, reviews the prevailing trends along with their pros and cons, and identifies promising directions for future research. We also keep tracing the latest works at Awesome-Object-Pose-Estimation. Copyright © 2024, The Authors. All rights reserved.

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

Computational Imaging for Machine perception: Transferring Semantic Segmentation beyond Aberrations

arXiv

引用

arXiv 2022年

作者： Jiang, Qi Shi, Hao Gao, Shaohua Zhang, Jiaming Yang, Kailun Sun, Lei Ni, Huajian Wang, Kaiwei The State Key Laboratory of Extreme Photonics and Instrumentation The National Engineering Research Center of Optical Instrumentation Zhejiang University Hangzhou310027 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Shanghai SUPREMIND Technology Company Ltd Shanghai201210 China

Semantic scene understanding with Minimalist Optical Systems (MOS) in mobile and wearable applications remains a challenge due to the corrupted imaging quality induced by optical aberrations. However, previous works only focus on improving the subjective imaging quality through the Computational Imaging (CI) technique, ignoring the feasibility of advancing semantic segmentation. In this paper, we pioneer the investigation of Semantic Segmentation under Optical Aberrations (SSOA) with MOS. To benchmark SSOA, we construct Virtual Prototype Lens (VPL) groups through optical simulation, generating Cityscapes-ab and KITTI-360-ab datasets under different behaviors and levels of aberrations. We look into SSOA via an unsupervised domain adaptation perspective to address the scarcity of labeled aberration data in real-world scenarios. Further, we propose Computational Imaging Assisted Domain Adaptation (CIADA) to leverage prior knowledge of CI for robust performance in SSOA. Based on our benchmark, we conduct experiments on the robustness of classical segmenters against aberrations. In addition, extensive evaluations of possible solutions to SSOA reveal that CIADA achieves superior performance under all aberration distributions, bridging the gap between computational imaging and downstream applications for MOS. The project page is at https://***/zju-jiangqi/CIADA. Copyright © 2022, The Authors. All rights reserved.

关键词： Aberrations

来源：评论

学校读者我要写书评

暂无评论

An Efficient Planning and control Framework for Quadrotors Based on Heuristic Search and Data-Driven Model Predictive control

引用

IEEE Transactions on Industrial Electronics 2025年

作者： Wang, Sifei Wang, Yaonan Miao, Zhiqiang Wang, Xiangke He, Wei Wang, Hesheng Hunan University College of Electrical and Information Engineering Changsha410082 China National Engineering Research Center for Robot Visual Perception and Control Changsha410082 China National University of Defense Technology College of Intelligence Science and Technology Changsha410073 China Beijing Information Science and Technology University School of Automation Institute of Artificial Intelligence Beijing100083 China University of Science and Technology School of Intelligence Science and Technology Beijing100083 China Shanghai Jiao Tong University Department of Automation Shanghai200240 China Ministry of Education of China Key Laboratory of System Control and Information Processing Shanghai200240 China Harbin Institute of Technology State Key Laboratory of Robotics and System Harbin150001 China

This article presents a framework for quadrotors that integrate planning and control, which employs a heuristic depth-first search (HDFS) with data-driven model predictive control (MPC). The proposed framework intends to enable multiquadrotor systems to traverse cluttered environments containing obstacles and disturbances. The heuristic function enables quadrotors to identify a secure route in a timely manner. The heuristic function setup employed by HDFS results in a reduction in the number of rasters accessed, particularly in scenarios that are not labyrinthine. This consequently leads to an enhancement in computational speed for multiquadrotor systems when compared to the A* algorithm. Furthermore, data-driven MPC enhances the nominal model of the quadrotor by modeling the disturbance while tracking the desired states. Consequently, data-driven MPC is capable of attaining superior tracking precision in a disturbance environment when compared to MPC without data-driven. The transformation from the path to the desired states of the quadrotor is achieved through the utilization of B-splines and differential flatness. Simulations and experiments substantiate the efficacy of the proposed approach. © 1982-2012 IEEE.

关键词： Predictive control systems

来源：评论

学校读者我要写书评

暂无评论

Edge-Computing-Driven Autonomous Ubiquitous Internet of Things in Electricity: Architecture and Challenges 3

Edge-Computing-Driven Autonomous Ubiquitous Internet of Thin...

引用

3rd IEEE Conference on Energy Internet and Energy System Integration, EI2 2019

作者： Liu, Dongqi Zeng, Xiangjun Wang, Yaonan Changsha Unviersity of Science and Technology Changsha China National Engineering Laboratory for Robot Visual Perception and Control Technology Changsha China

ISBN: (纸本)9781728131375

The distribution network is developing towards the direction of Internet of Things in Electricity(IoTE). As an emerging technology of the Internet of Things(IoT), edge computing has great application potential in the future IoTE. This paper presents an architecture of edge computing-driven IoTE, whose physical layer is an electrical network containing a high proportion of power electronic devices, and its information layer is a 5G-oriented power communication network containing a large amount of power terminal and mass communication data generated by the power terminal. For the physical layer, the virtual synchronous machine(VSM) algorithm are adopted to control the large number of power electronic components so as to guarantee the dynamic stability of physical power network. For the information layer, a new layered distributed information processing architecture, the Edge Computing Architecture, is introduced to address the needs of information monitoring and protection control in the smart distribution network. The architecture of the edge computing, and the applications that may be deployed in the edge computing gateways are introduced, and the challenges may be faced by the IoTE in the future development are further discussed. © 2019 IEEE.

关键词： Internet of things

来源：评论

学校读者我要写书评

暂无评论

CoBEV: Elevating Roadside 3D Object Detection with Depth and Height Complementarity

arXiv

引用

arXiv 2023年

作者： Shi, Hao Pang, Chengshan Zhang, Jiaming Yang, Kailun Wu, Yuhao Ni, Huajian Lin, Yining Stiefelhagen, Rainer Wang, Kaiwei The State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The Department of Engineering Science University of Oxford OxfordOX1 3PJ United Kingdom The School of Robotics Hunan University Changsha410012 China The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Shanghai SUPREMIND Technology Co. Ltd. Shanghai201210 China

Roadside camera-driven 3D object detection is a crucial task in intelligent transportation systems, which extends the perception range beyond the limitations of vision-centric vehicles and enhances road safety. While previous studies have limitations in using only depth or height information, we find both depth and height matter and they are in fact complementary. The depth feature encompasses precise geometric cues, whereas the height feature is primarily focused on distinguishing between various categories of height intervals, essentially providing semantic context. This insight motivates the development of Complementary-BEV (CoBEV), a novel end-to-end monocular 3D object detection framework that integrates depth and height to construct robust BEV representations. In essence, CoBEV estimates each pixel's depth and height distribution and lifts the camera features into 3D space for lateral fusion using the newly proposed two-stage complementary feature selection (CFS) module. A BEV feature distillation framework is also seamlessly integrated to further enhance the detection accuracy from the prior knowledge of the fusion-modal CoBEV teacher. We conduct extensive experiments on the public 3D detection benchmarks of roadside camera-based DAIR-V2X-I and Rope3D, as well as the private Supremind-Road dataset, demonstrating that CoBEV not only achieves the accuracy of the new state-of-the-art, but also significantly advances the robustness of previous methods in challenging long-distance scenarios and noisy camera disturbance, and enhances generalization by a large margin in heterologous settings with drastic changes in scene and camera parameters. For the first time, the vehicle AP score of a camera model reaches 80% on DAIR-V2X-I in terms of easy mode. The source code will be made publicly available at CoBEV. Copyright © 2023, The Authors. All rights reserved.

关键词： Feature Selection

来源：评论

学校读者我要写书评

暂无评论

Design and Analysis of a Synergy-Inspired Three-Fingered Hand

Design and Analysis of a Synergy-Inspired Three-Fingered Han...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Wenrui Chen Zhilan Xiao Jingwen Lu Zilong Zhao Yaonan Wang National Engineering Laboratory for Robot Vision Perception and Control Technology Hunan University Changsha China

ISBN: (数字)9781728173955

ISBN: (纸本)9781728173962

Hand synergy from neuroscience provides an effective tool for anthropomorphic hands to realize versatile grasping with simple planning and control. This paper aims to extend the synergy-inspired design from anthropomorphic hands to multi-fingered robot hands. The synergy-inspired hands are not necessarily humanoid in morphology but perform primary characteristics and functions similar to the human hand. At first, the biomechanics of hand synergy is investigated. Three biomechanical characteristics of the human hand synergy are explored as a basis for the mechanical simplification of the robot hands. Secondly, according to the synergy characteristics, a three-fingered hand is designed, and its kinematic model is developed for the analysis of some typical grasping and manipulation functions. Finally, a prototype is developed and preliminary grasping experiments validate the effectiveness of the design and analysis.

关键词： Thumb robots Joints Muscles Grasping Electronics packaging

来源：评论

学校读者我要写书评

暂无评论

Exploring Video-Based Driver Activity Recognition under Noisy Labels

arXiv

引用

arXiv 2025年

作者： Fan, Linjuan Wen, Di Peng, Kunyu Yang, Kailun Zhang, Jiaming Liu, Ruiping Chen, Yufan Zheng, Junwei Wu, Jiamin Han, Xudong Stiefelhagen, Rainer Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Germany School of Robotics National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China Shanghai AI Lab China University of Sussex United Kingdom

As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as real-world video data often contains mislabeled samples, impacting model reliability and performance. However, label noise learning is barely explored in the driver activity recognition field. In this paper, we propose the first label noise learning approach for the driver activity recognition task. Based on the cluster assumption, we initially enable the model to learn clustering-friendly low-dimensional representations from given videos and assign the resultant embeddings into clusters. We subsequently perform co-refinement within each cluster to smooth the classifier outputs. Furthermore, we propose a flexible sample selection strategy that combines two selection criteria without relying on any hyperparameters to filter clean samples from the training dataset. We also incorporate a self-adaptive parameter into the sample selection process to enforce balancing across classes. A comprehensive variety of experiments on the public Drive&Act dataset for all granularity levels demonstrates the superior performance of our method in comparison with other label-denoising methods derived from the image classification field. The source code is available at https://***/ilonafan/DAR-noisy-labels. Copyright © 2025, The Authors. All rights reserved.

关键词： Object recognition

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：