检索结果-内蒙古大学图书馆

E-3DGS: 3D Gaussian splatting with exposure and motion events

Applied Optics 2025年第14期64卷 3897-3908页

作者： Yin, Xiaoting Shi, Hao Bao, Yuhan Bing, Zhenshan Liao, Yiyi Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China The Chair of Robotics AI and Real-Time Systems Technical University of Munich Munich Germany College of Information Science and Electronic Engineering Zhejiang University Hangzhou China School of Robotics and National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China

Achieving 3D reconstruction from images captured under optimal conditions has been extensively studied in the vision and imaging fields. However, in real-world scenarios, challenges such as motion blur and insufficient illumination often limit the performance of standard frame-based cameras in delivering high-quality images. To address these limitations, we incorporate a transmittance adjustment device at the hardware level, enabling event cameras to capture both motion and exposure events for diverse 3D reconstruction scenarios. Motion events (triggered by camera or object movement) are collected in fast-motion scenarios when the device is inactive, while exposure events (generated through controlled camera exposure) are captured during slower motion to reconstruct grayscale images for high-quality training and optimization of event-based 3D Gaussian splatting (3DGS). Our framework supports three modes: high-quality reconstruction using exposure events, fast reconstruction relying on motion events, and balanced hybrid optimizing with initial exposure events followed by high-speed motion events. On the EventNeRF dataset, we demonstrate that exposure events significantly improve fine detail reconstruction compared to motion events and outperform frame-based cameras under challenging conditions such as low illumination and overexposure. Furthermore, we introduce EME-3D, a real-world 3D dataset with exposure events, motion events, camera calibration parameters, and sparse point clouds. Our method achieves faster and higher-quality reconstruction than event-based NeRF and is more cost-effective than methods combining event and RGB data. By combining motion and exposure events, E-3DGS sets a new benchmark for event-based 3D reconstruction with robust performance in challenging conditions and lower hardware demands. The source code and dataset are available on GitHub. © 2025 Optica Publishing Group.

关键词： Exposure controls

来源：评论

学校读者我要写书评

暂无评论

Motion planning using binary space partitioning

Motion planning using binary space partitioning

引用

Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and systems '91

作者： A.O. Tokuta Robotics and Visual Systems Laboratory Department of Computer Science and Engineering University of South Florida Tampa FL USA

This work explores a method for path planning for a robot in an environment that consists of stationary and moving obstacles. The technique uses binary partitioning of the environment by the obstacles to establish and analyze the spatial relationship between robot and obstacles. Hyperplanes are used to obtain recursively a disjoint set of D-dimensional cells, with each cell designated as belonging to either the interior or the exterior of the set. An overt idea of binary space partitioning as a representation of polytopes is given. Thus, the space-time configuration of free space is viewed as disjoint polytopes; each point in space-time is considered a map into a unique polytope. A traversal of the tree is used to obtain a linear order which gives the collision probability with the environment. Adjacent polytopes between the start and goal polytopes are then utilized to obtain a trajectory. Current implementation for a 2D static environment is discussed.< >

关键词： Path planning Orbital robotics Motion planning Robot motion robotics and automation Shape visual system Computer science Computational efficiency Tree graphs

来源：评论

学校读者我要写书评

暂无评论

Hybrid-augmented intelligence： collaboration and cognition

引用

Frontiers of Information Technology & Electronic Engineering 2017年第2期18卷 153-179页

作者： Nan-ning ZHENG Zi-yi LIU Peng-ju REN Yong-qiang MA Shi-tao CHEN Si-yu YU Jian-ru XUE Ba-dong CHEN Fei-yue WANG Institute of Artificial Intelligence and Robotics Xi ' an Jiaotong University Xi ' an 710049 China National Engineering Laboratory of Visual Information Processing Applications Xi 'an Jiaotong University Xi'an 710049 China State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing 100190 China

The long-term goal of artificial intelligence （AI） is to make machines learn and think like human beings. Due to the high levels of uncertainty and vulnerability in human life and the open-ended nature of problems that humans are facing, no matter how intelligent machines are, they are unable to completely replace humans. Therefore, it is necessary to introduce human cognitive capabilities or human-like cognitive models into AI systems to develop a new form of AI, that is, hybrid-augmented intelligence. This form of AI or machine intelligence is a feasible and important developing model. Hybrid-augmented intelligence can be divided into two basic models： one is human-in-the-loop augmented intelligence with human-computer collaboration, and the other is cognitive computing based augmented intelligence, in which a cognitive model is embedded in the machine learning system. This survey describes a basic framework for human-computer collaborative hybrid-augmented intelligence, and the basic elements of hybrid-augmented intelligence based on cognitive computing. These elements include intuitive reasoning, causal models, evolution of memory and knowledge, especially the role and basic principles of intuitive reasoning for complex problem solving, and the cognitive learning framework for visual scene understanding based on memory and reasoning. Several typical applications of hybrid-augmented intelligence in related fields are given.

关键词： Human-machine collaboration Hybrid-augmented intelligence Cognitive computing Intuitivereasoning Causal model Cognitive mapping visual scene understanding Self-driving cars

来源：评论

学校读者我要写书评

暂无评论

Stiffness Estimation and Intention Detection for Human-Robot Collaboration

Stiffness Estimation and Intention Detection for Human-Robot...

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Xiongjun Chen Yiming Jiang Chenguang Yang Key Laboratory of Autonomous Systems and Networked Control College of Automation Science and Engineering South China University of Technology Guangzhou China National Engineering Laboratory for Robot Visual Perception and Control Hunan University Changsha China Bristol Robotics Laboratory University of the West of England Bristol UK

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

In this paper, we propose a stiffness estimation and intention detection method for human-robot collaboration. The human arm endpoint stiffness can be obtained according to the muscle activation levels of the upper arm and the human arm configurations. The estimated endpoint stiffness of human arm is matching to the robot arm joint stiffness through an appropriate mapping. The motion intention of human arm is detected based on the wrist configuration which is recognized by a Myo armband attached at the forearm of the operator. In order to reduce the time of feature engineering to ensure the performance of real-time collaboration, the wrist configuration recognition is realised based on the neural learning algorithm. The sEMG of the human forearm is directly fed into the neural network after processing by filters and sliding windows. The force sensor at the end of the robot arm is embedded in the feedback loop to make the robot arm better adapted to the operator's movement. The results of experiments performed on Baxter robot platform illustrate a good performance and verifies the proposed method.

关键词： Wrist Neural networks Collaboration Estimation Robot sensing systems Manipulators Robots

来源：评论

学校读者我要写书评

暂无评论

Online Parameter Estimation For Uncertain Robot Manipulators With Fixed-time Convergence

Online Parameter Estimation For Uncertain Robot Manipulators...

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Chengzhi Zhu Yiming Jiang Chenguang Yang Key Laboratory of Autonomous Systems and Networked Control College of Automation Science and Engineering South China University of Technology Guangzhou China National Engineering Laboratory for Robot Visual Perception and Control Hunan University Changsha China Bristol Robotics Laboratory University of the West of England Bristol UK

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

For traditional parameter estimation schemes of uncertain robot, most of them were proposed to identify unknown parameter with desired precision, but few of them focused on the convergence time. Recently finite-time estimation techniques have been proposed by scholars to achieve estimation in finite time. In this paper, we proposed a novel estimation scheme for uncertain robot systems with fixed time instead of finite time. In order to avoid using acceleration signals during the estimation, a kind of auxiliary filtering technique was employed. Besides, a continuous and recursive update law was employed for the parameter estimation such that the computational burdens of real-time inversion of square matrices could be avoided. Finally the effectiveness of the identification algorithm is verified based on a 2-DOF uncertain robot model.

关键词： Parameter estimation Filtering Heuristic algorithms Estimation Real-time systems Manipulator dynamics Convergence

来源：评论

学校读者我要写书评

暂无评论

A Shared Pose Regression Network for Pose Estimation of Objects from RGB Images

A Shared Pose Regression Network for Pose Estimation of Obje...

引用

International IEEE Conference on Signal-Image Technologies and Internet-Based System

作者： Stefan Hein Bengtson Hampus Åström Thomas B. Moeslund Elin A. Topp Volker Krueger Department of Architecture Design and Media Technology Visual Analysis and Perception (VAP) Laboratory Pioneer Centre for AI Denmark Aalborg University Aalborg Denmark Department of Computer Science Lund University Robotics and Semantic Systems Lund Sweden

In this paper we propose a shared regression network to jointly estimate the pose of multiple objects, replacing multiple object-specific solutions. We demonstrate that this shared network can outperform other similar approaches that rely on multiple object-specific models by evaluating it on the TLESS dataset using the VSD (Visible Surface Discrepancy). Our approach offers a less complex solution, with fewer parameters, lower memory consumption and less training required. Furthermore, it inherently handles symmetric objects by using a depth-based loss during training and can predict in real-time. Finally, we show how our proposed pipeline can be used for fine-tuning a feature extractor jointly on all objects while training the shared pose regression network. This fine-tuning process improves the pose estimation performance.

关键词： Training Pose estimation Memory management Pipelines Feature extraction Rendering (computer graphics) Real-time systems

来源：评论

学校读者我要写书评

暂无评论

E-3DGS: Gaussian Splatting with Exposure and Motion Events

arXiv

引用

arXiv 2024年

作者： Yin, Xiaoting Shi, Hao Bao, Yuhan Bing, Zhenshan Liao, Yiyi Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University China School of Robotics National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China College of Information Science and Electronic Engineering Zhejiang University China The Chair of Robotics AI and Real-Time Systems Technical University of Munich Germany

Estimating Neural Radiance Fields (NeRFs) from images captured under optimal conditions has been extensively explored in the vision community. However, robotic applications often face challenges such as motion blur, insufficient illumination, and high computational overhead, which adversely affect downstream tasks like navigation, inspection, and scene visualization. To address these challenges, we propose E-3DGS, a novel event-based approach that partitions events into motion (from camera or object movement) and exposure (from camera exposure), using the former to handle fast-motion scenes and using the latter to reconstruct grayscale images for high-quality training and optimization of event-based 3D Gaussian Splatting (3DGS). We introduce a novel integration of 3DGS with exposure events for high-quality reconstruction of explicit scene representations. Our versatile framework can operate on motion events alone for 3D reconstruction, enhance quality using exposure events, or adopt a hybrid mode that balances quality and effectiveness by optimizing with initial exposure events followed by high-speed motion events. We also introduce EME-3D, a real-world 3D dataset with exposure events, motion events, camera calibration parameters, and sparse point clouds. Our method is faster and delivers better reconstruction quality than event-based NeRF while being more cost-effective than NeRF methods that combine event and RGB data by using a single event sensor. By combining motion and exposure events, E-3DGS sets a new benchmark for event-based 3D reconstruction with robust performance in challenging conditions and lower hardware demands. The source code and dataset will be available at https://***/MasterHow/E-3DGS. Copyright © 2024, The Authors. All rights reserved.

关键词： Gaussian distribution

来源：评论

学校读者我要写书评

暂无评论

Robot self-recognition via facial expression sensorimotor learning

Robot self-recognition via facial expression sensorimotor le...

引用

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Zhegong Shangguan Mengyuan Ding Chuang Yu Chaona Chen Adriana Tapus Autonomous Systems and Robotics Lab/U2IS ENSTA Paris Institut Polytechnique de Paris 828 Boulevard des Maréchaux Palaiseau France National Engineering Laboratory for Visual Information Applications college of Artificial Intelligence Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an China Cognitive Robotics Lab Department of Computer Science University of Manchester Kilburn Building Oxford Rd Manchester UK School of Psychology and Neuroscience University of Glasgow Glasgow UK

To develop robots that can show cognitive functions, we must learn from the knowledge of human cognition. Existing biological and psychological evidence suggests that self-face perception and sensorimotor learning mechanisms play a crucial role in self-recognition. However, one of the most important self-identity cues – facial information – has not been extensively studied in the robot self-recognition task. Current research on robot self-recognition primarily relies on the recognition of high-precision targets and tracking of manipulator motions, where the self-perception of facial information is not well studied. In this work, we propose a novel approach to achieve self-recognition via self-perception of facial expressions. Specifically, we developed a Conditional Generative Adversarial Network (CGAN) model using the knowledge on human cognitive and sensorimotor functions. It allows the robot to be aware of self-face (i.e., off-line model). Passing the observed visual variations in a mirror and comparing them to self-perceptive information, the robot can recognize the self through an online Bayesian learning regression. The results of our first experiment show that the robot can recognize itself in a mirror. The results from the second experiment show that our algorithm could be tricked by a similar robot with the same facial expressions, which is similar to the rubber hand illusion (RHI).

关键词：

来源：评论

学校读者我要写书评

暂无评论

Hierarchical Task Impedance Control of a Serial Manipulator for Minimally Invasive Surgery

Hierarchical Task Impedance Control of a Serial Manipulator ...

引用

IEEE International Conference on Human-Machine systems

作者： Hang Su Chenguang Yang Jiehao Li Yiming Jiang Giancarlo Ferrigno Elena De Momi Dipartimento di Elettronica Informazione e Bioingegneria Politecnico di Milano Milan Italy Bristol Robotics Laboratory University of the West of England Bristol United Kingdom State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing Institute of Technology Beijing China National Engineering Laboratory for Robot Visual Perception and Control Hunan University Changsha China Dipartimento di Elettronica Informazione e Bioingegneria Politecnico di Milano Milano Italy

ISBN: (数字)9781728158716

ISBN: (纸本)9781728158723

Flexibility and robustness have become key points in the development of surgical robot controller for physical interactions. However, the conventional impedance control schemes unaware of the actual surgical scenario, including complex physical interaction on the robot arm, lead to the loss of accuracy. In this paper, a hierarchical task impedance control scheme is proposed for Minimally Invasive Surgery (MIS) based on an operational space formulation of a 7 DoFs redundant robot. Its redundancy is exploited to guarantee a remote center of motion (RCM) constraint and to provide a flexible workspace for the medical staff to assist physicians. In addition to the achievement of the classical whole-body impedance control, the issue of uncertain disturbances will be addressed by a decoupled adaptive approximation based on a radial basis function neural network (RBFNN) within the control framework. Task performances under the hierarchical task impedance controller were validated and compared with previous work in the literature. Experimental results showed its improved performance in terms of positional error and RCM constraint, regardless of the existing uncertain physical interaction.

关键词： Task analysis Impedance Manipulators Tools Surgery Jacobian matrices

来源：评论

学校读者我要写书评

暂无评论

Fundus-Image-Based Retinal Vascular Analysis in Myopic Eyes 42

Fundus-Image-Based Retinal Vascular Analysis in Myopic Eyes

引用

42nd Chinese Control Conference, CCC 2023

作者： Shen, Jichen Zou, Haohan Wang, Yan Liu, Jinchao Yu, Ningbo College of Artificial Intelligence Nankai University Tianjin300350 China Clinical College of Ophthalmology Tianjin Medical University Tianjin300070 China Tianjin Key Lab of Ophthalmology and Visual Science Tianjin Eye Institute Tianjin Eye Hospital Nankai University Affiliated Eye Hospital Tianjin300020 China Nankai University Eye Institute Nankai University Tianjin300350 China Tianjin Key Laboratory of Intelligent Robotics Nankai University Tianjin300350 China Engineering Research Center of Trusted Behavior Intelligence Ministry of Education Nankai University Tianjin300350 China Institute of Intelligence Technology and Robotic Systems Shenzhen Research Institute of Nankai University Shenzhen518083 China

ISBN: (纸本)9789887581543

Myopia is prevalent worldwide and it is of great significance to prevent, control and intervene myopia in an early stage. The etiopathogenesis of myopia remains unclear and needs further research. Fundus photographs can show biomarkers and lesions of the retina in a non-invasive way directly. To discover some potential changes in myopic eyes, we extracted the retinal vascular features from vessel segmented results, and calculated the Spearman correlation coefficients between the retinal vascular features and the spherical refractive errors. The Kruskal-Wallis test was applied to explore the difference exists in the characteristics of retinal vessels among the mild, moderate and high myopia groups. The statistical analysis results indicated that the higher the degrees of myopia, the smaller the retinal vessels. This study found vascular changes in myopic eyes through fundus images, which could help to explain the mechanism of myopia and the damage caused by myopia. © 2023 Technical Committee on Control Theory, Chinese Association of Automation.

关键词： Ophthalmology

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：