Estimating camera motion and continuously reconstructing dense scenes in deformable environments presents a complex and open challenge. Many existing approaches tend to rely on assumptions about the scene’s topology ...
详细信息
ISBN:
(数字)9798350377705
ISBN:
(纸本)9798350377712
Estimating camera motion and continuously reconstructing dense scenes in deformable environments presents a complex and open challenge. Many existing approaches tend to rely on assumptions about the scene’s topology or the nature of deformable motion. However, these assumptions do not hold true in medical endoscopy applications. To address these challenges, we introduce DDS-SLAM, a novel dense deformable semantic neural SLAM that achieves accurate camera tracking, continuous dense scene reconstruction, and high-quality image rendering in deformable scenes. First, we propose a novel hybrid neural scene representation method capable of capturing both natural and artificial deformations. Additionally, by leveraging the 2D semantic information of the scene, we introduce a semantic loss function based on semantic distance fields. This approach guides network optimization at a higher level, thereby enhancing system performance. Furthermore, we validate our method through a series of experiments conducted on several representative medical datasets, demonstrating its superiority over other state-of-the-art approaches. The code is available at: https://***/IRMVLab/DDS-SLAM.
作者:
Jiwei ShanYirui LiQiyu FengDitao LiLijun HanHesheng WangDepartment of Automation
Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai China School of Mechanical Engineering
Shanghai Jiao Tong University Shanghai China
Building a self-model for robots, enabling them to simulate their physical selves and predict future states without direct interaction with the physical world, is crucial for robot motion planning and control. Existin...
详细信息
ISBN:
(数字)9798350377705
ISBN:
(纸本)9798350377712
Building a self-model for robots, enabling them to simulate their physical selves and predict future states without direct interaction with the physical world, is crucial for robot motion planning and control. Existing self-modeling methods primarily focus on rigid robots and typically require significant time, effort, and resources to gather training data. In this study, we introduce SoftNeRF, a self-supervised visual self-model designed for soft robots. We use a hybrid neural shape representation based on the Signed Distance Function (SDF) to capture both the geometry and complex nonlinear motion of soft robots. By leveraging differentiable rendering, our method learns a self-model from readily available RGB images, similar to how humans understand their physical state through reflection. To improve training efficiency and model accuracy, we propose an error-guided adaptive sampling strategy. SoftNeRF can serve as a plug-in for various downstream tasks, even when trained with data unrelated to those tasks. We demonstrate SoftNeRF’s ability to support shape prediction and motion planning for robots in both simulated and real-world environments. Furthermore, SoftNeRF excels in detecting and recovering from damage, thereby enhancing machine resilience. Code is available at: https://***/irmvlab/soft-nerf.
In image fusion,the desirable fused image is to obtain advantage information from different images of the same *** for the fusion of the infrared image and the visible image that have distinct features,this paper prop...
In image fusion,the desirable fused image is to obtain advantage information from different images of the same *** for the fusion of the infrared image and the visible image that have distinct features,this paper proposes an adaptive multiweight fusion based on multi-scale *** method designs different weight matrices according to the characteristics of the infrared image and the visible *** can also adaptively adjusts the weight size according to the *** on the difference of information entropy between infrared images and visible images,the method of this paper can keep the important information as much as *** results prove the method of this paper is fast and *** also has certain superiority compared with other methods.
The interaction topology plays a significant role in the collaboration of multiagent systems. How to preserve the topology against inference attacks has become an imperative task for security concerns. In this paper, ...
The interaction topology plays a significant role in the collaboration of multiagent systems. How to preserve the topology against inference attacks has become an imperative task for security concerns. In this paper, we propose a distributed topology-preserving algorithm for second-order multi-agent systems by adding noisy inputs. The major novelty is that we develop a strategic compensation approach to overcome the noise accumulation issue in the second-order dynamic process while ensuring the exact second-order consensus. Specifically, we design two distributed compensation strategies that make the topology more invulnerable against inference attacks. Furthermore, we derive the relationship between the inference error and the number of observations by taking the ordinary least squares estimator as a benchmark. Extensive simulations are conducted to verify the topology-preserving performance of the proposed algorithm.
This paper utilizes the weak approximation method to analyze differential games that involve mixed strategies. Mixed strategies have the potential to produce unique strategic behaviors, whereas traditional models and ...
This paper utilizes the weak approximation method to analyze differential games that involve mixed strategies. Mixed strategies have the potential to produce unique strategic behaviors, whereas traditional models and tools in pure strategy games cannot be directly applied. Based on the stochastic processes with independent increments, we define the mixed strategy without assuming the knowledge of the opponents' strategy and system state. However, this general mixed strategy poses challenges in evaluating game payoff and game value. To overcome these challenges, we utilize the weak approximation method to employ a stochastic differential game to characterize the dynamics of the mixed strategy game. We demonstrate that the game's payoff function can be precisely approximated with an error of the same scale as the step size. Furthermore, we estimate the upper and lower value functions of the weak approximated game to analyze the existence of game value. Finally, we provide numerical examples to illustrate and elaborate on our findings.
The new generation of industrial cyber-physical systems (ICPS) supported by the edge computing technology enables efficient distributed sensing under massive data volumes and frequent transmissions. Observability is e...
The new generation of industrial cyber-physical systems (ICPS) supported by the edge computing technology enables efficient distributed sensing under massive data volumes and frequent transmissions. Observability is essential to obtain good sensing performance, and most of existing sensing works directly assume that the system is observable. However, it is difficult to satisfy the assumption with the increasingly expanded network scale and dynamic scheduling of devices. To solve this problem, we propose an observability guaranteed distributed method (OGDM) for edge sensing with the cooperation of sensors and edge computing units (ECUs). We analyze the relationship between sensor scheduling and observability based on the network topology and graph signal processing (GSP) technology. In addition, we transform the observability condition into a convex form and take into account sensing error and energy consumption for optimization. Finally, our algorithm is applied to estimate the slab temperature in the hot rolling process. The effectiveness is verified by simulation results.
Building paired datasets in low-light enhancement entails significant cost and time, making such datasets precious commodities. Many researchers focus on how to enable models to learn more information from limited dat...
Building paired datasets in low-light enhancement entails significant cost and time, making such datasets precious commodities. Many researchers focus on how to enable models to learn more information from limited datasets. A prevalent strategy involves employing semi-supervised learning techniques to enhance model performance through additional unpaired images. However, one of the main challenges faced is the scarcity of a vast number of unpaired images from the same domain as the original low-light images. Consequently, we introduce a semi-supervised image enhancement method using pseudo-low-light images. Initially, we generate pseudo low-light images with less noise compared with the source domain image by the Signal-to-Noise Ratio prior and diffusion models. We then employ the Mean-Teacher network and the feature constraints of the pseudo-low-light images to realize low-light image enhancement. Comprehensive experimental results validate the efficacy of our approach on real-world datasets.
Nighttime semantic segmentation has attracted considerable attention due to its crucial status in the smart city. However, it is challenging to handle poor illumination and indiscernible information. To tackle these p...
详细信息
Nighttime semantic segmentation has attracted considerable attention due to its crucial status in the smart city. However, it is challenging to handle poor illumination and indiscernible information. To tackle these problems, a saliency-guided domain adaptation network, SGDA, is proposed via adapting daytime models to nighttime scenes. Firstly, a saliency guidance branch is attached to the segmentation network to enrich the spatial features and guide the model to better perceive detail information. Secondly, to embed the saliency guidance to the segmentation network, a pyramid attention architecture is designed to fuse the features from the two branches. Thirdly, an illumination adaptation module is constructed to close the intensity distributions via adversarial learning, with an elaborately designed loss function to improve the performance. Extensive experiments on Dark Zurich dataset and Nighttime Driving dataset validate the effectiveness of SGDA, and indicate that our method improves the accuracy on small object categories,
Offset-free model predictive control (MPC) provides a useful means for controlling systems with uncertainties and constraints, but suffers from the heavy computational burden of repeatedly solving an optimization prob...
Offset-free model predictive control (MPC) provides a useful means for controlling systems with uncertainties and constraints, but suffers from the heavy computational burden of repeatedly solving an optimization problem in real time. Such computational issue precludes the possibility of its application in systems requiring high realtime requirements, such as autonomous driving system. To address this problem, we develop a provably safe deep learning-based offset-free MPC framework. Based on the nominal offset-free MPC, the proposed MPC not only reserves the ability of disturbance rejection, but also leverages deep neural networks for approximating the explicit MPC solution to greatly reduce online computational time. Furthermore, a gauge map is used to guarantee the satisfaction of safe constraints. The proposed MPC is used in trajectory tracking control for smart autonomous driving. The simulation results show that the proposed MPC is an order of magnitude faster than the nominal offset-free MPC in safety-critical systems.
Safe and stable operation of a proton exchange membrane fuel cell (PEMFC) system requires stringent control of oxygen excess ratio (OER). However, the OER regulation in PEMFC is challenging due to frequent fluctuation...
Safe and stable operation of a proton exchange membrane fuel cell (PEMFC) system requires stringent control of oxygen excess ratio (OER). However, the OER regulation in PEMFC is challenging due to frequent fluctuations of current, various modeling nonlinearities, constrained manipulated variable, and real-time requirements. Offset-free model predictive control (MPC) provides a useful means for controlling systems with disturbances and constraints, but suffers from the heavy computational burden of repeatedly solving an optimization problem in real time. Such computational issue precludes the possibility of meeting the real-time requirements of PEMFC. In this paper, a PEMFC cathode gas supply model is firstly established. Next, we develop a safe deep learning-based offset-free MPC algorithm. Based on the nominal offset-free MPC, the proposed MPC not only reserves the ability of disturbance rejection, but also leverages deep neural networks for approximating the explicit solution to the MPC problem to greatly reduce online computational time. Furthermore, a gauge map is used to guarantee the satisfaction of safe constraints regarding compressor voltage. The simulation results show that the proposed MPC is an order of magnitude faster than the nominal offset-free MPC.
暂无评论