检索结果-内蒙古大学图书馆

Defocus to focus: photo-realistic bokeh rendering by fusing defocus and radiance priors

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Luo, Xianrui Peng, Juewen Xian, Ke Wu, Zijin Cao, Zhiguo Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China

We consider the problem of realistic bokeh rendering from a single all-in-focus image. Bokeh rendering mimics aesthetic shallow depth-of-field (DoF) in professional photography, but these visual effects generated by existing methods suffer from simple flat background blur and blurred in-focus regions, giving rise to unrealistic rendered results. In this work, we argue that realistic bokeh rendering should i) model depth relations and distinguish in-focus regions, ii) sustain sharp in-focus regions, and iii) render physically accurate Circle of Confusion (CoC). To this end, we present a Defocus to Focus (D2F) framework to learn realistic bokeh rendering by fusing defocus priors with the all-in-focus image and by implementing radiance priors in layered fusion. Since no depth map is provided, we introduce defocus hallucination to integrate depth by learning to focus. The predicted defocus map implies the blur amount of bokeh and is used to guide weighted layered rendering. In layered rendering, we fuse images blurred by different kernels based on the defocus map. To increase the reality of the bokeh, we adopt radiance virtualization to simulate scene radiance. The scene radiance used in weighted layered rendering reassigns weights in the soft disk kernel to produce the CoC. To ensure the sharpness of in-focus regions, we propose to fuse upsampled bokeh images and original images. We predict the initial fusion mask from our defocus map and refine the mask with a deep network. We evaluate our model on a large-scale bokeh dataset. Extensive experiments show that our approach is capable of rendering visually pleasing bokeh effects in complex scenes. In particular, our solution receives the runner-up award in the AIM 2020 Rendering Realistic Bokeh Challenge. © 2023, CC BY-NC-ND.

关键词： image fusion

Thermal Safety Analysis and Dynamic control Strategy for Mode Switching Process of Reversible Solid Oxide Cell System

学校读者我要写书评

暂无评论

Thermal Safety Analysis and Dynamic Control Strategy for Mod...

Chinese control Conference (CCC)

作者： Wei Zhao Guoqiang Liu Zexin Li Xi Li Key Laboratory of Image Processing and Intelligent Control of Education Ministry School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan Hubei China

Reversible solid oxide cells (rSOC) can operate in both electrolysis mode and in fuel cell mode with high efficiency and reduced cost using the same device for both functions. When used in dynamic operation with intermittent electrical power sources, rSOC system switches from the fuel cell (SOFC) to electrolyzer (SOEC) and vice versa depending on load and grid peculiarities. This can lead to temperature profiles within the stack that can potentially lead to the failure of the stack and eventually the system. In the present work, a system-level dynamic model of rSOC is established and validated against experimental data. Subsequently, detailed dynamic thermal behavior of stack during the switching between the two modes is analyzed, and a temperature management controller based on Model Predict control method (MPC) is proposed. Gas flow and temperature at the stack inlet are controlled by air flow and bypass valves, avoiding problems associated with temperature overshoot during transient operation. The simulation results show that the temperature controller has the ability to follow fast thermal changes while maintaining thermal safety, which indicates the competitiveness of the controller.

关键词：

Multiple Unmanned Surface Vehicle Coverage control in Dynamic Environments

学校读者我要写书评

暂无评论

Multiple Unmanned Surface Vehicle Coverage Control in Dynami...

Neuromorphic Computing (ICNC), International Conference on

作者： Hong Chen Dingxin He Huantao Mao Yong Yang Zhi-Wei Liu School of Artificial Intelligence and Automation Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan China

This paper investigates the area coverage problem for multiple Unmanned Surface Vehicles (USVs) in dynamic environments. Multiple USVs are employed to execute the coverage task using the Voronoi Partition method for task allocation. Parameter adaptive laws are employed to estimate the parameters of the sensing function and the Voronoi cell centroids for updating the target positions in dynamic environments. Additionally, considering the influence of water surface disturbances, a nonholonomic underactuated model analysis is conducted for the USV under non-full constraints, resulting in a motion strategy for USVs. This enables the multiple USVs to effectively cover the task area. Finally, simulation results are presented to validate the effectiveness of the coverage scheme designed in this paper and the ability of USVs to effectively cover dynamic environments.

关键词：

Low-Rank Optimal Transport for Robust Domain Adaptation

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2024年第7期11卷 1667-1680页

作者： Bingrong Xu Jianhua Yin Cheng Lian Yixin Su Zhigang Zeng IEEE the School of Automation Wuhan University of TechnologyWuhan 430070China Intelligent Transportation Systems Research Center Wuhan University of TechnologyWuhan 430063 Chongqing Research Institute Wuhan University of TechnologyChongqingChina the School of Artificial Intelligence and Automation Huazhong University of Science and TechnologyWuhan 430074 the Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan 430074China

When encountering the distribution shift between the source(training) and target(test) domains, domain adaptation attempts to adjust the classifiers to be capable of dealing with different domains. Previous domain adaptation research has achieved a lot of success both in theory and practice under the assumption that all the examples in the source domain are welllabeled and of high quality. However, the methods consistently lose robustness in noisy settings where data from the source domain have corrupted labels or features which is common in reality. Therefore, robust domain adaptation has been introduced to deal with such problems. In this paper, we attempt to solve two interrelated problems with robust domain adaptation:distribution shift across domains and sample noises of the source domain. To disentangle these challenges, an optimal transport approach with low-rank constraints is applied to guide the domain adaptation model training process to avoid noisy information influence. For the domain shift problem, the optimal transport mechanism can learn the joint data representations between the source and target domains using a measurement of discrepancy and preserve the discriminative information. The rank constraint on the transport matrix can help recover the corrupted subspace structures and eliminate the noise to some extent when dealing with corrupted source data. The solution to this relaxed and regularized optimal transport framework is a convex optimization problem that can be solved using the Augmented Lagrange Multiplier method, whose convergence can be mathematically proved. The effectiveness of the proposed method is evaluated through extensive experiments on both synthetic and real-world datasets.

关键词： Domain adaptation low-rank constraint noise corruption optimal transport

When Epipolar Constraint Meets Non-local Operators in Multi-View Stereo

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liu, Tianqi Ye, Xinyi Zhao, Weiyue Pan, Zhiyu Shi, Min Cao, Zhiguo Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China

Learning-based multi-view stereo (MVS) method heavily relies on feature matching, which requires distinctive and descriptive representations. An effective solution is to apply non-local feature aggregation, e.g., Transformer. Albeit useful, these techniques introduce heavy computation overheads for MVS. Each pixel densely attends to the whole image. In contrast, we propose to constrain non-local feature augmentation within a pair of lines: each point only attends the corresponding pair of epipolar lines. Our idea takes inspiration from the classic epipolar geometry, which shows that one point with different depth hypotheses will be projected to the epipolar line on the other view. This constraint reduces the 2D search space into the epipolar line in stereo matching. Similarly, this suggests that the matching of MVS is to distinguish a series of points lying on the same line. Inspired by this point-to-line search, we devise a line-to-point non-local augmentation strategy. We first devise an optimized searching algorithm to split the 2D feature maps into epipolar line pairs. Then, an Epipolar Transformer (ET) performs non-local feature augmentation among epipolar line pairs. We incorporate the ET into a learning-based MVS baseline, named ET-MVSNet. ET-MVSNet achieves state-of-the-art reconstruction performance on both the DTU and Tanks-and-Temples benchmark with high efficiency. Code is available at https://***/TQTQliu/ET-MVSNet. Copyright © 2023, The Authors. All rights reserved.

关键词： Benchmarking

ProtDAT: A Unified Framework for Protein Sequence Design from Any Protein Text Description

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Guo, Xiao-Yu Li, Yi-Fan Liu, Yuan Pan, Xiaoyong Shen, Hong-Bin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China

Protein design has become a critical method in advancing significant potential for various applications such as drug development and enzyme engineering. However, protein design methods utilizing large language models with solely pretraining and fine-tuning struggle to capture relationships in multi-modal protein data. To address this, we propose ProtDAT, a de novo fine-grained framework capable of designing proteins from any descriptive protein text input. ProtDAT builds upon the inherent characteristics of protein data to unify sequences and text as a cohesive whole rather than separate entities. It leverages an innovative multi-modal cross-attention, integrating protein sequences and textual information for a foundational level and seamless integration. Experimental results demonstrate that ProtDAT achieves the state-of-the-art performance in protein sequence generation, excelling in rationality, functionality, structural similarity, and validity. On 20,000 text-sequence pairs from Swiss-Prot, it improves pLDDT by 6%, TM-score by 0.26, and reduces RMSD by 1.2 Å, highlighting its potential to advance protein design. © 2024, CC BY-NC-SA.

关键词：

Differentiator-Based Adaptive H8 Tracking control of Fully Actuated Systems 3

学校读者我要写书评

暂无评论

Differentiator-Based Adaptive H8 Tracking Control of Fully A...

3rd Conference on Fully Actuated System Theory and Applications, FASTA 2024

作者： Feng, Yuxin Li, Zhiqiang Liu, Yang He, Zhaoshui Li, Hongyi Guangdong University of Technology School of Automation Guangdong Provincial Key Laboratory of Intelligent Decision and Cooperative Control Guangzhou510006 China Qingdao University of Science and Technology School of Automation and Electronics Engineering Qingdao266061 China Guangdong University of Technology School of Automation Guangzhou510006 China Key Laboratory for IoT Intelligent Information Processing and System Integration of Ministry of Education Guangzhou510006 China

ISBN: (纸本)9798350373691

This article addresses an adaptive tracking control problem for uncertain high-order fully actuated (HOFA) systems with unknown parameters and disturbances. Under the framework of backstepping, the unknown parameter is estimated and the external disturbance is handled by using adaptive control and H8 technique, respectively. Moreover, the Levant differentiator is employed to reduce the computation burden. Additionally, the boundedness of signals in the closed-loop system is proven using the Lyapunov theory. Finally, the effectiveness of the proposed scheme is validated through the simulation study. © 2024 IEEE.

关键词： Backstepping

FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Yirui Wei, Pengjin Liu, Zhenhuan Wang, Bingchao Yang, Jie Liu, Wei Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University China Key Laboratory of System Control and Information Processing Ministry of Education China

Producing traversability maps and understanding the surroundings are crucial prerequisites for autonomous navigation. In this paper, we address the problem of traversability assessment using point clouds. We propose a novel pillar feature extraction module that utilizes PointNet to capture features from point clouds organized in vertical volume and a 2D encoder-decoder structure to conduct traversability classification instead of the widely used 3D convolutions. This results in less computational cost while even better performance is achieved at the same time. We then propose a new spatio-temporal attention module to fuse multi-frame information, which can properly handle the varying density problem of LIDAR point clouds, and this makes our module able to assess distant areas more accurately. Comprehensive experimental results on augmented Semantic KITTI and RELLIS-3D datasets show that our method is able to achieve superior performance over existing approaches both quantitatively and quantitatively. Our code is publicly available at https://***/chenyirui/FASTC. © 2024, CC BY.

关键词： Semantics

GPC-LIO-SAM:Lidar inertial odometry and mapping method for mobile robot with ground plane constraint

学校读者我要写书评

暂无评论

GPC-LIO-SAM:Lidar inertial odometry and mapping method for m...

第43届中国控制会议

作者： Chong Cao Gang Peng Dingxin He Yihao Cao Yue Xu Zhang Deng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Key Laboratory of Image Information Processing and Intelligent Control Ministry of Education Engineering Research Center of Autonomous Intelligent Unmanned Systems Ministry of Education Wuhan Lisai Technology Co. Ltd.

ISBN: (数字)9789887581581

ISBN: (纸本)9798350366907

Due to the limitation of the vertical angle resolution of the lidar sensor,the observation information in the vertical direction is reduced,resulting in the elevation cumulative drift phenomenon of many lidar SLAM algorithms in large-scale environment,which reduces the accuracy of pose estimation and the quality of *** order to solve this problem,based on LIO-SAM,this paper proposes a lidar SLAM algorithm with ground plane *** method can effectively extract the ground point cloud and obtain the plane normal vector,and construct the constraint relationship with the prior plane normal *** optimal state estimation is solved by nonlinear optimization method,which effectively reduces the elevation drift caused by the long-term operation of the system in large-scale *** paper compares the improved algorithm with A-LOAM,LeGO-LOAM and original LIO-SAM algorithms in challenging datasets such as KITTI,M2 DGR and *** results show that this method effectively improves the accuracy of pose estimation and the quality of mapping,and limit the elevation drift of mobile robot in ground operation,which has high application value.

关键词： Ground plane constraint elevation drift LIDAR simultaneous localization and mapping(SLAM)