检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Li, Xingyi Cao, Zhiguo Sun, Huiqiang Zhang, Jianming Xian, Ke Lin, Guosheng Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Adobe Research S-Lab Nanyang Technological University Singapore

We present 3D Cinemagraphy, a new technique that marries 2D image animation with 3D photography. Given a single still image as input, our goal is to generate a video that contains both visual content animation and camera motion. We empirically find that naively combining existing 2D image animation and 3D photography methods leads to obvious artifacts or inconsistent animation. Our key insight is that representing and animating the scene in 3D space offers a natural solution to this task. To this end, we first convert the input image into feature-based layered depth images using predicted depth values, followed by unprojecting them to a feature point cloud. To animate the scene, we perform motion estimation and lift the 2D motion into the 3D scene flow. Finally, to resolve the problem of hole emergence as points move forward, we propose to bidirectionally displace the point cloud as per the scene flow and synthesize novel views by separately projecting them into target image planes and blending the results. Extensive experiments demonstrate the effectiveness of our method. A user study is also conducted to validate the compelling rendering results of our method. Copyright © 2023, The Authors. All rights reserved.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

A Real-time Local Planner Design for Smart Wheelchairs Based on Koopman Bilinear Model Predictive control

A Real-time Local Planner Design for Smart Wheelchairs Based...

引用

IEEE International Conference on Real-time Computing and Robotics (RCAR)

作者： Guanfeng Yu Han Zhang Zehao Wang Jingchuan Wang Department of Automation Institute of Medical Robotics Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China

ISBN: (数字)9798350372601

ISBN: (纸本)9798350372618

The paper introduces a Koopman bilinear model predictive control (KBMPC) as a local planner for smart wheelchair systems. This approach leverages the Koopman Operator to streamline the nonlinear terms in MPC, aiming to achieve superior real-time performance. In particular, we employ the Extended Dynamic Mode Decomposition (EDMD) method to approximate the infinite dimensional Koopman operator. To tackle the challenge of designing lifting functions, we systematically utilize the derivatives of known nonlinear structures to methodically derive lifting functions. This systematic approach facilitates the identification of a precise bilinear model. Next, we formulate the corresponding Koopman bilinear MPC problem. Finally, an iterative algorithm is employed to efficiently solve the KBMPC problem. This method linearizes the bilinear model around estimations and iteratively solves the resulting quadratic programming problem to refine estimations. This allows KBMPC to function as a real-time local planner for smart wheelchairs. The prediction of nonlinear terms shows that the identified Koopman bilinear model increases the prediction accuracy. Furthermore, experiments demonstrate the advantages of the designed KBMPC local planner, highlighting its superior real-time performance and predictive capabilities.

关键词： Pedestrians Accuracy Systematics Wheelchairs Estimation Predictive models Real-time systems

来源：评论

学校读者我要写书评

暂无评论

K-BMPC: Derivative-based Koopman Bilinear Model Predictive control For Tractor-trailer Trajectory Tracking With Unknown Parameters

K-BMPC: Derivative-based Koopman Bilinear Model Predictive C...

引用

IEEE International Conference on Robotics and Automation (ICRA)

作者： Zehao Wang Han Zhang Jingchuan Wang Department of Automation Institute of Medical Robotics Shanghai Jiao Tong University and Key Laboratory of System Control and Information Processing Ministry of Education of China and Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

Nonlinear dynamics bring difficulties to controller design for control-affine systems such as tractor-trailer vehicles, especially when the parameters in the dynamics are unknown. To address this constraint, we propose a derivative-based lifting function construction method, show that the corresponding infinite dimensional Koopman bilinear model over the lifting function is equivalent to the original control-affine system. Further, we analyze the propagation and bounds of state prediction errors caused by the truncation in derivative order. The identified finite dimensional Koopman bilinear model would serve as predictive model in the next step. Koopman Bilinear Model Predictive control (K-BMPC) is proposed to solve the trajectory tracking problem. We linearize the bilinear model around the estimation of the lifted state and control input. Then the bilinear Model Predictive control problem is approximated by a quadratic programming problem. Further, the estimation is updated at each iteration until the convergence is reached. Moreover, we implement our algorithm on a tractor-trailer system, taking into account the longitudinal and side slip effects. The open-loop simulation shows the proposed Koopman bilinear model captures the dynamics with unknown parameters and has good prediction performance. Closed-loop tracking results show the proposed K-BMPC exhibits elevated tracking precision with the commendable computational efficiency. The experimental results demonstrate the feasibility of K-BMPC.

关键词： Trajectory tracking Computational modeling Estimation Predictive models control systems Data models Nonlinear dynamical systems

来源：评论

学校读者我要写书评

暂无评论

Constraining Depth Map Geometry for Multi-View Stereo: A Dual-Depth Approach with Saddle-shaped Depth Cells

Constraining Depth Map Geometry for Multi-View Stereo: A Dua...

引用

International Conference on Computer Vision (ICCV)

作者： Xinyi Ye Weiyue Zhao Tianqi Liu Zihao Huang Zhiguo Cao Xin Li Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Department of Computer Science University of Albany Albany NY

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth geometry is also critical in MVS. In this paper, we demonstrate that different depth geometries have significant performance gaps, even using the same depth prediction error. Therefore, we introduce an ideal depth geometry composed of Saddle-Shaped Cells, whose predicted depth map oscillates upward and downward around the ground-truth surface, rather than maintaining a continuous and smooth depth plane. To achieve it, we develop a coarse-to-fine framework called Dual-MVSNet (DMVSNet), which can produce an oscillating depth plane. Technically, we predict two depth values for each pixel (Dual-Depth), and propose a novel loss function and a checkerboard-shaped selecting strategy to constrain the predicted depth geometry. Compared to existing methods, DMVSNet achieves a high rank on the DTU benchmark and obtains the top performance on challenging scenes of Tanks and Temples, demonstrating its strong performance and generalization ability. Our method also points to a new research direction for considering depth geometry in MVS.

关键词：

来源：评论

学校读者我要写书评

暂无评论

GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network

GNet: 3D Object Detection from Point Cloud with Geometry-Awa...

引用

IEEE International Conference on Cyborg and Bionic Systems (CBS)

作者： Hao Ruan Bingrong Xu Junbin Gao Lianguang Liu Junting Lv Yin Sheng Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China School of Automation Wuhan University of Technology Wuhan China

3D object detection based on point clouds in real-world applications has been a challenging task because the raw point cloud may be sparse or occluded. It may be caused by bad weather or limited sensor resolution, leading to decreasing detection performance. To this end, a novel highperformance Geometry-aware Network (GNet) is proposed and used to accurately detect 3D objects from sparse point clouds. Different from previous work that only regresses the offset of 3D bounding boxes numerically between ground truth (GT) and prediction, GNet considers the geometric information of 3D bounding boxes and combines the two effectively to achieve a better regression performance. In particular, Point Nets blocks learned voxel-wise features and the proposals are generated by the 3D voxel convolution neural network (voxel CNN). By utilizing the prior knowledge and the geometric properties of the 3D bounding boxes, the proposed novel OS-loss can improve detection performance and accelerate speed of inference. Furthermore, GNet takes advantage of prior geometry properties rather than only regressing the offset numerically. These speed up the convergence of the regression network. Finally, our proposed GNet was evaluated on the KITTI dataset for 3D objects and Bird’s Eye View (BEV) detection aspects. The results demonstrate that GNet can improve object detection performance for sparse point clouds.

关键词： Point cloud compression Location awareness Geometry Three-dimensional displays Neural networks Object detection Proposals

来源：评论

学校读者我要写书评

暂无评论

Fast Full-frame Video Stabilization with Iterative Optimization

Fast Full-frame Video Stabilization with Iterative Optimizat...

引用

International Conference on Computer Vision (ICCV)

作者： Weiyue Zhao Xin Li Zhan Peng Xianrui Luo Xinyi Ye Hao Lu Zhiguo Cao Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Department of Computer Science University of Albany Albany NY

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in video stabilization. Inspired by the analogy between wobbly frames and jigsaw puzzles, we propose an iterative optimization-based learning approach using synthetic datasets for video stabilization, which consists of two interacting submodules: motion trajectory smoothing and full-frame outpainting. First, we develop a two-level (coarse-to-fine) stabilizing algorithm based on the probabilistic flow field. The confidence map associated with the estimated optical flow is exploited to guide the search for shared regions through backpropagation. Second, we take a divide-and-conquer approach and propose a novel multi-frame fusion strategy to render full-frame stabilized views. An important new insight brought about by our iterative optimization approach is that the target video can be interpreted as the fixed point of nonlinear mapping for video stabilization. We formulate video stabilization as a problem of minimizing the amount of jerkiness in motion trajectories, which guarantees convergence with the help of fixed-point theory. Extensive experimental results are reported to demonstrate the superiority of the proposed approach in terms of computational speed and visual quality. The code will be available on GitHub.

关键词：

来源：评论

学校读者我要写书评

暂无评论

CDP-GAN:Near-Infrared and Visible image Fusion Via Color Distribution Preserved GAN

引用

IEEE/CAA Journal of Automatica Sinica 2022年第9期9卷 1698-1701页

作者： Jun Chen Kangle Wu Yang Yu Linbo Luo the School of Automation Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex SystemsEngineering Research Center of Intelligent Technology for Geo-ExplorationMinistry of EducationChina University of GeosciencesWuhan 430074China the Shanghai Institute of Technical Physics Key Laboratory of Infrared System Detecting and Imaging TechnologyChinese Academy of SciencesShanghai 200083China the School of Mechanical Engineering and Electronic Information China University of GeosciencesWuhan 430074China

Dear Editor,This letter is concerned with dealing with the great discrepancy between near-infrared(NIR)and visible(VS)image fusion via color distribution preserved generative adversarial network(CDP-GAN).Different from the global discriminator in prior GAN,conflict of preserving NIR details and VS color is resolved by introducing an attention guidance mechanism into the ***。

关键词： details dealing preserving

来源：评论

学校读者我要写书评

暂无评论

Sparse Andrew's Sine Norm Promoting Adaptive Algorithm under Non-Gaussian Noises 5

Sparse Andrew's Sine Norm Promoting Adaptive Algorithm under...

引用

5th IEEE International Conference on Electronic Information and Communication Technology, ICEICT 2022

作者： Hadi, Abdul Huang, Xinqi Ali, Burhan Li, Yingsong College of Information and Communications Engineering Harbin Engineering University Harbin150001 China College of Intelligent System and Control Science Engineering Harbin Engineering University Harbin150001 China Anhui University Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Anhui Hefei China

ISBN: (数字)9781665472111

ISBN: (纸本)9781665472111

Two sparse adaptive filtering (AF) algorithms based on Andrew's sine estimator (ASE) are presented to achieve improved performance for identifying sparse systems, where the ASE is derived within the least-square framework. Furthermore, zero-attracting (ZA) scheme is used in ASE to construct ZA-ASE and its re-weighting form (RZA-ASE) to combat non-Gaussian noises and use the sparse characteristics of the system. Their performance is investigated via simulations and compared with the least-mean square (LMS) and the maximum correntropy criterion (MCC) algorithms to show their superior performance. © 2022 IEEE.

关键词： Adaptive filtering

来源：评论

学校读者我要写书评

暂无评论

Large Language Models are Few-shot Generators: Proposing Hybrid Prompt Algorithm To Generate Webshell Escape Samples

arXiv

引用

arXiv 2024年

作者： Ma, Mingrui Han, Lansheng Zhou, Chunjie School of Cyber Science and Engineering Huazhong University of Science and Technology Hubei Wuhan430074 China The Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Hubei Wuhan430074 China

The frequent occurrence of cyber-attacks has made webshell attacks and defense gradually become a research hotspot in the field of network security. However, the lack of publicly available benchmark datasets and the over-reliance on manually defined rules for webshell escape sample generation have slowed down the progress of research related to webshell escape sample generation and artificial intelligence (AI)-based webshell detection. To address the drawbacks of weak webshell sample escape capabilities, the lack of webshell datasets with complex malicious features, and to promote the development of webshell detection, we propose the Hybrid Prompt algorithm for webshell escape sample generation with the help of large language models. As a prompt algorithm specifically developed for webshell sample generation, the Hybrid Prompt algorithm not only combines various prompt ideas including Chain of Thought, Tree of Thought, but also incorporates various components such as webshell hierarchical module and few-shot example to facilitate the LLM in learning and reasoning webshell escape strategies. Experimental results show that the Hybrid Prompt algorithm can work with multiple LLMs with excellent code reasoning ability to generate high-quality webshell samples with high Escape Rate (88.61% with GPT-4 model on VirusTotal detection engine) and Survival Rate (54.98% with GPT-4 model). Copyright © 2024, The Authors. All rights reserved.

关键词： Network security

来源：评论

学校读者我要写书评

暂无评论

Streaming-Data-Driven Distributionally Robust Joint Operation of Multi-Microgrids and Off-Site Hydrogen Refueling Stations under Uncertainties 11

Streaming-Data-Driven Distributionally Robust Joint Operatio...

引用

11th International Conference on Innovative Smart Grid Technologies - Asia, ISGT-Asia 2022

作者： Li, Longyan Ning, Chao Qiu, Haifeng Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai Engineering Research Center of Intelligent Control and Management Department of Automation Shanghai China School of Electrical & Electronic Engineering Nanyang Technological University Singapore Singapore

ISBN: (纸本)9798350399660

This paper proposes a novel online-learning-enabled hierarchical distributionally robust energy management framework for multi-microgrids (MMGs) with off-site hydrogen refueling stations (HRSs). The proposed framework integrates day-ahead scheduling, intra-day rescheduling and real-time control. The day-ahead scheduling is implemented via a central energy management system for optimal joint scheduling of the MMG systems and off-site HRSs, then the intra-day rescheduling is carried out to optimize the real-time operation and to generate the reference for local controllers. To adequately characterize the statistical properties of renewable and load uncertainties from data streams, we leverage a Dirichlet process mixture model to construct an online-update ambiguity set, which encodes multimodality and local moment information. Based upon this ambiguity set, an online-learning distributionally robust model predictive control (OL-DRMPC) is developed to enhance the tracking performance of energy storage references and to reduce conservatism while guaranteeing probabilistic operational constraints. Its effectiveness is verified in a case study. © 2022 IEEE.

关键词： Real time control

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：