检索结果-内蒙古大学图书馆

International Conference on Computer Vision (ICCV)

作者： Weiyue Zhao Xin Li Zhan Peng Xianrui Luo Xinyi Ye Hao Lu Zhiguo Cao Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Department of Computer Science University of Albany Albany NY

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in video stabilization. Inspired by the analogy between wobbly frames and jigsaw puzzles, we propose an iterative optimization-based learning approach using synthetic datasets for video stabilization, which consists of two interacting submodules: motion trajectory smoothing and full-frame outpainting. First, we develop a two-level (coarse-to-fine) stabilizing algorithm based on the probabilistic flow field. The confidence map associated with the estimated optical flow is exploited to guide the search for shared regions through backpropagation. Second, we take a divide-and-conquer approach and propose a novel multi-frame fusion strategy to render full-frame stabilized views. An important new insight brought about by our iterative optimization approach is that the target video can be interpreted as the fixed point of nonlinear mapping for video stabilization. We formulate video stabilization as a problem of minimizing the amount of jerkiness in motion trajectories, which guarantees convergence with the help of fixed-point theory. Extensive experimental results are reported to demonstrate the superiority of the proposed approach in terms of computational speed and visual quality. The code will be available on GitHub.

关键词：

来源：评论

学校读者我要写书评

暂无评论

3D Cinemagraphy from a Single image

arXiv

引用

arXiv 2023年

作者： Li, Xingyi Cao, Zhiguo Sun, Huiqiang Zhang, Jianming Xian, Ke Lin, Guosheng Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Adobe Research S-Lab Nanyang Technological University Singapore

We present 3D Cinemagraphy, a new technique that marries 2D image animation with 3D photography. Given a single still image as input, our goal is to generate a video that contains both visual content animation and camera motion. We empirically find that naively combining existing 2D image animation and 3D photography methods leads to obvious artifacts or inconsistent animation. Our key insight is that representing and animating the scene in 3D space offers a natural solution to this task. To this end, we first convert the input image into feature-based layered depth images using predicted depth values, followed by unprojecting them to a feature point cloud. To animate the scene, we perform motion estimation and lift the 2D motion into the 3D scene flow. Finally, to resolve the problem of hole emergence as points move forward, we propose to bidirectionally displace the point cloud as per the scene flow and synthesize novel views by separately projecting them into target image planes and blending the results. Extensive experiments demonstrate the effectiveness of our method. A user study is also conducted to validate the compelling rendering results of our method. Copyright © 2023, The Authors. All rights reserved.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

Named Entity Recognition Based on Knowledge Fusion and Boundary Feature Sharing

Named Entity Recognition Based on Knowledge Fusion and Bound...

引用

Advanced Algorithms and control Engineering (ICAACE), International Conference on

作者： Anrui Li Housheng Su School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan P. R. China Key Laboratory of Image Processing and Intelligence Control of Ministry of Education Huazhong University of Science and Technology Wuhan P. R. China

ISBN: (数字)9798331535087

ISBN: (纸本)9798331535094

Named entity recognition is a core task in the field of information extraction, which aims to recognize a relevant entity from unstructured text and classify that entity. Aiming at the problem that existing nested named entity recognition models cannot achieve better compatibility in recognizing long entities and the performance of the models, this study proposes a nested named entity recognition model based on knowledge fusion and boundary feature sharing. First, a joint training network based on the concepts of lexicon and knowledge graph is constructed to improve the text feature representation to obtain richer contextual information; second, the bimodal attention mechanism is used to capture the semantic correlation between lexical items and generate the spanning semantic representation matrix; furthermore, the boundary feature sharing strategy is designed to improve the generalization ability of the model for the rough transition problem of entity spanning boundaries. To verify the effectiveness of the model, it is tested on three benchmark datasets, including ACE2004, ACE2005, and SciERC datasets. The experimental results show that the proposed model outperforms the corresponding baseline model in terms of entity recognition F1 index.

关键词： Training Knowledge engineering Attention mechanisms Text recognition Semantics Named entity recognition Knowledge graphs Lexicon Information retrieval Context modeling

来源：评论

学校读者我要写书评

暂无评论

Real-Time Maritime Obstacle Detection Based on YOLOv5 for Autonomous Berthing 16th

Real-Time Maritime Obstacle Detection Based on YOLOv5 for Au...

引用

16th International Conference on Bio-Inspired Computing: Theories and Applications, BIC-TA 2021

作者： Chen, Guotong Qi, Jiangtao Dai, Zeyu Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China China Ship Scientific Research Center No. 222 Shanshui East Road Binhu District Wuxi214082 China

ISBN: (纸本)9789811912528

The shipping industry is developing towards intelligence, in which autonomous berthing and docking systems play an important role. Real-time maritime obstacle detection is essential for autonomous berthing, which can protect ships from collisions. In the field of real-time objection detection, YOLOv5s is one of the most effective networks. To solve the real-time maritime obstacle detection for autonomous berthing, we propose an improved network, named YOLOv5s-CBAM, which employs the convolutional block attention module to boost the representation power of YOLOv5s. In addition, we propose another network, named YOLOv5-SE, in which a squeeze-and-excitation block is introduced to recalibrate the channel-wise features adaptively. The experimental results demonstrate that YOLOv5s-CBAM outperforms YOLOv5s in the detection of large obstacles. Both YOLOv5s-CBAM and YOLOv5s-SE achieve state-of-the-art performance in various metrics compared with previous related work for maritime obstacle detection. © 2022, Springer Nature Singapore Pte Ltd.

关键词： Ships

来源：评论

学校读者我要写书评

暂无评论

Hybrid Relation Guided Set Matching for Few-shot Action Recognition

arXiv

引用

arXiv 2022年

作者： Wang, Xiang Zhang, Shiwei Qing, Zhiwu Tang, Mingqian Zuo, Zhengrong Gao, Changxin Jin, Rong Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Alibaba Group China

Current few-shot action recognition methods reach impressive performance by learning discriminative features for each video via episodic training and designing various temporal alignment strategies. Nevertheless, they are limited in that (a) learning individual features without considering the entire task may lose the most relevant information in the current episode, and (b) these alignment strategies may fail in misaligned instances. To overcome the two limitations, we propose a novel Hybrid Relation guided Set Matching (HyRSM) approach that incorporates two key components: hybrid relation module and set matching metric. The purpose of the hybrid relation module is to learn task-specific embeddings by fully exploiting associated relations within and cross videos in an episode. Built upon the task-specific features, we reformulate distance measure between query and support videos as a set matching problem and further design a bidirectional Mean Hausdorff Metric to improve the resilience to misaligned instances. By this means, the proposed HyRSM can be highly informative and flexible to predict query categories under the few-shot settings. We evaluate HyRSM on six challenging benchmarks, and the experimental results show its superiority over the state-of-the-art methods by a convincing margin. Copyright © 2022, The Authors. All rights reserved.

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

Global Consensus for Heterogeneous Saturated Multi-Agent Systems via Sampled-Data control 63

Global Consensus for Heterogeneous Saturated Multi-Agent Sys...

引用

63rd IEEE Conference on Decision and control, CDC 2024

作者： Qian, Juan Wang, Xiaoling Astolfi, Daniele Su, Housheng Jiang, Guo-Ping Nanjing University of Posts and Telecommunications College of Automation and the College of Artificial Intelligence Nanjing210023 China Nanjing210023 China Université Claude Bernard Lyon 1 Cnrs Lagepp Umr 5007 43 boulevard du 11 novembre 1918 VilleurbanneF-69100 France East China University of Science and Technology Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education Shanghai200237 China Huazhong University of Science and Technology School of Artificial Intelligence and Automation Image Processing and Intelligent Control Key Laboratory of Education Ministry of China Luoyu Road 1037 Wuhan430074 China

ISBN: (纸本)9798350316339

This paper addresses the global consensus problem for multi-input multi-output saturated systems within a sampled-data framework, aiming to advance global consensus, manage heterogeneous actuator saturation across components, and preserve distributed characteristics by using sampled-data feedback. We propose a distributed control algorithm that incorporates a redesigned saturation function, represented as decentralized dynamic saturation levels. These levels for each agent's dimensions are autonomously updated through an adaptive strategy, which mitigates heterogeneous saturation by carefully selecting constant and time-varying saturation parameters in it. Lyapunov analysis proves that global consensus can be achieved under the proposed control law, provided the sampling periods of all agents remain below a calculated threshold. An example is given to demonstrate the effectiveness of this approach. © 2024 IEEE.

关键词： Decentralized control

来源：评论

学校读者我要写书评

暂无评论

UniAnimate: Taming Unified Video Diffusion Models for Consistent Human image Animation

arXiv

引用

arXiv 2024年

作者： Wang, Xiang Zhang, Shiwei Gao, Changxin Wang, Jiayu Zhou, Xiaoqiang Zhang, Yingya Yan, Luxin Sang, Nong Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Alibaba Group Hangzhou310052 China University of Science and Technology of China Hefei230026 China

Recent diffusion-based human image animation techniques have demonstrated impressive success in synthesizing videos that faithfully follow a given reference identity and a sequence of desired movement poses. Despite this, there are still two limitations: i) an extra reference model is required to align the identity image with the main video branch, which significantly increases the optimization burden and model parameters;ii) the generated video is usually short in time (e.g., 24 frames), hampering practical applications. To address these shortcomings, we present a UniAnimate framework to enable efficient and long-term human video generation. First, to reduce the optimization difficulty and ensure temporal coherence, we map the reference image along with the posture guidance and noise video into a common feature space by incorporating a unified video diffusion model. Second, we propose a unified noise input that supports random noised input as well as first frame conditioned input, which enhances the ability to generate long-term video. Finally, to further efficiently handle long sequences, we explore an alternative temporal modeling architecture based on state space model to replace the original computation-consuming temporal Transformer. Extensive experimental results indicate that UniAnimate achieves superior synthesis results over existing state-of-the-art counterparts in both quantitative and qualitative evaluations. Notably, UniAnimate can even generate highly consistent one-minute videos by iteratively employing the first frame conditioning strategy. Code and models will be publicly available. Project page: https://***/. Copyright © 2024, The Authors. All rights reserved.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

A Novel Brain-Inspired Hierarchical Perception-Association Circuit Based on Memristor Arrays

SSRN

引用

SSRN 2023年

作者： Chen, Liangyu Wang, Xiaoping Chen, Zhanfei Yang, Chao Zeng, Zhigang School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Education Ministry of China Wuhan430074 China Hubei Key Laboratory of Brain-inspired Intelligent Systems Wuhan430074 China

In the brain, primary sensory cells can efficiently perceive multimodal stimuli, and then associative memory cells perform an advanced bidirectional associative memory function with perceived information. Here, a brain-inspired hierarchical perception-association circuit based on memristor arrays is proposed. Firstly, a memristive reservoir computing circuit is designed to simulate a low-level perceptual function, which mainly comprises dynamic analog reservoirs, memristor arrays, and analog integrators, enabling efficient spatio-temporal information processing. Secondly, a spiking bidirectional associative memory memristive circuit, as the core of the whole circuit, is proposed to mimick a high-level associative function, which mainly consists of memristor arrays, current amplifiers, and leaky integrate-and-fire neuron circuits, implementing multimodal associative learning. The simulation results in LTspice show that the modified neuron circuit exhibits 66× improvement in energy efficiency, and the proposed circuit can precisely perform the letter association and vision-audio association tasks in a spiking fashion with an average firing energy consumption of 230 pJ/spike, which has a great potential to be embedded in mobile robotic platforms. © 2023, The Authors. All rights reserved.

关键词： Memristors

来源：评论

学校读者我要写书评

暂无评论

DAFormer: Depth-aware 3D Object Detection Guided by Camera Model via Transformers

DAFormer: Depth-aware 3D Object Detection Guided by Camera M...

引用

IEEE International Conference on Cyborg and Bionic Systems (CBS)

作者： Junbin Gao Hao Ruan Bingrong Xu Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China School of Automation Wuhan University of Technology Wuhan China

3D object detection plays a critical role in autonomous driving perception. Although multi-view-based perception solutions have made significant progress, their performance is still far from being ready for practical use. The estimation of pixel depth is dependent on camera intrinsic properties, which led us to explore a depth-aware model guided by camera parameters. Our contribution in this paper is the DAFormer, which incorporates camera parameters and position-aware image features to detect 3D objects. The depthaware module uses camera parameters to reweight image features and estimate depth, enhancing and offsetting the 3D position embedding. The object query uses depth information enhanced features for end-to-end 3D detection by Attention layers. DAFormer achieves impressive results on the standard nuScenes dataset without any additional embellishments.

关键词： Solid modeling Three-dimensional displays Estimation Object detection Detectors Cameras Feature extraction

来源：评论

学校读者我要写书评

暂无评论

Analysis of Government-Taxation Methods and Maritime Companies’ Strategies Under Emission-Reduction Incentives

SSRN

引用

SSRN 2023年

作者： Wang, Jian Wenbo, Zhu School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education Wuhan430074 China

The current emission-reduction trend in the shipping industry is inevitable. This study uses a multi-stage Stackelberg game to establish a low-carbon maritime supply chain model that includes a government, a carrier, and a port. The government can choose to impose carbon taxes only on the port or on both the port and carrier, while there are different power structures: port-led or carrier-led. Equilibrium solutions in different scenarios indicate that the leading port’s profit is not affected by the implementation of a carbon tax, while the carrier, surprisingly, hopes to join the carbon-tax policy. Both the government and the carrier prefer a bilateral carbon-tax scenario led by the carrier, while the port has the opposite preference. In the process of seeking coordination opportunities, we find that, driven by shippers’ low-carbon preferences, the maritime supply chain exhibits a "triple increasing" phenomenon, which means higher cargo volume, more emission reduction, and higher freight prices. The government and carrier can control the occurrence of this phenomenon and promote an all-win scenario through the use of carbon taxes and subsidies. We provide coordination strategies for unilateral carbon taxes in the maritime supply chain under different power structures and demonstrate the important role of the government in coordination. This provides a new direction for the implementation of carbon taxes in the maritime supply chain. © 2023, The Authors. All rights reserved.

关键词： Taxation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：