检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Li, Xingyi Cao, Zhiguo Sun, Huiqiang Zhang, Jianming Xian, Ke Lin, Guosheng Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Adobe Research S-Lab Nanyang Technological University Singapore

We present 3D Cinemagraphy, a new technique that marries 2D image animation with 3D photography. Given a single still image as input, our goal is to generate a video that contains both visual content animation and camera motion. We empirically find that naively combining existing 2D image animation and 3D photography methods leads to obvious artifacts or inconsistent animation. Our key insight is that representing and animating the scene in 3D space offers a natural solution to this task. To this end, we first convert the input image into feature-based layered depth images using predicted depth values, followed by unprojecting them to a feature point cloud. To animate the scene, we perform motion estimation and lift the 2D motion into the 3D scene flow. Finally, to resolve the problem of hole emergence as points move forward, we propose to bidirectionally displace the point cloud as per the scene flow and synthesize novel views by separately projecting them into target image planes and blending the results. Extensive experiments demonstrate the effectiveness of our method. A user study is also conducted to validate the compelling rendering results of our method. Copyright © 2023, The Authors. All rights reserved.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

Constraining Depth Map Geometry for Multi-View Stereo: A Dual-Depth Approach with Saddle-shaped Depth Cells

Constraining Depth Map Geometry for Multi-View Stereo: A Dua...

引用

International Conference on Computer Vision (ICCV)

作者： Xinyi Ye Weiyue Zhao Tianqi Liu Zihao Huang Zhiguo Cao Xin Li Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Department of Computer Science University of Albany Albany NY

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth geometry is also critical in MVS. In this paper, we demonstrate that different depth geometries have significant performance gaps, even using the same depth prediction error. Therefore, we introduce an ideal depth geometry composed of Saddle-Shaped Cells, whose predicted depth map oscillates upward and downward around the ground-truth surface, rather than maintaining a continuous and smooth depth plane. To achieve it, we develop a coarse-to-fine framework called Dual-MVSNet (DMVSNet), which can produce an oscillating depth plane. Technically, we predict two depth values for each pixel (Dual-Depth), and propose a novel loss function and a checkerboard-shaped selecting strategy to constrain the predicted depth geometry. Compared to existing methods, DMVSNet achieves a high rank on the DTU benchmark and obtains the top performance on challenging scenes of Tanks and Temples, demonstrating its strong performance and generalization ability. Our method also points to a new research direction for considering depth geometry in MVS.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Multi-scale convolutional neural networks for brain disease diagnosis

Multi-scale convolutional neural networks for brain disease ...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Zhongyi Hu Libin Gao Yinsheng Tong Xingjin Lu Rui Li Lei Xiao Zuoyong Li College of Computer Science and Aritificial Intelligence Wenzhou University Wenzhou China Key Laboratory of Intelligent Image Processing and Analysis Wenzhou China College of Computer and Control Engineering Minjiang University Fuzhou China

The brain is the most sophisticated and complex organ in the human body. Nowadays, diagnosing complex and diverse brain diseases is a hot topic. Alzheimer's Disease (AD), Autism Spectrum Disorder (ASD), and others are common brain diseases. With the increased usage of Artificial Intelligence (AI) in medical image analysis, the endeavor to make AI comprehend brain images for assisting doctors in making objective diagnoses of brain diseases has gained considerable attention. Resting-state functional magnetic resonance imaging (rs-fMRI) is a widely used tool for diagnosing and analyzing brain ***, the Pearson correlation coefficient (PCC) method constructs a dynamic functional connectivity (dFC) network using a fixed window size. However, this method has limitations as it is challenging to extract potential high-level features from the dFC and determine local feature relevance. This paper presents a method for constructing dFC based on multi-scale sliding windows and proposes Multi-scale Convolutional Neural Networks (MsCNN) for learning and analyzing dFC at various scales. Finally, a deep fusion of features learned at different scales is employed for the diagnostic classification of brain *** to the rs-fMRI dataset from ADNI, the classification accuracy was 84.0% for eMCI/lMCI, 84.4% for lMCI/AD, and 58.4% for NC/eMCI/lMCI/AD. Applied to rs-fMRI data from ABIDE, the accuracy was 74.7% for ASD/NC. The proposed method exhibits robust classification performance and introduces a new approach to diagnosing other brain diseases.

关键词：

来源：评论

学校读者我要写书评

暂无评论

New Insights on the Stability of Sampled-Data-Based LFC for Power Systems: A Delay-Interval-Dependent LKF Approach

引用

IEEE Transactions on Smart Grid 2025年

作者： Wang, Wei-Min Wang, Yan-Wu Wan, Qian Zeng, Hong-Bing Huazhong University of Science and Technology Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Wuhan430074 China Hunan University of Technology School of Electrical and Information Engineering Zhuzhou412007 China

This paper analyzes the stability problem of load frequency control (LFC) for power systems under uncertain transmission delays. First, an argumented LFC system model accounting for uncertainties in transmission delays is proposed. Then, a novel delay-interval-dependent Lyapunov-Krasovskii functional (LKF) that takes into account both the upper and lower bounds of the transmission delay is proposed. Several less conservative stability criteria are derived using the proposed LKF. Based on the stability criterion obtained, the sampling interval and the upper and lower bounds of the transmission delay are taken as the conditions to guide the controller design. Finally, case studies are conducted based on a one-area power system and a three-area power system, both integrated with wind and solar power generation. The simulation comparison results demonstrate that the proposed LFC scheme exhibits strong robustness against uncertain transmission delays, load fluctuations, and the intermittent generation of wind and solar power. © 2010-2012 IEEE.

关键词： Stability criteria

来源：评论

学校读者我要写书评

暂无评论

Fast Full-frame Video Stabilization with Iterative Optimization

Fast Full-frame Video Stabilization with Iterative Optimizat...

引用

International Conference on Computer Vision (ICCV)

作者： Weiyue Zhao Xin Li Zhan Peng Xianrui Luo Xinyi Ye Hao Lu Zhiguo Cao Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Department of Computer Science University of Albany Albany NY

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in video stabilization. Inspired by the analogy between wobbly frames and jigsaw puzzles, we propose an iterative optimization-based learning approach using synthetic datasets for video stabilization, which consists of two interacting submodules: motion trajectory smoothing and full-frame outpainting. First, we develop a two-level (coarse-to-fine) stabilizing algorithm based on the probabilistic flow field. The confidence map associated with the estimated optical flow is exploited to guide the search for shared regions through backpropagation. Second, we take a divide-and-conquer approach and propose a novel multi-frame fusion strategy to render full-frame stabilized views. An important new insight brought about by our iterative optimization approach is that the target video can be interpreted as the fixed point of nonlinear mapping for video stabilization. We formulate video stabilization as a problem of minimizing the amount of jerkiness in motion trajectories, which guarantees convergence with the help of fixed-point theory. Extensive experimental results are reported to demonstrate the superiority of the proposed approach in terms of computational speed and visual quality. The code will be available on GitHub.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Real-Time Maritime Obstacle Detection Based on YOLOv5 for Autonomous Berthing 16th

Real-Time Maritime Obstacle Detection Based on YOLOv5 for Au...

引用

16th International Conference on Bio-Inspired Computing: Theories and Applications, BIC-TA 2021

作者： Chen, Guotong Qi, Jiangtao Dai, Zeyu Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China China Ship Scientific Research Center No. 222 Shanshui East Road Binhu District Wuxi214082 China

ISBN: (纸本)9789811912528

The shipping industry is developing towards intelligence, in which autonomous berthing and docking systems play an important role. Real-time maritime obstacle detection is essential for autonomous berthing, which can protect ships from collisions. In the field of real-time objection detection, YOLOv5s is one of the most effective networks. To solve the real-time maritime obstacle detection for autonomous berthing, we propose an improved network, named YOLOv5s-CBAM, which employs the convolutional block attention module to boost the representation power of YOLOv5s. In addition, we propose another network, named YOLOv5-SE, in which a squeeze-and-excitation block is introduced to recalibrate the channel-wise features adaptively. The experimental results demonstrate that YOLOv5s-CBAM outperforms YOLOv5s in the detection of large obstacles. Both YOLOv5s-CBAM and YOLOv5s-SE achieve state-of-the-art performance in various metrics compared with previous related work for maritime obstacle detection. © 2022, Springer Nature Singapore Pte Ltd.

关键词： Ships

来源：评论

学校读者我要写书评

暂无评论

Spiking Neural Network for Intra-cortical Brain Signal Decoding

arXiv

引用

arXiv 2025年

作者： Yang, Song Fu, Haotian Zhang, Herui Zhang, Peng Li, Wei Wu, Dongrui Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Hubei Key Laboratory of Brain-inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China Department of Biomedical Engineering College of Life Science and Technology Huazhong University of Science and Technology Wuhan430074 China

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based approaches have high computational cost. To improve both the decoding accuracy and efficiency, this paper proposes a spiking neural network (SNN) for effective and energy-efficient intra-cortical brain signal decoding. We also propose a feature fusion approach, which integrates the manually extracted neural activity vector features with those extracted by a deep neural network, to further improve the decoding accuracy. Experiments in decoding motor-related intra-cortical brain signals of two rhesus macaques demonstrated that our SNN model achieved higher accuracy than traditional artificial neural networks;more importantly, it was tens or hundreds of times more efficient. The SNN model is very suitable for high precision and low power applications like intracortical brain-computer interfaces. © 2025, CC BY.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Hybrid Relation Guided Set Matching for Few-shot Action Recognition

arXiv

引用

arXiv 2022年

作者： Wang, Xiang Zhang, Shiwei Qing, Zhiwu Tang, Mingqian Zuo, Zhengrong Gao, Changxin Jin, Rong Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Alibaba Group China

Current few-shot action recognition methods reach impressive performance by learning discriminative features for each video via episodic training and designing various temporal alignment strategies. Nevertheless, they are limited in that (a) learning individual features without considering the entire task may lose the most relevant information in the current episode, and (b) these alignment strategies may fail in misaligned instances. To overcome the two limitations, we propose a novel Hybrid Relation guided Set Matching (HyRSM) approach that incorporates two key components: hybrid relation module and set matching metric. The purpose of the hybrid relation module is to learn task-specific embeddings by fully exploiting associated relations within and cross videos in an episode. Built upon the task-specific features, we reformulate distance measure between query and support videos as a set matching problem and further design a bidirectional Mean Hausdorff Metric to improve the resilience to misaligned instances. By this means, the proposed HyRSM can be highly informative and flexible to predict query categories under the few-shot settings. We evaluate HyRSM on six challenging benchmarks, and the experimental results show its superiority over the state-of-the-art methods by a convincing margin. Copyright © 2022, The Authors. All rights reserved.

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

An Assist-as-Needed Variable Admittance controller for Adaptive Support of Mobile Walking Assistive Robots

An Assist-as-Needed Variable Admittance Controller for Adapt...

引用

International Conference on Mechatronics and Machine Vision in Practice (M2VIP)

作者： Xinxing Chen Yue Zheng Zongming Su Yuquan Leng Jian Huang Chenglong Fu Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities Southern University of Science and Technology Shenzhen China Technology Planning Department Huawei Technologies Shenzhen China Key Laboratory for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China

ISBN: (数字)9798350391916

ISBN: (纸本)9798350391923

Mobile walking assistive robots have been widely used for monitoring patients’ gait patterns and providing support to prevent falls. Traditional approaches often separate the operational modes of these robots into human-following and supporting modes, which can lead to discontinuities in assistance and potentially compromise safety. This paper proposes a novel assist-as-needed control strategy that incorporates a Balance Index (BI) to dynamically adjust the robot’s support based on the user’s balance capability. The BI is calculated using the interaction force between the user and the robot along the z-axis and the gait symmetry index (GSI). The proposed variable admittance controller modifies its parameters based on the BI, ensuring seamless transitions between compliance and support modes. Experimental validation was conducted with a healthy subject walking both with and without a knee fixation brace. The results demonstrate that the robot provides minimal interference during natural gait and increased support during impaired gait, validating the effectiveness of the proposed control strategy in enhancing user safety and promoting natural walking patterns.

关键词： Legged locomotion Force Stability criteria Interference Assistive robots User experience Safety Admittance Indexes Robots

来源：评论

学校读者我要写书评

暂无评论

UniAnimate: Taming Unified Video Diffusion Models for Consistent Human image Animation

arXiv

引用

arXiv 2024年

作者： Wang, Xiang Zhang, Shiwei Gao, Changxin Wang, Jiayu Zhou, Xiaoqiang Zhang, Yingya Yan, Luxin Sang, Nong Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Alibaba Group Hangzhou310052 China University of Science and Technology of China Hefei230026 China

Recent diffusion-based human image animation techniques have demonstrated impressive success in synthesizing videos that faithfully follow a given reference identity and a sequence of desired movement poses. Despite this, there are still two limitations: i) an extra reference model is required to align the identity image with the main video branch, which significantly increases the optimization burden and model parameters;ii) the generated video is usually short in time (e.g., 24 frames), hampering practical applications. To address these shortcomings, we present a UniAnimate framework to enable efficient and long-term human video generation. First, to reduce the optimization difficulty and ensure temporal coherence, we map the reference image along with the posture guidance and noise video into a common feature space by incorporating a unified video diffusion model. Second, we propose a unified noise input that supports random noised input as well as first frame conditioned input, which enhances the ability to generate long-term video. Finally, to further efficiently handle long sequences, we explore an alternative temporal modeling architecture based on state space model to replace the original computation-consuming temporal Transformer. Extensive experimental results indicate that UniAnimate achieves superior synthesis results over existing state-of-the-art counterparts in both quantitative and qualitative evaluations. Notably, UniAnimate can even generate highly consistent one-minute videos by iteratively employing the first frame conditioning strategy. Code and models will be publicly available. Project page: https://***/. Copyright © 2024, The Authors. All rights reserved.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：