检索结果-内蒙古大学图书馆

Constraining Depth Map Geometry for Multi-View Stereo: A Dual-Depth Approach with Saddle-shaped Depth Cells

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ye, Xinyi Zhao, Weiyue Liu, Tianqi Huang, Zihao Cao, Zhiguo Li, Xin Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Department of Computer Science University of Albany AlbanyNY12222 United States

Learning-based multi-view stereo (MVS) methods deal with predicting accurate depth maps to achieve an accurate and complete 3D representation. Despite the excellent performance, existing methods ignore the fact that a suitable depth geometry is also critical in MVS. In this paper, we demonstrate that different depth geometries have significant performance gaps, even using the same depth prediction error. Therefore, we introduce an ideal depth geometry composed of Saddle-Shaped Cells, whose predicted depth map oscillates upward and downward around the ground-truth surface, rather than maintaining a continuous and smooth depth plane. To achieve it, we develop a coarse-to-fine framework called Dual-MVSNet (DMVSNet), which can produce an oscillating depth plane. Technically, we predict two depth values for each pixel (Dual-Depth), and propose a novel loss function and a checkerboard-shaped selecting strategy to constrain the predicted depth geometry. Compared to existing methods,DMVSNet achieves a high rank on the DTU benchmark and obtains the top performance on challenging scenes of Tanks and Temples, demonstrating its strong performance and generalization ability. Our method also points to a new research direction for considering depth geometry in MVS. Copyright © 2023, The Authors. All rights reserved.

关键词： Geometry

Find Beauty in the Rare: Contrastive Composition Feature Clustering for Nontrivial Cropping Box Regression

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Pan, Zhiyu Chen, Yinpeng Zhang, Jiale Lu, Hao Cao, Zhiguo Zhong, Weicai Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Huawei CBG Consumer Cloud Service Search Product & Big Data Platform Department China

Automatic image cropping algorithms aim to recompose images like human-being photographers by generating the cropping boxes with improved composition quality. Cropping box regression approaches learn the beauty of composition from annotated cropping boxes. However, the bias of annotations leads to quasi-trivial recomposing results, which has an obvious tendency to the average location of training samples. The crux of this predicament is that the task is naively treated as a box regression problem, where rare samples might be dominated by normal samples, and the composition patterns of rare samples are not well exploited. Observing that similar composition patterns tend to be shared by the cropping boundaries annotated nearly, we argue to find the beauty of composition from the rare samples by clustering the samples with similar cropping boundary annotations, i.e., similar composition patterns. We propose a novel Contrastive Composition Clustering (C2C) to regularize the composition features by contrasting dynamically established similar and dissimilar pairs. In this way, common composition patterns of multiple images can be better summarized, which especially benefits the rare samples and endows our model with better generalizability to render nontrivial results. Extensive experimental results show the superiority of our model compared with prior arts. We also illustrate the philosophy of our design with an interesting analytical visualization. Copyright © 2023, The Authors. All rights reserved.

关键词： image enhancement

Research and application of Transformer based anomaly detection model: A literature review

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ma, Mingrui Han, Lansheng Zhou, Chunjie Hubei Key Laboratory of Distributed System Security Hubei Engineering Research Center on Big Data Security School of Cyber Science and Engineering Huazhong University of Science and Technology Hubei Wuhan430074 China The Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Hubei Wuhan430074 China

Transformer, as one of the most advanced neural network models in Natural Language processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review offers a fresh perspective on the concept of anomaly detection. We explore the current challenges of anomaly detection and provide detailed insights into the operating principles of Transformer and its variants in anomaly detection tasks. Additionally, we delineate various application scenarios for Transformer-based anomaly detection models and discuss the datasets and evaluation metrics employed. Furthermore, this review highlights the key challenges in Transformer-based anomaly detection research and conducts a comprehensive analysis of future research trends in this domain. The review includes an extensive compilation of over 100 core references related to Transformer-based anomaly detection. To the best of our knowledge, this is the first comprehensive review that focuses on the research related to Transformer in the context of anomaly detection. We hope that this paper can provide detailed technical information to researchers interested in Transformer-based anomaly detection tasks. Copyright © 2024, The Authors. All rights reserved.

关键词： Anomaly detection

Fast Full-frame Video Stabilization with Iterative Optimization

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhao, Weiyue Li, Xin Peng, Zhan Luo, Xianrui Ye, Xinyi Lu, Hao Cao, Zhiguo Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Department of Computer Science University of Albany AlbanyNY12222 United States

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in video stabilization. Inspired by the analogy between wobbly frames and jigsaw puzzles, we propose an iterative optimization-based learning approach using synthetic datasets for video stabilization, which consists of two interacting submodules: motion trajectory smoothing and full-frame outpainting. First, we develop a two-level (coarse-to-fine) stabilizing algorithm based on the probabilistic flow field. The confidence map associated with the estimated optical flow is exploited to guide the search for shared regions through backpropagation. Second, we take a divide-and-conquer approach and propose a novel multiframe fusion strategy to render full-frame stabilized views. An important new insight brought about by our iterative optimization approach is that the target video can be interpreted as the fixed point of nonlinear mapping for video stabilization. We formulate video stabilization as a problem of minimizing the amount of jerkiness in motion trajectories, which guarantees convergence with the help of fixed-point theory. Extensive experimental results are reported to demonstrate the superiority of the proposed approach in terms of computational speed and visual quality. The code will be available on GitHub. Copyright © 2023, The Authors. All rights reserved.

关键词： Iterative methods

Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Zili Chen, Hao Bai, Lei Li, Wenyuan Chen, keyan Wang, Zhengyi Ouyang, Wanli Zou, Zhengxia Shi, Zhenwei The Image Processing Center School of Astronautics The Beijing Key Laboratory of Digital Media The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China The Department of Geography University of Hong Kong Hong Kong The School of Oceanography Shanghai Jiao Tong University Shanghai200030 China The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China

Downscaling (DS) of meteorological variables involves obtaining high-resolution states from low-resolution meteorological fields and is an important task in weather forecasting. Previous methods based on deep learning treat downscaling as a super-resolution task in computer vision and utilize high-resolution gridded meteorological fields as supervision to improve resolution at specific grid scales. However, this approach has struggled to align with the continuous distribution characteristics of meteorological fields, leading to an inherent systematic bias between the downscaled results and the actual observations at meteorological stations. In this paper, we extend meteorological downscaling to arbitrary scattered station scales, establish a brand new benchmark and dataset, and retrieve meteorological states at any given station location from a coarse-resolution meteorological field. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Building on this foundation, we propose a new downscaling model based on hypernetwork architecture, namely HyperDS, which efficiently integrates different observational information into the model training, achieving continuous scale modeling of the meteorological field. Through extensive experiments, our proposed method outperforms other specially designed baseline models on multiple surface variables. Notably, the mean squared error (MSE) for wind speed and surface pressure improved by 67% and 19.5% compared to other methods. We will release the dataset and code subsequently. Copyright © 2024, The Authors. All rights reserved.

关键词： Weather forecasting

Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement

学校读者我要写书评

暂无评论

Watch the Speakers: A Hybrid Continuous Attribution Network ...

International Conference on Tools for Artificial intelligence (ICTAI)

作者： Shanglin Lei Xiaoping Wang Guanting Dong Jiang Li Yingjian Liu School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Institute of Artificial Intelligence Huazhong University of Science and Technology (HUST) Wuhan China

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization to diverse scenarios due to insufficient modeling of context, ambiguous capture of dialogue relationships and overfitting in speaker modeling. In this work, we present a Hybrid Continuous Attributive Network (HCAN) to address these issues in the perspective of emotional continuation and emotional attribution. Specifically, HCAN adopts a hybrid recurrent and attention-based module to model global emotion continuity. Then a novel Emotional Attribution Encoding (EAE) is proposed to model intra- and inter-emotional attribution for each utterance. Moreover, aiming to enhance the robustness of the model in speaker modeling and improve its performance in different scenarios, A comprehensive loss function emotional cognitive loss $\mathcal{L}_{EC}$ is proposed to alleviate emotional drift and overcome the overfitting of the model to speaker modeling. Our model achieves state-of-the-art performance on three datasets, demonstrating the superiority of our work. Another extensive comparative experiments and ablation studies on three benchmarks are conducted to provided evidence to support the efficacy of each module. Further exploration of generalization ability experiments shows the plug-and-play nature of the EAE module in our method.

关键词：

InferEM: Inferring the Speaker’s Intention for Empathetic Dialogue Generation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lv, Guoqing Li, Jiang Wang, Xiaoping Zeng, Zhigang The School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China The Hubei Key Laboratory of Brain-inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China

Current approaches to empathetic response generation typically encode the entire dialogue history directly and put the output into a decoder to generate friendly feedback. These methods focus on modelling contextual information but neglect capturing the direct intention of the speaker. We argue that the last utterance in the dialogue empirically conveys the intention of the speaker. Consequently, we propose a novel model named InferEM for empathetic response generation. We separately encode the last utterance and fuse it with the entire dialogue through the multi-head attention based intention fusion module to capture the speaker’s intention. Besides, we utilize previous utterances to predict the last utterance, which simulates human’s psychology to guess what the interlocutor may speak in advance. To balance the optimizing rates of the utterance prediction and response generation, a multitask learning strategy is designed for InferEM. Experimental results demonstrate the plausibility and validity of InferEM in improving empathetic expression. Copyright © 2022, The Authors. All rights reserved.

关键词： Encoding (symbols)

Distributed Resource Allocation via Accelerated Saddle Point Dynamics

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2021年第9期8卷 1588-1599页

作者： Wen-Ting Lin Yan-Wu Wang Chaojie Li Xinghuo Yu School of Artificial Intelligence and Automation Huazhong University of Science and TechnologyWuhan 430074 Key Laboratory of Image Processing and Intelligent Control Ministry of EducationHuazhong University of Science and TechnologyWuhan 430074China School of Electrical Engineering and Telecommunications University of New South WalesSydney NSW 2052Australia School of Engineering Royal Melbourne Institute of Technology(RMIT University)Melbourne VIC 3000Australia

In this paper,accelerated saddle point dynamics is proposed for distributed resource allocation over a multi-agent network,which enables a hyper-exponential convergence ***,an inertial fast-slow dynamical system with vanishing damping is introduced,based on which the distributed saddle point algorithm is *** dual variables are updated in two time scales,i.e.,the fast manifold and the slow *** the fast manifold,the consensus of the Lagrangian multipliers and the tracking of the constraints are pursued by the consensus *** the slow manifold,the updating of the Lagrangian multipliers is accelerated by inertial ***-exponential stability is defined to characterize a faster convergence of our proposed algorithm in comparison with conventional primal-dual algorithms for distributed resource *** simulation of the application in the energy dispatch problem verifies the result,which demonstrates the fast convergence of the proposed saddle point dynamics.

关键词： Accelerated saddle point dynamic distributed resource allocation hyper-exponential stability power dispatch

Finite-Time Couple-Group Consensus for Fractional-Order Multi-Agent Systems with Coopetition Interactions

学校读者我要写书评

暂无评论

Finite-Time Couple-Group Consensus for Fractional-Order Mult...

Chinese Control and Decision Conference, CCDC

作者： Rong Wu Lianghao Ji Cuijuan Zhang Shasha Yang Xing Guo Huaqing Li Chongqing Key Laboratory of Image Cognition Chongqing University of Posts and Telecommunications Chongqing China Chongqing Key Laboratory of Nonlinear Circuits and Intelligence Information Processing College of Electronic and Information Engineering Southwest University Chongqing China

ISBN: (纸本)9781665478977

The problem of finite-time couple-group consensus for fractional-order multi-agent systems with weakly connected topology is investigated in this paper through pinning control. A new error variable based on cooperative and competitive interactions among agents is introduced to transform the fractional-order multi-agent system into a first-order multi-agent system and a novel group consensus protocol is designed for the transformed system. By applying the Lyapunov approach and matrix theory, several sufficient conditions are obtained to ensure the achievement of finite-time couple-group consensus of the system. In addition, the settling time is upper bounded by a definite value, which is independent of the initial states. Finally, the correctness and validity of our findings are verified through some numerical simulations.

关键词： Sufficient conditions Upper bound Transforms Numerical simulation Control systems Topology Consensus protocol