检索结果-内蒙古大学图书馆

Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Zili Chen, Hao Bai, Lei Li, Wenyuan Chen, keyan Wang, Zhengyi Ouyang, Wanli Zou, Zhengxia Shi, Zhenwei The Image Processing Center School of Astronautics The Beijing Key Laboratory of Digital Media The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China The Department of Geography University of Hong Kong Hong Kong The School of Oceanography Shanghai Jiao Tong University Shanghai200030 China The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China

Downscaling (DS) of meteorological variables involves obtaining high-resolution states from low-resolution meteorological fields and is an important task in weather forecasting. Previous methods based on deep learning treat downscaling as a super-resolution task in computer vision and utilize high-resolution gridded meteorological fields as supervision to improve resolution at specific grid scales. However, this approach has struggled to align with the continuous distribution characteristics of meteorological fields, leading to an inherent systematic bias between the downscaled results and the actual observations at meteorological stations. In this paper, we extend meteorological downscaling to arbitrary scattered station scales, establish a brand new benchmark and dataset, and retrieve meteorological states at any given station location from a coarse-resolution meteorological field. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Building on this foundation, we propose a new downscaling model based on hypernetwork architecture, namely HyperDS, which efficiently integrates different observational information into the model training, achieving continuous scale modeling of the meteorological field. Through extensive experiments, our proposed method outperforms other specially designed baseline models on multiple surface variables. Notably, the mean squared error (MSE) for wind speed and surface pressure improved by 67% and 19.5% compared to other methods. We will release the dataset and code subsequently. Copyright © 2024, The Authors. All rights reserved.

关键词： Weather forecasting

Implicit Tracking-Based Distributed Constraint-Coupled Optimization

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Jingwang Su, Housheng The School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

A class of distributed optimization problem with a globally coupled equality constraint and local constrained sets is studied in this paper. For its special case where local constrained sets are absent, an augmented primal-dual gradient dynamics is proposed and analyzed, but it cannot be implemented distributedly since the violation of the coupled constraint needs to be used. Benefiting from the brand-new comprehending of a classical distributed unconstrained optimization algorithm, the novel implicit tracking approach is proposed to track the violation distributedly, which leads to the birth of the implicit tracking-based distributed augmented primal-dual gradient dynamics (IDEA). A projected variant of IDEA, i.e., Proj-IDEA, is further designed to deal with the general case where local constrained sets exist. With the aid of the Lyapunov stability theory, the convergences of IDEA and Proj-IDEA over undigraphs and digraphs are analyzed respectively. As far as we know, Proj-IDEA is the first constant step-size distributed algorithm which can solve the studied problem without the need of the strict convexity of local cost functions. Besides, if local cost functions are strongly convex and smooth, IDEA can achieve exponential convergence with a weaker condition about the coupled constraint. Finally, numerical experiments are taken to corroborate our theoretical results. © 2022, CC BY.

关键词： Cost functions

NPGA: A Unified Algorithmic Framework for Decentralized Constraint-Coupled Optimization

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Jingwang Su, Housheng School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

This work focuses on a class of general decentralized constraint-coupled optimization problems. We propose a novel nested primal-dual gradient algorithm (NPGA), which can achieve linear convergence under the weakest known condition, and its theoretical convergence rate surpasses all known results. More importantly, NPGA serves not only as an algorithm but also as a unified algorithmic framework, encompassing various existing algorithms as special cases. By designing different network matrices, we can derive numerous versions of NPGA and analyze their convergences by leveraging the convergence results of NPGA conveniently, thereby enabling the design of more efficient algorithms. Finally, we conduct numerical experiments to compare the convergence rates of NPGA and existing algorithms, providing empirical evidence for the superior performance of NPGA. Copyright © 2022, The Authors. All rights reserved.

关键词： Consensus algorithm

Multimodal Representations Learning Based on Mutual Information Maximization and Minimization and Identity Embedding for Multimodal Sentiment Analysis

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zheng, Jiahao Zhang, Sen Wang, Xiaoping Zeng, Zhigang School of Artificial Intelligence and Automation The Key Laboratory of Image Processing Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

Multimodal sentiment analysis (MSA) is a fundamental complex research problem due to the heterogeneity gap between different modalities and the ambiguity of human emotional expression. Although there have been many successful attempts to construct multimodal representations for MSA, there are still two challenges to be addressed: 1) A more robust multimodal representation needs to be constructed to bridge the heterogeneity gap and cope with the complex multimodal interactions, and 2) the contextual dynamics must be modeled effectively throughout the information flow. In this work, we propose a multimodal representation model based on Mutual information Maximization and Minimization and Identity Embedding (MMMIE). We combine mutual information maximization between modal pairs, and mutual information minimization between input data and corresponding features to mine the modal-invariant and task-related information. Furthermore, Identity Embedding is proposed to prompt the downstream network to perceive the contextual information. Experimental results on two public datasets demonstrate the effectiveness of the proposed model. Copyright © 2022, The Authors. All rights reserved.

关键词： Sentiment analysis

GA2MIF: Graph and Attention Based Two-Stage Multi-Source Information Fusion for Conversational Emotion Detection

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Jiang Wang, Xiaoping Lv, Guoqing Zeng, Zhigang School of Artificial Intelligence and Automation the Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is an up-and-coming research area in recent years, which is inspired by human capability to integrate multiple senses. Several graph-based approaches claim to capture interactive information between modalities, but the heterogeneity of multimodal data makes these methods prohibit optimal solutions. In this work, we introduce a multimodal fusion approach named Graph and Attention based Two-stage Multi-source Information Fusion (GA2MIF) for emotion detection in conversation. Our proposed method circumvents the problem of taking heterogeneous graph as input to the model while eliminating complex redundant connections in the construction of graph. GA2MIF focuses on contextual modeling and cross-modal modeling through leveraging Multi-head Directed Graph ATtention networks (MDGATs) and Multi-head Pairwise Cross-modal ATtention networks (MPCATs), respectively. Extensive experiments on two public datasets (i.e., IEMOCAP and MELD) demonstrate that the proposed GA2MIF has the capacity to validly capture intra-modal long-range contextual information and inter-modal complementary information, as well as outperforms the prevalent State-Of-The-Art (SOTA) models by a remarkable margin. Copyright © 2022, The Authors. All rights reserved.

关键词： Directed graphs

Self-supervised Multi-frame Monocular Depth Estimation with Pseudo-LiDAR Pose Enhancement

学校读者我要写书评

暂无评论

Self-supervised Multi-frame Monocular Depth Estimation with ...

IEEE International Conference on Robotics and Automation (ICRA)

作者： Wenhua Wu Guangming Wang Jiquan Zhong Hesheng Wang Zhe Liu MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai China Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Insititute of Medical Robotics Shanghai Jiao Tong University Shanghai China

Depth estimation is one of the most important tasks in scene understanding. In the existing joint self-supervised learning approaches of depth-pose estimation, depth estimation and pose estimation networks are independent of each other. They only use the adjacent image frames for pose estimation and lack the use of the estimated geometric information. To enhance the depth-pose association, we propose a monocular multi-frame unsupervised depth estimation framework, named PLPE-Depth. There are a depth estimation network and two pose estimation networks with image input and pseudo-LiDAR input. The main idea of our approach is to use the pseudo-LiDAR reconstructed from the depth map to estimate the pose of adjacent frames. We propose depth re-estimation with a better pose between the image pose and the pseudo-LiDAR pose to improve the accuracy of estimation. Besides, we improve the reconstruction loss and design a pseudo-LiDAR pose enhancement loss to facilitate the joint learning. Our approach enhances the use of the estimated depth information and strengthens the coupling between depth estimation and pose estimation. Experiments on the KITTI dataset show that our depth estimation achieves state-of-the-art performance at low resolution. Our source codes will be released on https://***/IRMVLabIPLPE-Depth.

关键词：

Spiking Neural Network for Intra-cortical Brain Signal Decoding

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Yang, Song Fu, Haotian Zhang, Herui Zhang, Peng Li, Wei Wu, Dongrui Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Hubei Key Laboratory of Brain-inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China Department of Biomedical Engineering College of Life Science and Technology Huazhong University of Science and Technology Wuhan430074 China

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based approaches have high computational cost. To improve both the decoding accuracy and efficiency, this paper proposes a spiking neural network (SNN) for effective and energy-efficient intra-cortical brain signal decoding. We also propose a feature fusion approach, which integrates the manually extracted neural activity vector features with those extracted by a deep neural network, to further improve the decoding accuracy. Experiments in decoding motor-related intra-cortical brain signals of two rhesus macaques demonstrated that our SNN model achieved higher accuracy than traditional artificial neural networks;more importantly, it was tens or hundreds of times more efficient. The SNN model is very suitable for high precision and low power applications like intracortical brain-computer interfaces. © 2025, CC BY.

关键词： Deep neural networks

GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network

学校读者我要写书评

暂无评论

GNet: 3D Object Detection from Point Cloud with Geometry-Awa...

IEEE International Conference on Cyborg and Bionic Systems (CBS)

作者： Hao Ruan Bingrong Xu Junbin Gao Lianguang Liu Junting Lv Yin Sheng Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China School of Automation Wuhan University of Technology Wuhan China

3D object detection based on point clouds in real-world applications has been a challenging task because the raw point cloud may be sparse or occluded. It may be caused by bad weather or limited sensor resolution, leading to decreasing detection performance. To this end, a novel highperformance Geometry-aware Network (GNet) is proposed and used to accurately detect 3D objects from sparse point clouds. Different from previous work that only regresses the offset of 3D bounding boxes numerically between ground truth (GT) and prediction, GNet considers the geometric information of 3D bounding boxes and combines the two effectively to achieve a better regression performance. In particular, Point Nets blocks learned voxel-wise features and the proposals are generated by the 3D voxel convolution neural network (voxel CNN). By utilizing the prior knowledge and the geometric properties of the 3D bounding boxes, the proposed novel OS-loss can improve detection performance and accelerate speed of inference. Furthermore, GNet takes advantage of prior geometry properties rather than only regressing the offset numerically. These speed up the convergence of the regression network. Finally, our proposed GNet was evaluated on the KITTI dataset for 3D objects and Bird’s Eye View (BEV) detection aspects. The results demonstrate that GNet can improve object detection performance for sparse point clouds.

关键词： Point cloud compression Location awareness Geometry Three-dimensional displays Neural networks Object detection Proposals

ESNet: evolution and succession network for high-resolution salient object detection 24

学校读者我要写书评

暂无评论

ESNet: evolution and succession network for high-resolution ...

Proceedings of the 41st International Conference on Machine Learning

作者： Hongyu Liu Runmin Cong Hua Li Qianqian Xu Qingming Huang Wei Zhang Institute of Information Science Beijing Jiaotong University & Beijing Key Laboratory of Advanced Information Science and Network Technology Beijing China School of Control Science and Engineering Shandong University & Key Laboratory of Machine Intelligence and System Control Ministry of Education Jinan China School of Computer Science and Technology Hainan University Hainan China Key Laboratory of Intelligent Information Processing Institute of Computing Technology CAS Beijing China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing China

Preserving details and avoiding high computational costs are the two main challenges for the High-Resolution Salient Object Detection (HRSOD) task. In this paper, we propose a two-stage HRSOD model from the perspective of evolution and succession, including an evolution stage with Low-resolution Location Model (LrLM) and a succession stage with High-resolution Refinement Model (HrRM). The evolution stage achieves detail-preserving salient objects localization on the low-resolution image through the evolution mechanisms on supervision and feature; the succession stage utilizes the shallow high-resolution features to complement and enhance the features inherited from the first stage in a lightweight manner and generate the final high-resolution saliency prediction. Besides, a new metric named Boundary-Detail-aware Mean Absolute Error (MAEBD) is designed to evaluate the ability to detect details in high-resolution scenes. Extensive experiments on five datasets demonstrate that our network achieves superior performance at real-time speed (49 FPS) compared to state-of-the-art methods. Our code is publicly available at: https://***/rmcong/ESNet_ICML24.

关键词：