检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Guo, Haonan Du, Bo Wu, Chen Han, Chengxi Zhang, Liangpei The State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing Wuhan University Wuhan China The National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence School of Computer Science Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University Wuhan China

Change detection (CD) is an important yet challenging task in the Earth observation field for monitoring Earth surface dynamics. The advent of deep learning techniques has recently propelled automatic CD into a technological revolution. Nevertheless, deep learning-based CD methods are still plagued by two primary issues: 1) insufficient temporal relationship modeling and 2) pseudo-change misclassification. To address these issues, we complement the strong temporal modeling ability of metric learning with the prominent fitting ability of segmentation and propose a deep change feature learning (DeepCL) framework for robust and explainable CD. Firstly, we designed a hard sample-aware contrastive loss, which reweights the importance of hard and simple samples. This loss allows for explicit modeling of the temporal correlation between bi-temporal remote sensing images. Furthermore, the modeled temporal relations are utilized as knowledge prior to guide the segmentation process for detecting change regions. The DeepCL framework is thoroughly evaluated both theoretically and experimentally, demonstrating its superior feature discriminability, resilience against pseudo changes, and adaptability to a variety of CD algorithms. Extensive comparative experiments substantiate the quantitative and qualitative superiority of DeepCL over state-of-the-art CD approaches. The source code will be made available at https://***/HaonanGuo/DeepCL. Copyright © 2023, The Authors. All rights reserved.

关键词： Change detection

来源：评论

学校读者我要写书评

暂无评论

Rethinking Federated Learning with Domain Shift: A Prototype View

Rethinking Federated Learning with Domain Shift: A Prototype...

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： Wenke Huang Mang Ye Zekun Shi He Li Bo Du National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence Hubei Key Laboratory of Multimedia and Network Communication Engineering School of Computer Science Wuhan University Wuhan China Hubei Luojia Laboratory Wuhan China

Federated learning shows a bright promise as a privacy-preserving collaborative learning technique. However, prevalent solutions mainly focus on all private data sampled from the same domain. An important challenge is that when distributed data are derived from diverse domains. The private model presents degenerative performance on other domains (with domain shift). Therefore, we expect that the global model optimized after the federated learning process stably provides generalizability performance on multiple domains. In this paper, we propose Federated Proto-types Learning (FPL) for federated learning under domain shift. The core idea is to construct cluster prototypes and unbiased prototypes, providing fruitful domain knowledge and a fair convergent target. On the one hand, we pull the sample embedding closer to cluster prototypes belonging to the same semantics than cluster prototypes from distinct classes. On the other hand, we introduce consistency regularization to align the local instance with the respective unbiased prototype. Empirical results on Digits and Office Caltech tasks demonstrate the effectiveness of the proposed solution and the efficiency of crucial modules.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Freevc: Towards High-Quality Text-Free One-Shot Voice Conversion

Freevc: Towards High-Quality Text-Free One-Shot Voice Conver...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Jingyi Li Weiping Tu Li Xiao National Engineering Research Center for Multimedia Software School of Computer Science Wuhan University Wuhan China Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University Wuhan China Hubei Luojia Laboratory China

Voice conversion (VC) can be achieved by first extracting source content information and target speaker information, and then reconstructing waveform with these information. However, current approaches normally either extract dirty content information with speaker information leaked in, or demand a large amount of annotated data for training. Besides, the quality of reconstructed waveform can be degraded by the mismatch between conversion model and vocoder. In this paper, we adopt the end-to-end framework of VITS for high-quality waveform reconstruction, and propose strategies for clean content information extraction without text annotation. We disentangle content information by imposing an information bottleneck to WavLM features, and propose the spectrogram-resize based data augmentation to improve the purity of extracted content information. Experimental results show that the proposed method outperforms the latest VC models trained with annotated data and has greater robustness.

关键词： Training Annotations Vocoders Signal processing Feature extraction Information retrieval Data models

来源：评论

学校读者我要写书评

暂无评论

Unsupervised Visible-Infrared Person Re-Identification via Progressive Graph Matching and Alternate Learning

Unsupervised Visible-Infrared Person Re-Identification via P...

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： Zesen Wu Mang Ye Hubei Key Laboratory of Multimedia and Network Communication Engineering National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence School of Computer Science Wuhan University Wuhan China Hubei Luojia Laboratory Wuhan China

Unsupervised visible-infrared person re-identification is a challenging task due to the large modality gap and the unavailability of cross-modality correspondences. Cross-modality correspondences are very crucial to bridge the modality gap. Some existing works try to mine cross-modality correspondences, but they focus only on local information. They do not fully exploit the global relationship across identities, thus limiting the quality of the mined correspondences. Worse still, the number of clusters of the two modalities is often inconsistent, exacerbating the unreliability of the generated correspondences. In response, we devise a Progressive Graph Matching method to globally mine cross-modality correspondences under cluster imbalance scenarios. PGM formulates correspondence mining as a graph matching process and considers the global information by minimizing the global matching cost, where the matching cost measures the dissimilarity of clusters. Besides, PGM adopts a progressive strategy to address the imbalance issue with multiple dynamic matching processes. Based on PGM, we design an Alternate Cross Contrastive Learning (ACCL) module to reduce the modality gap with the mined cross-modality correspondences, while mitigating the effect of noise in correspondences through an alternate scheme. Extensive experiments demonstrate the reliability of the generated correspondences and the effectiveness of our method.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Towards Modality-Agnostic Person Re-identification with Descriptive Query

Towards Modality-Agnostic Person Re-identification with Desc...

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： Cuiqun Chen Mang Ye Ding Jiang National Engineering Research Center for Multimedia Software Hubei Key Laboratory of Multimedia and Network Communication Engineering Institute of Artificial Intelligence School of Computer Science Wuhan University Wuhan China Hubei Luojia Laboratory Wuhan China

Person re-identification (ReID) with descriptive query (text or sketch) provides an important supplement for general image-image paradigms, which is usually studied in a single cross-modality matching manner, e.g., text-to-image or sketch-to-photo. However, without a camera-captured photo query, it is uncertain whether the text or sketch is available or not in practical scenarios. This motivates us to study a new and challenging modality-agnostic person re-ideruification problem. Towards this goal, we propose a unified person re-identification (UNIReID) architecture that can effectively adapt to cross-modality and multi-modality tasks. Specifically, UNIReID incorporates a simple dual-encoder with task-specific modality learning to mine and fuse visual and textual modality information. To deal with the imbalanced training problem of different tasks in UNIReID, we propose a task-aware dynamic training strategy in terms of task difficulty, adaptively adjusting the training focus. Besides, we construct three multi-modal ReID datasets by collecting the corresponding sketches from photos to support this challenging study. The experimental results on three multi-modal ReID datasets show that our UNIReID greatly improves the retrieval accuracy and generalization ability on different tasks and unseen scenarios.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval

Cross-Modal Implicit Relation Reasoning and Aligning for Tex...

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： Ding Jiang Mang Ye National Engineering Research Center for Multimedia Software Hubei Key Laboratory of Multimedia and Network Communication Engineering Institute of Artificial Intelligence School of Computer Science Wuhan University Wuhan China Hubei Luojia Laboratory Wuhan China

Text-to-image person retrieval aims to identify the target person based on a given textual description query. The primary challenge is to learn the mapping of visual and textual modalities into a common latent space. Prior works have attempted to address this challenge by leveraging separately pre-trained unimodal models to extract visual and textual features. However, these approaches lack the necessary underlying alignment capabilities required to match multimodal data effectively. Besides, these works use prior information to explore explicit part alignments, which may lead to the distortion of intra-modality information. To alleviate these issues, we present IRRA: a cross-modal Implicit Relation Reasoning and Aligning framework that learns relations between local visual-textual tokens and enhances global image-text matching without requiring additional prior supervision. Specifically, we first design an Implicit Relation Reasoning module in a masked language modeling paradigm. This achieves cross-modal interaction by integrating the visual cues into the textual tokens with a cross-modal multimodal interaction encoder. Secondly, to globally align the visual and textual embeddings, Similarity Distribution Matching is proposed to minimize the KL divergence between image-text similarity distributions and the normalized label matching distributions. The proposed method achieves new state-of-the-art results on all three public datasets, with a notable margin of about 3%-9% for Rank-1 accuracy compared to prior methods.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval

arXiv

引用

arXiv 2023年

作者： Jiang, Ding Ye, Mang National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence Hubei Key Laboratory of Multimedia and Network Communication Engineering School of Computer Science Wuhan University Wuhan China Hubei Luojia Laboratory Wuhan China

关键词： Modeling languages

来源：评论

学校读者我要写书评

暂无评论

Dear-DIA^(XMBD): Deep Autoencoder Enables Deconvolution of Data-Independent Acquisition Proteomics

引用

research 2024年第1期6卷 707-720页

作者： Qingzu He Chuan-Qi Zhong Xiang Li Huan Guo Yiming Li Mingxuan Gao Rongshan Yu Xianming Liu Fangfei Zhang Donghui Guo Fangfu Ye Tiannan Guo Jianwei Shuai Jiahuai Han Department of Physics and Fujian Provincial Key Laboratory for Soft Functional Materials ResearchXiamen UniversityXiamen 361005China Oujiang Laboratory(Zhejiang Lab for Regenerative Medicine Vision and Brain Health)and Wenzhou InstituteUniversity of Chinese Academy of SciencesWenzhouZhejiang 325001China School of Life Sciences Xiamen UniversityXiamen 361102China State Key Laboratory of Cellular Stress Biology Innovation Center for Cell Signaling NetworkXiamen 361102China Department of Computer Science Xiamen UniversityXiamen 361005China National Institute for Data Science in Health and Medicine School of MedicineXiamen UniversityXiamen 361102China Bruker(Beijing)Scientific Technology Co.Ltd. BeijingChina Westlake Laboratory of Life Sciences and Biomedicine Key Laboratory of Structural Biology of Zhejiang ProvinceSchool of Life SciencesWestlake University18 Shilongshan RoadHangzhou 310024China Institute of Basic Medical Sciences Westlake Institute for Advanced Study18 Shilongshan RoadHangzhou 310024China Westlake Omics Ltd. Yunmeng Road 1HangzhouChina Department of Electronic Engineering Xiamen UniversityXiamen 361005China

Data-independent acquisition(DIA)technology for protein identification from mass spectrometry and related algorithms is developing *** spectrum-centric analysis of DIA data without the use of spectra library from data-dependent acquisition data represents a promising *** this paper,we proposed an untargeted analysis method,Dear-DIA^(XMBD),for direct analysis of DIA ***-DIA^(XMBD) first integrates the deep variational autoencoder and triplet loss to learn the representations of the extracted fragment ion chromatograms,then uses the k-means clustering algorithm to aggregate fragments with similar representations into the same classes,and finally establishes the inverted index tables to determine the precursors of fragment clusters between precursors and peptides and between fragments and *** show that Dear-DIA^(XMBD) performs superiorly with the highly complicated DIA data of different species obtained by different instrument platforms.

关键词： Deep Auto Independent

来源：评论

学校读者我要写书评

暂无评论

Look from Coarse to Fine: A Hierarchical Lane Detection network

Look from Coarse to Fine: A Hierarchical Lane Detection Netw...

引用

Artificial Intelligence Innovation (ICAII), International Conference on

作者： Xichen Yu Yanduo Zhang Tao Lu Xun Li Jun Chang Hubei Provincial Key Laboratory of Intelligent Robot School of Computer Science and Engineering & School of Artificial Intelligence Wuhan Institute of Technology Wuhan China Hubei Key Laboratory of Multimedia and Network Communication Engineering National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence and School of Computer Science Wuhan University Wuhan China

Lane detection involves identifying a high-level semantic identifier with a slender structure, which requires both high-level feature detection for existence and low-level features for shape and position determination. The objective of this study is to introduce a framework called hierarchical lane detection (HLDNet), which from coarse to fine established stronger relationships between the global and local lanes to achieve stable and accurate lane detection. Specifically, we reframe the existing lane identification method by expressing lanes as a combination of lane instances (for existence detection) and lane point sets (for shape detection). Our proposed Lane IoU loss improves the model performance by regressing the lane instance as a whole. To enhance stability, we capture the complete lane with high-level features using multiple receptive fields. Additionally, our model adaptively fuses high- and low-level features, propagates key features between channels, and further enhances lane local feature representation. Our experimental results show significant improvements in the stability and accuracy of lane detection across multiple benchmark datasets and can run in realtime at a speed of 91 FPS.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Fine-Grained Noisy Segment Learning for Fatigue Detection

SSRN

引用

SSRN 2024年

作者： Wang, Mei Hu, Ruimin Liao, Liang Wang, Xiaochen Chen, Xiaohe Hu, Jinzhang National Engineering Research Center for Multimedia Software School of Computer Science Wuhan University Wuhan430072 China The Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University Wuhan430072 China The School of Computer Science and Engineering Nanyang Technological University Singapore The Wuhan Research Institute of Posts and Telecommunications Wuhan430072 China

In fatigue detection, fine-grained labels (seconds-based) commonly inherit coarse-grained labels (minutes-based or more). However, due to the dynamic and time-varying nature of fatigue states, ``Noisy Segments'' often arise in Fine-Grained Fatigue Detection (FD-FGNS). To address this, we propose an Adaptive Fine-Grained Noisy segment learning (AFGN) method, which differs from traditional manual relabeling approaches. AFGN consists of an unsupervised Trustworthy sample Extraction (uTE) method and a Dynamic Noise-tolerant Selective-supervised Contrastive Learning (DNSCL) module. uTE extracts trustworthy samples for positive guidance learning, while DNSCL effectively enhances the model’s tolerance to noise, ensuring robust latent representation learning. Furthermore, we introduce two re-annotated datasets with fine-grained labels, reDROZY and reRLDD. Empirical evidence demonstrates the superiority of AFGN over benchmark methods in mitigating noise in fatigue detection. This study, diving into the unexplored area of fine-grained fatigue detection with noisy labels, opens up new research and application prospects in this field. © 2024, The Authors. All rights reserved.

关键词： Learning systems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：