检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Zhu, Yabin Wang, Qianwu Li, Chenglong Tang, Jin Huang, Zhixiang The Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Anhui University School of Public Safety and Emergency Management Anhui University of Science and Technology Hefei231131 China School of Artificial Intelligence Anhui University Hefei230601 China Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui Provincial Key Laboratory of Security Artificial Intelligence School of Artificial Intelligence Anhui University Hefei230601 China Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Computer Science and Technology Anhui University Hefei230601 China Center for Big Data and Population Health of IHM China

The complementary benefits from visible and thermal infrared data are widely utilized in various computer vision task, such as visual tracking, semantic segmentation and object detection, but rarely explored in Multiple Object Tracking (MOT). In this work, we contribute a large-scale Visible-Thermal video benchmark for MOT, called VT-MOT. VT-MOT has the following main advantages. 1) The data is large scale and high diversity. VT-MOT includes 582 video sequence pairs, 401k frame pairs from surveillance, drone, and handheld platforms. 2) The cross-modal alignment is highly accurate. We invite several professionals to perform both spatial and temporal alignment frame by frame. 3) The annotation is dense and high-quality. VT-MOT has 3.99 million annotation boxes annotated and double-checked by professionals, including heavy occlusion and object re-acquisition (object disappear and reappear) challenges. To provide a strong baseline, we design a simple yet effective tracking framework, which effectively fuses temporal information and complementary information of two modalities in a progressive manner, for robust visible-thermal MOT. A comprehensive experiment are conducted on VT-MOT and the results prove the superiority and effectiveness of the proposed method compared with state-of-the-art methods. From the evaluation results and analysis, we specify several potential future directions for visible-thermal MOT. The project is released in https://***/wqw123wqw/PFTrack. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Accelerating evolutionary neural architecture search via multi-fidelity evaluation

arXiv

引用

arXiv 2021年

作者： Yang, Shangshang Tian, Ye Xiang, Xiaoshu Peng, Shichen Zhang, Xingyi Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Artificial Intelligence Anhui University Hefei230039 China Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education Institutes of Physical Science and Information Technology Anhui University Hefei230601 China

Evolutionary neural architecture search (ENAS) has recently received increasing attention by effectively finding high-quality neural architectures, which however consumes high computational cost by training the architecture encoded by each individual for complete epochs in individual evaluation. Numerous ENAS approaches have been developed to reduce the evaluation cost, but it is often difficult for most of these approaches to achieve high evaluation accuracy. To address this issue, in this paper we propose an accelerated ENAS via multifidelity evaluation termed MFENAS, where the individual evaluation cost is significantly reduced by training the architecture encoded by each individual for only a small number of epochs. The balance between evaluation cost and evaluation accuracy is well maintained by suggesting a multi-fidelity evaluation, which identifies the potentially good individuals that cannot survive from previous generations by integrating multiple evaluations under different numbers of training epochs. For high diversity of neural architectures, a population initialization strategy is devised to produce different neural architectures varying from ResNetlike architectures to Inception-like ones. Experimental results on CIFAR-10 show that the architecture obtained by the proposed MFENAS achieves a 2.39% test error rate at the cost of only 0.6 GPU days on one NVIDIA 2080TI GPU, demonstrating the superiority of the proposed MFENAS over state-of-the-art NAS approaches in terms of both computational cost and architecture quality. The architecture obtained by the proposed MFENAS is then transferred to CIFAR-100 and ImageNet, which also exhibits competitive performance to the architectures obtained by existing NAS approaches. The source code of the proposed MFENAS is available at https://***/DevilYangS/MFENAS/.MSC Codes 68W50, 68T07 © 2021, CC BY.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

DMNER: Biomedical Named Entity Recognition by Detection and Matching

DMNER: Biomedical Named Entity Recognition by Detection and ...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Junyi Bian Rongze Jiang Weiqi Zhai Tianyang Huang Xiaodi Huang Hong Zhou Shanfeng Zhu School of Computer Science Fudan University Shanghai China Institute of Science and Technology for Brain-Inspired Intelligence Fudan University Shanghai China School of Computing Mathematics and Engineering Charles Sturt University New South Wales Australia Atypon Systems LLC UK Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence Institute of Science and Technology for Brain-Inspired Intelligence and MOE Frontiers Center for Brain Science Shanghai Key Lab of Intelligent Information Processing Zhangjiang Fudan International Innovation Center Fudan University Shanghai China

ISBN: (数字)9798350386226

ISBN: (纸本)9798350386233

Biomedical Named Entity Recognition (NER) is a crucial task in extracting information from biomedical texts. However, the diversity of professional terminology, semantic complexity, and the widespread presence of synonyms pose significant challenges. Traditional methods that rely on sequence labeling training datasets often struggle to handle these complexities. To address this, we introduce a novel framework for BioNER, termed DMNER, which leverages external knowledge and operates in two steps: entity boundary detection and entity category identification through matching. The core of DMNER is its second step, which determines the entity category by retrieving similar entities and their categories from a knowledge dictionary using semantic similarity matching. Our experiments on 10 biomedical datasets demonstrate that DMNER outperforms baselines across these tasks, proving its effectiveness and adaptability. DMNER is versatile and can be applied to various NER tasks, including supervised NER, distantly supervised NER, and NER on multiple datasets with disjoint label sets. The DMNER code is publicly available 1 .

关键词： Training Dictionaries Codes Semantics Named entity recognition Complexity theory Labeling Data mining Bioinformatics

来源：评论

学校读者我要写书评

暂无评论

A Theoretically Guaranteed Quaternion Weighted Schatten p-norm Minimization Method for Color Image Restoration

arXiv

引用

arXiv 2023年

作者： Zhang, Qing-Hua He, Liang-Tian Wang, Yi-Lun Deng, Liang-Jian Liu, Jun Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Mathematical Sciences Anhui University Hefei230601 China Machinify Inc Palo AltoCA94301 United States School of Mathematical Sciences University of Electronic Science and Technology of China Chengdu611731 China Key Laboratory for Applied Statistics of MOE School of Mathematics and Statistics Northeast Normal University Changchun130024 China

Inspired by the fact that the matrix formulated by nonlocal similar patches in a natural image is of low rank, the rank approximation issue have been extensively investigated over the past decades, among which weighted nuclear norm minimization (WNNM) and weighted Schatten p-norm minimization (WSNM) are two prevailing methods have shown great superiority in various image restoration (IR) problems. Due to the physical characteristic of color images, color image restoration (CIR) is often a much more difficult task than its grayscale image counterpart. However, when applied to CIR, the traditional WNNM/WSNM method only processes three color channels individually and fails to consider their cross-channel correlations. Very recently, a quaternion-based WNNM approach (QWNNM) has been developed to mitigate this issue, which is capable of representing the color image as a whole in the quaternion domain and preserving the inherent correlation among the three color channels. Despite its empirical success, unfortunately, the convergence behavior of QWNNM has not been strictly studied yet. In this paper, on the one side, we extend the WSNM into quaternion domain and correspondingly propose a novel quaternion-based WSNM model (QWSNM) for tackling the CIR problems. Extensive experiments on two representative CIR tasks, including color image denoising and deblurring, demonstrate that the proposed QWSNM method performs favorably against many state-of-the-art alternatives, in both quantitative and qualitative evaluations. On the other side, more importantly, we preliminarily provide a theoretical convergence analysis, that is, by modifying the quaternion alternating direction method of multipliers (QADMM) through a simple continuation strategy, we theoretically prove that both the solution sequences generated by the QWNNM and QWSNM have fixed-point convergence guarantees. The source code of our algorithm can be downloaded at the website: https://***/qiuxuanzhizi/QWSNM. Copyr

关键词： Color

来源：评论

学校读者我要写书评

暂无评论

Efficient Robust Principal Component Analysis via Block Krylov Iteration and CUR Decomposition

Efficient Robust Principal Component Analysis via Block Kryl...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Shun Fang Zhengqin Xu Shiqian Wu Shoulie Xie School of Information Science and Engineering Wuhan University of Science and Technology China Institute of Robotics and Intelligent Systems Wuhan University of Science and Technology China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University China Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial Systems Signal Processing RF & Optical Dept. Institute for Infocomm Research A*STAR Singapore

Robust principal component analysis (RPCA) is widely studied in computer vision. Recently an adaptive rank estimate based RPCA has achieved top performance in low-level vision tasks without the prior rank, but both the rank estimate and RPCA optimization algorithm involve singular value decomposition, which requires extremely huge computational resource for large-scale matrices. To address these issues, an efficient RPCA (eRPCA) algorithm is proposed based on block Krylov iteration and CUR decomposition in this paper. Specifically, the Krylov iteration method is employed to approximate the eigenvalue decomposition in the rank estimation, which requires $O(ndrq+n(rq)^{2})$ for an $(n\times d)$ input matrix, in which $q$ is a parameter with a small value, $r$ is the target rank. Based on the estimated rank, CUR decomposition is adopted to replace SVD in updating low-rank matrix component, whose complexity reduces from $O(rnd)$ to $O(r^{2}n)$ per iteration. Experimental results verify the efficiency and effectiveness of the proposed eRPCA over the state-of-the-art methods in various low-level vision applications.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Machine learning prediction of network dynamics with privacy protection

arXiv

引用

arXiv 2022年

作者： Xia, Xin Su, Yansen Lü, Linyuan Zhang, Xingyi Lai, Ying-Cheng Zhang, Hai-Feng The Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Mathematical Science Anhui University Hefei230601 China The Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Artificial Intelligence Anhui University Hefei230601 China Institute of Fundamental and Frontier Sciences University of Electronic Science and Technology of China Chengdu610054 China School of Electrical Computer and Energy Engineering Arizona State University TempeAZ85287 United States

Predicting network dynamics based on data, a problem with broad applications, has been studied extensively in the past, but most existing approaches assume that the complete set of historical data from the whole network is available. This requirement presents a great challenge in applications, especially for large, distributed networks in the real world, where data collection is accomplished by many clients in a parallel fashion. Often, each client only has the time series data from a partial set of nodes and the client has access to only partial timestamps of the whole time series data and partial structure of the network. Due to privacy concerns or license related issues, the data collected by different clients cannot be shared. To accurately predict the network dynamics while protecting the privacy of different parties is a critical problem in the modern time. Here, we propose a solution based on federated graph neural networks (FGNNs) that enables the training of a global dynamic model for all parties without data sharing. We validate the working of our FGNN framework through two types of simulations to predict a variety of network dynamics (four discrete and three continuous dynamics). As a significant real-world application, we demonstrate successful prediction of State-wise influenza spreading in the USA. Our FGNN scheme represents a general framework to predict diverse network dynamics through collaborative fusing of the data from different parties without disclosing their privacy. © 2022, CC BY.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Cross-Modal Object Tracking via Modality-Aware Fusion Network and A Large-Scale Dataset

arXiv

引用

arXiv 2023年

作者： Liu, Lei Zhang, Mengya Li, Cheng Li, Chenglong Tang, Jin The Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Artificial Intelligence Anhui University Hefei230601 China The Information Materials and Intelligent Sensing Laboratory of Anhui Province Key Laboratory of Intelligent Computing and Signal Processing The Ministry of Education Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Computer Science and Technology Anhui University Hefei230601 China The School of Computer Science and Technology Anhui University Hefei230601 China

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven effective, existing multi-modal imaging platforms are complex and lack real-world applicability. In contrast, near-infrared (NIR) imaging, commonly used in surveillance cameras, can switch between RGB and NIR based on light intensity. However, tracking objects across these heterogeneous modalities poses significant challenges, particularly due to the absence of modality switch signals during tracking. To address these challenges, we propose an adaptive cross-modal object tracking algorithm called Modality-Aware Fusion Network (MAFNet). MAFNet efficiently integrates information from both RGB and NIR modalities using an adaptive weighting mechanism, effectively bridging the appearance gap and enabling a modality-aware target representation. It consists of two key components: an adaptive weighting module and a modality-specific representation module. The adaptive weighting module predicts fusion weights to dynamically adjust the contribution of each modality, while the modality-specific representation module captures discriminative features specific to RGB and NIR modalities. MAFNet offers great flexibility as it can effortlessly integrate into diverse tracking frameworks. With its simplicity, effectiveness, and efficiency, MAFNet outperforms state-of-the-art methods in cross-modal object tracking. To validate the effectiveness of our algorithm and overcome the scarcity of data in this field, we introduce CMOTB, a comprehensive and extensive benchmark dataset for cross-modal object tracking. CMOTB consists of 61 categories and 1000 video sequences, comprising a total of over 799K frames. We believe that our proposed method and dataset offer a strong foundation for advancing cross-modal object tracking research. The dataset, toolkit, a

关键词： Large dataset

来源：评论

学校读者我要写书评

暂无评论

Tiny Object Tracking: A Large-scale Dataset and A Baseline

arXiv

引用

arXiv 2022年

作者： Zhu, Yabin Li, Chenglong Liu, Yao Wang, Xiao Tang, Jin Luo, Bin Huang, Zhixiang Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Key Laboratory of Electromagnetic Environmental Sensing Anhui Higher Education Institutes Anhui Provincial Key Laboratory of Multimodal Cognitive Computation Anhui University Hefei230601 China Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Artificial Intelligence Anhui University Hefei230601 China School of Computer Science and Technology Anhui University Hefei230601 China Peng Cheng Laboratory Shenzhen China Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Key Laboratory of Electromagnetic Environmental Sensing Anhui Higher Education Institutes Anhui University Hefei230601 China

Tiny objects, frequently appearing in practical applications, have weak appearance and features, and receive increasing interests in meany vision tasks, such as object detection and segmentation. To promote the research and development of tiny object tracking, we create a large-scale video dataset, which contains 434 sequences with a total of more than 217K frames. Each frame is carefully annotated with a high-quality bounding box. In data creation, we take 12 challenge attributes into account to cover a broad range of viewpoints and scene complexities, and annotate these attributes for facilitating the attribute-based performance analysis. To provide a strong baseline in tiny object tracking, we propose a novel Multilevel Knowledge Distillation Network (MKDNet), which pursues three-level knowledge distillations in a unified framework to effectively enhance the feature representation, discrimination and localization abilities in tracking tiny objects. Extensive experiments are performed on the proposed dataset, and the results prove the superiority and effectiveness of MKDNet compared with state-of-the-art methods. The dataset, the algorithm code, and the evaluation code are available at https://***/mmic-lcl/Datasets-andbenchmark-code. Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

RGBT Tracking via Progressive Fusion Transformer with Dynamically Guided Learning

arXiv

引用

arXiv 2023年

作者： Zhu, Yabin Li, Chenglong Wang, Xiao Tang, Jin Huang, Zhixiang Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Key Laboratory of Electromagnetic Environmental Sensing of Anhui Higher Education Institutes School of Electronic and Information Engineering Anhui University Hefei230601 China Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Artificial Intelligence Anhui University Hefei230601 China Information Materials and Intelligent Sensing Laboratory of Anhui Province Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Computer Science and Technology Anhui University Hefei230601 China

Existing Transformer-based RGBT tracking methods either use cross-attention to fuse the two modalities, or use self-attention and cross-attention to model both modality-specific and modality-sharing information. However, the significant appearance gap between modalities limits the feature representation ability of certain modalities during the fusion process. To address this problem, we propose a novel Progressive Fusion Transformer called ProFormer, which progressively integrates single-modality information into the multimodal representation for robust RGBT tracking. In particular, ProFormer first uses a self-attention module to collaboratively extract the multimodal representation, and then uses two cross-attention modules to interact it with the features of the dual modalities respectively. In this way, the modality-specific information can well be activated in the multimodal representation. Finally, a feed-forward network is used to fuse two interacted multimodal representations for the further enhancement of the final multimodal representation. In addition, existing learning methods of RGBT trackers either fuse multimodal features into one for final classification, or exploit the relationship between unimodal branches and fused branch through a competitive learning strategy. However, they either ignore the learning of single-modality branches or result in one branch failing to be well optimized. To solve these problems, we propose a dynamically guided learning algorithm that adaptively uses well-performing branches to guide the learning of other branches, for enhancing the representation ability of each branch. Extensive experiments demonstrate that our proposed ProFormer sets a new state-of-the-art performance on RGBT210, RGBT234, LasHeR, and VTUAV datasets. In particular, the improvements of ProFormer on the LasHeR dataset are up to +6.2%/+ 4.1% in PR/SR compared with existing best RGBT tracker. Copyright © 2023, The Authors. All rights reserved.

关键词： Learning algorithms

来源：评论

学校读者我要写书评

暂无评论

CRSOT: Cross-Resolution Object Tracking using Unaligned Frame and Event Cameras

arXiv

引用

arXiv 2024年

作者： Zhu, Yabin Wang, Xiao Li, Chenglong Jiang, Bo Zhu, Lin Huang, Zhixiang Tian, Yonghong Tang, Jin Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education Anhui University China School of Computer Science and Technology Anhui University China School of Artificial Intelligence Anhui University China Beijing Institute of Technology Beijing China School of Electronic and Information Engineering Anhui University China Peng Cheng Laboratory Shenzhen China School of Computer Science Peking University Beijing China School of Electronic and Computer Engineering Peking University Shenzhen China

Existing datasets for RGB-DVS tracking are collected with DVS346 camera and their resolution (346 × 260) is low for practical applications. Actually, only visible cameras are deployed in many practical systems, and the newly designed neuromorphic cameras may have different resolutions. The latest neuromorphic sensors can output high-definition event streams, but it is very difficult to achieve strict alignment between events and frames on both spatial and temporal views. Therefore, how to achieve accurate tracking with unaligned neuromorphic and visible sensors is a valuable but unresearched problem. In this work, we formally propose the task of object tracking using unaligned neuromorphic and visible cameras. We build the first unaligned frame-event dataset CRSOT collected with a specially built data acquisition system, which contains 1,030 high-definition RGB-Event video pairs, 304,974 video frames. In addition, we propose a novel unaligned object tracking framework that can realize robust tracking even using the loosely aligned RGB-Event data. Specifically, we extract the template and search regions of RGB and Event data and feed them into a unified ViT backbone for feature embedding. Then, we propose uncertainty perception modules to encode the RGB and Event features, respectively, then, we propose a modality uncertainty fusion module to aggregate the two modalities. These three branches are jointly optimized in the training phase. Extensive experiments demonstrate that our tracker can collaborate the dual modalities for high-performance track- Copyright © 2024, The Authors. All rights reserved.

关键词： Cameras

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：