检索结果-内蒙古大学图书馆

Challenge-Aware RGBT Tracking 1

学校读者我要写书评

暂无评论

16th European Conference on Computer Vision, ECCV 2020

作者： Li, Chenglong Liu, Lei Lu, Andong Ji, Qing Tang, Jin Key Lab of Intelligent Computing and Signal Processing of Ministry of Education Anhui Provincial Key Laboratory of Multimodal Cognitive Computation School of Computer Science and Technology Anhui University Hefei230601 China

ISBN: (数字)9783030585426

ISBN: (纸本)9783030585419

RGB and thermal source data suffer from both shared and specific challenges, and how to explore and exploit them plays a critical role to represent the target appearance in RGBT tracking. In this paper, we propose a novel challenge-aware neural network to handle the modality-shared challenges (e.g., fast motion, scale variation and occlusion) and the modality-specific ones (e.g., illumination variation and thermal crossover) for RGBT tracking. In particular, we design several parameter-shared branches in each layer to model the target appearance under the modality-shared challenges, and several parameter-independent branches under the modality-specific ones. Based on the observation that the modality-specific cues of different modalities usually contains the complementary advantages, we propose a guidance module to transfer discriminative features from one modality to another one, which could enhance the discriminative ability of some weak modality. Moreover, all branches are aggregated together in an adaptive manner and parallel embedded in the backbone network to efficiently form more discriminative target representations. These challenge-aware branches are able to model the target appearance under certain challenges so that the target representations can be learnt by a few parameters even in the situation of insufficient training data. From the experimental results we will show that our method operates at a real-time speed while performing well against the state-of-the-art methods on three benchmark datasets. © 2020, Springer Nature Switzerland AG.

关键词： Computers

MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhao, Haoyu Lu, Tianyi Gu, Jiaxi Zhang, Xing Zheng, Qingping Wu, Zuxuan Xu, Hang Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center on Intelligent Visual Computing China Huawei Noah's Ark Lab Hong Kong Zhejiang University China

The diffusion model is widely leveraged for either video generation or video editing. As each field has its task-specific problems, it is difficult to merely develop a single diffusion for completing both tasks simultaneously. Video diffusion sorely relying on the text prompt can be adapted to unify the two tasks. However, it lacks a high capability of aligning heterogeneous modalities between text and image, leading to various misalignment problems. In this work, we are the first to propose a unified Multi-alignment Diffusion, dubbed as MagDiff, for both tasks of high-fidelity video generation and editing. The proposed MagDiff introduces three types of alignments, including subject-driven alignment, adaptive prompts alignment, and high-fidelity alignment. Particularly, the subject-driven alignment is put forward to trade off the image and text prompts, serving as a unified foundation generative model for both tasks. The adaptive prompts alignment is introduced to emphasize different strengths of homogeneous and heterogeneous alignments by assigning different values of weights to the image and the text prompts. The high-fidelity alignment is developed to further enhance the fidelity of both video generation and editing by taking the subject image as an additional model input. Experimental results on four benchmarks suggest that our method outperforms the previous method on each task. Copyright © 2023, The Authors. All rights reserved.

关键词：

Fixation guided network for salient object detection 2

学校读者我要写书评

暂无评论

Fixation guided network for salient object detection

2nd ACM International Conference on Multimedia in Asia, MMAsia 2020

作者： Cui, Zhe Su, Li Zhang, Weigang Huang, Qingming University of Chinese Academy of Sciences China Harbin Institute of Technology Weihai China University of Chinese Academy of Sciences Key Lab of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences China

ISBN: (纸本)9781450383080

Convolutional neural network (CNN) based salient object detection (SOD) has achieved great development in recent years. However, in some challenging cases, i.e. small-scale salient object, low contrast salient object and cluttered background, existing salient object detect methods are still not satisfying. In order to accurately detect salient objects, SOD networks need to fix the position of most salient part. Fixation prediction (FP) focuses on the most visual attractive regions, so we think it could assist in locating salient objects. As far as we know, there are few methods jointly consider SOD and FP tasks. In this paper, we propose a fixation guided salient object detection network (FGNet) to leverage the correlation between SOD and FP. FGNet consists of two branches to deal with fixation prediction and salient object detection respectively. Further, an effective feature cooperation module (FCM) is proposed to fuse complementary information between the two branches. Extensive experiments on four popular datasets and comparisons with twelve state-of-the-art methods show that the proposed FGNet well captures the main context of images and locates salient objects more accurately. © 2021 ACM.

关键词： Computer vision

PromptFusion: Decoupling Stability and Plasticity for Continual Learning

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Chen, Haoran Wu, Zuxuan Han, Xintong Jia, Menglin Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China Huya Inc China Cornell Univeristy United States

Current research on continual learning mainly focuses on relieving catastrophic forgetting, and most of their success is at the cost of limiting the performance of newly incoming tasks. Such a trade-off is referred to as the stability-plasticity dilemma and is a more general and challenging problem for continual learning. However, the inherent conflict between these two concepts makes it seemingly impossible to devise a satisfactory solution to both of them simultaneously. Therefore, we ask, "is it possible to divide them into two separate problems to conquer them independently?". To this end, we propose a prompt-tuning-based method termed PromptFusion to enable the decoupling of stability and plasticity. Specifically, PromptFusion consists of a carefully designed Stabilizer module that deals with catastrophic forgetting and a Booster module to learn new knowledge concurrently. Furthermore, to address the computational overhead brought by the additional architecture, we propose PromptFusion-Lite which improves PromptFusion by dynamically determining whether to activate both modules for each input image. Extensive experiments show that both PromptFusion and PromptFusion-Lite achieve promising results on popular continual learning datasets for class-incremental and domain-incremental settings. Especially on Split-Imagenet-R, one of the most challenging datasets for class-incremental learning, our method can exceed state-of-the-art prompt-based methods by more than 5% in accuracy, with PromptFusion-Lite using 14.8% less computational resources than PromptFusion. Code is available at https://***/HaoranChen/PromptFusion. © 2023, CC BY.

关键词： Contrastive Learning

DiffusionAD: Norm-guided One-step Denoising Diffusion for Anomaly Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Hui Wang, Zheng Wu, Zuxuan Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China School of Computer Science Zhejiang University of Technology China

Anomaly detection has garnered extensive applications in real industrial manufacturing due to its remarkable effectiveness and efficiency. However, previous generative-based models have been limited by suboptimal reconstruction quality, hampering their overall performance. We introduce DiffusionAD, a novel anomaly detection pipeline comprising a reconstruction sub-network and a segmentation sub-network. A fundamental enhancement lies in our reformulation of the reconstruction process using a diffusion model into a noise-to-norm paradigm. Here, anomalous regions are perturbed with Gaussian noise and reconstructed as normal, overcoming the limitations of previous models by facilitating anomaly-free restoration. Additionally, we propose a rapid one-step denoising paradigm, significantly faster than the traditional iterative denoising in diffusion models. Furthermore, the introduction of the norm-guided paradigm elevates the accuracy and fidelity of reconstructions. The segmentation sub-network predicts pixel-level anomaly scores using the input image and its anomaly-free restoration. Comprehensive evaluations on four standard and challenging benchmarks reveal that DiffusionAD outperforms current state-of-the-art approaches, demonstrating the effectiveness and broad applicability of the proposed pipeline. Copyright © 2023, The Authors. All rights reserved.

关键词： Anomaly detection

SegIC: Unleashing the Emergent Correspondence for In-Context Segmentation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Meng, Lingchen Lan, Shiyi Li, Hengduo Alvarez, Jose M. Wu, Zuxuan Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China NVIDIA United States University of Maryland United States

In-context segmentation aims at segmenting novel images using a few labeled example images, termed as "in-context examples", exploring content similarities between examples and the target. The resulting models can be generalized seamlessly to novel segmentation tasks, significantly reducing the labeling and training costs compared with conventional pipelines. However, in-context segmentation is more challenging than classic ones requiring the model to learn segmentation rules conditioned on a few samples. Unlike previous work with ad-hoc or non-end-to-end designs, we propose SegIC, an end-to-end segment-in-context framework built upon a single vision foundation model (VFM). In particular, SegIC leverages the emergent correspondence within VFM to capture dense relationships between target images and in-context samples. As such, information from in-context samples is then extracted into three types of instructions, i.e. geometric, visual, and meta instructions, serving as explicit conditions for the final mask prediction. SegIC is a straightforward yet effective approach that yields state-of-the-art performance on one-shot segmentation benchmarks. Notably, SegIC can be easily generalized to diverse tasks, including video object segmentation and open-vocabulary segmentation. Code will be available at https://***/MengLcool/SEGIC. Copyright © 2023, The Authors. All rights reserved.

关键词： Image segmentation

VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognition 27

学校读者我要写书评

暂无评论

VANER: Leveraging Large Language Model for Versatile and Ada...

27th European Conference on Artificial Intelligence, ECAI 2024

作者： Bian, Junyi Zhai, Weiqi Huang, Xiaodi Zheng, Jiaxuan Zhu, Shanfeng School of Computer Science Fudan University Shanghai200433 China Institute of Science and Technology for Brain-Inspired Intelligence Fudan University China Ministry of Education Shanghai200433 China MOE Frontiers Center for Brain Science Fudan University Shanghai200433 China Zhangjiang Fudan International Innovation Center Shanghai200433 China Shanghai Key Lab of Intelligent Information Processing Fudan University Shanghai200433 China School of Computing and Mathematics Charles Sturt University AlburyNSW2640 Australia

ISBN: (纸本)9781643685489

The prevalent solution for BioNER involves using representation learning techniques combined with sequence ***, such methods are inherently task-specific, demonstrate poor generalizability, and often require a dedicated model for each *** leverage the versatile capabilities of recent large language models (LLMs), several approaches have explored generative techniques for entity ***, these approaches often fall short compared to previous sequence labeling *** this paper, we utilize the open-sourced LLM LLaMA2 as the backbone model, and design specific instructions to distinguish between different types of entities and *** combining the LLM's understanding of instructions with sequence labeling techniques, we train a model using a mix of datasets capable of extracting various types of *** that the backbone LLMs lacks specialized medical knowledge, we also integrate external entity knowledge bases and employ instruction tuning to enable the model to densely recognize curated *** parameter-efficient training model, VANER, significantly outperforms previous LLMs-based *** the first time, as an LLM-based model, VANER surpasses the majority of conventional state-of-the-art BioNER systems, achieving the highest F1 scores across three datasets. © 2024 The Authors.

关键词： labeled data

Triorthogonal Codes and Self-dual Codes

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Shi, Minjia Lu, Haodong Kim, Jon-Lark Solé, Patrick The Key Laboratory of Intelligent Computing Signal Processing Ministry of Education School of Mathematical Sciences Anhui University Hefei230601 China State Key Laboratory of Integrated Service Networks Xidian University Xi’an710071 China Department of Mathematics Sogang University Seoul Korea Republic of Aix Marseille Univ CNRS Centrale Marseille I2M Marseille France

Triorthogonal matrices were introduced in Quantum Information Theory in connection with distillation of magic states (Bravyi and Haah (2012)). We give an algorithm to construct binary triorthogonal matrices from binary self-dual codes. Further, we generalize to this setting the classical coding techniques of shortening and extending. We also give some simple propagation *** Codes 94B05 © 2024, CC BY.

关键词： Matrix algebra

intelligent ultrasonic distance measurer system with temperature compensation algorithm

学校读者我要写书评

暂无评论

Intelligent ultrasonic distance measurer system with tempera...

2022 International Applied Computational Electromagnetics Society Symposium, ACES-China 2022

作者： Wu, Yuwen Yang, Qiang Tang, Kai Zou, Jianhang Zhuo, Jianming Feng, Naixing Cai, Yijun Xiamen University of Technology Smart Sensing Integrated Circuit Engineering Research Center of Universities in Fujian Province Xiamen361024 China Xiamen Wish Information Technology Co. Ltd Xiamen361006 China Xiamen Blue Ocean Technology Co. Ltd Xiamen361022 China Anhui University Key Laboratory of Intelligent Computing & Signal Processing Ministry of Education Hefei China

ISBN: (纸本)9781665452366

With regard to distance measurement in daily life, the traditional way is to measure the distance between objects through rulers. Nowadays, ultrasonic ranging, laser ranging, radar ranging, sonar ranging and other technologies have enriched the way of distance measurement. At the same time, it is possible to choose a suitable solution according to different actual environments. This paper design an intelligent ultrasonic ranging system through the research of ultrasonic characteristics and the application of existing ultrasonic ranging. The paper introduces the design ideas and process of the intelligent ultrasonic ranging system. Through the design of independent buttons, the normal mode ranging and the high-precision mode ranging are generated to achieve the division of the measurement range and accuracy. When the distance between the measured object and the intelligent ultrasonic ranging system is less than the preset value or exceeds the range of this mode, the buzzer will sound an alarm, so that the system can be used in more fields. The system detects the current ambient temperature in real time, so that the distance measurement can be compensated and modified by the temperature compensation algorithm in the system to achieve self-adaptation and reduce measurement errors. © 2022 IEEE.

关键词： Range finding