检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Wang, Haoran Mai, Xinji Tao, Zeng Tong, Xuan Lin, Junxiong Wang, Yan Yu, Jiawen Wang, Boyang Yan, Shaoqi Zhao, Qing Zhou, Ziheng Gao, Shuyong Zhang, Wenqiang Shanghai Engineering Research Center of AI & Robotics Academy for Engineering & Technology Fudan University Shanghai China School of Information Science and Technology Fudan University Shanghai China Fudan University Shanghai China Engineering Research Center of AI & Robotics Ministry of Education Academy for Engineering & Technology Fudan University Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai China

The contemporary state-of-the-art of Dynamic Facial Expression Recognition (DFER) technology facilitates remarkable progress by deriving emotional mappings of facial expressions from video content, underpinned by training on voluminous datasets. Yet, the DFER datasets encompass a substantial volume of noise data. Noise arises from low-quality captures that defy logical labeling, and instances that suffer from mislabeling due to annotation bias, engendering two principal types of uncertainty: the uncertainty regarding data usability and the uncertainty concerning label reliability. Addressing the two types of uncertainty, we have meticulously crafted a two-stage framework aiming at Seeking Certain data In extensive Uncertain data (SCIU). This initiative aims to purge the DFER datasets of these uncertainties, thereby ensuring that only clean, verified data is employed in training processes. To mitigate the issue of low-quality samples, we introduce the Coarse-Grained Pruning (CGP) stage, which assesses sample weights and prunes those deemed unusable due to their low weight. For samples with incorrect annotations, the Fine-Grained Correction (FGC) stage evaluates prediction stability to rectify mislabeled data. Moreover, SCIU is conceived as a universally compatible, plug-and-play framework, tailored to integrate seamlessly with prevailing DFER methodologies. Rigorous experiments across prevalent DFER datasets and against numerous benchmark methods substantiates SCIU’s capacity to markedly elevate performance metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

The minority matters: a diversity-promoting collaborative metric learning algorithm 22

The minority matters: a diversity-promoting collaborative me...

引用

Proceedings of the 36th International Conference on Neural information processing Systems

作者： Shilong Bao Qianqian Xu Zhiyong Yang Yuan He Xiaochun Cao Qingming Huang State Key Laboratory of Information Security Institute of Information Engineering CAS and School of Cyber Security University of Chinese Academy of Sciences Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS School of Computer Science and Tech. University of Chinese Academy of Sciences Alibaba Group School of Cyber Science and Technology Shenzhen Campus Sun Yat-sen University Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS and School of Computer Science and Tech. University of Chinese Academy of Sciences and Key Laboratory of Big Data Mining and Knowledge Management CAS and Peng Cheng Laboratory

ISBN: (纸本)9781713871088

Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and Collaborative Filtering. Following the convention of RS, existing methods exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting, we argue that the unique user representation might induce preference bias, especially when the item category distribution is imbalanced. To address this issue, we propose a novel method called Diversity-Promoting Collaborative Metric Learning (DPCML), with the hope of considering the commonly ignored minority interest of the user. The key idea behind DPCML is to include a multiple set of representations for each user in the system. Based on this embedding paradigm, user preference toward an item is aggregated from different embeddings by taking the minimum item-user distance among the user embedding set. Furthermore, we observe that the diversity of the embeddings for the same user also plays an essential role in the model. To this end, we propose a Diversity Control Regularization Scheme (DCRS) to accommodate the multi-vector representation strategy better. Theoretically, we show that DPCML could generalize well to unseen test data by tackling the challenge of the annoying operation that comes from the minimum value. Experiments over a range of benchmark datasets speak to the efficacy of DPCML.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Two-photon imaging of rabbit mammary tissue with 3D reconstruction

引用

Optik 2024年 309卷

作者： Liu, Meng Hou, Guozhong Li, Yuan Deng, Yanyan Zhang, Yuan Wang, Xiaofeng Xu, Chang Song, Kaiyuan Liu, Xinlong Xia, Yuanqin Zhang, Yong Hebei University of Technology Hebei Key Laboratory of Advanced Laser Technology and Equipment School of Science Tianjin300401 China Research Center for Humanoid Sensing Research Institute of Intelligent Sensing Zhejiang Lab Hangzhou311100 China Cangzhou Normal University School of Physics and Information Engineering Cangzhou061001 China Technical Institute of Physics and Chemistry Chinese Academy of Sciences Beijing100190 China

A broadband two-photon fluorescence (TPF) imaging system, based on a femtosecond oscillator, has been constructed. This system enables TPF imaging of rabbit mammary gland tissue samples by detecting TPF signals generated from the tissue upon excitation by broadband femtosecond pulses. Specifically, TPF imaging utilizes a detection window of 565–615 nm to capture TPF signals from the fluorescent adenine dinucleotide (FAD) present in lactating cells within breast tissue. Moreover, the 3D reconstruction algorithm has been optimized to visualize the 3D structure of the rabbit mammary gland acinar *** optimized three-dimensional reconstruction algorithm can reduce ambiguous signal regions, making the reconstructed three-dimensional structure more reliable and accurate. This is of significant importance for studying the microscopic structure and cell distribution of breast tissue, contributing to a deeper understanding of the tissue's physiological status. © 2024 Elsevier GmbH

关键词： Tissue

来源：评论

学校读者我要写书评

暂无评论

Text recognition in real scenarios with a few labeled samples 25

Text recognition in real scenarios with a few labeled sample...

引用

25th International Conference on Pattern Recognition, ICPR 2020

作者： Lin, Jinghuang Cheng, Zhanzhan Bai, Fan Niu, Yi Pu, Shiliang Zhou, Shuigeng Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai200433 China Hikvision Research Institute China

ISBN: (纸本)9781728188089

Scene text recognition (STR) is still a hot research topic in computer vision field due to its various applications. Existing works mainly focus on learning a general model with a huge number of synthetic text images to recognize unconstrained scene texts, and have achieved substantial progress. However, these methods are not quite applicable in many real-world scenarios where 1) high recognition accuracy is required, while 2) labeled samples are lacked. To tackle this challenging problem, this paper proposes a few-shot adversarial sequence domain adaptation (FASDA) approach to build sequence adaptation between the synthetic source domain (with many synthetic labeled samples) and a specific target domain (with only some or a few real labeled samples). This is done by simultaneously learning each character's feature representation with an attention mechanism and establishing the corresponding character-level latent subspace with adversarial learning. Our approach can maximize the character-level confusion between the source domain and the target domain, thus achieves the sequence-level adaptation with even a small number of labeled samples in the target domain. Extensive experiments on various datasets show that our method significantly outperforms the finetuning scheme, and obtains comparable performance to the state-of-the-art STR methods. © 2020 IEEE

关键词： Computer vision

来源：评论

学校读者我要写书评

暂无评论

MVC-VPR: Mutual Learning of Viewpoint Classification and Visual Place Recognition

arXiv

引用

arXiv 2024年

作者： Gu, Qiwen Wang, Xufei Zhang, Fenglin Zhao, Junqiao Tao, Siyue Ye, Chen Feng, Tiantian Jiang, Changjun Department of Computer Science and Technology School of Electronics and Information Engineering Tongji University Shanghai China The Shanghai Research Institute for Intelligent Autonomous System Tongji University Shanghai China The MOE Key Lab of Embedded System and Service Computing Tongji University Shanghai China School of Surveying and Geo-Informatics Tongji University Shanghai China

Visual Place Recognition (VPR) aims to robustly identify locations by leveraging image retrieval based on descriptors encoded from environmental images. However, drastic appearance changes of images captured from different viewpoints at the same location pose incoherent supervision signals for descriptor learning, which severely hinder the performance of VPR. Previous work proposes classifying images based on manually defined rules or ground truth labels for viewpoints, followed by descriptor training based on the classification results. However, not all datasets have ground truth labels of viewpoints and manually defined rules may be suboptimal, leading to degraded descriptor performance. To address these challenges, we introduce the mutual learning of viewpoint self-classification and VPR. Starting from coarse classification based on geographical coordinates, we progress to finer classification of viewpoints using simple clustering techniques. The dataset is partitioned in an unsupervised manner while simultaneously training a descriptor extractor for place recognition. Experimental results show that this approach almost perfectly partitions the dataset based on viewpoints, thus achieving mutually reinforcing effects. Our method even excels state-of-the-art (SOTA) methods that partition datasets using ground truth labels. Copyright © 2024, The Authors. All rights reserved.

关键词： Self-supervised learning

来源：评论

学校读者我要写书评

暂无评论

Blockchain-Based Homomorphic Transaction Framework for Enhanced Consumer Security and Business Scalability

引用

IEEE Transactions on Consumer Electronics 2024年

作者： Guo, Tao Shang, Fengjun Dai, Xiangguang Liu, Qilie Chongqing University of Posts and Telecommunications School of Computer Science and Technology Chongqing400065 China Key Laboratory of Big Data Intelligent Computing Chongqing400065 China Chongqing Three Gorges University Key Lab. of Intelligent Info. Proc. and Contr. of Chongqing Munic. Institutions of Higher Education Chongqing Engineering Research Center of Internet of Things and Intelligent Control Technology School of Three Gorges Artificial Intelligence Chongqing400044 China Chongqing University of Posts and Telecommunications School of Communications and Information Engineering Chongqing400065 China

Energy trading in distributed microgrids represents an effective means of enhancing the utilization of renewable energy. However, the aggregation of large-scale consumption data may encounter business scalability issues and potential privacy exposure concerns, necessitating the development of novel secure and scalable frameworks for integrating consumption demands between prosumer and microgrid entities. we research focuses on providing a user-friendly transaction model for consumers and microgrid operators. Firstly, a privacy aggregation scheme for user resource requests is designed to ensure the security and decentralization of user data. In addition, the model employs a bidirectional heterogeneous resource allocation mechanism to support the optimal allocation of multiple resources, such as renewable energy, power assets, energy storage devices, and carbon credits, among different microgrids. Finally, a microgrid transaction prototype has been constructed on the Truffle development framework. In this context, smart contracts has been designed to ensure that the transactions are carried out automatically. Experimental results indicate that the scheme provides enhanced security for multi-resource trading in a cluster context relative to existing methodologies. The number of transactions increases linearly with the resource overhead, resulting in more efficient utilization of energy trading. Furthermore, the framework's scalability has been demonstrated through both temporal and spatial considerations. © 1975-2011 IEEE.

关键词： Decentralized finance

来源：评论

学校读者我要写书评

暂无评论

OmniVL: One Foundation Model for Image-Language and Video-Language Tasks

arXiv

引用

arXiv 2022年

作者： Wang, Junke Chen, Dongdong Wu, Zuxuan Luo, Chong Zhou, Luowei Zhao, Yucheng Xie, Yujia Liu, Ce Jiang, Yu-Gang Yuan, Lu Shanghai Key Lab of Intell. Info. Processing School of Cs Fudan University China Shanghai Collaborative Innovation Center on Intelligent Visual Computing China Microsoft Cloud + Ai Microsoft Research Asia China

This paper presents OmniVL, a new foundation model to support both image-language and video-language tasks using one universal architecture. It adopts a unified transformer-based visual encoder for both image and video inputs, and thus can perform joint image-language and video-language pretraining. We demonstrate, for the first time, such a paradigm benefits both image and video tasks, as opposed to the conventional one-directional transfer (e.g., use image-language to help video-language). To this end, we propose a decoupled joint pretraining of image-language and video-language to effectively decompose the vision-language modeling into spatial and temporal dimensions and obtain performance boost on both image and video tasks. Moreover, we introduce a novel unified vision-language contrastive (UniVLC) loss to leverage image-text, video-text, image-label (e.g., image classification), video-label (e.g., video action recognition) data together, so that both supervised and noisily supervised pretraining data are utilized as much as possible. Without incurring extra task-specific adaptors, OmniVL can simultaneously support visual only tasks (e.g., image classification, video action recognition), cross-modal alignment tasks (e.g., image/video-text retrieval), and multi-modal understanding and generation tasks (e.g., image/video question answering, captioning). We evaluate OmniVL on a wide range of downstream tasks and achieve state-of-the-art or competitive results with similar model size and data scale. Copyright © 2022, The Authors. All rights reserved.

关键词： Image classification

来源：评论

学校读者我要写书评

暂无评论

OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning

arXiv

引用

arXiv 2024年

作者： Hong, Lingyi Yan, Shilin Zhang, Renrui Li, Wanyun Zhou, Xinyu Guo, Pinxue Jiang, Kaixun Chen, Yiting Li, Jinglun Chen, Zhaoyu Zhang, Wenqiang Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University Shanghai China The Chinese University of Hong Kong Hong Kong Shanghai Engineering Research Center of AI & Robotics Academy for Engineering & Technology Fudan University Shanghai China Engineering Research Center of AI & Robotics Ministry of Education Academy for Engineering & Technology Fudan University Shanghai China

Visual object tracking aims to localize the target object of each frame based on its initial appearance in the first frame. Depending on the input modility, tracking tasks can be divided into RGB tracking and RGB+X (e.g. RGB+N, and RGB+D) tracking. Despite the different input modalities, the core aspect of tracking is the temporal matching. Based on this common ground, we present a general framework to unify various tracking tasks, termed as OneTracker. OneTracker first performs a large-scale pre-training on a RGB tracker called Foundation Tracker. This pretraining phase equips the Foundation Tracker with a stable ability to estimate the location of the target object. Then we regard other modality information as prompt and build Prompt Tracker upon Foundation Tracker. Through freezing the Foundation Tracker and only adjusting some additional trainable parameters, Prompt Tracker inhibits the strong localization ability from Foundation Tracker and achieves parameter-efficient finetuning on downstream RGB+X tracking tasks. To evaluate the effectiveness of our general framework OneTracker, which is consisted of Foundation Tracker and Prompt Tracker, we conduct extensive experiments on 6 popular tracking tasks across 11 benchmarks and our OneTracker outperforms other models and achieves state-ofthe-art performance. Copyright © 2024, The Authors. All rights reserved.

关键词： Foundations

来源：评论

学校读者我要写书评

暂无评论

Look Before You Match: Instance Understanding Matters in Video Object Segmentation

arXiv

引用

arXiv 2022年

作者： Wang, Junke Chen, Dongdong Wu, Zuxuan Luo, Chong Tang, Chuanxin Dai, Xiyang Zhao, Yucheng Xie, Yujia Yuan, Lu Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center on Intelligent Visual Computing China Microsoft Cloud + AI Microsoft Research Asia China

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of instance understanding ability, the above approaches are oftentimes brittle to large appearance variations or viewpoint changes resulted from the movement of objects and cameras. In this paper, we argue that instance understanding matters in VOS, and integrating it with memory-based matching can enjoy the synergy, which is intuitively sensible from the definition of VOS task, i.e., identifying and segmenting object instances within the video. Towards this goal, we present a two-branch network for VOS, where the query-based instance segmentation (IS) branch delves into the instance details of the current frame and the VOS branch performs spatial-temporal matching with the memory bank. We employ the well-learned object queries from IS branch to inject instance-specific information into the query key, with which the instance-augmented matching is further performed. In addition, we introduce a multi-path fusion block to effectively combine the memory readout with multi-scale features from the instance segmentation decoder, which incorporates high-resolution instance-aware features to produce final segmentation results. Our method achieves state-of-the-art performance on DAVIS 2016/2017 val (92.6% and 87.1%), DAVIS 2017 test-dev (82.8%), and YouTube-VOS 2018/2019 val (86.3% and 86.3%), outperforming alternative methods by clear margins. Copyright © 2022, The Authors. All rights reserved.

关键词： Motion compensation

来源：评论

学校读者我要写书评

暂无评论

Revisiting Adversarial Robustness Distillation: Robust Soft labels Make Student Better

Revisiting Adversarial Robustness Distillation: Robust Soft ...

引用

International Conference on Computer Vision (ICCV)

作者： Bojia Zi Shihao Zhao Xingjun Ma Yu-Gang Jiang Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan Univeristy Shanghai Collaborative Innovation Center on Intelligent Visual Computing School of Information Technology Deakin University Geelong Australia

ISBN: (纸本)9781665428132

Adversarial training is one effective approach for training robust deep neural networks against adversarial attacks. While being able to bring reliable robustness, adversarial training (AT) methods in general favor high capacity models, i.e., the larger the model the better the robustness. This tends to limit their effectiveness on small models, which are more preferable in scenarios where storage or computing resources are very limited (e.g., mobile devices). In this paper, we leverage the concept of knowledge distillation to improve the robustness of small models by distilling from adversarially trained large models. We first revisit several state-of-the-art AT methods from a distillation perspective and identify one common technique that can lead to improved robustness: the use of robust soft labels – predictions of a robust model. Following this observation, we propose a novel adversarial robustness distillation method called Robust Soft label Adversarial Distillation (RSLAD) to train robust small student models. RSLAD fully exploits the robust soft labels produced by a robust (adversarially-trained) large teacher model to guide the student’s learning on both natural and adversarial examples in all loss terms. We empirically demonstrate the effectiveness of our RSLAD approach over existing adversarial training and distillation methods in improving the robustness of small models against state-of-the-art attacks including the AutoAttack. We also provide a set of understandings on our RSLAD and the importance of robust soft labels for adversarial robustness distillation. Code: https://***/zibojia/RSLAD.

关键词： Training Deep learning Computer vision Codes Computational modeling Neural networks Predictive models

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：