检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Liu, Guoshan Yin, Hailong Zhu, Bin Chen, Jingjing Ngo, Chong-Wah Jiang, Yu-Gang Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan University China Shanghai Collaborative Innovation Center on Intelligent Visual Computing China Singapore Management University Singapore

The growing interest in generating recipes from food images has drawn substantial research attention in recent years. Existing works for recipe generation primarily utilize a two-stage training method—first predicting ingredients from a food image and then generating instructions from both the image and ingredients. Large Multi-modal Models (LMMs), which have achieved notable success across a variety of vision and language tasks, shed light on generating both ingredients and instructions directly from images. Nevertheless, LMMs still face the common issue of hallucinations during recipe generation, leading to suboptimal performance. To tackle this issue, we propose a retrieval augmented large multimodal model for recipe generation. We first introduce Stochastic Diversified Retrieval Augmentation (SDRA) to retrieve recipes semantically related to the image from an existing datastore as a supplement, integrating them into the prompt to add diverse and rich context to the input image. Additionally, Self-Consistency Ensemble Voting mechanism is proposed to determine the most confident prediction recipes as the final output. It calculates the consistency among generated recipe candidates, which use different retrieval recipes as context for generation. Extensive experiments validate the effectiveness of our proposed method, which demonstrates state-of-the-art (SOTA) performance in recipe generation on the Recipe1M dataset. © 2024, CC BY-NC-ND.

关键词： Food ingredients

来源：评论

学校读者我要写书评

暂无评论

SSFam: Scribble Supervised Salient Object Detection Family

arXiv

引用

arXiv 2024年

作者： Liu, Zhengyi Deng, Sheng Wang, Xinrui Wang, Linbo Fang, Xianyong Tang, Bin Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Computer Science and Technology Anhui University Hefei China School of Artificial Intelligence and Big Data Hefei University Hefei China

Scribble supervised salient object detection (SSSOD) constructs segmentation ability of attractive objects from surroundings under the supervision of sparse scribble labels. For the better segmentation, depth and thermal infrared modalities serve as the supplement to RGB images in the complex scenes. Existing methods specifically design various feature extraction and multi-modal fusion strategies for RGB, RGB-Depth, RGB-Thermal, and Visual-Depth-Thermal image input respectively, leading to similar model flood. As the recently proposed Segment Anything Model (SAM) possesses extraordinary segmentation and prompt interactive capability, we propose an SSSOD family based on SAM, named SSFam, for the combination input with different modalities. Firstly, different modal-aware modulators are designed to attain modal-specific knowledge which cooperates with modal-agnostic information extracted from the frozen SAM encoder for the better feature ensemble. Secondly, a siamese decoder is tailored to bridge the gap between the training with scribble prompt and the testing with no prompt for the stronger decoding ability. Our model demonstrates the remarkable performance among combinations of different modalities and refreshes the highest level of scribble supervised methods and comes close to the ones of fully supervised methods. https://***/liuzywen/SSFam Copyright © 2024, The Authors. All rights reserved.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

Talents Training in Antenna Engineering 5

Talents Training in Antenna Engineering

引用

5th IEEE International Conference on Electronic Information and Communication Technology, ICEICT 2022

作者： Li, Yingsong Huang, Zhixiang Jiang, Tao Li, Yibing Ye, Fang Chung, Kwok L. College of Information and Communication Engineering Harbin Engineering University Harbin15001 China Anhui University Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education China School of Computer Science and Engineering Huizhou University Huizhou516007 China

ISBN: (数字)9781665472111

ISBN: (纸本)9781665472111

We propose the antenna developments from nature to engineering, which is a natural method to train student for designing antenna. Also, the interest of the students can be stimulated. Using this method, the students can get how to design antennas and will be interested on the antenna engineering. Then, young talents can be brought up. By using this strategy, a nature Logo is introduced and cooperated with the proposed talent training method to get new antennas. Also, the results for the developed antenna is also simulated and analyzed based on the theory from the text book. In the future, the proposed talents training techniques or method can also be expanded to other different research directions. © 2022 IEEE.

关键词： Antennas

来源：评论

学校读者我要写书评

暂无评论

Teaching Chinese sign language with a smartphone

引用

Virtual Reality & intelligent Hardware 2021年第3期3卷 248-260页

作者： Yanxiao ZHANG Yuecong MIN Xilin CHEN Key Lab of Intelligent Information Processing of Chinese Academy of Sciences(CAS) Institute of Computing TechnologyCASBeijing 100190China University of Chinese Academy of Sciences Beijing 100049China

Background There is a large group of deaf-mutes worldwide, and sign language is a major communication tool in this community. It is necessary for deaf-mutes to be able to communicate with others who are capable of hearing, and hearing people also need to understand sign language, which produces a great demand for sign language tuition. Even though there have already been a large number of books written about sign language, it is inefficient to learn sign language through reading alone, and the same can be said on watching videos. To solve this problem, we developed a smartphone-based interactive Chinese sign language teaching system that facilitates sign language learning. Methods The system provides a learner with some learning modes and captures the learner's actions using the front camera of the smartphone. At present, the system provides a vocabulary set with 1000 frequently used words, and the learner can evaluate his/her sign action by subjective or objective comparison. In the mode of word recognition, the users can play any word within the vocabulary, and the system will return the top three retrieved candidates;thus, it can remind the learners what the sign is. Results This system provides interactive learning to enable a user to efficiently learn sign language. The system adopts an algorithm based on point cloud recognition to evaluate a user's sign and costs about 700ms of inference time for each sample, which meets the real-time requirements. Conclusion This interactive learning system decreases the communication barriers between deaf-mutes and hearing people.

关键词： Computer assisted learning Sign language evaluation Smartphone platform

来源：评论

学校读者我要写书评

暂无评论

Self-Training with Contrastive Learning for Adversarial Domain Adaptation

Self-Training with Contrastive Learning for Adversarial Doma...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Shanshan Wang Minbin Hu Xingyi Zhang Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education Institutes of Physical Science and Information Technology Anhui University Hefei China School of Computer Science and Technology Anhui University Hefei China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Unsupervised domain adaptation (UDA) aims to transfer the knowledge learned from the labeled source domain to the unlabeled target domain. Traditional methods often focus on minimizing the distribution gap between feature spaces of the two domains to achieve domain-invariant representations. However, this approach may not fully leverage the inherent class-specific information and could adversely affect decision boundaries in the target domain. In this paper, we introduce an adversarial contrastive self-training framework. The model integrates both intra-class and inter-class domain differences for better alignment between the source and target domains. Initially, we augment target domain samples using Fourier transformations, obtaining reliable samples and pseudo-labels through self-training. We then employ intra-domain contrastive learning on the reliable samples and pseudo-labels, alongside labeled source domain samples, to achieve intra-domain compactness. Finally, we utilize adversarial learning to achieve global alignment. This comprehensive approach ensures improved adaptation performance while also addressing the limitations of previous methods.

关键词： Adaptation models Neural networks Contrastive learning Adversarial machine learning Reliability

来源：评论

学校读者我要写书评

暂无评论

General Sparse Normalization and Proportionate ASE Algorithms 5

General Sparse Normalization and Proportionate ASE Algorithm...

引用

5th IEEE International Conference on Electronic Information and Communication Technology, ICEICT 2022

作者： Hadi, Abdul Peng, Yan Qadir, Abdul Li, Yingsong Khan, Khushal College of Information and Communication Engineering Harbin Engineering University Harbin China Anhui Province Key Laboratory of Target Recognition and Feature Extraction LuAn230088 China Anhui University Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education China College of Intelligent System and Control Science Engineering Harbin Engineering University China

ISBN: (数字)9781665472111

ISBN: (纸本)9781665472111

Andrew's Sine Estimator (ASE) has recently been used to invent adaptive filtering, which can combat more kind of noises than conventional estimators. Inspired by the LMS and its sparse forms, normalization and proportionate ASE algorithms with Lawson constraints are constructed with the respective given names of Lawson normalization ASE (LNASE) and Lawson proportionate NASE (LPNASE). Simulations are performed to analyze the performance of these algorithms under impulsive noise. © 2022 IEEE.

关键词： Impulse noise

来源：评论

学校读者我要写书评

暂无评论

MEFFGRN: Matrix enhancement and feature fusion-based method for reconstructing the gene regulatory network of epithelioma papulosum cyprini cells by spring viremia of carp virus infection

引用

Computers in Biology and Medicine 2024年 179卷 108835-108835页

作者： Wei, Pi-Jing Bao, Jin-Jin Gao, Zhen Tan, Jing-Yun Cao, Rui-Fen Su, Yansen Zheng, Chun-Hou Deng, Li Key Laboratory of Intelligent Computing & Signal Processing of Ministry of Education Institutes of Physical Science and Information Technology Anhui University 111 Jiulong Road HefeiAnhui230601 China Key Laboratory of Intelligent Computing & Signal Processing of Ministry of Education School of Computer Science and Technology Anhui University 111 Jiulong Road HefeiAnhui230601 China Shenzhen Key Laboratory of Microbial Genetic Engineering College of Life Sciences and Oceanology Shenzhen University Guangdong Shenzhen518055 China School of Artificial Intelligence Anhui University 111 Jiulong Road HefeiAnhui230601 China

Gene regulatory networks (GRNs) are crucial for understanding organismal molecular mechanisms and processes. Construction of GRN in the epithelioma papulosum cyprini (EPC) cells of cyprinid fish by spring viremia of carp virus (SVCV) infection helps understand the immune regulatory mechanisms that enhance the survival capabilities of cyprinid fish. Although many computational methods have been used to infer GRNs, specialized approaches for predicting the GRN of EPC cells following SVCV infection are lacking. In addition, most existing methods focus primarily on gene expression features, neglecting the valuable network structural information in known GRNs. In this study, we propose a novel supervised deep neural network, named MEFFGRN (Matrix Enhancement- and Feature Fusion-based method for Gene Regulatory Network inference), to accurately predict the GRN of EPC cells following SVCV infection. MEFFGRN considers both gene expression data and network structure information of known GRN and introduces a matrix enhancement method to address the sparsity issue of known GRN, extracting richer network structure information. To optimize the benefits of CNN (Convolutional Neural Network) in image processing, gene expression and enhanced GRN data were transformed into histogram images for each gene pair respectively. Subsequently, these histograms were separately fed into CNNs for training to obtain the corresponding gene expression and network structural features. Furthermore, a feature fusion mechanism was introduced to comprehensively integrate the gene expression and network structural features. This integration considers the specificity of each feature and their interactive information, resulting in a more comprehensive and precise feature representation during the fusion process. Experimental results from both real-world and benchmark datasets demonstrate that MEFFGRN achieves competitive performance compared with state-of-the-art computational methods. Furthermore, study

关键词： Gene expression

来源：评论

学校读者我要写书评

暂无评论

Attacking Voice Anonymization Systems with Augmented Feature and Speaker Identity Difference

arXiv

引用

arXiv 2024年

作者： Zhang, Yanzhe Bi, Zhonghao Xiao, Feiyang Yang, Xuefeng Zhu, Qiaoxi Guan, Jian Group of Intelligent Signal Processing College of Computer Science and Technology Harbin Engineering University China Faculty of Computing Harbin Institute of Technology China Acoustics Lab University of Technology Sydney Australia

This study focuses on the First VoicePrivacy Attacker Challenge within the ICASSP 2025 signal processing Grand Challenge, which aims to develop speaker verification systems capable of determining whether two anonymized speech signals are from the same speaker. However, differences between feature distributions of original and anonymized speech complicate this task. To address this challenge, we propose an attacker system that combines Data Augmentation enhanced feature representation and Speaker Identity Difference enhanced classifier to improve verification performance, termed DA-SID. Specifically, data augmentation strategies (i.e., data fusion and SpecAugment) are utilized to mitigate feature distribution gaps, while probabilistic linear discriminant analysis (PLDA) is employed to further enhance speaker identity difference. Our system significantly outperforms the baseline, demonstrating exceptional effectiveness and robustness against various voice anonymization systems, ultimately securing a top-5 ranking in the challenge. Copyright © 2024, The Authors. All rights reserved.

关键词： Anonymity

来源：评论

学校读者我要写书评

暂无评论

BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection

BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detecti...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Zhenxin Li Shiyi Lan Jose M. Alvarez Zuxuan Wu Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University Shanghai Collaborative Innovation Center of Intelligent Visual Computing NVIDIA

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Recently, the rise of query-based Transformer decoders is reshaping camera-based 3D object detection. These query-based decoders are surpassing the traditional dense BEV (Bird's Eye View)-based methods. However, we argue that dense BEV frameworks remain important due to their out-standing abilities in depth estimation and object localization, depicting 3D scenes accurately and comprehensively. This paper aims to address the drawbacks of the existing dense BEV-based 3D object detectors by introducing our proposed enhanced components, including a CRF-modulated depth estimation module enforcing object-level consistencies, a long-term temporal aggregation module with extended receptive fields, and a two-stage object decoder combining perspective techniques with CRF-modulated depth embedding. These enhancements lead to a “modernized” dense BEV framework dubbed BEVNeXt. On the nuScenes benchmark, BEVNeXt outperforms both BEV-based and query-based frameworks under various settings, achieving a state-of-the-art result of 64.2 NDS on the nuScenes test set.

关键词： Location awareness Three-dimensional displays Estimation Object detection Detectors Benchmark testing Transformers

来源：评论

学校读者我要写书评

暂无评论

Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding

Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vis...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Wujian Peng Sicheng Xie Zuyao You Shiyi Lan Zuxuan Wu Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University Shanghai Collaborative Innovation Center of Intelligent Visual Computing NVIDIA

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Vision language models (VLM) have demonstrated re-markable performance across various downstream tasks. However, understanding fine-grained visual-linguistic con-cepts, such as attributes and inter-object relationships, re-mains a significant challenge. While several benchmarks aim to evaluate VLMs in finer granularity, their primary fo-cus remains on the linguistic aspect, neglecting the visual dimension. Here, we highlight the importance of evaluating VLMs from both a textual and visual perspective. We intro-duce a progressive pipeline to synthesize images that vary in a specific attribute while ensuring consistency in all other aspects. Utilizing this data engine, we carefully design a benchmark, SPEC, to diagnose the comprehension of object size, position, existence, and count. Subsequently, we con-duct a thorough evaluation offour leading VLMs on SPEC. Surprisingly, their performance is close to random guess, revealing significant limitations. With this in mind, we pro-pose a simple yet effective approach to optimize VLMs in fine- grained understanding, achieving significant improve-ments on SPEC without compromising the zero-shot performance. Results on two additional fine-grained benchmarks also show consistent improvements, further validating the transferability of our approach. Code and data are available at https://***/wjpoom/SPEC.

关键词： Visualization Computer vision Codes Computational modeling Pipelines Benchmark testing Linguistics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：