检索结果-内蒙古大学图书馆

11th International Conference on Learning Representations, ICLR 2023

作者： Shi, Fan Li, Bin Xue, Xiangyang Shanghai Key Laboratory of Intelligent Information Processing School of Computer Science Fudan University China

Human cognition has compositionality. We understand a scene by decomposing the scene into different concepts (e.g., shape and position of an object) and learning the respective laws of these concepts, which may be either natural (e.g., laws of motion) or man-made (e.g., laws of a game). The automatic parsing of these laws indicates the model's ability to understand the scene, which makes law parsing play a central role in many visual tasks. This paper proposes a deep latent variable model for Compositional LAw Parsing (CLAP), which achieves the human-like compositionality ability through an encoding-decoding architecture to represent concepts in the scene as latent variables. CLAP employs concept-specific latent random functions instantiated with Neural Processes to capture the law of concepts. Our experimental results demonstrate that CLAP outperforms the baseline methods in multiple visual tasks such as intuitive physics, abstract visual reasoning, and scene representation. The law manipulation experiments illustrate CLAP's interpretability by modifying specific latent random functions on samples. For example, CLAP learns the laws of position-changing and appearance constancy from the moving balls in a scene, making it possible to exchange laws between samples or compose existing laws into novel laws. © 2023 11th International Conference on Learning Representations, ICLR 2023. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Paradigm Shift in Natural Language processing

引用

Machine Intelligence Research 2022年第3期19卷 169-183页

作者： Tian-Xiang Sun Xiang-Yang Liu Xi-Peng Qiu Xuan-Jing Huang School of Computer Science Fudan UniversityShanghai 200438China Shanghai Key Laboratory of Intelligent Information Processing Fudan UniversityShanghai 200438China

In the era of deep learning, modeling for most natural language processing (NLP) tasks has converged into several mainstream paradigms. For example, we usually adopt the sequence labeling paradigm to solve a bundle of tasks such as POS-tagging, named entity recognition (NER), and chunking, and adopt the classification paradigm to solve tasks like sentiment analysis. With the rapid progress of pre-trained language models, recent years have witnessed a rising trend of paradigm shift, which is solving one NLP task in a new paradigm by reformulating the task. The paradigm shift has achieved great success on many tasks and is becoming a promising way to improve model performance. Moreover, some of these paradigms have shown great potential to unify a large number of NLP tasks, making it possible to build a single model to handle diverse tasks. In this paper, we review such phenomenon of paradigm shifts in recent years, highlighting several paradigms that have the potential to solve different NLP tasks.

关键词： Natural language processing pre-trained language models deep learning sequence-to-sequence paradigm shift

来源：评论

学校读者我要写书评

暂无评论

Double-Mix-Net: A Multimodal Music Emotion Recognition Network with Multi-layer Feature Mixing 10th

Double-Mix-Net: A Multimodal Music Emotion Recognition Netwo...

引用

10th Conference on Sound and Music Technology, CSMT 2023

作者： Li, Peilin Chen, Kairan Wei, Weixin Zhao, Jiahao Li, Wei School of Computer Science and Technology Fudan University Shanghai Shanghai200438 China Shanghai Key Laboratory of Intelligent Information Processing Fudan University Shanghai Shanghai200433 China

ISBN: (纸本)9789819779611

Computational music emotion recognition (MER) is an important task that aims to recognize emotional content in music tracks. Understanding the emotional content of music can help tailor therapeutic interventions to specific emotional needs, potentially improving their effectiveness. Piano music is widely used in music therapy for depression, anxiety, and other mental health conditions. However, comparatively little work has been done on MER in piano music, which is a challenging task due to the unique difficulties in recognizing emotions in single-timbre music without vocals, especially on valence. In this paper, we propose a novel Double-Mix-Net model that utilizes the multi-layer feature mixing and multi-modal feature mixing methods to improve classification performance. Our model uses both the title of the YouTube music video and the music context to predict the emotion of a given music track. Additionally, we make full use of different granularity features through the multi-layer feature mixing method. Our proposed model achieved state-of-the-art accuracy performance of 73.8% on the Emopia dataset and is the first multi-modal network designed for piano emotion recognition. The results of our study highlight the importance of considering the music title and utilizing multi-layer feature mixing methods in piano music emotion recognition. This work helps the emotional understanding of piano music. Our proposed model can be applied in various domains such as music recommendation systems, film scoring, and game design to enhance the emotional impact of music. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Game design

来源：评论

学校读者我要写书评

暂无评论

Audio-Driven Identity Manipulation for Face Inpainting 24

Audio-Driven Identity Manipulation for Face Inpainting

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Sun, Yuqi Lin, Qing Tan, Weimin Yan, Bo Shanghai Key Laboratory of Intelligent Information Processing School of Computer Science Fudan University Shanghai China Singapore Nanyang Technological University Singapore

ISBN: (纸本)9798400706868

Recent advances in multimodal artificial intelligence have greatly improved the integration of vision-language-audio cues to enrich the content creation process. Inspired by these developments, in this paper, we first integrate audio into the face inpainting task to facilitate identity manipulation. Our main insight is that a person's voice carries distinct identity markers, such as age and gender, which provide an essential supplement for identity-aware face inpainting. By extracting identity information from audio as guidance, our method can naturally support tasks of identity preservation and identity swapping in face inpainting. Specifically, we introduce a dual-stream network architecture comprising a face branch and an audio branch. The face branch is tasked with extracting deterministic information from the visible parts of the input masked face, while the audio branch is designed to capture heuristic identity priors from the speaker's voice. The identity codes from two streams are integrated using a multi-layer perceptron (MLP) to create a virtual unified identity embedding that represennts comprehensive identity features. In addition, to explicitly exploit the information from audio, we introduce an audio-face generator to generate an 'fake' audio face directly from audio and fuse the multi-scale intermediate features from the audio-face generator into face inpainting network through an audio-visual feature fusion (AVFF) module. Extensive experiments demonstrate the positive impact of extracting identity information from audio on face inpainting task, especially in identity preservation. © 2024 ACM.

关键词： Visual languages

来源：评论

学校读者我要写书评

暂无评论

A Heuristic Radiomics Feature Selection Method Based on Frequency Iteration and Multi-Supervised Training Mode

引用

computers, Materials & Continua 2024年第5期79卷 2277-2293页

作者： Zhigao Zeng Aoting Tang Shengqiu Yi Xinpan Yuan Yanhui Zhu School of Computer Hunan University of TechnologyZhuzhou412007China Hunan Key Laboratory of Intelligent Information Perception and Processing Technology Zhuzhou412007China

Radiomics is a non-invasive method for extracting quantitative and higher-dimensional features from medical images for *** has received great attention due to its huge application prospects in recent *** can know that the number of features selected by the existing radiomics feature selectionmethods is basically about *** this paper,a heuristic feature selection method based on frequency iteration and multiple supervised training mode is *** on the combination between features,it decomposes all features layer by layer to select the optimal features for each layer,then fuses the optimal features to form a local optimal group layer by layer and iterates to the global optimal combination *** with the currentmethod with the best prediction performance in the three data sets,thismethod proposed in this paper can reduce the number of features fromabout ten to about three without losing classification accuracy and even significantly improving classification *** proposed method has better interpretability and generalization ability,which gives it great potential in the feature selection of radiomics.

关键词： Radiomics feature selection machine learning metaheuristic

来源：评论

学校读者我要写书评

暂无评论

HARNESSING JOINT RAIN-/DETAIL-AWARE REPRESENTATIONS TO ELIMINATE INTRICATE RAINS 12

HARNESSING JOINT RAIN-/DETAIL-AWARE REPRESENTATIONS TO ELIMI...

引用

12th International Conference on Learning Representations, ICLR 2024

作者： Ran, Wu Ma, Peirong He, Zhiquan Ren, Hao Lu, Hong School of Computer Science Fudan University China Shanghai Key Lab of Intelligent Information Processing China

Recent advances in image deraining have focused on training powerful models on mixed multiple datasets comprising diverse rain types and backgrounds. However, this approach tends to overlook the inherent differences among rainy images, leading to suboptimal results. To overcome this limitation, we focus on addressing various rainy images by delving into meaningful representations that encapsulate both the rain and background components. Leveraging these representations as instructive guidance, we put forth a Context-based Instance-level Modulation (CoI-M) mechanism adept at efficiently modulating CNN- or Transformer-based models. Furthermore, we devise a rain-/detail-aware contrastive learning strategy to help extract joint rain-/detail-aware representations. By integrating CoI-M with the rain-/detail-aware Contrastive learning, we develop CoIC, an innovative and potent algorithm tailored for training models on mixed datasets. Moreover, CoIC offers insight into modeling relationships of datasets, quantitatively assessing the impact of rain and details on restoration, and unveiling distinct behaviors of models given diverse inputs. Extensive experiments validate the efficacy of CoIC in boosting the deraining ability of CNN and Transformer models. CoIC also enhances the deraining prowess remarkably when real-world dataset is included. © 2024 12th International Conference on Learning Representations, ICLR 2024. All rights reserved.

关键词： Rain

来源：评论

学校读者我要写书评

暂无评论

SPIKING CONVOLUTIONAL NEURAL NETWORKS FOR TEXT CLASSIFICATION 11

SPIKING CONVOLUTIONAL NEURAL NETWORKS FOR TEXT CLASSIFICATIO...

引用

11th International Conference on Learning Representations, ICLR 2023

作者： Lv, Changze Xu, Jianhan Zheng, Xiaoqing School of Computer Science Fudan University Shanghai 200433 China Shanghai Key Laboratory of Intelligent Information Processing

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very few works that have demonstrated the efficacy of SNNs in language tasks partially because it is non-trivial to represent words in the forms of spikes and to deal with variable-length texts by SNNs. This work presents a "conversion + fine-tuning" two-step method for training SNNs for text classification and proposes a simple but effective way to encode pre-trained word embeddings as spike trains. We show empirically that after fine-tuning with surrogate gradients, the converted SNNs achieve comparable results to their DNN counterparts with much less energy consumption across multiple datasets for both English and Chinese. We also show that such SNNs are more robust to adversarial attacks than DNNs. © 2023 11th International Conference on Learning Representations, ICLR 2023. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Image Enhancement via Associated Perturbation Removal and Texture Reconstruction Learning

引用

IEEE/CAA Journal of Automatica Sinica 2024年第11期11卷 2253-2269页

作者： Kui Jiang Ruoxi Wang Yi Xiao Junjun Jiang Xin Xu Tao Lu IEEE the School of Computer Science and Technology Harbin Institute of Technology Zhengzhou Research Institute Harbin Institute of Technology the School of Artificial Intelligence Jianghan University the School of Geodesy and Geomatics Wuhan University the Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System Wuhan University of Science and Technology the School of Computer Science and Engineering and also with the Hubei Province Key Laboratory of Intelligent Robot Wuhan Institute of Technology

Degradation under challenging conditions such as rain, haze, and low light not only diminishes content visibility, but also results in additional degradation side effects, including detail occlusion and color distortion. However, current technologies have barely explored the correlation between perturbation removal and background restoration, consequently struggling to generate high-naturalness content in challenging scenarios. In this paper, we rethink the image enhancement task from the perspective of joint optimization: Perturbation removal and texture reconstruction. To this end, we advise an efficient yet effective image enhancement model, termed the perturbation-guided texture reconstruction network(PerTeRNet). It contains two subnetworks designed for the perturbation elimination and texture reconstruction tasks, respectively. To facilitate texture recovery,we develop a novel perturbation-guided texture enhancement module(PerTEM) to connect these two tasks, where informative background features are extracted from the input with the guidance of predicted perturbation priors. To alleviate the learning burden and computational cost, we suggest performing perturbation removal in a sub-space and exploiting super-resolution to infer high-frequency background details. Our PerTeRNet has demonstrated significant superiority over typical methods in both quantitative and qualitative measures, as evidenced by extensive experimental results on popular image enhancement and joint detection tasks. The source code is available at https://***/kuijiang94/PerTeRNet.

关键词： Association learning attention mechanism image enhancement perturbation modeling

来源：评论

学校读者我要写书评

暂无评论

Mixture of Experts for Audio-Visual Learning 38

Mixture of Experts for Audio-Visual Learning

引用

38th Conference on Neural information processing Systems, NeurIPS 2024

作者： Cheng, Ying Li, Yang He, Junjie Feng, Rui School of Computer Science Fudan University China Shanghai Key Laboratory of Intelligent Information Processing China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China

With the rapid development of multimedia technology, audio-visual learning has emerged as a promising research topic within the field of multimodal analysis. In this paper, we explore parameter-efficient transfer learning for audio-visual learning and propose the Audio-Visual Mixture of Experts (AVMoE) to inject adapters into pre-trained models flexibly. Specifically, we introduce unimodal and cross-modal adapters as multiple experts to specialize in intra-modal and inter-modal information, respectively, and employ a lightweight router to dynamically allocate the weights of each expert according to the specific demands of each task. Extensive experiments demonstrate that our proposed approach AVMoE achieves superior performance across multiple audio-visual tasks, including AVE, AVVP, AVS, and AVQA. Furthermore, visual-only experimental results also indicate that our approach can tackle challenging scenes where modality information is missing. The source code is available at https://***/yingchengy/AVMOE. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

L_(1)-Smooth SVM with Distributed Adaptive Proximal Stochastic Gradient Descent with Momentum for Fast Brain Tumor Detection

引用

computers, Materials & Continua 2024年第5期79卷 1975-1994页

作者： Chuandong Qin Yu Cao Liqun Meng School of Mathematics and Information Science North Minzu UniversityYinchuan750021China Ningxia Key Laboratory of Intelligent Information and Big Data Processing Yinchuan750021China

Brain tumors come in various types,each with distinct characteristics and treatment approaches,making manual detection a time-consuming and potentially ambiguous *** tumor detection is a valuable tool for gaining a deeper understanding of tumors and improving treatment *** learning models have become key players in automating brain tumor *** descent methods are the mainstream algorithms for solving machine learning *** this paper,we propose a novel distributed proximal stochastic gradient descent approach to solve the L_(1)-Smooth Support Vector Machine(SVM)classifier for brain tumor ***,the smooth hinge loss is introduced to be used as the loss function of *** avoids the issue of nondifferentiability at the zero point encountered by the traditional hinge loss function during gradient descent ***,the L_(1) regularization method is employed to sparsify features and enhance the robustness of the ***,adaptive proximal stochastic gradient descent(PGD)with momentum,and distributed adaptive PGDwithmomentum(DPGD)are proposed and applied to the L_(1)-Smooth *** computing is crucial in large-scale data analysis,with its value manifested in extending algorithms to distributed clusters,thus enabling more efficient processing ofmassive amounts of *** DPGD algorithm leverages Spark,enabling full utilization of the computer’s multi-core *** to its sparsity induced by L_(1) regularization on parameters,it exhibits significantly accelerated convergence *** the perspective of loss reduction,DPGD converges faster than *** experimental results show that adaptive PGD withmomentumand its variants have achieved cutting-edge accuracy and efficiency in brain tumor ***-trained models,both the PGD andDPGD outperform other models,boasting an accuracy of 95.21%.

关键词： Support vector machine proximal stochastic gradient descent brain tumor detection distributed computing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：