Deep learning(DL) systems exhibit multiple behavioral characteristics such as correctness, robustness, and fairness. Ensuring that these behavioral characteristics function properly is crucial for maintaining the accu...
详细信息
With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been p...
详细信息
With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost adaptation. Although PEFT has demonstrated effectiveness and been widely applied, the underlying principles are still unclear. In this paper, we adopt the PAC-Bayesian generalization error bound, viewing pre-training as a shift of prior distribution which leads to a tighter bound for generalization error. We validate this shift from the perspectives of oscillations in the loss landscape and the quasi-sparsity in gradient distribution. Based on this, we propose a gradient-based sparse finetuning algorithm, named Sparse Increment Fine-Tuning (SIFT), and validate its effectiveness on a range of tasks including the GLUE Benchmark and Instruction-tuning. The code is accessible at https://***/song-wx/SIFT. Copyright 2024 by the author(s)
Drug-target interaction (DTI) prediction is vital for drug discovery and repurposing. Hypergraph is utilized in DTI prediction for modeling higher-order relationships in biomedical networks. Although the strategies of...
详细信息
It is anticipated that wireless vehicular ad hoc networks (VANETs) can further enhance the safety of autonomous vehicles. Recently, two major standards for the next generation of VANET technologies have been suggested...
详细信息
Reinforcement learning has been successfully applied in software testing, but the existing testing methods cannot perform effective testing according to the characteristics of applications, and using outdated interact...
详细信息
With the expansion of network services,large-scale networks have progressively become *** network status changes rapidly in response to customer needs and configuration changes,so network configuration changes are als...
详细信息
With the expansion of network services,large-scale networks have progressively become *** network status changes rapidly in response to customer needs and configuration changes,so network configuration changes are also very ***,no matter what changes,the network must ensure the correct conditions,such as isolating tenants from each other or guaranteeing essential *** changes occur,it is necessary to verify the after-changed ***,for the verification of large-scale network configuration changes,many current verifiers show poor *** order to solve the problem ofmultiple global verifications caused by frequent updates of local configurations in large networks,we present a fast configuration updates verification tool,FastCUV,for distributed control *** aims to enhance the efficiency of distributed control plane verification for medium and large networks while ensuring *** paper presents a method to determine the network range affected by the configuration *** present a flow model and graph structure to facilitate the design of verification algorithms and speed up *** scheme verifies the network area affected by obtaining the change of the Forwarding Information Base(FIB)before and *** supports rich network attributes,meanwhile,has high efficiency and correctness *** experimental verification and result analysis,our method outperforms the state-of-the-art method to a certain extent.
This paper proposes a method based on large-scale speech pre-trained models for the task of Chinese speech emotion recognition. Similar to the transfer learning approach in image classification task, speech pre-traine...
详细信息
The algorithm proposed in this paper aims to address the issue of structural content distortions in images that occur after applying image style transfer. It introduces a structural consistency-based approach called t...
详细信息
With the development of the Internet, users can freely publish posts on various social media platforms, which offers great convenience for keeping abreast of the world. However, posts usually carry many rumors, which ...
详细信息
With the development of the Internet, users can freely publish posts on various social media platforms, which offers great convenience for keeping abreast of the world. However, posts usually carry many rumors, which require plenty of manpower for monitoring. Owing to the success of modern machine learning techniques, especially deep learning models, we tried to detect rumors as a classification problem automatically. Early attempts have always focused on building classifiers relying on image or text information, i.e., single modality in posts. Thereafter, several multimodal detection approaches employ an early or late fusion operator for aggregating multiple source information. Nevertheless, they only take advantage of multimodal embeddings for fusion and ignore another important detection factor, i.e., the intermodal inconsistency between modalities. To solve this problem, we develop a novel deep visual-linguistic fusion network(DVLFN) considering cross-modal inconsistency, which detects rumors by comprehensively considering modal aggregation and contrast information. Specifically, the DVLFN first utilizes visual and textual deep encoders, i.e., Faster R-CNN and bidirectional encoder representations from transformers, to extract global and regional embeddings for image and text modalities. Then, it predicts posts' authenticity from two aspects:(1) intermodal inconsistency, which employs the Wasserstein distance to efficiently measure the similarity between regional embeddings of different modalities, and(2) modal aggregation, which experimentally employs the early fusion to aggregate two modal embeddings for prediction. Consequently, the DVLFN can compose the final prediction based on the modal fusion and inconsistency measure. Experiments are conducted on three real-world multimedia rumor detection datasets collected from Reddit, Good News, and Weibo. The results validate the superior performance of the proposed DVLFN.
Dynamic graphs are ubiquitous across disciplines where observations usually change over time. Regressions on dynamic graphs often contribute to diverse critical tasks, such as climate early-warning and traffic control...
详细信息
暂无评论