The underwater environment is complex and diverse, making it challenging to locate aquatic organisms accurately. The precise identification of underwater animals is crucial for ecological research and fisheries manage...
详细信息
Recently, crowdsourcing has established itself as an efficient labeling solution by distributing tasks to crowd workers. As the workers can make mistakes with diverse expertise, one core learning task is to estimate e...
详细信息
Recently, crowdsourcing has established itself as an efficient labeling solution by distributing tasks to crowd workers. As the workers can make mistakes with diverse expertise, one core learning task is to estimate each worker’s expertise, and aggregate over them to infer the latent true labels. In this paper, we show that as one of the major research directions, the noise transition matrix based worker expertise modeling methods commonly overfit the annotation noise, either due to the oversimplified noise assumption or inaccurate estimation. To solve this problem, we propose a knowledge distillation framework (KD-Crowd) by combining the complementary strength of noise-model-free robust learning techniques and transition matrix based worker expertise modeling. The framework consists of two stages: in Stage 1, a noise-model-free robust student model is trained by treating the prediction of a transition matrix based crowdsourcing teacher model as noisy labels, aiming at correcting the teacher’s mistakes and obtaining better true label predictions;in Stage 2, we switch their roles, retraining a better crowdsourcing model using the crowds’ annotations supervised by the refined true label predictions given by Stage 1. Additionally, we propose one f-mutual information gain (MIG^(f)) based knowledge distillation loss, which finds the maximum information intersection between the student’s and teacher’s prediction. We show in experiments that MIG^(f) achieves obvious improvements compared to the regular KL divergence knowledge distillation loss, which tends to force the student to memorize all information of the teacher’s prediction, including its errors. We conduct extensive experiments showing that, as a universal framework, KD-Crowd substantially improves previous crowdsourcing methods on true label prediction and worker expertise estimation.
Unsupervised Domain Adaptation(UDA)intends to achieve excellent results by transferring knowledge from labeled source domains to unlabeled target domains in which the data or label distribution *** UDA methods have ac...
详细信息
Unsupervised Domain Adaptation(UDA)intends to achieve excellent results by transferring knowledge from labeled source domains to unlabeled target domains in which the data or label distribution *** UDA methods have acquired great success when labels in the source domain are ***,even the acquisition of scare clean labels in the source domain needs plenty of costs as *** the presence of label noise in the source domain,the traditional UDA methods will be seriously degraded as they do not deal with the label *** this paper,we propose an approach named Robust Self-training with Label Refinement(RSLR)to address the above *** adopts the self-training framework by maintaining a Labeling Network(LNet)on the source domain,which is used to provide confident pseudo-labels to target samples,and a Target-specific Network(TNet)trained by using the pseudo-labeled *** combat the effect of label noise,LNet progressively distinguishes and refines the mislabeled source *** combination with class rebalancing to combat the label distribution shift issue,RSLR achieves effective performance on extensive benchmark datasets.
Predicting RNA binding protein(RBP) binding sites on circular RNAs(circ RNAs) is a fundamental step to understand their interaction mechanism. Numerous computational methods are developed to solve this problem, but th...
详细信息
Predicting RNA binding protein(RBP) binding sites on circular RNAs(circ RNAs) is a fundamental step to understand their interaction mechanism. Numerous computational methods are developed to solve this problem, but they cannot fully learn the features. Therefore, we propose circ-CNNED, a convolutional neural network(CNN)-based encoding and decoding framework. We first adopt two encoding methods to obtain two original matrices. We preprocess them using CNN before fusion. To capture the feature dependencies, we utilize temporal convolutional network(TCN) and CNN to construct encoding and decoding blocks, respectively. Then we introduce global expectation pooling to learn latent information and enhance the robustness of circ-CNNED. We perform circ-CNNED across 37 datasets to evaluate its effect. The comparison and ablation experiments demonstrate that our method is superior. In addition, motif enrichment analysis on four datasets helps us to explore the reason for performance improvement of circ-CNNED.
Deep learning has achieved good results in the field of image recognition due to the key role of the optimizer in a deep learning network. In this work, the optimizers of dynamical system models are established,and th...
详细信息
Deep learning has achieved good results in the field of image recognition due to the key role of the optimizer in a deep learning network. In this work, the optimizers of dynamical system models are established,and the influence of parameter adjustments on the dynamic performance of the system is proposed. This is a useful supplement to the theoretical control models of optimizers. First, the system control model is derived based on the iterative formula of the optimizer, the optimizer model is expressed by differential equations, and the control equation of the optimizer is established. Second, based on the system control model of the optimizer, the phase trajectory process of the optimizer model and the influence of different hyperparameters on the system performance of the learning model are analyzed. Finally, controllers with different optimizers and different hyperparameters are used to classify the MNIST and CIFAR-10 datasets to verify the effects of different optimizers on the model learning performance and compare them with related methods. Experimental results show that selecting appropriate optimizers can accelerate the convergence speed of the model and improve the accuracy of model recognition. Furthermore, the convergence speed and performance of the stochastic gradient descent(SGD) optimizer are better than those of the stochastic gradient descent-momentum(SGD-M) and Nesterov accelerated gradient(NAG) optimizers.
The advancement of hyperspectral detection technology has challenged the development of hyperspectral camouflage materials. Despite the high spectral similarity of existing bio-inspired hyperspectral materials, their ...
详细信息
Multidrug resistance(MDR),the major mechanism by which various cancers develop specific resistance to therapeutic agents,has set up enormous obstacles to many forms of tumor *** cocktail therapy administration,based o...
详细信息
Multidrug resistance(MDR),the major mechanism by which various cancers develop specific resistance to therapeutic agents,has set up enormous obstacles to many forms of tumor *** cocktail therapy administration,based on the combination of multiple drugs for anti-MDR chemotherapy,often suffers from inconsistent in vivo pharmacokinetic behaviors that cannot act synchronously on the lesions,leading to limited pharmacodynamic *** the emergence of nanomedicines,which has improved chemotherapeutic drugs’bioavailability and therapeutic effect on clinical application,these monotherapy-based nano-formulations still show poor progression in overcoming ***,a“one stone and three birds”nanococktail integrated by a cocrystal@protein-anchoring strategy was purposed for triple-payload delivery,which paclitaxel-disulfiram cocrystal-like nanorods(NRs)were anchored with the basic protein drug Cytochrome c(Cyt C),followed by hyaluronic-acid *** particular,NRs were utilized as carrier-like particles to synchronously deliver biomacromolecule Cyt C into tumor cells and then promote cell *** note,on A549/Taxol drug-resistant tumor-bearing mice,the system with extraordinarily high encapsulation efficiency demonstrated prolonged in vivo circulation and increased tumor-targeting accumulation,significantly reversing tumor drug resistance and improving therapeutic *** mechanistic study indicated that the system induced the apoptosis of Taxol-resistant tumor cells through the signal axis P-glycoprotein/Cyt C/caspase ***,this nanococktail strategy offers a promising approach to improve the sensitivity of tumor cells to chemotherapeutic drugs and strengthen intractable drug-resistant oncotherapy.
In recent years, infrared target detection has played a crucial role in intelligent transportation and assisted driving. Addressing the current issues of low detection accuracy, poor robustness, and missed detections ...
详细信息
In today's society, people increasingly need information acquisition due to the rapid development of science and technology and the consequent increase in available data. However, finding the information users nee...
详细信息
End-to-end training has emerged as a prominent trend in speech recognition, with Conformer models effectively integrating Transformer and CNN architectures. However, their complexity and high computational cost pose d...
详细信息
暂无评论