Comparing the structures of current neural networks and the biological brain, it can be observed that many mechanisms correspond to each other according to their functions. From the perspective of the biological brain...
详细信息
ISBN:
(数字)9798350394085
ISBN:
(纸本)9798350394092
Comparing the structures of current neural networks and the biological brain, it can be observed that many mechanisms correspond to each other according to their functions. From the perspective of the biological brain, different components have different long-term or short-term memory effects, such as the hippopotamus. However, current neural networks do not pay much attention to this aspect. In this work, we incorporated many hypotheses or theories inspired by the territory of neurobiology to retain the learned knowledge. To start with, we follow the inspiration of the synaptic homeostasis hypothesis (SHY) [1] and add an additional training stage to the training process of the model, which can ensure that only the most important information remains intact and the insignificant synapse can be pruned. In other words, we divide the overall training process into two learning stages: synaptogenesis and synaptic sparsifying. We experimentally demonstrate that our novel learning strategy significantly outperforms the traditional solution in training a sequence of tasks at different times on three public datasets, which supports that the proposed method is more efficient for resource-limited edge devices.
We developed a dual optical/x-ray ultrafast photodetector based on in-house grown Cdo * Mg0.03Te single crystals. The detector is characterized by ~200 ps full-width-at-half-maximum, readout-electronics limited photor...
详细信息
Feeding the training data to neural networks in a specific sequence, from the simple data to the difficult data, utilizing curriculum learning can enhance performance improvements over the typical learning strategy ba...
详细信息
ISBN:
(数字)9798350394085
ISBN:
(纸本)9798350394092
Feeding the training data to neural networks in a specific sequence, from the simple data to the difficult data, utilizing curriculum learning can enhance performance improvements over the typical learning strategy based on shuffling training samples randomly, without any additional computational costs. This training approach has been successfully applied in all fields of machine learning. However, the current curriculum learning will gradually introduce difficult samples until the model eventually performs joint training. In addition, our experimental results find and demonstrate how the order of training tasks arranged according to the difficulty of different tasks influences the reuse percentage of model capacity, allowing us to observe the impact of curriculum learning on model performance from different perspectives. Finally, we also separately conduct three ablations analyses of our model to comprehensively enhance the understanding of the impacts of the proposed approach and further demonstrate its scalability to a standard large-scale dataset, i.e., the ImageNet dataset.
This paper proposes a Complex-Valued Neural Network (CVNN) for glucose sensing in milli-meter wave (mmWave). Based on the propagation characteristics of millimeter wave in glucose medium, we obtain the S21 parameter o...
详细信息
Exceptional points(EPs)have been extensively explored in mechanical,acoustic,plasmonic,and photonic ***,little is known about the role of EPs in tailoring the dynamic tunability of optical devices.A specific type of E...
详细信息
Exceptional points(EPs)have been extensively explored in mechanical,acoustic,plasmonic,and photonic ***,little is known about the role of EPs in tailoring the dynamic tunability of optical devices.A specific type of EPs known as chiral EPs has recently attracted much attention for controlling the flow of light and for building sensors with better responsivity.A recently demonstrated route to chiral EPs via lithographically defined symmetric Mie scatterers on the rim of resonators has not only provided the much-needed mechanical stability for studying chiral EPs,but also helped reduce losses originating from nanofabrication imperfections,facilitating the in-situ study of chiral EPs and their contribution to the dynamics and tunability of ***,we use asymmetric Mie scatterers to break the rotational symmetry of a microresonator,to demonstrate deterministic thermal tuning across a chiral EP,and to demonstrate EP-mediated chiral optical nonlinear response and efficient electro-optic *** results indicate asymmetric electro-optic modulation with up to 17 dB contrast at GHz and CMOS-compatible voltage *** wafer-scale nano-manufacturing of chiral electro-optic modulators and the chiral EP-tailored tunning may facilitate new micro-resonator functionalities in quantum information processing,electromagnetic wave control,and optical interconnects.
In this paper, we study the transmission strategy of a ground-based beyond diagonal reconfigurable intelligent surface (BD-RIS), a.k.a RIS 2.0, in a network where multiple unmanned aerial vehicles (UAVs) simultaneousl...
In this paper, we study the transmission strategy of a ground-based beyond diagonal reconfigurable intelligent surface (BD-RIS), a.k.a RIS 2.0, in a network where multiple unmanned aerial vehicles (UAVs) simultaneously transmit signals to the respective groups of users. It is assumed that each group is assigned subcarriers orthogonal to those assigned to other groups and rate splitting multiple access (RSMA) is adopted within each group. A corresponding mixed integer nonlinear programming problem (MINLP) is formulated, which aims to jointly optimize 1) allocation of BD-RIS elements to groups, 2) BD-RIS phase rotations, 3) rate allocation in RSMA, and 4) precoders. To solve the problem, we propose using generalized benders decomposition (GBD) augmented with a manifold-based algorithm. GBD splits the MINLP problem into two sub-problems, namely the primal and the relaxed master problem, which are solved alternately and iteratively. In the primal problem, we apply block coordinate descent (BCD) to manage the coupling of variables effectively. Moreover, we recognize the manifold structure in the phase rotation constraint of BD-RIS, enabling the Riemannian conjugate gradient (RCG). Simulation results demonstrate the effectiveness of the proposed approach in maximizing spectral efficiency.
Searching reads from unknown origins in a reference database and finding evolutionarily similar genomes is central to many applications. Quantifying the similarity by estimating the distance between each read and matc...
详细信息
Multimodal Emotion Recognition in Conversation (ERC) is a task of predicting the emotion of each utterance in a conversation by utilizing both verbal and non-verbal modalities. However, existing approaches often strug...
详细信息
ISBN:
(数字)9798331529024
ISBN:
(纸本)9798331529031
Multimodal Emotion Recognition in Conversation (ERC) is a task of predicting the emotion of each utterance in a conversation by utilizing both verbal and non-verbal modalities. However, existing approaches often struggle to bridge cross-modal gaps, resulting in misaligned features and frequent misclassification of minority emotions into semantically similar majority emotions. To address these challenges, we propose MERNet, a framework that employs cross-modal knowledge distillation and contrastive learning to align multimodal features and effectively distinguish subtle emotions in conversations. Our framework consists of two stages: 1) guiding non-verbal modalities with the text modality to transfer knowledge and align their features, and 2) applying contrastive learning with emotion labels as anchors to distinguish subtle differences between similar emotions and address the class imbalance problem. Experiments conducted on two benchmark datasets, IEMOCAP and MELD, demonstrate that our MERNet outperforms existing state-of-the-art models.
In this work, we analyzed numerically a multiscale nanosystem based on sMIM on TBG. Spontaneous formation of a water-meniscus by the approximation between the tip-sample concentrates the microwave fields, reaching res...
暂无评论