Transformer has achieved excellent performance in the knowledge tracing (KT) task, but they are criticized for the manually selected input features for fusion and the defect of single global context modelling to direc...
Transformer has achieved excellent performance in the knowledge tracing (KT) task, but they are criticized for the manually selected input features for fusion and the defect of single global context modelling to directly capture students' forgetting behavior in KT, when the related records are distant from the current record in terms of time. To address the issues, this paper first considers adding convolution operations to the Transformer to enhance its local context modelling ability used for students' forgetting behavior, then proposes an evolutionary neural architecture search approach to automate the input feature selection and automatically determine where to apply which operation for achieving the balancing of the local/global context modelling. In the search space design, the original global path containing the attention module in Transformer is replaced with the sum of a global path and a local path that could contain different convolutions, and the selection of input features is also considered. To search the best architecture, we employ an effective evolutionary algorithm to explore the search space and also suggest a search space reduction strategy to accelerate the convergence of the algorithm. Experimental results on the two largest and most challenging education datasets demonstrate the effectiveness of the architecture found by the proposed approach.
Transfer learning aims to leverage the knowledge of the source domain to help the learning of unlabeled target domain models. However, all conventional transfer learning methods assume that samples from source and tar...
详细信息
Utilizing functional magnetic resonance imaging (fMRI) to model functional brain networks (FBNs) is increasingly prominent in attention-deficit/hyperactivity disorder (ADHD) research, revealing neural impact and mecha...
详细信息
Utilizing functional magnetic resonance imaging (fMRI) to model functional brain networks (FBNs) is increasingly prominent in attention-deficit/hyperactivity disorder (ADHD) research, revealing neural impact and mechanisms through the exploration of activated brain regions. However, current FBNs-based methods face two major challenges. The primary challenge stems from the limitations of existing modeling methods in accurately capturing both regional correlations and long-distance dependencies (LDDs) within the dynamic brain, thereby affecting the diagnostic accuracy of FBNs as biomarkers. Additionally, limited sample size and class imbalance also pose a challenge to the learning performance of the model. To address the issues, we propose an automated diagnostic framework, which integrates modeling, multimodal fusion, and classification into a unified process. It aims to extract representative FBNs and efficiently incorporate domain knowledge to guide ADHD classification. Our work mainly includes three-fold: 1) A multi-head attention-based region-enhancement module (MAREM) is designed to simultaneously capture regional correlations and LDDs across the entire sequence of brain activity, which facilitates the construction of representative FBNs. 2) The multimodal supplementary learning module (MSLM) is proposed to integrate domain knowledge from phenotype data with FBNs from neuroimaging data, achieving information complementarity and alleviating the problems of insufficient medical data and unbalanced sample categories. 3) An ADHD automatic diagnosis framework guided by FBNs and domain knowledge (ADF-FAD) is proposed to help doctors make more accurate decisions, which is applied to the ADHD-200 dataset to confirm its effectiveness. The results indicate that the FBNs extracted by MAREM perform well in modeling and classification. After with MSLM, the model achieves accuracy of 92.4%, 74.4%, and 80% at NYU, PU, and KKI, respectively, demonstrating its ability to effecti
Math word problem (MWP) represents a critical research area within reading comprehension, where accurate comprehension of math problem text is crucial for generating math expressions. However, current approaches still...
详细信息
Dunhuang culture is a treasure house of human history and culture. As an integral part of Dunhuang culture, Dunhuang dance is famous for its unique national characteristics and artistic characteristics. In the form of...
详细信息
A broadband transmissive linear-to-circular polarization conversion metamaterial composed of 5-layer '-shaped units was designed, and it was placed directly above the ordinary linear polarization antenna so that t...
详细信息
A microstrip line broadband directional coupler is designed based on microstrip line theory. The bandwidth of the coupler is extended by using a cascade of multiple coupled lines. The isolation of the directional coup...
A microstrip line broadband directional coupler is designed based on microstrip line theory. The bandwidth of the coupler is extended by using a cascade of multiple coupled lines. The isolation of the directional coupler is greatly improved by covering the microstrip line with a dielectric layer [1] and by loading the branching compensation capacitor to compensate for the odd-even mode phase velocity difference. Simulation results of ANSYS HFSS 2019 show that the return loss ( $S_{11}$ ) is greater than 20 dB, the insertion loss ( $S_{21}$ ) is less than 1.7 dB, the coupling degree (S31) is about −6dB(±0.8dB), the isolation degree (S41) is greater than 23.4dB, and the minimum directionality is greater than 17dB during 700 MHz-3700 MHz. The physical size of coupler is $18\text{mm}\times 60\text{mm}$ , which meets the design requirements of 6dB coupler.
Recent advancements in CNNs for medical image segmentation have focused on the combination of CNN and Transformer architectures to capture both local and global features. However, challenges remain, such as effectivel...
详细信息
This paper presents a parallel coupled line bandpass filter for X-band applications, which has low insertion loss, broadband and easy processing. By loading the CSRR (Complementary Split Ring Resonator) and SRR (Split...
This paper presents a parallel coupled line bandpass filter for X-band applications, which has low insertion loss, broadband and easy processing. By loading the CSRR (Complementary Split Ring Resonator) and SRR (Split Ring Resonator) structures, three additional transmission zeros are added to improve the out-of-band rejection performance of the filter. Moreover, the rectangular DGS structure below the triple-parallel coupling line reduces the insertion loss of the filter. The simulation results show that the filter center frequency is 9.5GHz, the insertion loss is 0.8dB, S11
In this paper, we propose a miniaturized wide-stopband SIW dual-band filter. SIW limits the propagation of electromagnetic waves and thus enables the miniaturization of the filter. A passband below the waveguide cutof...
In this paper, we propose a miniaturized wide-stopband SIW dual-band filter. SIW limits the propagation of electromagnetic waves and thus enables the miniaturization of the filter. A passband below the waveguide cutoff frequency is generated by etching the CSRR structure on the surface of the SIW, while a modified CSRR-DGS structure is etched on the backside of the SIW structure, and the other passband is generated by coupling the CSRR etched on the surface of the SIW to the ground. In addition, the CSRR-DGS structure broadens the stopband without increasing the filter size. Through the circuit equivalent analysis and parameter optimization of the filter structure, the final simulation results are as follows: the filter has a passband of 3.5 GHz (WIMAX) and 5.2 GHz (WLAN), the 3dB bandwidths of the two bands are 130MHz and 180MHz respectively, the insertion loss is 0.5 dB and 0.65 dB, and the size is $0.18\lambda_{\mathrm{g}}\times 0.27\lambda_{\mathrm{g}}$ . Overall, it achieves high performance and also has a wide range of applications.
暂无评论