In edge computing, the Zero-Trust Security Model (ZTSM), as a key enabling technology for next-generation networks, plays a crucial role in providing authentication for addressing data sharing concerns, such as freque...
详细信息
In the era of large-scale pretrained models, artificial neural networks(ANNs) have excelled in natural language understanding(NLU) tasks. However, their success often necessitates substantial computational resourc...
详细信息
In the era of large-scale pretrained models, artificial neural networks(ANNs) have excelled in natural language understanding(NLU) tasks. However, their success often necessitates substantial computational resources and energy consumption. To address this, we explore the potential of spiking neural networks(SNNs) in NLU——a promising avenue with demonstrated advantages, including reduced power consumption and improved efficiency due to their event-driven characteristics. We propose the SpikingMiniLM,a novel spiking Transformer model tailored for natural language understanding. We first introduce a multi-step encoding method to convert text embeddings into spike trains. Subsequently, we redesign the attention mechanism and residual connections to make our model operate on the pure spike-based paradigm without any normalization technique. To facilitate stable and fast convergence, we propose a general parameter initialization method grounded in the stable firing rate principle. Furthermore, we apply an ANN-to-SNN knowledge distillation to overcome the challenges of pretraining SNNs. Our approach achieves a macro-average score of 75.5 on the dev sets of the GLUE benchmark, retaining 98% of the performance exhibited by the teacher model MiniLMv2. Our smaller model also achieves similar performance to BERTMINIwith fewer parameters and much lower energy consumption, underscoring its competitiveness and resource efficiency in NLU tasks.
A few-electron quantum dot is shown to exhibit a millionfold magnetoresistance if the source and drain electron reservoirs have spin accumulations ΔμS and ΔμD that are induced and controlled by two ferromagnetic c...
详细信息
A few-electron quantum dot is shown to exhibit a millionfold magnetoresistance if the source and drain electron reservoirs have spin accumulations ΔμS and ΔμD that are induced and controlled by two ferromagnetic contacts. If ΔμS and ΔμD have the same sign, a single-electron spin is trapped on the quantum dot and the current vanishes due to Pauli spin blockade between the single quantum dot and the spin-polarized reservoirs. Charge can flow freely when ΔμS and ΔμD are antiparallel. Transport calculations for sequential tunneling show that when the thermal energy is small compared to the singlet-triplet splitting energy, the current on/off ratio is above 106 for Si quantum dots. The device can operate as a spin transistor with huge magnetoresistance, but can also readily be switched to operate as a spin qubit by reconfiguring the source-drain bias and the gate voltage.
An excitation of highly nonlinear, complex magnetization dynamics in a ferromagnet, for example chaos, is a new research target in spintronics. This technology is applied to practical applications such as random numbe...
详细信息
An excitation of highly nonlinear, complex magnetization dynamics in a ferromagnet, for example chaos, is a new research target in spintronics. This technology is applied to practical applications such as random number generators and information processing systems. One way to induce complex dynamics is applying feedback effect to the ferromagnet. The role of the feedback electric current on the magnetization dynamics was studied in the past. However, there is another way to apply feedback effect to the ferromagnet, namely feedback magnetic field. In this paper, we developed both numerical and theoretical analyses on the role of the feedback magnetic field causing complex magnetization dynamics. The numerical simulation indicates the change of the dynamical behavior from a simple oscillation with a unique frequency to complex dynamics such as amplitude modulation and chaos. The theoretical analyses on the equation of motion qualitatively explain several features found in the numerical simulations, exemplified as an appearance of multipeak structure in the Fourier spectra. The difference of the role of the feedback electric current and magnetic field is also revealed from the theoretical analyses.
Spin selection is explored for a quantum dot spin qubit with spin accumulations ΔμS and ΔμD in the source and drain reservoir, created by ferromagnetic contacts. If ΔμS and ΔμD have opposite signs, a single el...
详细信息
Spin selection is explored for a quantum dot spin qubit with spin accumulations ΔμS and ΔμD in the source and drain reservoir, created by ferromagnetic contacts. If ΔμS and ΔμD have opposite signs, a single electron can be trapped on the quantum dot in two opposite spin states, depending on the source-drain voltage. The selected spin is then electrically reversible and with low error rates for temperatures up to above 4 K. If ΔμS and ΔμD have the same sign, the spin selectivity is enhanced and persists up to even higher temperature than for a spin qubit with spin accumulation in only one of the reservoirs. These results offer opportunities to improve and electrically control spin qubit initialization and readout at elevated temperature.
In this work, we report an excitation of chaos and a nontrivial magnetization switching via transient chaos in a three-terminal spin-torque oscillator (STO). The driving force of the chaos is a voltage-controlled magn...
详细信息
In this work, we report an excitation of chaos and a nontrivial magnetization switching via transient chaos in a three-terminal spin-torque oscillator (STO). The driving force of the chaos is a voltage-controlled magnetic anisotropy (VCMA) effect generated by a feedback signal from the STO since the feedback effect is known to be effective in exciting chaos in a dynamical system. Solving the Landau-Lifshitz-Gilbert equation numerically and applying temporal and statistical analyses to its solution, the existence of the chaos driven by the feedback VCMA effect is identified. Simultaneously, however, transient chaos is also observed, where the magnetization initially shows chaotic behavior but finally switches its direction. This transient dynamics from chaos to magnetization switching was unexpected because the sign of the feedback VCMA effect was chosen so that the switching current increases and, as a result, the situation rather favors the condition for sustaining chaos. It is implied that this switching happens when narrowing a stable region of the magnetic potential energy by the feedback effect and magnetization precession pointing to a saddle point coincidentally occur simultaneously.
We develop perpendicularly magnetized magnetic tunnel junctions consisting of a recording layer exhibiting a low magnetic damping to investigate the influence of magnetic damping on the write-error rate of voltage-dri...
详细信息
We develop perpendicularly magnetized magnetic tunnel junctions consisting of a recording layer exhibiting a low magnetic damping to investigate the influence of magnetic damping on the write-error rate of voltage-driven magnetization switching. The effective magnetic damping is reduced to about one-third that of a conventional Ta/Co−Fe−B/MgO recording layer by eliminating the spin pumping effect. The low magnetic damping contributes to a 3-orders-of-magnitude reduction in the write-error rate for the longer write pulses, which is explained by the suppression of thermal fluctuation during the switching process. The low magnetic damping also enables a long period of magnetization precession to control the dynamics via the voltage-controlled magnetic anisotropy effect.
Brand new mechanism of strain-induced magnetic anisotropy is proposed to secure retention energy while keeping writing current small for SOT-MRAM. The new mechanism succeeded in making switching current threshold inde...
详细信息
The notion of variation is introduced for the Boolean set and based on which Boolean logic backpropagation principle is developed. Using this concept, deep models can be built with weights and activations being Boolea...
详细信息
It is described how the heat generation by an electrical current in a ferromagnetic tunnel contact to a nonmagnetic material depends on the spin accumulation in the nonmagnetic electrode for both Joule and Peltier hea...
详细信息
It is described how the heat generation by an electrical current in a ferromagnetic tunnel contact to a nonmagnetic material depends on the spin accumulation in the nonmagnetic electrode for both Joule and Peltier heating. This enables the control of the heating in the tunnel contact by an external applied magnetic field that induces spin precession of the spin accumulation. Thereby, a Hanle type of spin signal is imprinted in the heating power. We derive expressions for the magnitude and sign of the magnetic-field-dependent heating power for Joule and Peltier heating, and discuss the important parameters. For contacts with small resistance-area product, the spin accumulation provides the dominant contribution to the Joule heating power, which can therefore be modulated by more than a factor of 2 with a magnetic field. The described phenomenon can also produce genuine spin signals in various devices, including nonlocal lateral spin valves.
暂无评论