Good power quality and high-power efficiency are important aspects of power system management. Harmonic, as an unwanted frequency component in electrical signals, can interfere with power quality and reduce electrical...
详细信息
A key challenge in contrastive learning is to generate negative samples from a large sample set to contrast with positive samples, for learning better encoding of the data. These negative samples often follow a softma...
详细信息
A key challenge in contrastive learning is to generate negative samples from a large sample set to contrast with positive samples, for learning better encoding of the data. These negative samples often follow a softmax distribution which are dynamically updated during the training process. However, sampling from this distribution is non-trivial due to the high computational costs in computing the partition function. In this paper, we propose an Efficient Markov Chain Monte Carlo negative sampling method for Contrastive learning (EMC2). We follow the global contrastive learning loss as introduced in (Yuan et al., 2022), and propose EMC2 which utilizes an adaptive Metropolis-Hastings subroutine to generate hardness-aware negative samples in an online fashion during the optimization. We prove that EMC2 finds an O(1/√T)-stationary point of the global contrastive loss in T iterations. Compared to prior works, EMC2 is the first algorithm that exhibits global convergence (to stationarity) regardless of the choice of batch size while exhibiting low computation and memory cost. Numerical experiments validate that EMC2 is effective with small batch training and achieves comparable or better performance than baseline algorithms. We report the results for pre-training image encoders on STL-10 and Imagenet-100. Copyright 2024 by the author(s)
The strong impact of the strain-induced Dzyaloshinskii-Moriya interaction (SIDMI) on the magnetization dynamics of skyrmions in nanomagnetic structures is demonstrated. The effects of SIDMI are characterized by skyrmi...
详细信息
The strong impact of the strain-induced Dzyaloshinskii-Moriya interaction (SIDMI) on the magnetization dynamics of skyrmions in nanomagnetic structures is demonstrated. The effects of SIDMI are characterized by skyrmion equations (SEs) of motion and magnetoelastic (ME) equations. The study is performed on a model system of MgO/CoFe/Pt stacked on a piezoelectric substrate. The results demonstrate a major nonlinear amplification in both the first- and higher-harmonic magnitudes of the skyrmion breathing mode due to SIDMI. Remarkably, this enhancement can trigger a skyrmion collapse, enabling its deletion with ultraweak strain-induced excitations. The SIDMI effect is shown to be much more significant than the conventional ME effect. These findings open different avenues for the efficient manipulation of nanomagnetic structures through strain.
Cardiovascular diseases (CVDs), a leading cause of global mortality, are intricately linked to arterial stiffness, a key factor in cardiovascular health. Non-invasive assessment of arterial stiffness, particularly thr...
详细信息
Empowering cellular networks with augmented sensing capabilities is a key research area in sixth generation (6 G) communication systems. Recently, we have witnessed a plethora of efforts to devise solutions that integ...
详细信息
In recent times, planar omnidirectional wireless power transfer has emerged as a prominent technology, especially in consumer electronics application. However, in such scenario, the presence of multiple receivers with...
详细信息
The integration of edge controllers into smart grid infrastructures facilitates advanced functionalities and high responsiveness, thereby bolstering the overall efficiency of the energy grid. The freshness of the sens...
详细信息
The topology selection plays a key role in minimizing the losses and improving the output waveform quality of an inverter. In addition, increasing the switching frequency of an inverter help to reduce the size of EMI ...
详细信息
The emerging and foreseen advancements in 5G and Beyond 5G (B5G) networking infrastructures enhance both communications capabilities and the flexibility of executing computational tasks in a distributed manner, includ...
详细信息
Establishing early warning systems and efficient management of water resources in tidal reaches is crucial for achieving adequate flood protection. In tidal reaches, the river stage interacts non-linearly with tides (...
详细信息
暂无评论