With the rapid development of blockchain technology, P2P networks are facing increasing security threats, among which Eclipse attacks, as a type of network isolation attack, have seriously affected the normal operatio...
详细信息
The integration of machine learning (ML) into mobile applications presents unique challenges, particularly in resource-constrained environments such as iOS devices. Skin lesion classification is a critical task in der...
详细信息
This study focuses on designing of lead-free double perovskite solar cells (DPSCs). Lead-free organic–inorganic DPSCs have achieved very good efficiency within a short period of active research. Formamidinium based d...
详细信息
In video surveillance,anomaly detection requires training machine learning models on spatio-temporal video ***,sometimes the video-only data is not sufficient to accurately detect all the abnormal ***,we propose a nov...
详细信息
In video surveillance,anomaly detection requires training machine learning models on spatio-temporal video ***,sometimes the video-only data is not sufficient to accurately detect all the abnormal ***,we propose a novel audio-visual spatiotemporal autoencoder specifically designed to detect anomalies for video surveillance by utilizing audio data along with video *** paper presents a competitive approach to a multi-modal recurrent neural network for anomaly detection that combines separate spatial and temporal autoencoders to leverage both spatial and temporal features in audio-visual *** proposed model is trained to produce low reconstruction error for normal data and high error for abnormal data,effectively distinguishing between the two and assigning an anomaly *** is conducted on normal datasets,while testing is performed on both normal and anomalous *** anomaly scores from the models are combined using a late fusion technique,and a deep dense layer model is trained to produce decisive scores indicating whether a sequence is normal or *** model’s performance is evaluated on the University of California,San Diego Pedestrian 2(UCSD PED 2),University of Minnesota(UMN),and Tampere University of Technology(TUT)Rare Sound Events datasets using six evaluation *** is compared with state-of-the-art methods depicting a high Area Under Curve(AUC)and a low Equal Error Rate(EER),achieving an(AUC)of 93.1 and an(EER)of 8.1 for the(UCSD)dataset,and an(AUC)of 94.9 and an(EER)of 5.9 for the UMN *** evaluations demonstrate that the joint results from the combined audio-visual model outperform those from separate models,highlighting the competitive advantage of the proposed multi-modal approach.
Model compression is one of the most popular approaches to improve the accessibility of Large Language Models (LLMs) by reducing their memory footprint. However, the gaining of such efficiency benefits often simultane...
详细信息
Model compression is one of the most popular approaches to improve the accessibility of Large Language Models (LLMs) by reducing their memory footprint. However, the gaining of such efficiency benefits often simultaneously demands extensive engineering efforts and intricate designs to mitigate the performance decline. In this work, we leverage (Soft) Prompt Tuning in its most vanilla form and discover such conventionally learned soft prompts can recover the performance of compressed LLMs. More surprisingly, we observe such recovery effect to be transferable among different tasks and models (albeit natural tokenizer and dimensionality limitations), resulting in further overhead reduction and yet, subverting the common belief that learned soft prompts are task-specific. Our work is fully orthogonal and compatible with model compression frameworks such as pruning and quantization, where we enable up to 8× compressed LLM (with a joint 4-bit quantization and 50% weight pruning compression) to match its uncompressed counterparts on popular benchmarks. We note that we are the first to reveal vanilla Parameter-Efficient Fine-Tuning (PEFT) techniques have the potential to be utilized under a compression recovery context, opening a new line of opportunities for model accessibility advancement while freeing our fellow researchers from the previously present engineering burdens and constraints. The code is available at https://***/zirui-ray-liu/compress-thenprompt. Copyright 2024 by the author(s)
This article investigates large batch training techniques using layer-wise adaptive scaling ratio (LARS) across diverse settings. In particular, we first show that a state-of-the-art technique, called LARS with the wa...
详细信息
Extensive efforts have been made in designing large multiple-input multiple-output(MIMO)arrays. Nevertheless, improvements in conventional antenna characteristics cannot ensure significant MIMO performance improvement...
详细信息
Extensive efforts have been made in designing large multiple-input multiple-output(MIMO)arrays. Nevertheless, improvements in conventional antenna characteristics cannot ensure significant MIMO performance improvement in realistic multipath environments. Array decorrelation techniques have been proposed, achieving correlation reductions by either tilting the antenna beams or shifting the phase centers away from each other. Hence, these methods are mainly limited to MIMO terminals with small arrays. To avoid such problems, this work proposes a decorrelation optimization technique based on phase correcting surface(PCS)that can be applied to large MIMO arrays, enhancing their MIMO performances in a realistic(non-isotropic)multipath environment. First, by using a near-field channel model and an optimization algorithm, a near-field phase distribution improving the MIMO capacity is obtained. Then the PCS(consisting of square elements)is used to cover the array's aperture, achieving the desired near-field phase *** examples demonstrate the effectiveness of this PCS-based near-field optimization technique. One is a1 × 4 dual-polarized patch array(working at 2.4 GHz)covered by a 2 × 4 PCS with 0.6λ center-to-center distance. The other is a 2 × 8 dual-polarized dipole array, for which a 4 × 8 PCS with 0.4λ center-to-center distance is designed. Their MIMO capacities can be effectively enhanced by 8% and 10% in single-cell and multi-cell scenarios, respectively. The PCS has insignificant effects on mutual coupling, matching, and the average radiation efficiency of the patch array, and increases the antenna gain by about 2.5 dB while keeping broadside radiations to ensure good cellular coverage, which benefits the MIMO performance of the *** proposed technique offers a new perspective for improving large MIMO arrays in realistic multipath in a statistical sense.
Modular conversational systems heavily rely on the performance of their natural language understanding (NLU) and natural language generation (NLG) components. NLU focuses on extracting core semantic concepts from inpu...
详细信息
In recent years,intelligent robots are extensively applied in the field of the industry and intelligent rehabilitation,wherein the human-robot interaction(HRI)control strategy is a momentous part that needs to be ***,...
详细信息
In recent years,intelligent robots are extensively applied in the field of the industry and intelligent rehabilitation,wherein the human-robot interaction(HRI)control strategy is a momentous part that needs to be ***,the efficacy and robustness of the HRI control algorithm in the presence of unknown external disturbances deserve to be *** deal with these urgent issues,in this study,artificial systems,computational experiments and a parallel execution intelligent control framework are constructed for the HRI *** upper limb-robotic exoskeleton system is re-modelled as an artificial *** on surface electromyogram-based subject's active motion intention in the practical system,a non-convex function activated anti-disturbance zeroing neurodynamic(NC-ADZND)controller is devised in the artificial system for parallel interaction and HRI control with the practical ***,the linear activation function-based zeroing neurodynamic(LAF-ZND)controller and proportionalderivative(posterior deltoid(PD))controller are presented and *** results substantiate the global convergence and robustness of the proposed controller in the presence of different external *** addition,the simulation results verify that the NC-ADZND controller is better than the LAF-ZND and the PD controllers in respect of convergence order and anti-disturbance characteristics.
This work considers the problem of intercepting rogue drones targeting sensitive critical infrastructure facilities. While current interception technologies focus mainly on the jamming/spoofing tasks, the challenges o...
详细信息
暂无评论