Traffic congestion has emerged as a pervasive challenge across global urban landscapes, inducing delays, productivity losses, and heightened air pollution. Conventional traffic signal systems often falter in adapting ...
详细信息
Objective: To develop a computer-aided diagnostic system for retinopathy of prematurity (ROP) disease using retinal vessel morphological features. Methods: A total of 200 fundus images from 136 preterm infants with st...
Résumé: Les outils digitaux tels que la blockchain, l’Internet des objets (IoT) et le big data (BD) ont été largement utilisés pour digitaliser la logistique et la gestion de la chaîne d...
详细信息
Model compression is one of the most popular approaches to improve the accessibility of Large Language Models (LLMs) by reducing their memory footprint. However, the gaining of such efficiency benefits often simultane...
详细信息
Model compression is one of the most popular approaches to improve the accessibility of Large Language Models (LLMs) by reducing their memory footprint. However, the gaining of such efficiency benefits often simultaneously demands extensive engineering efforts and intricate designs to mitigate the performance decline. In this work, we leverage (Soft) Prompt Tuning in its most vanilla form and discover such conventionally learned soft prompts can recover the performance of compressed LLMs. More surprisingly, we observe such recovery effect to be transferable among different tasks and models (albeit natural tokenizer and dimensionality limitations), resulting in further overhead reduction and yet, subverting the common belief that learned soft prompts are task-specific. Our work is fully orthogonal and compatible with model compression frameworks such as pruning and quantization, where we enable up to 8× compressed LLM (with a joint 4-bit quantization and 50% weight pruning compression) to match its uncompressed counterparts on popular benchmarks. We note that we are the first to reveal vanilla Parameter-Efficient Fine-Tuning (PEFT) techniques have the potential to be utilized under a compression recovery context, opening a new line of opportunities for model accessibility advancement while freeing our fellow researchers from the previously present engineering burdens and constraints. The code is available at https://***/zirui-ray-liu/compress-thenprompt. Copyright 2024 by the author(s)
As per the Data Compiled by the Ministry of Indian Railways, there are nearly 5413 people who lost their lives in Railway accidents from 2015-2020, most of which are due to careless and rushed boarding & de-boardi...
详细信息
The social media platform Twitter is all about what’s happening in the world. Twitter has been the core of spread of information when compared with other social media platforms. Anything and everything break open on ...
详细信息
Ambiguous set has recently been introduced as a new branch of mathematics and computerscience dealing with the nature of ambiguity of uncertain events. There is much scope for the development of new theories based on...
详细信息
The integrated wind turbine-power transmission line systems integrate wind turbines into high-voltage power transmission lines by directly interconnecting wind turbines to high-voltage power transmission lines without...
详细信息
Dual Active Bridge (DAB) converter is the most prominent topology of Isolated Bidirectional DC-DC (IBDC) converters. This type of DAB converter serves as interface between the energy storage devices for renewable ener...
详细信息
Reconfigurable intelligent surface(RIS)assisted dual-function radar communications(DFRC)system is a promising integrated sensing and communication(ISAC)technology for future *** this paper,we propose a scheme of RIS-a...
详细信息
Reconfigurable intelligent surface(RIS)assisted dual-function radar communications(DFRC)system is a promising integrated sensing and communication(ISAC)technology for future *** this paper,we propose a scheme of RIS-assisted DFRC system based on frequency shifted chirp spread spectrum index modulation(RDFI)for secure *** proposed RDFI achieves the sensing and transmission of target location information in its radar and communication modes,*** both modes,the frequency-shifted chirp spread spectrum index modulation(FSCSS-IM)signal is used as the baseband signal for radar and communications,so that the signal sent by the radar also carries *** scheme implements the RIS-assisted beamforming in the communication mode through the azimuth information of the target acquired in the radar mode,so that the signal received from the eavesdropper is distorted in amplitude and *** addition,this paper analyzes the radar measurement accuracy and communication security of the FSCSS-IM signal using ambiguity function and secrecy rate(SR)analysis,*** results show that RDFI achieves both excellent bit error rate(BER)performance and physical layer security of communications.
暂无评论