In this paper, rate splitting (RS) has been applied in a mixed dual-hop radio frequency/free space optical (RF/FSO) relay system. In particular, assuming fixed-gain amplify-and-forward (AF) and decode-and-forward (DF)...
详细信息
An increasingly popular machine learning paradigm is to pretrain a neural network (NN) on many tasks offline, then adapt it to downstream tasks, often by re-training only the last linear layer of the network. This app...
详细信息
An increasingly popular machine learning paradigm is to pretrain a neural network (NN) on many tasks offline, then adapt it to downstream tasks, often by re-training only the last linear layer of the network. This approach yields strong downstream performance in a variety of contexts, demonstrating that multitask pretraining leads to effective feature learning. Although several recent theoretical studies have shown that shallow NNs learn meaningful features when either (i) they are trained on a single task or (ii) they are linear, very little is known about the closer-to-practice case of nonlinear NNs trained on multiple tasks. In this work, we present the first results proving that feature learning occurs during training with a nonlinear model on multiple tasks. Our key insight is that multi-task pretraining induces a pseudo-contrastive loss that favors representations that align points that typically have the same label across tasks. Using this observation, we show that when the tasks are binary classification tasks with labels depending on the projection of the data onto an r-dimensional subspace within the d rdimensional input space, a simple gradient-based multitask learning algorithm on a two-layer ReLU NN recovers this projection, allowing for generalization to downstream tasks with sample and neuron complexity independent of d. In contrast, we show that with high probability over the draw of a single task, training on this single task cannot guarantee to learn all r ground-truth features. Copyright 2024 by the author(s)
The automatic localization of the left ventricle(LV)in short-axis magnetic resonance(MR)images is a required step to process cardiac images using convolutional neural networks for the extraction of a region of interes...
详细信息
The automatic localization of the left ventricle(LV)in short-axis magnetic resonance(MR)images is a required step to process cardiac images using convolutional neural networks for the extraction of a region of interest(ROI).The precise extraction of the LV’s ROI from cardiac MRI images is crucial for detecting heart disorders via cardiac segmentation or ***,this task appears to be intricate due to the diversities in the size and shape of the LV and the scattering of surrounding tissues across different ***,this study proposed a region-based convolutional network(Faster R-CNN)for the LV localization from short-axis cardiac MRI images using a region proposal network(RPN)integrated with deep feature classification and *** was trained using images with corresponding bounding boxes(labels)around the LV,and various experiments were applied to select the appropriate layers and set the suitable *** experimental findings showthat the proposed modelwas adequate,with accuracy,precision,recall,and F1 score values of 0.91,0.94,0.95,and 0.95,*** model also allows the cropping of the detected area of LV,which is vital in reducing the computational cost and time during segmentation and classification ***,itwould be an ideal model and clinically applicable for diagnosing cardiac diseases.
The quality of the airwe breathe during the courses of our daily lives has a significant impact on our health and well-being as ***,personal air quality measurement remains *** this study,we investigate the use of fir...
详细信息
The quality of the airwe breathe during the courses of our daily lives has a significant impact on our health and well-being as ***,personal air quality measurement remains *** this study,we investigate the use of first-person photos for the prediction of air *** main idea is to harness the power of a generalized stacking approach and the importance of haze features extracted from first-person images to create an efficient new stacking model called AirStackNet for air pollution *** consists of two layers and four regression models,where the first layer generates meta-data fromLight Gradient Boosting Machine(Light-GBM),Extreme Gradient Boosting Regression(XGBoost)and CatBoost Regression(CatBoost),whereas the second layer computes the final prediction from the meta-data of the first layer using Extra Tree Regression(ET).The performance of the proposed AirStackNet model is validated using public Personal Air Quality Dataset(PAQD).Our experiments are evaluated using Mean Absolute Error(MAE),Root Mean Square Error(RMSE),Coefficient of Determination(R2),Mean Squared Error(MSE),Root Mean Squared Logarithmic Error(RMSLE),and Mean Absolute Percentage Error(MAPE).Experimental Results indicate that the proposed AirStackNet model not only can effectively improve air pollution prediction performance by overcoming the Bias-Variance tradeoff,but also outperforms baseline and state of the art models.
Bayesian optimization (BO) is more efficient in automatically synthesizing operational amplifier (opamp) topologies compared to conventional methods. However, the design space for behavior-level opamp topologies invol...
详细信息
Green-hydrogen production is vital in mitigating carbon emissions and is being adopted *** its transition to a more diverse energy mix with a bigger share for renewable energy,United Arab Emirates(UAE)has committed to...
详细信息
Green-hydrogen production is vital in mitigating carbon emissions and is being adopted *** its transition to a more diverse energy mix with a bigger share for renewable energy,United Arab Emirates(UAE)has committed to investing billions of dollars in the production of green *** study presents the results of the techno-economic assessment of a green-hydrogen-based commercial-building microgrid design in the *** microgrid has been designed based on the building load demand,green-hydrogen production potential utilizing solar photovoltaic(PV)energy and discrete stack reversible fuel cell electricity generation during non-PV *** the current market conditions and the hot humid climate of the UAE,a performance analysis is derived to evaluate the technical and economic feasibility of this *** study aims at maximizing both the building microgrid’s independence from the main grid and its renewable *** results indicate that the designed system is capable of meeting three-quarters of its load demand independently from the main grid and is supported by a 78%renewable-energy *** economic analysis demonstrates a 3.117-$/kg levelized cost of hydrogen production and a 0.248-$/kWh levelized cost for storing hydrogen as ***,the levelized cost of system energy was found to be less than the current utility costs in the *** analysis shows the significant impact of the capital cost and discount rate on the levelized cost of hydrogen generation and storage.
This paper addresses the critical challenge of privacy in Online Social Networks(OSNs),where centralized designs compromise user *** propose a novel privacy-preservation framework that integrates blockchain technology...
详细信息
This paper addresses the critical challenge of privacy in Online Social Networks(OSNs),where centralized designs compromise user *** propose a novel privacy-preservation framework that integrates blockchain technology with deep learning to overcome these *** methodology employs a two-tier architecture:the first tier uses an elitism-enhanced Particle Swarm Optimization and Gravitational Search Algorithm(ePSOGSA)for optimizing feature selection,while the second tier employs an enhanced Non-symmetric Deep Autoencoder(e-NDAE)for anomaly ***,a blockchain network secures users’data via smart contracts,ensuring robust data *** tested on the NSL-KDD dataset,our framework achieves 98.79%accuracy,a 10%false alarm rate,and a 98.99%detection rate,surpassing existing *** integration of blockchain and deep learning not only enhances privacy protection in OSNs but also offers a scalable model for other applications requiring robust security measures.
Among various power system disturbances,cascading failures are considered the most serious and extreme threats to grid operations,potentially leading to significant stability issues or even widespread power *** power ...
详细信息
Among various power system disturbances,cascading failures are considered the most serious and extreme threats to grid operations,potentially leading to significant stability issues or even widespread power *** power systems’behaviors during cascading failures is of great importance to comprehend how failures originate and propagate,as well as to develop effective preventive and mitigative control *** intricate mechanism of cascading failures,characterized by multi-timescale dynamics,presents exceptional challenges for their *** paper provides a comprehensive review of simulation models for cascading failures,providing a systematic categorization and a comparison of these *** challenges and potential research directions for the future are also discussed.
Multi-armed bandits (MAB) is a sequential decision-making model in which the learner controls the trade-off between exploration and exploitation to maximize its cumulative reward. Federated multi-armed bandits (FMAB) ...
详细信息
We show that a classical spin liquid phase can emerge from an ordered magnetic state in the two-dimensional frustrated Shastry-Sutherland Ising lattice due to lateral confinement. Two distinct classical spin liquid st...
详细信息
We show that a classical spin liquid phase can emerge from an ordered magnetic state in the two-dimensional frustrated Shastry-Sutherland Ising lattice due to lateral confinement. Two distinct classical spin liquid states are stabilized: (i) long-range spin-correlated dimers, and (ii) exponentially decaying spin-correlated disordered states, depending on widths of W=3n, 3n+1 or W=3n+2,n being a positive integer. Stabilization of spin liquids in a square-triangular lattice moves beyond the conventional geometric paradigm of kagome, triangular, or tetrahedral arrangements of antiferromagnetic ions, where spin liquids have been discussed conventionally.
暂无评论