Personalized Federated Learning (PFL) represents a promising solution for decentralized learning in heterogeneous data environments. Partial model personalization has been proposed to improve the efficiency of PFL by ...
Personalized Federated Learning (PFL) represents a promising solution for decentralized learning in heterogeneous data environments. Partial model personalization has been proposed to improve the efficiency of PFL by selectively updating local model parameters instead of aggregating all of them. However, previous work on partial model personalization has mainly focused on Convolutional Neural Networks (CNNs), leaving a gap in understanding how it can be applied to other popular models such as Vision Transformers (ViTs). In this work, we investigate where and how to partially personalize a ViT model. Specifically, we empirically evaluate the sensitivity to data distribution of each type of layer. Based on the insights that the self-attention layer and the classification head are the most sensitive parts of a ViT, we propose a novel approach called FedPerfix, which leverages plugins to transfer information from the aggregated model to the local client as a personalization. Finally, we evaluate the proposed approach on CIFAR-100, OrganAMNIST, and Office-Home datasets and demonstrate its effectiveness in improving the model’s performance compared to several advanced PFL methods. Code is available at https://***/imguangyu/FedPerfix
We have built a scalable mixed-signal readout circuit for a 3D position sensitive PET detector that achieves ~100 ps FWHM CTR. For this work we used individual 3×3×3 mm3 and 3×3×10 mm3 LGSO crystal...
We present a deep-learning method based on Wiener filters and U-Nets that performs image reconstruction in systems with spatially-varying aberrations. We train on simulated microscopy measurements and test on experime...
详细信息
Nanotechnology-based drug delivery platforms have been developed over the last two decades because of their favorable features in terms of improved drug bioavailability and *** recent advancement in nanotechnology pla...
详细信息
Nanotechnology-based drug delivery platforms have been developed over the last two decades because of their favorable features in terms of improved drug bioavailability and *** recent advancement in nanotechnology platforms,this approach still falls short to meet the complexity of biological systems and diseases,such as avoiding systemic side effects,manipulating biological interactions and overcoming drug resistance,which hinders the therapeutic outcomes of the NP-based drug delivery *** address these issues,various strategies have been developed including the use of engineered cells and/or cell membrane-coated *** membrane receptor profiles and characteristics are vital in performing therapeutic functions,targeting,and homing of either engineered cells or cell membrane-coated nanocarriers to the sites of *** this context,we comprehensively discuss various cell-and cell membrane-based drug delivery approaches towards cancer therapy,the therapeutic potential of these strategies,and the limitations associated with engineered cells as drug carriers and cell membrane-associated drug ***,we review various cell types and cell membrane receptors for their potential in targeting,immunomodulation and overcoming drug resistance in cancer.
In breast cancer detection and diagnosis, the longitudinal analysis of mammogram images is crucial. Contemporary models excel in detecting temporal imaging feature changes, thus enhancing the learning process over seq...
详细信息
Understanding the process of learning in neural networks is crucial for improving their performance and interpreting their behavior. This can be approximately understood by asking how a model's output is influence...
详细信息
Osteochondral tissue is a highly specialized and complex tissue composed of articular cartilage and subchondral bone that are separated by a calcified cartilage *** or gradient scaffolds,often in conjunction with stem...
详细信息
Osteochondral tissue is a highly specialized and complex tissue composed of articular cartilage and subchondral bone that are separated by a calcified cartilage *** or gradient scaffolds,often in conjunction with stem cells and growth factors,have been developed to mimic the respective layers for osteochondral defect *** this study,we designed a hyaline cartilage-hypertrophic cartilage bilayer graft(RGD/RGDW)with ***,we demonstrated that RGD peptide-modified chondroitin sulfate cryogel(RGD group)is chondro-conductive and capable of hyaline cartilage ***,we incorporated whitlockite(WH),a Mg^(2+)-containing calcium phosphate,into RGD cryogel(RGDW group)to induce chondrocyte hypertrophy and form collagen X-rich hypertrophic *** is the first study to use WH to produce hypertrophic ***-laden RGDW cryogel exhibited significantly upregulated expression of hypertrophy markers in vitro and formed ectopic hypertrophic cartilage in vivo,which mineralized into calcified cartilage in bone ***,RGD cryogel and RGDW cryogel were combined into bilayer(RGD/RGDW group)and implanted into rabbit osteochondral defect,where RGD layer supports hyaline cartilage regeneration and bioceramic-containing RGDW layer promotes calcified cartilage *** the RGD group(monolayer)formed hyaline-like neotissue that extends into the subchondral bone,the RGD/RGDW group(bilayer)regenerated hyaline cartilage tissue confined to its respective layer and promoted osseointegration for integrative defect repair.
暂无评论