检索结果-内蒙古大学图书馆

Rethinking Barely-Supervised Volumetric Medical Image Segmentation from an Unsupervised Domain Adaptation Perspective

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Shen, Zhiqiang Cao, Peng Su, Junming Yang, Jinzhu Zaiane, Osmar R. School of Computer Science and Engineering Northeastern University Shenyang110819 China Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Northeastern University Shenyang110819 China Alberta Machine Intelligence Institute University of Alberta Edmonton Canada

This paper investigates an extremely challenging problem: barely-supervised volumetric medical image segmentation (BSS). A BSS training dataset consists of two parts: 1) a barely-annotated labeled set, where each labeled image contains only a single-slice annotation, and 2) an unlabeled set comprising numerous unlabeled volumetric images. State-of-the-art BSS methods employ a registration-based paradigm, which uses inter-slice image registration to propagate single-slice annotations into volumetric pseudo labels, constructing a completely annotated labeled set, to which a semi-supervised segmentation scheme can be applied. However, the paradigm has a critical limitation: the pseudo-labels generated by image registration are unreliable and noisy. Motivated by this, we propose a new perspective: instead of solving BSS within a semi-supervised learning scheme, this work formulates BSS as an unsupervised domain adaptation problem. To this end, we propose a novel BSS framework, Barely-supervised learning via unsupervised domain Adaptation (BvA), as an alternative to the dominant registration paradigm. Specifically, we first design a novel noise-free labeled data construction algorithm (NFC) for slice-to-volume labeled data synthesis. Then, we introduce a frequency and spatial Mix-Up strategy (FSX) to mitigate the domain shifts. Extensive experiments demonstrate that our method provides a promising alternative for BSS. Remarkably, the proposed method, trained on the left atrial segmentation dataset with only one barely-labeled image, achieves a Dice score of 81.20%, outperforming the state-of-the-art by 61.71%. The code is available at https://***/Senyh/BvA. Copyright © 2024, The Authors. All rights reserved.

关键词： Self-supervised learning

A Hierarchical Semantic Distillation Framework for Open-Vocabulary Object Detection

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Fu, Shenghao Yan, Junkai Yang, Qize Wei, Xihan Xie, Xiaohua Zheng, Wei-Shi School of Computer Science and Engineering Sun Yat-sen University Guangzhou510006 China Peng Cheng Laboratory China Tongyi Lab Alibaba Group China School of Computer Science and Engineering Sun Yat-sen University Guangdong Guangzhou China Guangdong Key Laboratory of Information Security Technology Sun Yat-sen University Guangdong Guangzhou China Key Laboratory of Machine Intelligence and Advanced Computing Sun Yat-sen University Ministry of Education Guangdong Guangzhou China

Open-vocabulary object detection (OVD) aims to detect objects beyond the training annotations, where detectors are usually aligned to a pre-trained vision-language model, e.g., CLIP, to inherit its generalizable recognition ability so that detectors can recognize new or novel objects. However, previous works directly align the feature space with CLIP and fail to learn the semantic knowledge effectively. In this work, we propose a hierarchical semantic distillation framework named HD-OVD to construct a comprehensive distillation process, which exploits generalizable knowledge from the CLIP model in three aspects. In the first hierarchy of HD-OVD, the detector learns fine-grained instance-wise semantics from the CLIP image encoder by modeling relations among single objects in the visual space. Besides, we introduce text space novel-class-aware classification to help the detector assimilate the highly generalizable classwise semantics from the CLIP text encoder, representing the second hierarchy. Lastly, abundant image-wise semantics containing multi-object and their contexts are also distilled by an image-wise contrastive distillation. Benefiting from the elaborated semantic distillation in triple hierarchies, our HD-OVD inherits generalizable recognition ability from CLIP in instance, class, and image levels. Thus, we boost the novel AP on the OV-COCO dataset to 46.4% with a ResNet50 backbone, which outperforms others by a clear margin. We also conduct extensive ablation studies to analyze how each component works. Code is available at https://***/iSEE-laboratory/HD-OVD. Copyright © 2025, The Authors. All rights reserved.

关键词： Semantics

From intuition to AI: evolution of small molecule representations in drug discovery

学校读者我要写书评

暂无评论

BRIEFINGS IN BIOINFORMATICS 2024年第1期25卷 bbad422-bbad422页

作者： Mcgibbon, Miles Shave, Steven Dong, Jie Gao, Yumiao Houston, Douglas R. Xie, Jiancong Yang, Yuedong Schwaller, Philippe Blay, Vincent Institute of Quantitative Biology Biochemistry and Biotechnology University of Edinburgh Edinburgh Scotland EH9 3BF United Kingdom Xiangya School of Pharmaceutical Sciences Central South University Changsha 410013 China Key Laboratory of Machine Intelligence and Advanced Computing Sun Yat-Sen University Guangzhou 510000 China Laboratory of Artificial Chemical Intelligence (LIAC) Institut des Sciences et Ingénierie Chimiques Ecole Polytechnique Fédérale de Lausanne (EPFL) Lausanne Switzerland

Within drug discovery, the goal of AI scientists and cheminformaticians is to help identify molecular starting points that will develop into safe and efficacious drugs while reducing costs, time and failure rates. To achieve this goal, it is crucial to represent molecules in a digital format that makes them machine-readable and facilitates the accurate prediction of properties that drive decision-making. Over the years, molecular representations have evolved from intuitive and human-readable formats to bespoke numerical descriptors and fingerprints, and now to learned representations that capture patterns and salient features across vast chemical spaces. Among these, sequence-based and graph-based representations of small molecules have become highly popular. However, each approach has strengths and weaknesses across dimensions such as generality, computational cost, inversibility for generative applications and interpretability, which can be critical in informing practitioners' decisions. As the drug discovery landscape evolves, opportunities for innovation continue to emerge. These include the creation of molecular representations for high-value, low-data regimes, the distillation of broader biological and chemical knowledge into novel learned representations and the modeling of up-and-coming therapeutic modalities.

关键词： drug discovery autoencoders transformers artificial intelligence SMILES machine learning

Vision-Language Model IP Protection via Prompt-based Learning

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Lianyu Wang, Meng Fu, Huazhu Zhang, Daoqiang The Key Laboratory of Brain-Machine Intelligence Technology Ministry of Education China Centre for Innovation and Precision Eye Health Yong Loo Lin School of Medicine National University of Singapore Singapore Institute of High Performance Computing Agency for Science Technology and Research Singapore

Vision-language models (VLMs) like CLIP (Contrastive Language-Image Pre-Training) have seen remarkable success in visual recognition, highlighting the increasing need to safeguard the intellectual property (IP) of well-trained models. Effective IP protection extends beyond ensuring authorized usage;it also necessitates restricting model deployment to authorized data domains, particularly when the model is fine-tuned for specific target domains. However, current IP protection methods often rely solely on the visual backbone, which may lack sufficient semantic richness. To bridge this gap, we introduce IP-CLIP, a lightweight IP protection strategy tailored to CLIP, employing a prompt-based learning approach. By leveraging the frozen visual backbone of CLIP, we extract both image style and content information, incorporating them into the learning of IP prompt. This strategy acts as a robust barrier, effectively preventing the unauthorized transfer of features from authorized domains to unauthorized ones. Additionally, we propose a style-enhancement branch that constructs feature banks for both authorized and unauthorized domains. This branch integrates self-enhanced and cross-domain features, further strengthening IP-CLIP’s capability to block features from unauthorized domains. Finally, we present new three metrics designed to better balance the performance degradation of authorized and unauthorized domains. Comprehensive experiments in various scenarios demonstrate its promising potential for application in IP protection tasks for VLMs. © 2025, CC BY-NC-ND.

关键词： Semantics

Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentification

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wu, Chao Ge, Wenhang Wu, Ancong Chang, Xiaobin School of Artificial Intelligence Sun Yat-sen University China Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou510006 China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China School of Computer Science and Engineering Sun Yat-sen University China

To learn camera-view invariant features for person Re-IDentification (Re-ID), the cross-camera image pairs of each person play an important role. However, such cross-view training samples could be unavailable under the ISolated Camera Supervised (ISCS) setting, e.g., a surveillance system deployed across distant scenes. To handle this challenging problem, a new pipeline is introduced by synthesizing the cross-camera samples in the feature space for model training. Specifically, the feature encoder and generator are end-to-end optimized under a novel method, Camera-Conditioned Stable Feature Generation (CCSFG). Its joint learning procedure raises concern on the stability of generative model training. Therefore, a new feature generator, σ-Regularized Conditional Variational Autoencoder (σReg. CVAE), is proposed with theoretical and experimental analysis on its robustness. Extensive experiments on two ISCS person Re-ID datasets demonstrate the superiority of our CCSFG to the competitors. 1 © 2022, CC BY.

关键词： Cameras

Self-Paced Sample Selection for Barely-Supervised Medical Image Segmentation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Su, Junming Shen, Zhiqiang Cao, Peng Yang, Jinzhu Zaiane, Osmar R. Computer Science and Engineering Northeastern University Shenyang China Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Northeastern University Shenyang China National Frontiers Science Center for Industrial Intelligence and Systems Optimization Shenyang China Alberta Machine Intelligence Institute University of Alberta Edmonton Canada

The existing barely-supervised medical image segmentation (BSS) methods, adopting a registration-segmentation paradigm, aim to learn from data with very few annotations to mitigate the extreme label scarcity problem. However, this paradigm poses a challenge: pseudo-labels generated by image registration come with significant noise. To address this issue, we propose a self-paced sample selection framework (SPSS) for BSS. Specifically, SPSS comprises two main components: 1) self-paced uncertainty sample selection (SU) for explicitly improving the quality of pseudo labels in the image space, and 2) self-paced bidirectional feature contrastive learning (SC) for implicitly improving the quality of pseudo labels through enhancing the separability between class semantics in the feature space. Both SU and SC are trained collaboratively in a self-paced learning manner, ensuring that SPSS can learn from high-quality pseudo labels for BSS. Extensive experiments on two public medical image segmentation datasets demonstrate the effectiveness and superiority of SPSS over the state-of-the-art. Our code is release at https://***/SuuuJM/SPSS. Copyright © 2024, The Authors. All rights reserved.

关键词： Image enhancement

A differential public PUF design for lightweight authentication 16

学校读者我要写书评

暂无评论

A differential public PUF design for lightweight authenticat...

2021 International Conference on Synthesis, Modeling, Analysis and Simulation Methods and Applications to Circuit Design, SMACD 2021 and 16th Conference on PhD Research in Microelectronics and Electronics, PRIME 2021

作者： Duan, Shengyu Sai, Gaole School of Computer Engineering and Science Shanghai University Shanghai200444 China State Key Laboratory of Computer Architecture Institute of Computing Technology Chinese Academy of Sciences China Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen Institutes of Advanced Technology China

ISBN: (纸本)9783800755899

Physical Unclonable Functions (PUFs) have emerged as a promising primitive to provide a hardware keyless security mechanism for integrated circuit applications. Public PUFs (PPUFs) address the crucial PUF vulnerability of requiring databases to store the secrete reference information. This paper investigates one of the PPUF families, differential PPUF (dPPUF), which exploits complexly interacted logic to create time gap between actual execution and simulation, and to prevent simulation attacks. Conventional dPPUFs have high costs. We observe the repressers have large impact on simulation time, but take a great proportion in current dPPUF structure. We thereby present a represser network with specially designed interconnection and shared logic, to maintain a high circuit complexity and to reduce the area cost. We show the proposed dPPUF has similar resilience over simulation attacks as the conventional design. Area cost can be reduced by up to 44%, and thus the proposed design can be used for lightweight authentication. © VDE VERLAG GMBH.

关键词： Authentication

Overview Paper A Comprehensive Survey of Digital Image Steganography and Steganalysis

学校读者我要写书评

暂无评论

APSIPA Transactions on Signal and Information Processing 2024年第1期13卷

作者： Luo, Weiqi Wei, Kangkang Li, Qiushi Ye, Miaoxin Tan, Shunquan Tang, Weixuan Huang, Jiwu School of Computer Science and Engineering Sun Yat-sen University China School of Software Nanchang University China Shenzhen Key Laboratory of Media Security Shenzhen University China Institute of Artificial Intelligence Guangzhou University China Guangdong Laboratory of Machine Perception and Intelligent Computing Faculty of Engineering Shenzhen MSU-BIT University China

In the realm of digital communications, steganography and steganalysis have become a solution for securely exchanging covert information. This survey initiates with an exploration of the widely used passive-warden scenario model, analyzing its significance, key performance indicators, relevant databases, and clarifying some commonly misunderstood fundamental concepts associated with this model. Subsequently, the paper comprehensively examines the evolution and current state of digital image steganography and steganalysis, highlighting the transition from traditional handcrafted based methods to sophisticated deep learning based techniques developed over the past two decades. It offers thorough descriptions and evaluations of typical methods in both steganography and steganalysis, with a particular emphasis on deep learning-based techniques that have emerged in recent years. Furthermore, the survey identifies significant challenges currently faced in translating theoretical research into practical applications. By integrating these insights, the survey not only charts the historical development and technological advancements in steganography and steganalysis but also establishes a proactive agenda for future research aimed at enhancing security in covert communications. © 2024 W. Luo, K. Wei, Q. Li, M. Ye, S. Tan, W. Tang and J. Huang.

关键词： Steganalysis steganography

EMBANet: A Flexible Efficient Multi-branch Attention Network

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zu, Keke Zhang, Hu Lu, Jian Zhang, Lei Xu, Chen Shenzhen Key Laboratory of Advanced Machine Learning and Applications Shenzhen University Shenzhen China Department of Computing The Hong Kong Polytechnic University Hong Kong Shenzhen China University of Electronic Science and Technology of China Zhejiang Quzhou China

This work presents a novel module, namely multi-branch concat (MBC), to process the input tensor and obtain the multi-scale feature map. The proposed MBC module brings new degrees of freedom (DoF) for the design of attention networks by allowing the type of transformation operators and the number of branches to be flexibly adjusted. Two important transformation operators, multiplex and split, are considered in this work, both of which can represent multi-scale features at a more granular level and increase the range of receptive fields. By integrating the MBC and attention module, a multi-branch attention (MBA) module is consequently developed to capture the channel-wise interaction of feature maps for establishing the long-range channel dependency. By substituting the 3x3 convolutions in the bottleneck blocks of the ResNet with the proposed MBA, a novel block namely efficient multi-branch attention (EMBA) is obtained, which can be easily plugged into the state-of-the-art backbone CNN models. Furthermore, a new backbone network called EMBANet is established by stacking the EMBA blocks. The proposed EMBANet is extensively evaluated on representative computer vision tasks including: classification, detection, and segmentation. And it demonstrates consistently superior performance over the popular backbones. Copyright © 2024, The Authors. All rights reserved.

关键词：