检索结果-内蒙古大学图书馆

Heterogeneous Domain Adaptation via Correlative and Discriminative Feature Learning

学校读者我要写书评

暂无评论

IEEE Transactions on Multimedia 2025年 27卷 3447-3461页

作者： Lu, Yuwu Lin, Dewei Shen, Linlin Zhou, Yicong Pan, Jiahui South China Normal University School of Artificial Intelligence Foshan528225 China Shenzhen University College of Computer Science and Software Engineering Shenzhen518055 China Shenzhen University Guangdong Key Laboratory of Intelligent Information Processing Shenzhen518060 China University of Nottingham Ningbo China Department of Computer Science Ningbo315100 China University of Macau Department of Computer and Information Science China

Heterogeneous domain adaptation seeks to learn an effective classifier or regression model for unlabeled target samples by using the well-labeled source samples but residing in different feature spaces and lying different distributions. Most recent works have concentrated on learning domain-invariant feature representations to minimize the distribution divergence via target pseudo-labels. However, two critical issues need to be further explored: 1) new feature representations should be not only domain-invariant but also category-correlative and discriminative, and 2) alleviating the negative transfer caused by the incorrect pseudo-labeling target samples could boost the adaptation performance during the iterative learning process. To address these issues, in this paper, we put forward a novel heterogeneous domain adaptation method to learn category-correlative and discriminative representations, referred to as correlative and discriminative feature learning (CDFL). Specifically, CDFL aims to learn a feature space where class-specific feature correlations between the source and target domains are maximized, the divergences of marginal and conditional distribution between the source and target domains are minimized, and the distances of inter-class distribution are forced to be maximized to ensure the discriminative ability. Meanwhile, a selective pseudo-labeling procedure based on the correlation coefficient and classifier prediction is introduced to boost class-specific feature correlation and discriminative distribution alignment in an iteration way. Extensive experiments certify that CDFL outperforms the state-of-the-art algorithms on five standard benchmarks. © 1999-2012 IEEE.

关键词： Contrastive Learning

HCF-Net: Hybrid Coarse-to-Fine Network for Forgery Reconstruction

学校读者我要写书评

暂无评论

HCF-Net: Hybrid Coarse-to-Fine Network for Forgery Reconstru...

2021 International Workshop on Safety and Security of Deep Learning, SSDL 2021

作者： Zhuo, Long Tan, Shunquan Guangdong Key Laboratory of Intelligent Information Processing Shenzhen Key Laboratory of Media Security Shenzhen Institute of Artificial Intelligence and Robotics for Society China College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China

Due to the ubiquity of photo editing software, it is convenient and prevalent to create fake images which may cause terrible misunderstandings. To address this issue, we introduce forgery reconstruction, a novel image reconstruction that automatically reconstructs a forged image into its original appearance. To achieve this, we present a new two-phase system, including a forgery localization phase and a reconstruction phase, where we first localize forged regions and then inpaint the natural texture. The proposed approach, called HCF-Net, is a hybrid two coarse-to-fine networks. Unlike the existing solutions of image reconstruction that relies on the prior knowledge of the areas to be recovered, our proposed system is free from the mask information. To guide the reconstruction, we propose a new strategy for extracting noise features in the forgery localization phase, which leverages the relationships among the image channels and localizes the tampered regions more precisely. For better performance, we equip a dual attention module in the reconstruction phase. Our automatic system is applicable to localize the tampered areas and reconstruct the missing part in a single pass. The extensive experiments demonstrate that our system achieves state-of-the-art performance in forgery localization and generates higher-quality and more flexible results than traditional inpainting methods. © 2021 CEUR-WS. All rights reserved.

关键词： Image reconstruction

Look Inside for More: Internal Spatial Modality Perception for 3D Anomaly Detection 39

学校读者我要写书评

暂无评论

Look Inside for More: Internal Spatial Modality Perception f...

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Liang, Hanzhe Xie, Guoyang Hou, Chengbin Wang, Bingshu Gao, Can Wang, Jinbao College of Computer Science and Software Engineering Shenzhen University Shenzhen China Shenzhen Audencia Financial Technology Institute Shenzhen University Shenzhen China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Department of Intelligent Manufacturing CATL Ningde China School of Computing and Artificial Intelligence Fuyao University of Science and Technology Fuzhou China School of Software Northwestern Polytechnical University Xi’an China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen China

ISBN: (纸本)157735897X

3D anomaly detection has recently become a significant focus in computer vision. Several advanced methods have achieved satisfying anomaly detection performance. However, they typically concentrate on the external structure of 3D samples and struggle to leverage the internal information embedded within samples. Inspired by the basic intuition of why not look inside for more, we introduce a straightforward method named Internal Spatial Modality Perception (ISMP) to explore the feature representation from internal views fully. Specifically, our proposed ISMP consists of a critical perception module, Spatial Insight Engine (SIE), which abstracts complex internal information of point clouds into essential global features. Besides, to better align structural information with point data, we propose an enhanced key point feature extraction module for amplifying spatial structure feature representation. Simultaneously, a novel feature filtering module is incorporated to reduce noise and redundant features for further aligning precise spatial structure. Extensive experiments validate the effectiveness of our proposed method, achieving object-level and pixel-level AUROC improvements of 4.2% and 13.1%, respectively, on the Real3D-AD benchmarks. Note that the strong generalization ability of SIE has been theoretically proven and is verified in both classification and segmentation tasks. © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词： Feature extraction

DAMPER: A Dual-Stage Medical Report Generation Framework with Coarse-Grained MeSH Alignment and Fine-Grained Hypergraph Matching

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Huang, Xiaofei Chen, Wenting Liu, Jie Lu, Qisheng Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen China Department of Electrical Engineering City University of Hong Kong Kowloon Hong Kong National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing, where physicians typically conduct an initial quick review followed by a detailed examination. Moreover, current alignment methods may lead to misaligned relationships. To address these issues, we propose DAMPER, a dual-stage framework for medical report generation that mimics the clinical pipeline of report writing in two stages. In the first stage, a MeSH-Guided Coarse-Grained Alignment (MCG) stage that aligns chest X-ray (CXR) image features with medical subject headings (MeSH) features to generate a rough keyphrase representation of the overall impression. In the second stage, a Hypergraph-Enhanced Fine-Grained Alignment (HFG) stage that constructs hypergraphs for image patches and report annotations, modeling high-order relationships within each modality and performing hypergraph matching to capture semantic correlations between image regions and textual phrases. Finally,the coarse-grained visual features, generated MeSH representations, and visual hypergraph features are fed into a report decoder to produce the final medical report. Extensive experiments on public datasets demonstrate the effectiveness of DAMPER in generating comprehensive and accurate medical reports, outperforming state-of-the-art methods across various evaluation metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Coarse-grained modeling

Multiple Autoencoder-Based Anomaly Detection with Fuzzy Rough Sets

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Tan, Xiaofeng Gao, Can Zhou, Jie Yue, Xiaodong College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen518060 China SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China School of Computer Engineering and Science Shanghai University Shanghai200444 China

Anomaly detection is a practical and essential research topic with a wide range of applications. However, existing anomaly detection methods may face challenges when handling high-dimensional data with complex distributions. In this study, we propose a multiple autoencoder-based anomaly detection method with the aid of fuzzy rough sets. Specifically, the autoencoder is first improved by introducing the kernel fuzzy relation to enhance its representation capability in low-dimensional space. Then, the theory of fuzzy rough sets is employed to perform anomaly detection in the learned low-dimensional representation by fusing multi-view proximity-based information. Finally, to handle complex data, multiple autoencoders are utilized to collaboratively detect anomalies by integrating local anomaly information from different perspectives. Comparative experiments conducted on the selected datasets reveal that the proposed method is superior to state-of-the-art methods, improving over classical autoencoder by 5.58% in terms of the AUC-ROC index. © 2024, The Authors. All rights reserved.

关键词： Anomaly detection

A ROS Based Open Source Simulation Environment for Robotics Beginners 6

学校读者我要写书评

暂无评论

A ROS Based Open Source Simulation Environment for Robotics ...

6th International Conference on Robotics and Automation engineering, ICRAE 2021

作者： Su, Linyu Qiu, Guoping Tang, Wengming Chen, Min Shenzhen University College of Electronic and Information Engineering Guangdong Key Laboratory of Intelligent Information Processing Shenzhen Institute of Artificial Intelligence and Robotics for Society China Super-accurate Vision Science and Technology Ltd Shenzhen China

ISBN: (纸本)9781665406970

This paper presents an open source robot simulation environment based on the robot operating system (ROS). To help novice to learn robotics, we have designed several important experiments that most robotics beginners will need to practice. Our simulation environment provides an efficient, safe, and transferable testing and operating environment for the rapid verification of robot algorithms. Through practicing the experiments in this paper, robotics beginners can learn robotics knowledge faster, better and at a lower cost, which should great facilitate them to operate robots in real-world applications. Source code, simulation video and detailed wiki for the simulation environment are available online at https://***/Suyixiu/robot_sim. © 2021 IEEE.

关键词： Robotics

Evaluating Human Perception of Novel View Synthesis: Subjective Quality Assessment of Gaussian Splatting and NeRF in Dynamic Scenes

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Yuhang Maraval, Joshua Zhang, Zhengyu Ramin, Nicolas Tian, Shishun Zhang, Lu Guangdong Key Laboratory of Intelligent Information Processing College of Electronics and Information Engineering Shenzhen University Shenzhen518060 China IRT bcom France School of Electronics and Communication Engineering Guangzhou University Guangzhou China Univ Rennes INSA Rennes CNRS IETR - UMR 6164 RennesF-35000 France

Gaussian Splatting (GS) and Neural Radiance Fields (NeRF) are two groundbreaking technologies that have revolutionized the field of Novel View Synthesis (NVS), enabling immersive photorealistic rendering and user experiences by synthesizing multiple viewpoints from a set of images of sparse views. The potential applications of NVS, such as high-quality virtual and augmented reality, detailed 3D modeling, and realistic medical organ imaging, underscore the importance of quality assessment of NVS methods from the perspective of human perception. Although some previous studies have explored subjective quality assessments for NVS technology, they still face several challenges, especially in NVS methods selection, scenario coverage, and evaluation methodology. To address these challenges, we conducted two subjective experiments for the quality assessment of NVS technologies containing both GS-based and NeRF-based methods, focusing on dynamic and real-world scenes. This study covers 360°, front-facing, and single-viewpoint videos while providing a richer and greater number of real scenes. Meanwhile, it’s the first time to explore the impact of NVS methods in dynamic scenes with moving objects. The two types of subjective experiments help to fully comprehend the influences of different viewing paths from a human perception perspective and pave the way for future development of full-reference and no-reference quality metrics. In addition, we established a comprehensive benchmark of various state-of-the-art objective metrics on the proposed database, highlighting that existing methods still struggle to accurately capture subjective quality. The results give us some insights into the limitations of existing NVS methods and may promote the development of new NVS methods. Copyright © 2025, The Authors. All rights reserved.

关键词： Medical imaging

Blind Multimodal Quality Assessment of Low-light Images

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wang, Miaohui Xu, Zhuowei Xu, Mai Lin, Weisi The Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China School of Electronic and Information Engineering Beihang University Beijing China School of Computer Science and Engineering Nanyang Technological University Nanyang Avenue 50 Singapore

Blind image quality assessment (BIQA) aims at automatically and accurately forecasting objective scores for visual signals, which has been widely used to monitor product and service quality in low-light applications, covering smartphone photography, video surveillance, autonomous driving, etc. Recent developments in this field are dominated by unimodal solutions inconsistent with human subjective rating patterns, where human visual perception is simultaneously reflected by multiple sensory information. In this article, we present a unique blind multimodal quality assessment (BMQA) of low-light images from subjective evaluation to objective score. To investigate the multimodal mechanism, we first establish a multimodal low-light image quality (MLIQ) database with authentic low-light distortions, containing image-text modality pairs. Further, we specially design the key modules of BMQA, considering multimodal quality representation, latent feature alignment and fusion, and hybrid self-supervised and supervised learning. Extensive experiments show that our BMQA yields state-of-the-art accuracy on the proposed MLIQ benchmark database. In particular, we also build an independent single-image modality Dark-4K database, which is used to verify its applicability and generalization performance in mainstream unimodal applications. Qualitative and quantitative results on Dark-4K show that BMQA achieves superior performance to existing BIQA approaches as long as a pre-trained model is provided to generate text description. The proposed framework and two databases as well as the collected BIQA methods and evaluation metrics are made publicly available on here. © 2023, CC BY.

关键词： Image quality

Massive MIMO-ISAC System With 1-Bit ADCs/DACs

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Bowen Li, Hongyu Liao, Bin Cheng, Ziyang The School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu China The Department of Electrical & Electronic Engineering Imperial College London LondonSW7 2AZ United Kingdom The Guangdong Key Laboratory of Intelligent Information Processing College of Electronics and Information Engineering Shenzhen University Shenzhen518060 China

This paper investigates a hardware-efficient massive multiple-input multiple-output integrated sensing and communication (MIMO-ISAC) system with 1-bit analog-to-digital converters (ADCs)/digital-to-analog converters (DACs). The proposed system, referred to as 1BitISAC, employs 1-bit DACs at the ISAC transmitter and 1-bit ADCs at the sensing receiver, achieving significant reductions in power consumption and hardware costs. For such kind of systems, two 1BitISAC joint transceiver designs, i.e., i) quality of service constrained 1BitISAC design and ii) quality of detection constrained design, are considered and the corresponding problems are formulated. In order to address these problems, we thoroughly analyze the radar detection performance after 1-bit ADCs quantization and the communication bit error rate. This analysis yields new design insights and leads to unique radar and communication metrics, which enables us to simplify the original problems and employ majorization-minimization and integer linear programming methods to solve the problems. Numerical results are provided to validate the performance analysis of the proposed 1BitISAC and to compare with other ISAC configurations. The superiority of the proposed 1BitISAC system in terms of balancing ISAC performance and energy efficiency is also demonstrated. Copyright © 2024, The Authors. All rights reserved.

关键词： Energy efficiency