检索结果-内蒙古大学图书馆

arXiv 2025年

作者： Wei, Hao Zhou, Yanhui Jia, Yiwen Ge, Chenyang Anwar, Saeed Mian, Ajmal National Key Laboratory of Human-Machine Hybrid Augmented Intelligence Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an710049 China School of Information and Telecommunication Xi’an Jiaotong University Xi’an710049 China Department of Computer Science and Software Engineering The University of Western Australia Crawley PerthWA6009 Australia

Perceptual image compression has shown strong potential for producing visually appealing results at low bitrates, surpassing classical standards and pixel-wise distortion-oriented neural methods. However, existing methods typically improve compression performance by incorporating explicit semantic priors, such as segmentation maps and textual features, into the encoder or decoder, which increases model complexity by adding parameters and floating-point operations. This limits the model’s practicality, as image compression often occurs on resource-limited mobile devices. To alleviate this problem, we propose a lightweight perceptual Image Compression method using Implicit Semantic Priors (ICISP). We first develop an enhanced visual state space block that exploits local and global spatial dependencies to reduce redundancy. Since different frequency information contributes unequally to compression, we develop a frequency decomposition modulation block to adaptively preserve or reduce the low-frequency and high-frequency information. We establish the above blocks as the main modules of the encoder-decoder, and to further improve the perceptual quality of the reconstructed images, we develop a semantic-informed discriminator that uses implicit semantic priors from a pretrained DINOv2 encoder. Experiments on popular benchmarks show that our method achieves competitive compression performance and has significantly fewer network parameters and floating point operations than the existing state-of-the-art. We will release the code and trained models. Copyright © 2025, The Authors. All rights reserved.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistency

arXiv

引用

arXiv 2024年

作者： Xie, Yiping Yu, Zitong Wu, Bingjie Xie, Weicheng Shen, Linlin Computer Vision Institute School of Computer Science & Software Engineering Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China School of Computing and Information Technology Great Bay University Dongguan523000 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China Singapore

Remote Photoplethysmography (rPPG) is a non-contact method that uses facial video to predict changes in blood volume, enabling physiological metrics measurement. Traditional rPPG models often struggle with poor generalization capacity in unseen domains. Current solutions to this problem is to improve its generalization in the target domain through Domain Generalization (DG) or Domain Adaptation (DA). However, both traditional methods require access to both source domain data and target domain data, which cannot be implemented in scenarios with limited access to source data, and another issue is the privacy of accessing source domain data. In this paper, we propose the first Source-free Domain Adaptation benchmark for rPPG measurement (SFDA-rPPG), which overcomes these limitations by enabling effective domain adaptation without access to source domain data. Our framework incorporates a Three-Branch Spatio-Temporal Consistency Network (TSTC-Net) to enhance feature consistency across domains. Furthermore, we propose a new rPPG distribution alignment loss based on the Frequency-domain Wasserstein Distance (FWD), which leverages optimal transport to align power spectrum distributions across domains effectively and further enforces the alignment of the three branches. Extensive cross-domain experiments and ablation studies demonstrate the effectiveness of our proposed method in source-free domain adaptation settings. Our findings highlight the significant contribution of the proposed FWD loss for distributional alignment, providing a valuable reference for future research and applications. The source code is available at https://***/XieYiping66/SFDA-rPPG. Copyright © 2024, The Authors. All rights reserved.

关键词： Photoplethysmography

来源：评论

学校读者我要写书评

暂无评论

Online Self-distillation and Self-modeling for 3D Brain Tumor Segmentation

引用

IEEE Journal of Biomedical and Health Informatics 2025年 PP卷 PP页

作者： Pang, Yan Li, Yunhao Huang, Teng Liang, Jiaming Wang, Zhen Dong, Changyu Kuang, Dongyang Hu, Ying Chen, Hao Lei, Tim Wang, Qiong The Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen China The School of Artificial Intelligence Guangzhou University China The Zhejiang Lab Hangzhou China Sun Yat-sen University China The Department of Computer Science and Engineering The Department of Chemical and Biological Engineering Hong Kong University of Science and Technology China The Department of Electrical Engineering University of Colorado Denver United States

In the specialized domain of brain tumor segmentation, supervised segmentation approaches are hindered by the limited availability of high-quality labeled data, a condition arising from data privacy concerns, significant costs, and ethical issues. In response to this challenge, this paper presents a training framework that adeptly integrates a plug-and-play component, MOD, into current supervised learning models, boosting their efficacy in scenarios with limited data. The MOD consists of an Online Tokenizer and a Dense Predictor, which employs self-distillation and self-modeling on masked patches, promoting swift convergence and efficient representation learning. During the inference phase, the plug-and-play MOD component is excluded, preserving the computational efficiency of the original model without incurring extra processing costs. We substantiated the value of our approach through experiments on leading 3D brain tumor segmentation baselines. Remarkably, models augmented with the MOD consistently showcased superior results, achieving elevated Dice coefficients and HD95 scores on two datasets: BraTS 2021 and MSD 2019 Task-01 Brain Tumor. Code: https://***/aigzhusmart/MOD © 2013 IEEE.

关键词： Self-supervised learning

来源：评论

学校读者我要写书评

暂无评论

Robust 3D Face Alignment with Multi-Path Neural Architecture Search

Robust 3D Face Alignment with Multi-Path Neural Architecture...

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Zhichao Jiang Hongsong Wang Xi Teng Baopu Li Institute of Deep Learning (IDL) Baidu Beijing China Department of Computer Science and Engineering Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications Southeast University Nanjing China Computer Vision Technology Institution Baidu Beijing China Baidu Research Baidu Sunnyvale USA

ISBN: (数字)9798350390155

ISBN: (纸本)9798350390162

3D face alignment is a very challenging and fundamental problem in computer vision. Existing deep learning-based methods manually design different networks to regress either parameters of a 3D face model or 3D positions of face vertices. However, designing such networks relies on expert knowledge, and these methods often struggle to produce consistent results across various face poses. To address this limitation, we employ Neural Architecture Search (NAS) to automatically discover the optimal architecture for 3D face alignment. We propose a novel Multi-path One-shot Neural Architecture Search (MONAS) framework that leverages multi-scale features and contextual information to enhance face alignment across various poses. The MONAS comprises two key algorithms: Multi-path Networks Unbiased Sampling Based Training and Simulated Annealing based Multi-path One-shot Search. Experimental results on three popular benchmarks demonstrate the superior performance of the MONAS for both sparse alignment and dense alignment.

关键词： Training Learning systems Solid modeling computer vision Three-dimensional displays Neural networks Simulated annealing Network architecture Search problems Faces

来源：评论

学校读者我要写书评

暂无评论

SSC- l0 : Sparse Subspace Clustering with the l0 Inequality Constraint 7th

SSC- l0 : Sparse Subspace Clustering with the l0 Inequality...

引用

7th Asian Conference on Pattern Recognition, ACPR 2023

作者： Wang, Yangbo Zhou, Jie Lin, Qingshui Lu, Jianglin Gao, Can National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China Basic Teaching Department Liaoning Technical University Huludao125105 China College of Engineering Northeastern University BostonMA02115 United States

ISBN: (纸本)9783031476648

Self-expression learning methods often obtain a coefficient matrix to measure the similarity between pairs of samples. However, directly using all points to represent a fixed sample in a class under the self-expression framework may not be ideal, as points from other classes participate in the representing process. To alleviate this issue, this study attempts to achieve representation learning between points only coming from the same class. In practice, it is easier for data points from the same class to represent each other than that from different classes. So, when reconstructing a point, if the number of non-zero elements in the coefficient vector is limited, a model is more likely to select data points from the class where the reconstructed point lies to complete the reconstruction work. Based on this idea, we propose Sparse Subspace Clustering with the l0 inequality constraint (SSC- l0 ). In SSC- l0, the l0 inequality constraint determines the maximum number of non-zero elements in the coefficient vector, which helps SSC- l0 to conduct representation learning among the points in the same class. After introducing the simplex constraint to ensure the translation invariance of the model, an optimization method concerning l0 inequality constraint is formed to solve the proposed SSC- l0, and its convergence is theoretically analyzed. Extensive experiments on well-known datasets demonstrate the superiority of SSC- l0 compared to several state-of-the-art methods. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

关键词： Learning systems

来源：评论

学校读者我要写书评

暂无评论

StyleGene: Crossover and Mutation of Region-level Facial Genes for Kinship Face Synthesis

StyleGene: Crossover and Mutation of Region-level Facial Gen...

引用

Conference on computer vision and Pattern Recognition (CVPR)

作者： Hao Li Xianxu Hou Zepeng Huang Linlin Shen Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University National Engineering Laboratory for Big Data System Computing Technology Shenzhen University School of AI and Advanced Computing Xi'an Jiaotong-Liverpool University Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University

High-fidelity kinship face synthesis has many potential applications, such as kinship verification, missing child identification, and social media analysis. However, it is challenging to synthesize high-quality descendant faces with genetic relations due to the lack of large-scale, high-quality annotated kinship data. This paper proposes RFG (Region-level Facial Gene) extraction framework to address this issue. We propose to use IGE (Image-based Gene Encoder), LGE (Latent-based Gene Encoder) and Gene Decoder to learn the RFGs of a given face image, and the relationships between RFGs and the latent space of Style-GAN2. As cycle-like losses are designed to measure the $\mathcal{L}_{2}$ distances between the output of Gene Decoder and image encoder, and that between the output of LGE and IGE, only face images are required to train our framework, i.e. no paired kinship face data is required. Based upon the proposed RFGs, a crossover and mutation module is further designed to inherit the facial parts of parents. A Gene Pool has also been used to introduce the variations into the mutation of RFGs. The diversity of the faces of descendants can thus be significantly increased. Qualitative, quantitative, and subjective experiments on FIW, TSKinFace, and FF-Databases clearly show that the quality and diversity of kinship faces generated by our approach are much better than the existing state-of-the-art methods.

关键词：

来源：评论

学校读者我要写书评

暂无评论

NavCoT: Boosting LLM-Based vision-and-Language Navigation via Learning Disentangled Reasoning

引用

IEEE Transactions on Pattern Analysis and Machine intelligence 2025年第7期47卷 5945-5957页

作者： Bingqian Lin Yunshuang Nie Ziming Wei Jiaqi Chen Shikui Ma Jianhua Han Hang Xu Xiaojun Chang Xiaodan Liang Shenzhen Campus Sun Yat-sen University Shenzhen China Shanghai Jiao Tong University Shanghai China University of Hong Kong Pok Fu Lam Hong Kong Dataa Robotics Company Beijing China Huawei Noah's Ark Lab Shanghai China School of Information Science and Technology University of Science and Technology of China Hefei China Department of Computer Vision Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi UAE Peng Cheng Laboratory Shenzhen China Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou China

vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the promising capacity of large language models (LLMs) in VLN by improving navigational reasoning accuracy and interpretability. However, their predominant use in an offline manner usually suffers from substantial domain gap between the VLN task and the LLM training corpus. This paper proposes a novel strategy called Nav igational C hain- o f- T hought (NavCoT), where we fulfill parameter-efficient in-domain training to enable self-guided navigational decision, leading to a significant mitigation of the domain gap in a cost-effective manner. Specifically, at each timestep, the LLM is prompted to forecast the navigational chain-of-thought by: 1) acting as a world model to imagine the next observation according to the instruction, 2) selecting the candidate observation that best aligns with the imagination, and 3) determining the action based on the reasoning from the prior steps. In this way, the action prediction can be effectively simplified benefiting from the disentangled reasoning. Through constructing formalized labels for training, the LLM can learn to generate desired and reasonable chain-of-thought outputs for improving the action decision. Experimental results across various training settings and popular VLN benchmarks (e.g., Room-to-Room (R2R), Room-across-Room (RxR), Room-for-Room (R4R)) show the significant superiority of NavCoT over the direct action prediction variants. Through simple parameter-efficient finetuning, our NavCoT outperforms a recent GPT4-based approach with $\sim$ 7% relative improvement on the R2R dataset. We believe that NavCoT will help unlock more task-adaptive and scalable LLM-based embodied agents, which are helpful for developing real-world robotics applications.

关键词： Navigation Cognition Training Scalability Glass Planning Large language models History Electronic mail Visualization

来源：评论

学校读者我要写书评

暂无评论

Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Report 17th

Efficient Single-Image Depth Estimation on Mobile Devices, ...

引用

17th European Conference on computer vision, ECCV 2022

作者： Ignatov, Andrey Malivenko, Grigory Timofte, Radu Treszczotko, Lukasz Chang, Xin Ksiazek, Piotr Lopuszynski, Michal Pioro, Maciej Rudnicki, Rafal Smyl, Maciej Ma, Yujie Li, Zhenyu Chen, Zehui Xu, Jialei Liu, Xianming Jiang, Junjun Shi, XueChao Xu, Difan Li, Yanan Wang, Xiaotao Lei, Lei Zhang, Ziyu Wang, Yicheng Huang, Zilong Luo, Guozhong Yu, Gang Fu, Bin Li, Jiaqi Wang, Yiran Huang, Zihao Cao, Zhiguo Conde, Marcos V. Sapozhnikov, Denis Lee, Byeong Hyun Park, Dongwon Hong, Seongmin Lee, Joonhee Lee, Seunggyu Chun, Se Young Computer Vision Lab ETH Zürich Zürich Switzerland AI Witchlabs Zollikerberg Switzerland University of Wuerzburg Wuerzburg Germany TCL Research Europe Warsaw Poland Harbin Institute of Technology Harbin China Xiaomi Inc. Beijing China Tencent GY-Lab Shenzhen China National Key Laboratory of Science and Technology on Multi-Spectral Information Processing School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Department of Electrical and Computer Engineering Seoul National University Seoul Korea Republic of

ISBN: (纸本)9783031250651

Various depth estimation models are now widely used on many mobile and IoT devices for image segmentation, bokeh effect rendering, object tracking and many other mobile tasks. Thus, it is very crucial to have efficient and accurate depth estimation models that can run fast on low-power mobile chipsets. In this Mobile AI challenge, the target was to develop deep learning-based single image depth estimation solutions that can show a real-time performance on IoT platforms and smartphones. For this, the participants used a large-scale RGB-to-depth dataset that was collected with the ZED stereo camera capable to generated depth maps for objects located at up to 50 m. The runtime of all models was evaluated on the Raspberry Pi 4 platform, where the developed solutions were able to generate VGA resolution depth maps at up to 27 FPS while achieving high fidelity results. All models developed in the challenge are also compatible with any Android or Linux-based mobile devices, their detailed description is provided in this paper. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models

arXiv

引用

arXiv 2024年

作者： Sun, Wangtao Zhang, Chenxiang Zhang, Xueyou Yu, Xuanqing Huang, Ziyang Xu, Haotian Chen, Pei He, Shizhu Zhao, Jun Liu, Kang The Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China CAS Engineering Laboratory for Intelligent Industrial Vision Institute of Automation Chinese Academy of Sciences Beijing China Department of Computer Science and Engineering Texas A&M University United States Shanghai Artificial Intelligence Laboratory China Xiaohongshu Inc China AI Lab AIGility Cloud Innovation Beijing China

Although Large Language Models (LLMs) have demonstrated strong instruction-following ability, they are further supposed to be controlled and guided by inferential rules in real-world scenarios to be safe, accurate, and intelligent. This demands the possession of inferential rule-following capability of LLMs. However, no prior work has made a clear evaluation of the inferential rule-following capability of LLMs. Previous studies that try to evaluate the inferential rule-following capability of LLMs fail to distinguish the inferential rule-following scenarios from the instruction-following scenarios. Therefore, this paper first clarifies the concept of inferential rule-following and proposes a comprehensive benchmark, RuleBench, to evaluate a diversified range of inferential rule-following abilities. Our experimental results on a variety of LLMs show that they are still limited in following rules. Our analysis based on the evaluation results provides insights into the improvements for LLMs toward a better inferential rule-following intelligent agent. We further propose Inferential Rule-Following Tuning (IRFT). The experimental results show that through IRFT, LLMs can learn abstract inferential rule-following abilities from purely synthetic data and then generalize to RuleBench. The data and code can be found at: https://***/r/llm-rulefollowing-B3E3/ Copyright © 2024, The Authors. All rights reserved.

关键词： Intelligent agents

来源：评论

学校读者我要写书评

暂无评论

UnrealROX+: An improved tool for acquiring synthetic data from virtual 3D environments

arXiv

引用

arXiv 2021年

作者： Martinez-Gonzalez, Pablo Oprea, Sergiu Castro-Vargas, John Alejandro Garcia-Garcia, Alberto Orts-Escolano, Sergio Garcia-Rodriguez, Jose Vincze, Markus Department of Computer Technology University of Alicante Spain Department of Computer Science and Artificial Intelligence University of Alicante Spain Spain Vision for Robotics Laboratory Tu Wien Austria

Synthetic data generation has become essential in last years for feeding data-driven algorithms, which surpassed traditional techniques performance in almost every computer vision problem. Gathering and labelling the amount of data needed for these data-hungry models in the real world may become unfeasible and error-prone, while synthetic data give us the possibility of generating huge amounts of data with pixel-perfect annotations. However, most synthetic datasets lack from enough realism in their rendered images. In that context UnrealROX generation tool was presented in 2019, allowing to generate highly realistic data, at high resolutions and framerates, with an efficient pipeline based on Unreal Engine, a cutting-edge videogame engine. UnrealROX enabled robotic vision researchers to generate realistic and visually plausible data with full ground truth for a wide variety of problems such as class and instance semantic segmentation, object detection, depth estimation, visual grasping, and navigation. Nevertheless, its workflow was very tied to generate image sequences from a robotic on-board camera, making hard to generate data for other purposes. In this work, we present UnrealROX+, an improved version of UnrealROX where its decoupled and easy-to-use data acquisition system allows to quickly design and generate data in a much more flexible and customizable way. Moreover, it is packaged as an Unreal plug-in, which makes it more comfortable to use with already existing Unreal projects, and it also includes new features such as generating albedo or a Python API for interacting with the virtual environment from Deep Learning frameworks. © 2021, CC BY-SA.

关键词： computer vision

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：