检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Xiao, Junjin Zhang, Qing Xu, Zhan Zheng, Wei-Shi School of Computer Science and Engineering Sun Yat-sen University China Adobe Research United States Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

Human avatar has become a novel type of 3D asset with various applications. Ideally, a human avatar should be fully customizable to accommodate different settings and environments. In this work, we introduce NECA, an approach capable of learning versatile human representation from monocular or sparse-view videos, enabling granular customization across aspects such as pose, shadow, shape, lighting and texture. The core of our approach is to represent humans in complementary dual spaces and predict disentangled neural fields of geometry, albedo, shadow, as well as an external lighting, from which we are able to derive realistic rendering with high-frequency details via volumetric rendering. Extensive experiments demonstrate the advantage of our method over the state-of-the-art methods in photorealistic rendering, as well as various editing tasks such as novel pose synthesis and relighting. The code is available at https://***/iSEE-laboratory/NECA. Copyright © 2024, The Authors. All rights reserved.

关键词： Lighting

来源：评论

学校读者我要写书评

暂无评论

EPIMR:Prediction of Enhancer-Promoter Interactions by Multi-Scale ResNet on Image Representation

引用

Big Data Mining and Analytics 2024年第3期7卷 668-681页

作者： Qiaozhen Meng Yinuo Lyu Xiaoqing Peng Junhai Xu Jijun Tang Fei Guo School of Computer Science and Technology College of Intelligence and ComputingTianjin UniversityTianjin 300350China Aeronautical Information Service Center of the Civil Aviation Administration of China(AISC.ATMB.CAAC) Beijing 100015China Center for Medical Genetics&Hunan Key Laboratory of Medical Genetics School of Life SciencesCentral South UniversityChangsha 410038China Shenzhen Institute of Advanced Technology Chinese Academy of SciencesShenzhen 518000China School of Computer Science and Engineering Central South UniversityChangsha 410083China

Prediction of enhancer-promoter interactions(EPIs)is key to regulating gene expression and diagnosing genetic *** to limited resolution,biological experiments perform not as well as expected while precisely identifying specific interactions,giving rise to computational biology *** EPI predictors have been developed,but their prediction accuracy still needs to be ***,we design a new model named EPIMR to identify enhancer-promoter ***,Hilbert Curve is utilized to represent sequences to images to preserve the position and spatial ***,a multi-scale residual neural network(ResNet)is used to learn the distinguishing features of different abstraction ***,matching heuristics are adopted to concatenate the learned features of enhancers and promoters,which pays attention to their potential interaction *** results on six cell lines indicate that EPIMR performs better than existing methods,with higher area under the precision-recall curve(AUPR)and area under the receiver operating characteristic(AUROC)results on benchmark and under-sampling ***,our model is pre-trained on all cell lines,which improves not only the transferability of cross-cell line prediction,but also cell line-specific prediction *** conclusion,our method serves as a valuable technical tool for predicting enhancer-promoter interactions,contributing to the understanding of gene transcription *** code and results are available at https://***/guofei-tju/EPIMR.

关键词： enhancer-promoter interactions Hilbert Curve multi-scale residual neural network(ResNet)

来源：评论

学校读者我要写书评

暂无评论

Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model

arXiv

引用

arXiv 2024年

作者： Zheng, Dian Wu, Xiao-Ming Yang, Shuzhou Zhang, Jian Hu, Jian-Fang Zheng, Wei-Shi School of Computer Science and Engineering Sun Yat-sen University China School of Electronic and Computer Engineering Peking University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

Universal image restoration is a practical and potential computer vision task for real-world applications. The main challenge of this task is handling the different degradation distributions at once. Existing methods mainly utilize task-specific conditions (e.g., prompt) to guide the model to learn different distributions separately, named multi-partite mapping. However, it is not suitable for universal model learning as it ignores the shared information between different tasks. In this work, we propose an advanced selective hourglass mapping strategy based on diffusion model, termed DiffUIR. Two novel considerations make our DiffUIR non-trivial. Firstly, we equip the model with strong condition guidance to obtain accurate generation direction of diffusion model (selective). More importantly, DiffUIR integrates a flexible shared distribution term (SDT) into the diffusion algorithm elegantly and naturally, which gradually maps different distributions into a shared one. In the reverse process, combined with SDT and strong condition guidance, DiffUIR iteratively guides the shared distribution to the task-specific distribution with high image quality (hourglass). Without bells and whistles, by only modifying the mapping strategy, we achieve state-of-the-art performance on five image restoration tasks, 22 benchmarks in the universal setting and zero-shot generalization setting. Surprisingly, by only using a lightweight model (only 0.89M), we could achieve outstanding performance. The source code and pre-trained models are available at https://***/iSEE-laboratory/DiffUIR. Copyright © 2024, The Authors. All rights reserved.

关键词： Image reconstruction

来源：评论

学校读者我要写书评

暂无评论

Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model

Selective Hourglass Mapping for Universal Image Restoration ...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Dian Zheng Xiao-Ming Wu Shuzhou Yang Jian Zhang Jian-Fang Hu Wei-Shi Zheng School of Computer Science and Engineering Sun Yat-sen University China School of Electronic and Computer Engineering Peking University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Universal image restoration is a practical and poten-tial computer vision task for real-world applications. The main challenge of this task is handling the different degra-dation distributions at once. Existing methods mainly utilize task-specific conditions (e.g., prompt) to guide the model to learn different distributions separately, named multi-partite mapping. However, it is not suitable for universal model learning as it ignores the shared information between different tasks. In this work, we propose an advanced selective hourglass mapping strategy based on diffusion model, termed DiffUIR. Two novel considerations make our Dif-fUIR non-trivial. Firstly, we equip the model with strong condition guidance to obtain accurate generation direction of diffusion model (selective). More importantly, DiffUIR integrates a flexible shared distribution term (SDT) into the diffusion algorithm elegantly and naturally, which gradually maps different distributions into a shared one. In the reverse process, combined with SDT and strong condition guidance, DiffUIR iteratively guides the shared distribution to the task-specific distribution with high image quality (hourglass). Without bells and whistles, by only modifying the mapping strategy, we achieve state-of-the-art performance on five image restoration tasks, 22 benchmarks in the universal setting and zero-shot generalization setting. Surprisingly, by only using a lightweight model (only 0.89M), we could achieve outstanding performance. The source code and pre-trained models are available at https://***/iSEE-laboratory/DiffUIR.

关键词： Image quality Computer vision Accuracy Computational modeling Source coding Benchmark testing Diffusion models

来源：评论

学校读者我要写书评

暂无评论

Event-Guided Procedure Planning from Instructional Videos with Text Supervision

arXiv

引用

arXiv 2023年

作者： Wang, An-Lan Lin, Kun-Yu Du, Jia-Run Meng, Jingke Zheng, Wei-Shi School of Computer Science and Engineering Sun Yat-sen University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

In this work, we focus on the task of procedure planning from instructional videos with text supervision, where a model aims to predict an action sequence to transform the initial visual state into the goal visual state. A critical challenge of this task is the large semantic gap between observed visual states and unobserved intermediate actions, which is ignored by previous works. Specifically, this semantic gap refers to that the contents in the observed visual states are semantically different from the elements of some action text labels in a procedure. To bridge this semantic gap, we propose a novel event-guided paradigm, which first infers events from the observed states and then plans out actions based on both the states and predicted events. Our inspiration comes from that planning a procedure from an instructional video is to complete a specific event and a specific event usually involves specific actions. Based on the proposed paradigm, we contribute an Event-guided Prompting-based Procedure Planning (E3P) model, which encodes event information into the sequential modeling process to support procedure planning. To further consider the strong action associations within each event, our E3P adopts a mask-and-predict approach for relation mining, incorporating a probabilistic masking scheme for regularization. Extensive experiments on three datasets demonstrate the effectiveness of our proposed model. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Event-Guided Procedure Planning from Instructional Videos with Text Supervision

Event-Guided Procedure Planning from Instructional Videos wi...

引用

International Conference on Computer Vision (ICCV)

作者： An-Lan Wang Kun-Yu Lin Jia-Run Du Jingke Meng Wei-Shi Zheng School of Computer Science and Engineering Sun Yat-sen University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

关键词：

来源：评论

学校读者我要写书评

暂无评论

Self-supervised Cross-stage Regional Contrastive Learning for Object Detection

Self-supervised Cross-stage Regional Contrastive Learning fo...

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Junkai Yan Lingxiao Yang Yipeng Gao Wei-Shi Zheng School of Computer Science and Engineering Sun Yat-sen University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

Cross-stage object similarity is a vital property of generic supervised object detectors, which maintains similar feature responses to the same object across feature maps of different intermediate stages of the backbone network. Since an object can be predicted by multiple stages, this similarity is beneficial for accurate object classification and localization. Inspired by this property, we introduce Cross-stage regional Contrastive Learning (CrossCL) to learn the cross-stage object similarity during the model pre-training. Since labels are unavailable in self-supervised learning, we treat the regions sharing the same position in different stages as the same object and constrain them to have similar feature responses across stages to achieve cross-stage object similarity. The learned feature representations of CrossCL share a similar property with supervised detectors, thus showing strong transfer capability to object detection tasks. Besides, we also provide in-depth discussions, ablation studies, and visualizations to understand better how CrossCL works. Code is available at https://***/yanjk3/CrossCL.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Generating Anomalies for Video Anomaly Detection with Prompt-based Feature Mapping

Generating Anomalies for Video Anomaly Detection with Prompt...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Zuhao Liu Xiao-Ming Wu Dian Zheng Kun-Yu Lin Wei-Shi Zheng School of Computer Science and Engineering Sun Yat-sen University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

Anomaly detection in surveillance videos is a challenging computer vision task where only normal videos are available during training. Recent work released the first virtual anomaly detection dataset to assist real-world detection. However, an anomaly gap exists because the anomalies are bounded in the virtual dataset but unbounded in the real world, so it reduces the generalization ability of the virtual dataset. There also exists a scene gap between virtual and real scenarios, including scene-specific anomalies (events that are abnormal in one scene but normal in another) and scene-specific attributes, such as the viewpoint of the surveillance camera. In this paper, we aim to solve the problem of the anomaly gap and scene gap by proposing a prompt-based feature mapping framework (PFMF). The PFMF contains a mapping network guided by an anomaly prompt to generate unseen anomalies with unbounded types in the real scenario, and a mapping adaptation branch to narrow the scene gap by applying domain classifier and anomaly classifier. The proposed framework outperforms the state-of-the-art on three benchmark datasets. Extensive ablation experiments also show the effectiveness of our framework design.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Feature Rotation Invariance Learning for Point Cloud Analysis 10

Feature Rotation Invariance Learning for Point Cloud Analysi...

引用

10th IEEE Smart World Congress, SWC 2024

作者： Shi, Lu Cao, Qi Zhang, Guoqing Yi, Jin Huang, Yansen Cen, Yigang Beijing Jiaotong University State Key Laboratory of Advanced Rail Autonomous Operation The School of Computer Science and Technology Visual Intellgence +X International Cooperation Joint Laboratory of Moe Beijing100044 China University of Glasgow The School of Computing Science 567739 Singapore Beijing Jiaotong University With the Key Laboratory of Big Data & Artificial Intelligence in Transportation Ministry of Education The State Key Laboratory of Advanced Rail Autonomous Operation The School of Computer and Information Technology Beijing100044 China Guizhou University Guizhou Lianjian Civil Engineering Quality Testing Monitoring Center Co. Ltd The College of Civil Engineering Guizhou550025 China

ISBN: (纸本)9798331520861

While deep learning has significantly advanced point cloud analysis, extracting effective features from their disordered structure remains challenging. Existing approaches often rely on complex network architectures or manual feature engineering to achieve rotation invariance, which increases inference latency. This paper offers a novel perspective on this challenge, showing that rotation-sensitive models can achieve performance comparable to rotation-invariant models when trained with rotation-augmented data. Given the significant differences in the feature distributions of rotation-sensitive and rotation-invariant models, we propose Feature Rotation Invariance Learning (FRIL), a framework that leverages Distance Metric Learning and rotation-based constraints to help rotation-sensitive models extract rotation-invariant features. This approach eliminates the need for additional modules, enabling robust performance against rotations. Extensive experiments demonstrate that FRIL consistently outperforms existing rotation-invariant methods across various visual tasks. © 2024 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Images

arXiv

引用

arXiv 2025年

作者： Xiao, Junjin Zhang, Qing Nie, Yonewei Zhu, Lei Zheng, Wei-Shi School of Computer Science and Engineering Sun Yat-sen University China South China University of Technology China China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

This paper presents RoGSplat, a novel approach for synthesizing high-fidelity novel views of unseen human from sparse multi-view images, while requiring no cumbersome per-subject optimization. Unlike previous methods that typically struggle with sparse views with few overlappings and are less effective in reconstructing complex human geometry, the proposed method enables robust reconstruction in such challenging conditions. Our key idea is to lift SMPL vertices to dense and reliable 3D prior points representing accurate human body geometry, and then regress human Gaussian parameters based on the points. To account for possible misalignment between SMPL model and images, we propose to predict image-aligned 3D prior points by leveraging both pixel-level features and voxel-level features, from which we regress the coarse Gaussians. To enhance the ability to capture high-frequency details, we further render depth maps from the coarse 3D Gaussians to help regress fine-grained pixel-wise Gaussians. Experiments on several benchmark datasets demonstrate that our method outperforms state-of-the-art methods in novel view synthesis and cross-dataset generalization. Our code is available at https: //***/iSEE-laboratory/RoGSplat. Copyright © 2025, The Authors. All rights reserved.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：