检索结果-内蒙古大学图书馆

Learning Survival Distribution with Implicit Survival Function

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ling, Yu Tan, Weimin Yan, Bo School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University Shanghai China

Survival analysis aims at modeling the relationship between covariates and event occurrence with some untracked (censored) samples. In implementation, existing methods model the survival distribution with strong assumptions or in a discrete time space for likelihood estimation with censorship, which leads to weak generalization. In this paper, we propose Implicit Survival Function (ISF) based on Implicit Neural Representation for survival distribution estimation without strong assumptions, and employ numerical integration to approximate the cumulative distribution function for prediction and optimization. Experimental results show that ISF outperforms the state-of-the-art methods in three public datasets and has robustness to the hyperparameter controlling estimation precision. Copyright © 2023, The Authors. All rights reserved.

关键词： Distribution functions

Uncer2Natural: Uncertainty-Aware Unsupervised Image Denoising

学校读者我要写书评

暂无评论

Uncer2Natural: Uncertainty-Aware Unsupervised Image Denoisin...

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Chenyu Huang Weimin Tan Jiaxing Shi Zhen Xing Bo Yan School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University Shanghai China

Recently, unsupervised image denoising methods learning from paired noisy samples have received increasing attention. These methods build on the idea that the mean of multiple noisy images of the same scene is the ideal clean image. However, these methods ignore the effect of Aleatoric uncertainty in the noisy image (e.g., pixels deviating from the expected distribution). The presence of Aleatoric uncertainty causes degradation of the reconstructed target pixels, resulting in high uncertainty for these pixels (i.e., low confidence), which in turn leads to sub-optimal denoising results. To address this problem, we propose a novel uncertainty-aware unsupervised image denoising method named Uncer2Natural (U2N). It dynamically predicts the Aleatoric uncertainty for each noisy sample and produces satisfactory denoising results by reducing the effect of Aleatoric uncertainty. Extensive experimental results show that U2N outperforms state-of-the- art unsupervised image denoising methods in terms of both quantitative metrics and qualitative visual quality.

关键词： Degradation visualization Uncertainty Art Noise reduction Signal processing Noise measurement

Towards a Unified User Interface for visual Analysis of Retinal Data in Ophthalmology

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Röhlig, Martin Nonnemann, Lars Schulz, Hans-Jörg Stachs, Oliver Schumann, Heidrun Institute for Visual and Analytic Computing University of Rostock Germany Department of Computer Science Aarhus University Denmark Department of Ophthalmology Rostock University Medical Center Germany

The visual analysis of retinal data contributes to the understanding of a wide range of eye diseases. For the evaluation of cross-sectional studies, ophthalmologists rely on workflows and toolsets established in their work environment. That is, they know what tools and data are needed at each step of their workflow. Yet, manually operating the various tools, including activation, data handling, or view arrangement, can be cumbersome and time-consuming. We thus introduce a new visualization-supported toolchaining approach that combines workflow, tools, and data. First, we provide access to the tools required for each step of the workflow. Second, we handle the exchange of data between these tools. Third, we organize the views of the tools on screen using suitable layouts. Fourth, we visualize the connection between workflow, tools, and data to support the data analysis. We demonstrate our approach with a use case in ophthalmic research and report on initial feedback from experts. © 2023, CC BY.

关键词： Ophthalmology

Instruct-NeuralTalker: Editing Audio-Driven Talking Radiance Fields with Instructions

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Sun, Yuqi He, Ruian Tan, Weimin Yan, Bo School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University Shanghai China

Recent neural talking radiance field methods have shown great success in photorealistic audio-driven talking face synthesis. In this paper, we propose the first novel interactive framework that utilizes human instructions to edit talking radiance fields to achieve personalized talking face generation. Given a short speech video, we first build an efficient talking radiance field and then apply the latest conditional diffusion model to edit images with human instructions during the optimization. To ensure audio-lip synchronization during the editing process, we propose a progressive dataset updating strategy to ensure successful editing while preventing distortion of lip shapes. We also introduce a lightweight refinement network for complementing image details and achieving controllable detail generation in the final rendered image. Our method enables real-time rendering at up to 30FPS on consumer hardware. Multiple metrics and user verification show that our approach significantly improves rendering quality compared to state-of-the-art methods. © 2023, CC BY-NC-ND.

关键词： Rendering (computer graphics)

Fine-Grained Blind Face Inpainting with 3D Face Component Disentanglement

学校读者我要写书评

暂无评论

Fine-Grained Blind Face Inpainting with 3D Face Component Di...

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Yu Bai Ruian He Weimin Tan Bo Yan Yangle Lin School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University Shanghai China

Inpainting is a task to restore occlusion or other corruption on images. However, previous works require mask of the occluded area to restore the occluded image, which is inconvenient for application. Blind face inpainting aims to automatically restore the occluded face without position information of the corrupt region. In this paper, we propose a novel fine-grained blind face inpainting framework, combining 3D face components disentanglement with generative network. Canonical face texture and shape disentangled by unsupervised 3D face model is restored separately to get occlusion-free rendered result. Finally, the pixel-to-pixel generative module utilize the occlusion image and the coarse de-occlusion face to get refined inpainted result. We also build up a new dataset called CelebO-3D which consists of occluded face images synthesized with 3D occlusion and rendered by 3D face model. Extensive experiments show that the proposed method is effective and robust in face blind inpainting both in synthesized and real images. Extensive evaluations and comparison with previous methods also show our superior effectiveness and lightweight architecture.

关键词： Solid modeling Three-dimensional displays Shape Speech enhancement Signal processing Acoustics Image restoration

Motion Matters: Difference-based Multi-scale Learning for Infrared UAV Detection

学校读者我要写书评

暂无评论

Motion Matters: Difference-based Multi-scale Learning for In...

IEEE computer Society Conference on computer Vision and Pattern Recognition Workshops (CVPRW)

作者： Ruian He Shili Zhou Ri Cheng Yuqi Sun Weimin Tan Bo Yan School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University Shanghai China

Unmanned Aerial Vehicle (UAV) detection in the wild is a challenging task due to the presence of background noise and the varying size of the object. To address these obstacles, we propose a novel learning framework for robust UAV detectors, which we call Difference-based Multi-scale Learning (DML). We argue that motion information matters in UAV detection because of the low recognition in one frame. Our method utilizes the frame difference of multiple previous frames, extracting motion information and blocking background noise. We also fuse multiple spatial-temporal scales for training and inferencing, enabling fusion from different sources. In addition, to better evaluate the performance of UAV detection in different scales, we propose Multi-Scale Average Precision (MSAP) metric to aggregate the detection accuracy over multiple scales. Through extensive experiments, we demonstrate that our proposed approach improves the detection accuracy of baseline models. Notably, we achieve SOTA performance in the 3rd Anti-UAV Challenge, with 2nd place in Track 2 and 4th place in Track 1. 1

关键词：

Uncertainty-Guided Spatial Pruning Architecture for Efficient Frame Interpolation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Cheng, Ri Jiang, Xuhao He, Ruian Zhou, Shili Tan, Weimin Yan, Bo School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University Shanghai China

The video frame interpolation (VFI) model applies the convolution operation to all locations, leading to redundant computations in regions with easy motion. We can use dynamic spatial pruning method to skip redundant computation, but this method cannot properly identify easy regions in VFI tasks without supervision. In this paper, we develop an Uncertainty-Guided Spatial Pruning (UGSP) architecture to skip redundant computation for efficient frame interpolation dynamically. Specifically, pixels with low uncertainty indicate easy regions, where the calculation can be reduced without bringing undesirable visual results. Therefore, we utilize uncertainty-generated mask labels to guide our UGSP in properly locating the easy region. Furthermore, we propose a self-contrast training strategy that leverages an auxiliary non-pruning branch to improve the performance of our UGSP. Extensive experiments show that UGSP maintains performance but reduces FLOPs by 34%/52%/30% compared to baseline without pruning on Vimeo90K/UCF101/MiddleBury datasets. In addition, our method achieves state-of-the-art performance with lower FLOPs on multiple benchmarks. Copyright © 2023, The Authors. All rights reserved.

关键词： Benchmarking

Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Mou, Xinyi Wei, Zhongyu Huang, Xuanjing School of Data Science Fudan University China Research Institute of Intelligent and Complex Systems Fudan University China School of Computer Science Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China

Social media has emerged as a cornerstone of social movements, wielding significant influence in driving societal change. Simulating the response of the public and forecasting the potential impact has become increasingly important. However, existing methods for simulating such phenomena encounter challenges concerning their efficacy and efficiency in capturing the behaviors of social movement participants. In this paper, we introduce a hybrid framework HiSim for social media user simulation, wherein users are categorized into two types. Core users are driven by Large Language Models, while numerous ordinary users are modeled by deductive agent-based models. We further construct a Twitter-like environment to replicate their response dynamics following trigger events. Subsequently, we develop a multi-faceted benchmark SoMoSiMu-Bench for evaluation and conduct comprehensive experiments across real-world datasets. Experimental results demonstrate the effectiveness and flexibility of our method 1 Copyright © 2024, The Authors. All rights reserved.

关键词： Computational methods

Causal discovery via conditional independence testing with proxy variables 24

学校读者我要写书评

暂无评论

Causal discovery via conditional independence testing with p...

Proceedings of the 41st International Conference on Machine Learning

作者： Mingzhou Liu Xinwei Sun Yu Qiao Yizhou Wang School of Computer Science and Center on Frontiers of Computing Studies (CFCS) Peking University Sch. of Data Science Fudan University Dep. of Automation Shanghai Jiao Tong University Center on Frontiers of Computing Studies (CFCS) and School of Computer Science and Inst. for Artificial Intelligence and Nat'l Eng. Research Center of Visual Technology and Nat'l Key Lab of General Artificial Intelligence Peking University

Distinguishing causal connections from correlations is important in many scenarios. However, the presence of unobserved variables, such as the latent confounder, can introduce bias in conditional independence testing commonly employed in constraint-based causal discovery for identifying causal relations. To address this issue, existing methods introduced proxy variables to adjust for the bias caused by unobserveness. However, these methods were either limited to categorical variables or relied on strong parametric assumptions for identification. In this paper, we propose a novel hypothesis-testing procedure that can effectively examine the existence of the causal relationship over continuous variables, without any parametric constraint. Our procedure is based on discretization, which under completeness conditions, is able to asymptotically establish a linear equation whose coefficient vector is identifiable under the causal null hypothesis. Based on this, we introduce our test statistic and demonstrate its asymptotic level and power. We validate the effectiveness of our procedure using both synthetic and real-world data. Code is publicly available at https://***/lmz123321/proxy_causal_discovery.

关键词：