检索结果-内蒙古大学图书馆

End-to-end Optimized Lossy Compression for Neural-morphic Spiking Camera Captured Data

IEEE Transactions on Circuits and Systems for Video Technology 2025年第6期35卷 6074-6086页

作者： Feng, Kexiang Jia, Chuanmin Pan, Jingshan Ma, Siwei Gao, Wen Chinese Academy of Sciences Institute of Computing Technology Beijing100190 China University of Chinese Academy of Sciences Beijing100049 China Peking University National Engineering Research Center of Visual Technology Beijing100871 China Peking University Wangxuan Institute of Computer Technology Beijing100080 China Shandong Computer Science Center National Supercomputer in Jinan Jinan250014 China Peking University National Engineering Research Center of Visual Technology School of Computer Science Beijing100871 China Peng Cheng Laboratory Shenzhen518055 China

Recently, the bio-inspired spike camera with continuous motion recording capability has attracted tremendous attention due to its ultra high temporal resolution imaging characteristic. Such imaging feature results in huge data storage and transmission burden compared to that of traditional camera, raising severe challenge and imminent necessity in compression for spike camera captured content. Existing lossy data compression methods could not be applied for compressing spike streams efficiently due to integrate-and-fire characteristic and binarized data structure. Considering the imaging principle and information fidelity of spike cameras, we propose a novel Reconstruction-based Contextual Spike Compression (RCSC) framework, which contains scene reconstruction, contextual image compression and spike generation. To our knowledge, it is the first learning-based model for efficient and robust spike stream compression with informative fidelity. Extensive experimental results show that our model outperforms the state-of-the-art conventional codec VVC intra by 6.14% and surpasses the state-of-the-art learned codec by 2.53% in BD-rate reduction, establishing a strong baseline for spike compression. © 1991-2012 IEEE.

关键词： Image compression

来源：评论

学校读者我要写书评

暂无评论

Trace-based Multi-Dimensional Root Cause Localization of Performance Issues in Microservice Systems 24

Trace-based Multi-Dimensional Root Cause Localization of Per...

引用

44th ACM/IEEE International Conference on Software Engineering, ICSE 2024

作者： Zhang, Chenxi Dong, Zhen Peng, Xin Zhang, Bicheng Chen, Miao Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China School of Computer Science and Shanghai Key Laboratory of Data Science Fudan University China

ISBN: (纸本)9798400702174

Modern microservice systems have become increasingly complicated due to the dynamic and complex interactions and runtime environment. It leads to the system vulnerable to performance issues caused by a variety of reasons, such as the runtime environments, communications, coordinations, or implementations of services. Traces record the detailed execution process of a request through the system and have been widely used in performance issues diagnosis in microservice systems. By identifying the execution processes and attribute value combinations that are common in anomalous traces but rare in normal traces, engineers may localize the root cause of a performance issue into a smaller scope. However, due to the complex structure of traces and the large number of attribute combinations, it is challenging to find the root cause from the huge search space. In this paper, we propose TraceContrast, a trace-based multidimensional root cause localization approach. TraceContrast uses a sequence representation to describe the complex structure of a trace with attributes of each span. Based on the representation, it combines contrast sequential pattern mining and spectrum analysis to localize multidimensional root causes efficiently. Experimental studies on a widely used microservice benchmark show that TraceContrast outperforms existing approaches in both multidimensional and instance-dimensional root cause localization with significant accuracy advantages. Moreover, Trace-Contrast is efficient and its efficiency can be further improved by parallel execution. © 2024 ACM.

关键词： Spectrum analysis

来源：评论

学校读者我要写书评

暂无评论

Automatic Lens Design based on Differentiable Ray-tracing

Automatic Lens Design based on Differentiable Ray-tracing

引用

Computational Optical Sensing and Imaging, COSI 2022

作者： Yang, Xinge Fu, Qiang Heidrich, Wolfgang Visual Computing Center King Abdullah University of Science and Technology Thuwal23955 Saudi Arabia

We propose a fully differentiable optical design method enabled by curriculum learning. Preliminary results show that our framework is suitable to solve highly non-convex problems like cellphone lens design. © 20... 详细信息

ISBN: (纸本)9781557528209

关键词： Optical design

来源：评论

学校读者我要写书评

暂无评论

Explainable XR: Understanding User Behaviors of XR Environments using LLM-assisted Analytics Framework

arXiv

引用

arXiv 2025年

作者： Kim, Yoonsang Aamir, Zainab Singh, Mithilesh Boorboor, Saeed Mueller, Klaus Kaufman, Arie E. Center for Visual Computing Stony Brook University New York United States

We present Explainable XR, an end-to-end framework for analyzing user behavior in diverse eXtended Reality (XR) environments by leveraging Large Language Models (LLMs) for data interpretation assistance. Existing XR user analytics frameworks face challenges in handling cross-virtuality – AR, VR, MR – transitions, multi-user collaborative application scenarios, and the complexity of multimodal data. Explainable XR addresses these challenges by providing a virtuality-agnostic solution for the collection, analysis, and visualization of immersive sessions. We propose three main components in our framework: (1) A novel user data recording schema, called User Action Descriptor (UAD), that can capture the users’ multimodal actions, along with their intents and the contexts;(2) a platform-agnostic XR session recorder, and (3) a visual analytics interface that offers LLM-assisted insights tailored to the analysts’ perspectives, facilitating the exploration and analysis of the recorded XR session data. We demonstrate the versatility of Explainable XR by demonstrating five use-case scenarios, in both individual and collaborative XR applications across virtualities. Our technical evaluation and user studies show that Explainable XR provides a highly usable analytics solution for understanding user actions and delivering multifaceted, actionable insights into user behaviors in immersive environments. Copyright © 2025, The Authors. All rights reserved.

关键词： visual analytics

来源：评论

学校读者我要写书评

暂无评论

Neural Texture Synthesis with Guided Correspondence

Neural Texture Synthesis with Guided Correspondence

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Yang Zhou Kaijian Chen Rongjun Xiao Hui Huang Visual Computing Research Center Shenzhen University

Markov random fields (MRFs) are the cornerstone of classical approaches to example-based texture synthesis. Yet, it is not fully valued in the deep learning era. This pa-per aims to re-promote the combination of MRFs and neural networks, i.e., the CNNMRF model, for texture synthesis, with two key observations made. We first propose to compute the Guided Correspondence Distance in the nearest neighbor search, based on which a Guided Correspondence loss is defined to measure the similarity of the output texture to the example. Experiments show that our approach sur-passes existing neural approaches in uncontrolled and con-trolled texture synthesis. More importantly, the Guided Cor-respondence loss can function as a general textural loss in, e.g., training generative networks for real-time controlled synthesis and inversion-based single-image editing. In con-trast, existing textural losses, such as the Sliced Wasserstein loss, cannot work on these challenging tasks.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Flexible Kokotsakis Meshes with Skew Faces: Generalization of the Orthodiagonal Involutive Type

arXiv

引用

arXiv 2023年

作者： Aikyn, Alisher Liu, Yang Lyakhov, Dmitry A. Rist, Florian Pottmann, Helmut Michels, Dominik L. KAUST Visual Computing Center Saudi Arabia

In this paper, we introduce and study a remarkable class of mechanisms formed by a 3×3 arrangement of rigid quadrilateral faces with revolute joints at the common edges. In contrast to the well-studied Kokotsakis meshes with a quadrangular base, we do not assume the planarity of the quadrilateral faces. Our mechanisms are a generalization of Izmestiev's orthodiagonal involutive type of Kokotsakis meshes formed by planar quadrilateral faces. The importance of this Izmestiev class is undisputed as it represents the first known flexible discrete surface - T-nets - which has been constructed by Graf and Sauer. Our algebraic approach yields a complete characterization of all flexible 3×3 quad meshes of the orthodiagonal involutive type up to some degenerated cases. It is shown that one has a maximum of 8 degrees of freedom to construct such mechanisms. This is illustrated by several examples, including cases which could not be realized using planar faces. We demonstrate the practical realization of the proposed mechanisms by building a physical prototype using stainless steel. In contrast to plastic prototype fabrication, we avoid large tolerances and inherent flexibility. Copyright © 2023, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models 38

Lumen: Unleashing Versatile Vision-Centric Capabilities of L...

引用

38th Conference on Neural Information Processing Systems, NeurIPS 2024

作者： Jiao, Yang Chen, Shaoxiang Jie, Zequn Chen, Jingjing Ma, Lin Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center on Intelligent Visual Computing China Meituan China

Large Multimodal Model (LMM) is a hot research topic in the computer vision area and has also demonstrated remarkable potential across multiple disciplinary fields. A recent trend is to further extend and enhance the perception capabilities of LMMs. The current methods follow the paradigm of adapting the visual task outputs to language-oriented formats. This adaptation leads to the convenient development of such LMMs with minimal modifications, however, it overlooks the inductive biases within diverse visual tasks and hinders the learning of perception capabilities. To address this issue, we propose a novel LMM architecture named Lumen, which decouples the learning of perception capabilities into task-agnostic and task-specific stages. Firstly, Lumen promotes fine-grained vision-language concept alignment, which is the fundamental capability for various visual tasks. Thus the output of the task-agnostic stage is a shared representation for all vision-centric tasks we address in this paper. Afterward, the task-specific decoding is carried out by flexibly routing the shared representation to lightweight task decoders with negligible training efforts. Comprehensive experimental results on a series of vision-centric and VQA benchmarks indicate that our Lumen model not only achieves or surpasses the performance of existing LMM-based approaches in a range of vision-centric tasks while maintaining general visual understanding and instruction following capabilities. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Uncer2Natural: Uncertainty-Aware Unsupervised Image Denoising 48

Uncer2Natural: Uncertainty-Aware Unsupervised Image Denoisin...

引用

48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023

作者： Huang, Chenyu Tan, Weimin Shi, Jiaxing Xing, Zhen Yan, Bo Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai China

ISBN: (纸本)9781728163277

Recently, unsupervised image denoising methods learning from paired noisy samples have received increasing attention. These methods build on the idea that the mean of multiple noisy images of the same scene is the ideal clean image. However, these methods ignore the effect of Aleatoric uncertainty in the noisy image (e.g., pixels deviating from the expected distribution). The presence of Aleatoric uncertainty causes degradation of the reconstructed target pixels, resulting in high uncertainty for these pixels (i.e., low confidence), which in turn leads to sub-optimal denoising results. To address this problem, we propose a novel uncertainty-aware unsupervised image denoising method named Uncer2Natural (U2N). It dynamically predicts the Aleatoric uncertainty for each noisy sample and produces satisfactory denoising results by reducing the effect of Aleatoric uncertainty. Extensive experimental results show that U2N outperforms state-of-the- art unsupervised image denoising methods in terms of both quantitative metrics and qualitative visual quality. © 2023 IEEE.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Motion Matters: Difference-based Multi-scale Learning for Infrared UAV Detection

Motion Matters: Difference-based Multi-scale Learning for In...

引用

2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023

作者： He, Ruian Zhou, Shili Cheng, Ri Sun, Yuqi Tan, Weimin Yan, Bo Shanghai Collaborative Innovation Center of Intelligent Visual Computing Fudan University School of Computer Science Shanghai Key Laboratory of Intelligent Information Processing Shanghai China

ISBN: (纸本)9798350302493

Unmanned Aerial Vehicle (UAV) detection in the wild is a challenging task due to the presence of background noise and the varying size of the object. To address these obstacles, we propose a novel learning framework for robust UAV detectors, which we call Difference-based Multi-scale Learning (DML). We argue that motion information matters in UAV detection because of the low recognition in one frame. Our method utilizes the frame difference of multiple previous frames, extracting motion information and blocking background noise. We also fuse multiple spatial-temporal scales for training and inferencing, enabling fusion from different sources. In addition, to better evaluate the performance of UAV detection in different scales, we propose Multi-Scale Average Precision (MSAP) metric to aggregate the detection accuracy over multiple scales. Through extensive experiments, we demonstrate that our proposed approach improves the detection accuracy of baseline models. Notably, we achieve SOTA performance in the 3rd Anti-UAV Challenge, with 2nd place in Track 2 and 4th place in Track 1. © 2023 IEEE.

关键词： Antennas

来源：评论

学校读者我要写书评

暂无评论

DeepStack: Deeply Stacking visual Tokens is Surprisingly Simple and Effective for LMMs 38

DeepStack: Deeply Stacking Visual Tokens is Surprisingly Sim...

引用

38th Conference on Neural Information Processing Systems, NeurIPS 2024

作者： Meng, Lingchen Yang, Jianwei Tian, Rui Dai, Xiyang Wu, Zuxuan Gao, Jianfeng Jiang, Yu-Gang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University China Shanghai Collaborative Innovation Center of Intelligent Visual Computing China Microsoft Corporation United States

Most large multimodal models (LMMs) are implemented by feeding visual tokens as a sequence into the first layer of a large language model (LLM). The resulting architecture is simple but significantly increases computation and memory costs, as it has to handle a large number of additional tokens in its input layer. This paper presents a new architecture DeepStack for LMMs. Considering N layers in the language and vision transformer of LMMs, we stack the visual tokens into N groups and feed each group to its aligned transformer layer from bottom to top, as illustrated in Fig. 1. Surprisingly, this simple method greatly enhances the power of LMMs to model interactions among visual tokens across layers but with minimal additional cost. We apply DeepStack to both language and vision transformer in LMMs, and validate the effectiveness of DeepStack LMMs with extensive empirical results. Using the same context length, our DeepStack 7B and 13B parameters surpass their counterparts by 2.7 and 2.9 on average across 9 benchmarks, respectively. Using only one-fifth of the context length, DeepStack rivals closely to the counterparts that use the full context length. These gains are particularly pronounced on high-resolution tasks, e.g., 4.2, 11.0, and 4.0 improvements on TextVQA, DocVQA, and InfoVQA compared to LLaVA-1.5-7B, respectively. We further apply DeepStack to vision transformer layers, which brings us a similar amount of improvements, 3.8 on average compared with LLaVA-1.5-7B. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：