检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Shang, Zirui Zhu, Yubo Li, Hongxi Yang, Shuo Wu, Xinxiao Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology China Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China

Video summarization aims to eliminate visual redundancy while retaining key parts of video to construct concise and comprehensive synopses. Most existing methods use discriminative models to predict the importance scores of video frames. However, these methods are susceptible to annotation inconsistency caused by the inherent subjectivity of different annotators when annotating the same video. In this paper, we introduce a generative framework for video summarization that learns how to generate summaries from a probability distribution perspective, effectively reducing the interference of subjective annotation noise. Specifically, we propose a novel diffusion summarization method based on the Denoising Diffusion Probabilistic Model (DDPM), which learns the probability distribution of training data through noise prediction, and generates summaries by iterative denoising. Our method is more resistant to subjective annotation noise, and is less prone to overfitting the training data than discriminative methods, with strong generalization ability. Moreover, to facilitate training DDPM with limited data, we employ an unsupervised video summarization model to implement the earlier denoising process. Extensive experiments on various datasets (TVSum, SumMe, and FPVSum) demonstrate the effectiveness of our method. Copyright © 2024, The Authors. All rights reserved.

关键词： Image denoising

来源：评论

学校读者我要写书评

暂无评论

Data-free Multi-label Image Recognition via LLM-powered Prompt Tuning

arXiv

引用

arXiv 2024年

作者： Yang, Shuo Shang, Zirui Wang, Yongqi Deng, Derong Chen, Hongwei Cheng, Qiyuan Wu, Xinxiao Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology China

This paper proposes a novel framework for multi-label image recognition without any training data, called data-free framework, which uses knowledge of pre-trained Large Language Model (LLM) to learn prompts to adapt pre-trained Vision-Language Model (VLM) like CLIP to multi-label classification. Through asking LLM by well-designed questions, we acquire comprehensive knowledge about characteristics and contexts of objects, which provides valuable text descriptions for learning prompts. Then we propose a hierarchical prompt learning method by taking the multi-label dependency into consideration, wherein a subset of category-specific prompt tokens are shared when the corresponding objects exhibit similar attributes or are more likely to co-occur. Benefiting from the remarkable alignment between visual and linguistic semantics of CLIP, the hierarchical prompts learned from text descriptions are applied to perform classification of images during inference. Our framework presents a new way to explore the synergies between multiple pre-trained models for novel category recognition. Extensive experiments on three public datasets (MS-COCO, VOC2007, and NUS-WIDE) demonstrate that our method achieves better results than the state-of-the-art methods, especially outperforming the zero-shot multi-label recognition methods by 4.7% in mAP on MS-COCO. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Caseg: Clip-Based Action Segmentation With Learnable Text Prompt

Caseg: Clip-Based Action Segmentation With Learnable Text Pr...

引用

IEEE International Conference on Image Processing

作者： Suyuan Huang Haoxin Zhang Yanyu Xu Yan Gao Yao Hu Zengchang Qin Intelligent Computing and Machine Learning Lab School of ASEE Beihang University Xiaohongshu Inc. Institute of High Performance Computing A*Star Guangzhou Zhongsuan Cloud Technology Co.. Ltd.

ISBN: (数字)9798350349399

ISBN: (纸本)9798350349405

Video action segmentation aims to identify and localize actions. Existing models have achieved impressive performance with pre-extracted frame-level features, but this may limit zero-shot learning and cross-dataset inference, especially for new actions or scenes. To overcome this problem, we propose a novel end-to-end network designed for robust performance across both familiar and novel action segmentation scenarios. Our approach combines a plug-and-play visual prompt module enhancing CLIP features’ temporal understanding, and a learnable text prompt that enriches label semantics and refines the model’s focus, significantly boosting performance. Our results demonstrate that CLIP features can assist in action segmentation tasks, and prompts can improve task effectiveness. Furthermore, our findings show that CLIP features contain information that i3d features do not. We evaluate the proposed method on several video datasets, including Georgia Tech Egocentric Activities (GTEA), 50Salads, and Breakfast, and the results show that the proposed model outperforms existing SOTA models.

关键词： Image segmentation Visualization Zero-shot learning Surveillance Semantics Refining Human-robot interaction

来源：评论

学校读者我要写书评

暂无评论

Temporal Attention Convolution Network for Energy Time Series Forecasting 7

Temporal Attention Convolution Network for Energy Time Serie...

引用

7th International Symposium on Advances in Electrical, Electronics, and Computer Engineering

作者： Hu, Min Xu, Haijun Wang, Xiaohua Li, Liang Li, Hongbo Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine Hefei University of Technology Hefei230009 China Intelligent Interconnected Systems Laboratory of Anhui Province Hefei University of Technology Hefei230009 China MediaTek Hefei230009 China

ISBN: (纸本)9781510656437

Energy time series are characterized by stochasticity, short-term periodicity, and long-term periodicity. Many traditional models such as the autoregressive model, Gaussian process regression are unable to capture the complex time relationships of energy time series. Recurrent neural networks (RNNs), which are widely used for energy time series forecasting, are prone to gradient disappearance or gradient explosion when processing a long sequence data. Thus, RNNs are failed to capture the complete information of the whole long sequence data. To extract complex irregular patterns of energy time series and selectively learn spatio-temporal features, a Temporal Attention Convolution Network (TACN) is proposed in this paper. This structure can extract spatial and temporal features of energy time series, which full filled with our demand. Firstly, to solve the problem that RNNs are prone to information loss when processing the long sequence data, a temporal convolutional network (TCN) is introduced. TCN enables the output to capture the complete information of the whole long sequence data. Then, to reinforce the TCN for extracting effective spatio-temporal features, Squeeze-and-Excitation Network (SENet), a module for computing channel attention, was introduced to this TCN structure. By applying this module, the ability of the acquisition of important channel information has been enhanced. Finally, to further improve the robustness of the model, an autoregressive linear module is constructed to capture the linear relationship among the variables. Experiments on the publicly available datasets Electricity and Solar-Energy show that compare with existing deep learning models, TACN achieves more ideal performance. © 2022 SPIE. All rights reserved.

关键词： Time series

来源：评论

学校读者我要写书评

暂无评论

3D Visual Illusion Depth Estimation

arXiv

引用

arXiv 2025年

作者： Yao, Chengtang Liu, Zhidan Zeng, Jiaxi Yu, Lidong Wu, Yuwei Jia, Yunde Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology China Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China NVIDIA United States

3D visual illusion is a perceptual phenomenon where a two-dimensional plane is manipulated to simulate three-dimensional spatial relationships, making a flat artwork or object look three-dimensional in the human visual system. In this paper, we reveal that the machine visual system is also seriously fooled by 3D visual illusion, including monocular and binocular depth estimation. In order to explore and analyze the impact of 3D visual illusion on depth estimation, we collect a large dataset containing almost 3k scenes and 200k images to train and evaluate SOTA monocular and binocular depth estimation methods. We also propose a robust depth estimation framework that uses common sense from a vision-language model to adaptively select reliable depth from binocular disparity and monocular depth. Experiments show that SOTA monocular, binocular, and multi-view depth estimation approaches are all fooled by various 3D visual illusions, while our method achieves SOTA performance. https://***/YaoChengTang/3DVisual-Illusion-Depth-Estimation © 2025, CC BY.

关键词： Three dimensional computer graphics

来源：评论

学校读者我要写书评

暂无评论

GAN-based Symmetric Embedding Costs Adjustment for Enhancing Image Steganographic Security 24

GAN-based Symmetric Embedding Costs Adjustment for Enhancing...

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Ye, Miaoxin Zhou, Saixing Luo, Weiqi Tan, Shunquan Huang, Jiwu Guangdong Provincial Key Laboratory of Information Security Technology Sun Yat-Sen University Guangzhou China Shenzhen Key Laboratory of Media Security College of Computer Science and Software Engineering Shenzhen University Shenzhen China Guangdong Laboratory of Machine Perception and Intelligent Computing Faculty of Engineering Shenzhen MSU-BIT University Shenzhen China

ISBN: (纸本)9798400706868

Designing embedding costs is pivotal in modern image steganography. Many studies have shown adjusting symmetric embedding costs to asymmetric ones can enhance steganographic security. However, most existing methods heavily depend on manually defined parameters or rules, limiting security performance improvements. To overcome this limitation, we introduce an advanced GAN-based framework that transitions symmetric costs to asymmetric ones without the need for the manual intervention seen in existing approaches, such as the detailed specification of cost modulation directions and magnitudes. In our framework, we firstly achieve symmetric costs for a cover image, which is randomly split into two sub-images, with part of the secret information embedded into one. Subsequently, we design a GAN model to adjust the embedding costs of the second sub-image to asymmetric, facilitating the secure embedding of the remaining secret information. To support our phased embedding approach, our GAN's discriminator incorporates two steganalyers with different tasks: distinguishing the generator's final output, i.e., the stego image, from both the input cover image and the partially embedded stego image, providing diverse guidance to the generator. In addition, we introduce a simple yet effective update strategy to ensure a stable training process. Comprehensive experiments demonstrate that our method significantly enhances security over existing symmetric steganography techniques, achieving state-of-the-art levels compared to other methods focused on embedding costs adjustments. Additionally, detailed ablation studies validate our approach's effectiveness. © 2024 ACM.

关键词： Steganography

来源：评论

学校读者我要写书评

暂无评论

CMA: A Chromaticity Map Adapter for Robust Detection of Screen-Recapture Document Images

CMA: A Chromaticity Map Adapter for Robust Detection of Scre...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Changsheng Chen Liangwei Lin Yongqi Chen Bin Li Jishen Zeng Jiwu Huang Guangdong Key Laboratory of Intelligent Information Processing and Shenzhen Key Laboratory of Media Security Shenzhen University Alibaba Group Guangdong Laboratory of Machine Perception and Intelligent Computing Faculty of Engineering Shenzhen MSU-BIT University

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

The rebroadcasting of screen-recaptured document images introduces a significant risk to the confidential docu-ments processed in government departments and commer-cial companies. However, detecting recaptured document images subjected to distortions from online social networks (OSNs) is challenging since the common forensics cues, such as moiré pattern, are weakened during transmission. In this work, we first devise a pixel-level distortion model of the screen-recaptured document image to identify the robust features of color artifacts. Then, we extract a chromaticity map from the recaptured image to highlight the presence of color artifacts even under low-quality samples. Based on the prior understanding, we design a chromaticity map adapter (CMA) to efficiently extract the chromaticity map, and feed it into the transformer backbone as multi-modal prompt tokens. To evaluate the performance of the pro-posed method, we collect a recaptured office document im-age dataset with over 10K diverse samples. Experimental results demonstrate that the proposed CMA method outper-forms a SOTA approach (with RGB modality only), reducing the average EER from 26.82% to 16.78%. Robustness eval-uation shows that our method achieves 0.8688 and 0.7554 AUCs under samples with JPEG compression $(QF=70)$ and resolution as low as $534\times 503$ pixels.

关键词： Image color analysis Social networking (online) Forensics Splicing Transform coding Feature extraction Distortion

来源：评论

学校读者我要写书评

暂无评论

Finding Emotional Focus for Emotion Recognition at Sentence Level

引用

Chinese Journal of Electronics 2023年第1期22卷 99-103页

作者： Changqin Quan Fuji Ren Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine Hefei University of Technology Hefei China Faculty of Engineering The University of Tokushima Tokushima Japan

Emotion recognition at sentence level is one of the fundamental problems of textual emotion understanding. Based on the observation that sentence emotional focus can be expressed by some clauses in this sentence, this paper proposes to find the emotional focus for sentence emotion recognition. For the sake of breaking through the problems brought about by depending on emotion lexicons, we first recognize word emotions in a sentence based on Maximum entropy model. And then homogeneous Markov model is built for clause emotion recognition; After that, a strategy based on emotion selection is proposed for a sentence with multiple clauses, and genetic algorithm is used for clause selection by textual feature weighting. The experimental results show that, comparing with the baseline, there are 9.1% and 3.6% improvement respectively for two different evaluations. It is demonstrated that finding emotional focus by clause selection is able to improve the performance of sentence emotion recognition significantly.

关键词： Emotion recognition Speech recognition Markov processes Entropy Real-time systems Task analysis Research and development

来源：评论

学校读者我要写书评

暂无评论

Hierarchical Multiview Top-k Pooling with Deep-Q-Networks

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2024年第6期5卷 2985-2996页

作者： Li, Zhi-Peng Su, Hai-Long Wu, Yong- Zhang, Qin-Hu Yuan, Chang-An Gribova, Valeriya Filaretov, Vladimir Fedorovich Huang, De-Shuang Eastern Institute of Technology Zhejiang Ningbo315201 China University of Science and Technology of China School of Life Sciences Anhui Hefei230026 China Tongji University Institute of Machine Learning and Systems Biology School of Electronics and Information Engineering Shanghai201804 China Guangxi Academy of Sciences Institute of Big Data and Intelligent Computing Research Center Nanning530007 China Far Eastern Branch of the Russian Academy of Sciences Institute of Automation and Control Processes Vladivostok690041 Russia

Graph neural networks (GNNs) are extensions of deep neural networks to graph-structured data. It has already attracted widespread attention for various tasks such as node classification and link prediction. Existing research focuses more on graph convolutional neural networks (GCNs). However, it is usually overlooked that graph pooling can obtain graph representations by summarizing and down-sampling node information. Meanwhile, existing graph pooling methods mainly use top-k for node selection, but most of them consider only single view information when scoring nodes, and the k values in top-k are usually selected empirically. This work proposes the hierarchical multiview top-k pooling (HMTPool) with deep-Q-networks, which scores nodes taking into account multiview information (considering graph structure and features) and does not rely on the empirical adaptive selection of the best k value. HMTPool is a two-stage process. It first uses a variant GCN and multilayer perceptron to score the nodes from structural and feature perspectives, respectively and then performs fusion operations on the multiview information scores of the nodes. In addition, to select the optimal pooling ratio of top-k, we propose a deep-Q-network-based top-k (DTop-k) node selection method, which can adaptively select the best pooling ratio without prior knowledge. Experimental results on six TUDatasets and two Benchmarking GNNs datasets demonstrate the effectiveness of our proposed approach. © 2020 IEEE.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

Temporally Consistent Stereo Matching

arXiv

引用

arXiv 2024年

作者： Zeng, Jiaxi Yao, Chengtang Wu, Yuwei Jia, Yunde Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology China Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China Horizon Robotics China

Stereo matching provides depth estimation from binocular images for downstream applications. These applications mostly take video streams as input and require temporally consistent depth maps. However, existing methods mainly focus on the estimation at the single-frame level. This commonly leads to temporally inconsistent results, especially in ill-posed regions. In this paper, we aim to leverage temporal information to improve the temporal consistency, accuracy, and efficiency of stereo matching. To achieve this, we formulate video stereo matching as a process of temporal disparity completion followed by continuous iterative refinements. Specifically, we first project the disparity of the previous timestamp to the current viewpoint, obtaining a semi-dense disparity map. Then, we complete this map through a disparity completion module to obtain a well-initialized disparity map. The state features from the current completion module and from the past refinement are fused together, providing a temporally coherent state for subsequent refinement. Based on this coherent state, we introduce a dual-space refinement module to iteratively refine the initialized result in both disparity and disparity gradient spaces, improving estimations in ill-posed regions. Extensive experiments demonstrate that our method effectively alleviates temporal inconsistency while enhancing both accuracy and efficiency. Currently, our method ranks second on the KITTI 2015 benchmark, while achieving superior efficiency compared to other state-of-the-art methods. The code is available at https://***/jiaxiZeng/Temporally-Consistent-Stereo-Matching. © 2024, CC BY-NC-ND.

关键词： Efficiency

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：