检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Zhai, Mingliang Li, Yulin Qin, Xiameng Yi, Chen Xie, Qunyi Zhang, Chengquan Yao, Kun Wu, Yuwei Jia, Yunde Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology China Baidu Inc. China Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China

Transformers achieve promising performance in document understanding because of their high effectiveness and still suffer from quadratic computational complexity dependency on the sequence length. General efficient transformers are challenging to be directly adapted to model document. They are unable to handle the layout representation in documents, e.g. word, line and paragraph, on different granularity levels and seem hard to achieve a good trade-off between efficiency and performance. To tackle the concerns, we propose Fast-StrucTexT, an efficient multi-modal framework based on the StrucTexT algorithm with an hourglass transformer architecture, for visual document understanding. Specifically, we design a modality-guided dynamic token merging block to make the model learn multi-granularity representation and prunes redundant tokens. Additionally, we present a multi-modal interaction module called Symmetry Cross Attention (SCA) to consider multi-modal fusion and efficiently guide the token mergence. The SCA allows one modality input as query to calculate cross attention with another modality in a dual phase. Extensive experiments on FUNSD, SROIE, and CORD datasets demonstrate that our model achieves the state-of-the-art performance and almost 1.9× faster inference time than the state-of-the-art methods. Copyright © 2023, The Authors. All rights reserved.

关键词： Economic and social effects

来源：评论

学校读者我要写书评

暂无评论

Exploring Query Efficient Data Generation towards Data-free Model Stealing in Hard Label Setting

arXiv

引用

arXiv 2024年

作者： Pei, Gaozheng Lyu, Shaojie Ma, Ke Yang, Pinci Xu, Qianqian Sun, Yingfei School of Electronic Electrical and Communication Engineering UCAS Beijing China Key Laboratory of Intelligent Information Processing Institute of Computing Technology CAS Beijing China Tencent Corporate

Data-free model stealing involves replicating the functionality of a target model into a substitute model without accessing the target model’s structure, parameters, or training data. The adversary can only access the target model’s predictions for generated samples. Once the substitute model closely approximates the behavior of the target model, attackers can exploit its white-box characteristics for subsequent malicious activities, such as adversarial attacks. Existing methods within cooperative game frameworks often produce samples with high confidence for the prediction of the substitute model, which makes it difficult for the substitute model to replicate the behavior of the target model. This paper presents a new data-free model stealing approach called Query Efficient Data Generation (QEDG). We introduce two distinct loss functions to ensure the generation of sufficient samples that closely and uniformly align with the target model’s decision boundary across multiple classes. Building on the limitation of current methods, which typically yield only one piece of supervised information per query, we propose the query-free sample augmentation that enables the acquisition of additional supervised information without increasing the number of queries. Motivated by theoretical analysis, we adopt the consistency rate metric, which more accurately evaluates the similarity between the substitute and target models. We conducted extensive experiments to verify the effectiveness of our proposed method, which achieved better performance with fewer queries compared to the state-of-the-art methods on the real MLaaS scenario and five datasets. Copyright © 2024, The Authors. All rights reserved.

关键词： Structured Query Language

来源：评论

学校读者我要写书评

暂无评论

Parameterized Cost Volume for Stereo Matching

Parameterized Cost Volume for Stereo Matching

引用

International Conference on Computer Vision (ICCV)

作者： Jiaxi Zeng Chengtang Yao Lidong Yu Yuwei Wu Yunde Jia Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology China Autonomous Driving Algorithm Deeproute Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China

Stereo matching becomes computationally challenging when dealing with a large disparity range. Prior methods mainly alleviate the computation through dynamic cost volume by focusing on a local disparity space, but it requires many iterations to get close to the ground truth due to the lack of a global view. We find that the dynamic cost volume approximately encodes the disparity space as a single Gaussian distribution with a fixed and small variance at each iteration, which results in an inadequate global view over disparity space and a small update step at every iteration. In this paper, we propose a parameterized cost volume to encode the entire disparity space using multi-Gaussian distribution. The disparity distribution of each pixel is parameterized by weights, means, and variances. The means and variances are used to sample disparity candidates for cost computation, while the weights and means are used to calculate the disparity output. The above parameters are computed through a JS-divergence-based optimization, which is realized as a gradient descent update in a feed-forward differential module. Experiments show that our method speeds up the runtime of RAFT-Stereo by 4 ~ 15 times, achieving real-time performance and comparable accuracy. The code is available at https://***/jiaxiZeng/Parameterized-Cost-Volume-for-Stereo-Matching.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Sparse Point Guided 3D Lane Detection

Sparse Point Guided 3D Lane Detection

引用

International Conference on Computer Vision (ICCV)

作者： Chengtang Yao Lidong Yu Yuwei Wu Yunde Jia School of Computer Science & Technology Beijing Key Laboratory of Intelligent Information Technology Beijing Institute of Technology China Autonomous Driving Algorithm DeepRoute Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University China

3D lane detection usually builds a dense correspondence between the front-view space and the BEV space to estimate lane points in the 3D space. 3D lanes only occupy a small ratio of the dense correspondence, while most correspondence belongs to the redundant background. This sparsity phenomenon bottlenecks valuable computation and raises the computation cost of building a high-resolution correspondence for accurate results. In this paper, we propose a sparse point-guided 3D lane detection, focusing on points related to 3D lanes. Our method runs in a coarse-to-fine manner, including coarse-level lane detection and iterative fine-level sparse point refinements. In coarse-level lane detection, we build a dense but efficient correspondence between the front view and BEV space at a very low resolution to compute coarse lanes. Then in fine-level sparse point refinement, we sample sparse points around coarse lanes to extract local features from the high-resolution front-view feature map. The high-resolution local information brought by sparse points refines 3D lanes in the BEV space hierarchically from low resolution to high resolution. The sparse point guides a more effective information flow and greatly promotes the SOTA result by 3 points on the overall F1-score and 6 points on several hard situations while reducing almost half memory cost and speeding up 2 times.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Interpretable Object Recognition by Semantic Prototype Analysis

Interpretable Object Recognition by Semantic Prototype Analy...

引用

IEEE Workshop on Applications of Computer Vision (WACV)

作者： Qiyang Wan Ruiping Wang Xilin Chen Institute of Computing Technology CAS Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Beijing China University of Chinese Academy of Sciences Beijing China

People can usually give reasons for recognizing a particular object as a specific category, using various means such as body language (by pointing out) and natural language (by telling). This inspires us to develop a recognition model with such principles to explain the recognition process to enhance human trust. We propose Semantic Prototype Analysis Network (SPANet), an interpretable object recognition approach that enables models to explicate the decision process more lucidly and comprehensibly to humans by "pointing out where to focus" and "telling about why it is" simultaneously. With the proposed method, some part prototypes with semantic concepts will be provided to elaborate on the classification together with a group of visualized samples to achieve both part-wise and semantic interpretability. The results of extensive experiments demonstrate that SPANet is able to recognize objects almost as well as the non-interpretable models, at the same time generating intelligible explanations for its decision process.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Multi-View Consistent 3D GAN Inversion via Bidirectional Encoder

Multi-View Consistent 3D GAN Inversion via Bidirectional Enc...

引用

International Conference on Automatic Face and Gesture Recognition

作者： Haozhan Wu Hu Han Shiguang Shan Xilin Chen Key Laboratory of Intelligent Information Processing Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of the Chinese Academy of Sciences Beijing China

ISBN: (数字)9798350394948

ISBN: (纸本)9798350394955

3D GAN inversion enables not only 3D reconstruction from a 2D image, but also novel view synthesis and image editing. Existing works ensure the novel view synthesis quality by constraining the synthesized views to conform to the real image distribution. However, most of the methods did not consider the multi-view consistency, i.e., different photos of the same 3D scene via 3D GAN inversion can be inverted to the same 3D scene. In this paper, we propose a bidirectional encoder (BiDiE) for 3D GAN inversion that can improve the multi-view consistency and alleviate the interference of camera parameter prediction errors. On the one hand, the bidirectional encoder takes real images as input, estimates the camera parameters, and performs 3D reconstruction. On the other hand, the bidirectional encoder takes randomly sampled latent code and camera parameters as input, and generates synthesized images to assist in the latent code learning process. In addition, we extend the latent space from W+ to W++ to improve its reconstruction and editing capabilities. Experiments on the FFHQ, CelebA-HQ and Multi-PIE datasets prove that our proposed method outperforms state-of-the-art methods in multi-view consistent reconstruction as well as editing capability. 1 1 Code and datasets are available at https://***/WHZMM/BiDiE

关键词： Three-dimensional displays Codes Face recognition Interference Gesture recognition Cameras Image reconstruction

来源：评论

学校读者我要写书评

暂无评论

WiViPose: A Video-aided Wi-Fi Framework for Environment-Independent 3D Human Pose Estimation

引用

IEEE Transactions on Multimedia 2025年

作者： Zhang, Lei Ning, Haoran Tang, Jiaxin Chen, Zhenxiang Zhong, Yaping Han, Yahong Tianjin University College of Intelligence and Computing the Tianjin Key Laboratory of Advanced Network Technology and Application Tianjin300050 China Key Laboratory of Computing Power Network and Information Security Ministry of Education China University of Jinan Shandong Provincial Key Laboratory of Ubiquitous Intelligent Computing the School of Information Science and Engineering Jinan250022 China Wuhan Sports University Sports Big-data Research Center Wuhan430079 China Tianjin University College of Intelligence and Computing the Tianjin Key Laboratory of Machine Learning Tianjin300350 China

The inherent complexity of Wi-Fi signals makes video-aided Wi-Fi 3D pose estimation difficult. The challenges include the limited generalizability of the task across diverse environments, its significant signal heterogeneity, and its inadequate ability to analyze local and geometric information. To overcome these challenges, we introduce WiViPose, a video-aided Wi-Fi framework for 3D pose estimation, which attains enhanced cross-environment generalization through cross-layer optimization. Bilinear temporal-spectral fusion (BTSF) is initially used to fuse the time-domain and frequency-domain features derived from Wi-Fi. Video features are derived from a multiresolution convolutional pose machine and enhanced by local self-attention. Cross-modality data fusion is facilitated through an attention-based transformer, with the process further refined under a supervisory mechanism. WiViPose demonstrates effectiveness by achieving an average percentage of correct keypoints (PCK)@50 of 91.01% across three typical indoor environments. © 2025 IEEE.

关键词： Frequency domain analysis

来源：评论

学校读者我要写书评

暂无评论

ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations

ES3: Evolving Self-Supervised Learning of Robust Audio-Visua...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Yuanhang Zhang Shuang Yang Shiguang Shan Xilin Chen Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciences Beijing China

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

We propose a novel strategy, ES 3 , for self-supervised learning of robust audio-visual speech representations from unlabeled talking face videos. While many recent approaches for this task primarily rely on guiding the learning process using the audio modality alone to capture information shared between audio and video, we reframe the problem as the acquisition of shared, unique (modality-specific) and synergistic speech information to address the inherent asymmetry between the modalities. Based on this formulation, we propose a novel “evolving” strategy that progressively builds joint audio-visual speech representations that are strong for both uni-modal (audio & visual) and bi-modal (audio-visual) speech. First, we leverage the more easily learnable audio modality to initialize audio and visual representations by capturing audio-unique and shared speech information. Next, we incorporate video-unique speech information and bootstrap the audio-visual repre-sentations on top of the previously acquired shared knowledge. Finally, we maximize the total audio-visual speech information, including synergistic information to obtain robust and comprehensive representations. We implement ES 3 as a simple Siamese framework and experiments on both English benchmarks and a newly contributed large-scale Mandarin dataset show its effectiveness. In particular, on LRS2-BBC, our smallest model is on par with SoTA models with only 1/2 parameters and 1/8 unlabeled data (223h).

关键词： Visualization Computer vision Self-supervised learning Manuals Benchmark testing Data models Pattern recognition

来源：评论

学校读者我要写书评

暂无评论

Towards Robust Semantic Segmentation against Patch-based Attack via Attention Refinement

arXiv

引用

arXiv 2024年

作者： Yuan, Zheng Zhang, Jie Wang, Yude Shan, Shiguang Chen, Xilin Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China University of Chinese Academy of Sciences Beijing100049 China

The attention mechanism has been proven effective on various visual tasks in recent years. In the semantic segmentation task, the attention mechanism is applied in various methods, including the case of both Convolution Neural Networks (CNN) and Vision Transformer (ViT) as backbones. However, we observe that the attention mechanism is vulnerable to patch-based adversarial attacks. Through the analysis of the effective receptive field, we attribute it to the fact that the wide receptive field brought by global attention may lead to the spread of the adversarial patch. To address this issue, in this paper, we propose a Robust Attention Mechanism (RAM) to improve the robustness of the semantic segmentation model, which can notably relieve the vulnerability against patch-based attacks. Compared to the vallina attention mechanism, RAM introduces two novel modules called Max Attention Suppression and Random Attention Dropout, both of which aim to refine the attention matrix and limit the influence of a single adversarial patch on the semantic segmentation results of other positions. Extensive experiments demonstrate the effectiveness of our RAM to improve the robustness of semantic segmentation models against various patch-based attack methods under different attack settings. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Three-Dimensional Data Security Architecture of Agricultural Supply Chain Driven by Blockchain 5

Three-Dimensional Data Security Architecture of Agricultural...

引用

5th International Conference on High Performance Big Data and intelligent Systems, HDIS 2023

作者： Chen, Xiao Zhang, Guofeng Zhao, Chuan Wang, Bingbing Feng, Bin Wang, Peng Li, Qiuling Li, Songhe Shen, Cong School of Economics and Management Taishan University Taian China School of Information Science and Technology Taishan University Taian China School of Information Science and Engineering Shandong Provincial Key Laboratory of Network-based Intelligent Computing University of Jinan Jinan China School of Information Science and Engineering University of Jinan Jinan China College of Physics and Electronic Engineering Taishan University Taian China

ISBN: (纸本)9798350394160

Agricultural supply chain systems mainly focus on technological applications, but do not pay enough attention to the privacy protection and data security guarantee of the entire supply chain entities. They face practical challenges such as low enthusiasm, poor data quality, and low credibility. This work starts from three dimensions of supply chain entities, blockchain technology, and government/regulatory agencies, fully integrating blockchain and the Internet of Things, blockchain and big data, blockchain and artificial intelligence, and designing a three-dimensional data security architecture for agricultural supply chain. Research suggests that utilizing the data security guarantees provided by three dimensions, the distributed storage, tamper resistance, transparency, traceability and other technical features of blockchain, as well as the automatic perception, real-time aggregation, intelligent processing and other functions of the technology integration platform, can effectively eliminate commercial and security concerns of supply chain entities. It has important reference significance and value for promoting supply chain data security sharing and regulating regulation. More importantly, this work emphasizes the comprehensive guarantee of supply chain security, effectively reversing the direction of integrated application of blockchain and agricultural supply chain, and has important implications for guiding the construction of agricultural supply chain systems. ©2023 IEEE.

关键词： Blockchain

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：