检索结果-内蒙古大学图书馆

virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE Conference on

作者： Jiadong Liang Feng Lu State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China

ISBN: (数字)9798350374490

ISBN: (纸本)9798350374506

Vivid talking face generation has potential applications in virtual reality. Existing methods can generate talking faces that are synchronized with the audio, but typically ignore the accurate expression of emotions. In this paper, we propose an advanced two-step framework to synthesize talking face videos with vivid emotional appearances. The first step is designed to generate emotional fine-grained landmarks, including the normalized landmarks, gaze, and head pose. In the second step, we map the facial landmarks to latent key points, which are then fed into the pre-trained model to generate high-quality face images. Extensive experiments demonstrate the effectiveness of our method.

关键词： Solid modeling Three-dimensional displays Conferences virtual reality User interfaces Digital humans Synchronization

来源：评论

学校读者我要写书评

暂无评论

Object Tracking by Jointly Utilizing Template Updating and Relocation Mechanisms⋆

SSRN

引用

SSRN 2023年

作者： Wen, Jia Ren, Kejun School of Information Science and Engineering Yanshan University Qinhuangdao066099 China The Key Laboratory for Computer Virtual Technology System Integration of Hebei Province China

The Siamese network-based tracker has achieved competitive performance in the field of single target tracking because of its excellent tracking speed and tracking accuracy. When faced with target deformations, most Siamese trackers rely on fixed template features from the initial frame, severely constraining the tracker’s performance. To mitigate this situation, we introduce a novel tracking framework(SiamTAR) that allows adaptive template updates based on past tracking information. In addition, we design a feature refinement module which can capture the target information more accurately at the full scale on the search image through an integrated attention mechanism, thus enabling the tracker to pay less attention to redundant information. Notably, we introduce a relocalization mechanism to solve the problems of random drift of the tracking box and inaccurate scale estimation in online tracking. Extensive experiments on GOT-10K, UAV123, OTB100 and DTB70 datasets show that the tracker achieves good tracking results and real-time performance. © 2023, The Authors. All rights reserved.

关键词： Target tracking

来源：评论

学校读者我要写书评

暂无评论

Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation

Exploring Regional Clues in CLIP for Zero-Shot Semantic Segm...

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： Yi Zhang Meng-Hao Guo Miao Wang Shi-Min Hu State Key Laboratory of Virtual Reality Technology and Systems SCSE Beihang University Department of Computer Science and Technology BNRist Tsinghua University

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

CLIP has demonstrated marked progress in visual recognition due to its powerful pre-training on large-scale image-text pairs. However, it still remains a critical challenge: how to transfer image-level knowledge into pixel-level understanding tasks such as semantic segmentation. In this paper, to solve the mentioned challenge, we analyze the gap between the capability of the CLIP model and the requirement of the zero-shot semantic segmentation task. Based on our analysis and observations, we propose a novel method for zero-shot semantic segmentation, dubbed CLIP-RC (CLIP with Regional Clues), bringing two main insights. On the one hand, a region-level bridge is necessary to provide fine-grained semantics. On the other hand, over-fitting should be mitigated during the training stage. Benefiting from the above discoveries, CLIP-RC achieves state-of-the-art performance on various zero-shot semantic segmentation benchmarks, including PASCAL VOC, PASCAL Context, and COCO-Stuff 164K. Code will be available at https://***/Jittor/JSeg.

关键词： Training Bridges Visualization computer vision Image recognition Codes Semantic segmentation

来源：评论

学校读者我要写书评

暂无评论

Rolling Horizon Co-evolution for Snake AI Competition 13th

Rolling Horizon Co-evolution for Snake AI Competition

引用

13th IFIP TC 12 International Conference on Intelligent Information Processing, IIP 2024

作者： Li, Hui Zhou, Jiayi Zhang, Qingquan Research Institute of Trustworthy Autonomous System Southern University of Science and Technology Shenzhen518055 China Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China

ISBN: (纸本)9783031578076

The Snake game, a classic in the gaming world, gains new dimensions with the Snake AI competition, where two players controlled by AI algorithms can now compete simultaneously in the same game session. This competition holds significance in advancing our understanding of artificial intelligence (AI) algorithms. In the 2020 and 2021 Snake AI competitions, popular algorithms, using graph-based search or heuristic strategies, demonstrate competitive performance, such as the A* algorithm, Monte Carlo Tree Search (MCTS). Contrary to these heuristic approaches, the Rolling Horizon Co-evolution Algorithm (RHCA), characterised by its core principles of rolling horizon evaluation and co-evolution, maintains two populations, one for each player, to co-evolve with each other without reliance on heuristics. RHCA has been verified its effectiveness in a two-player spaceship game. In this paper, we extend the RHCA application to the two-player Snake AI game, comparing it with other state-of-the-art methods. Additionally, we introduce various obstacles to create different complex scenarios, ensuring a comprehensive analysis. Experimental results reveal RHCA’s superior and stable performance, especially in resource-constrained and complex scenarios. Furthermore, an analysis of RHCA’s behaviours across maps with diverse obstacle scenarios highlights its ability to make intelligent decisions in competing with state-of-the-art methods. © IFIP International Federation for Information Processing 2024.

关键词： Trees (mathematics)

来源：评论

学校读者我要写书评

暂无评论

Robust Dual-Modal Speech keyword Spotting for XR Headsets

arXiv

引用

arXiv 2024年

作者： Cai, Zhuojiang Ma, Yuhan Lu, Feng State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China

While speech interaction finds widespread utility within the Extended Reality (XR) domain, conventional vocal speech keyword spotting systems continue to grapple with formidable challenges, including suboptimal performance in noisy environments, impracticality in situations requiring silence, and susceptibility to inadvertent activations when others speak nearby. These challenges, however, can potentially be surmounted through the cost-effective fusion of voice and lip movement information. Consequently, we propose a novel vocal-echoic dual-modal keyword spotting system designed for XR headsets. We devise two different modal fusion approches and conduct experiments to test the system’s performance across diverse scenarios. The results show that our dual-modal system not only consistently outperforms its single-modal counterparts, demonstrating higher precision in both typical and noisy environments, but also excels in accurately identifying silent utterances. Furthermore, we have successfully applied the system in real-time demonstrations, achieving promising results. The code is available at https://***/caizhuojiang/VE-KWS. Copyright © 2024, The Authors. All rights reserved.

关键词： Cost effectiveness

来源：评论

学校读者我要写书评

暂无评论

Multi-Scale Feature Extraction with Supervised Contrastive Learning for Vulnerability Detection 36

Multi-Scale Feature Extraction with Supervised Contrastive L...

引用

36th International Conference on Software Engineering and Knowledge Engineering, SEKE 2024

作者： Zhao, Yahui Lu, Lu Liang, Zhihong Suo, Siliang School of Computer Science and Engineering South China University of Technology Guangzhou China Pazhou Laboratory Guangzhou China Pengcheng Laboratory Shenzhen China Electric Power Research Institute CSG Guangzhou China Guangdong Provincial Key Laboratory of Power System Network Security Guangzhou China

ISBN: (纸本)1891706594

The capacity of Deep Learning to automatically learn features from source code has facilitated its extensive utilization in detecting software vulnerabilities. However, existing pre-trained models regard code snippets as token sequences, neglecting the inherent structure of the code. The utilization of graph-based code representations is constrained by the limitations of Graph Neural Networks, particularly the difficulty in capturing long-range dependencies, which renders it challenging to learn grammatical and semantic information from complex code graph representations. This paper proposes a novel multi-scale software vulnerability detection method based on supervised contrastive learning. The method integrates local features obtained from code paths with structural features extracted from the Code Property Graph by GraphTrans, thereby achieving a multi-scale feature representation of the source code. Additionally, a supervised contrastive loss function is employed during training in order to fully utilize label information and address the class imbalance problem. The experimental results demonstrate that the proposed method outperforms existing state-of-the-art methods, achieving the highest accuracy, precision, and F1 on the real-world benchmark dataset CodeXGLUE for software vulnerability detection. © 2024 Knowledge systems Institute Graduate School. All rights reserved.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

VT-SGN:Spiking Graph Neural Network for Neuromorphic Visual-Tactile Fusion

引用

IEEE Transactions on Haptics 2024年 PP卷 PP-PP页

作者： Wu, Peiliang Zhang, Haozhe Li, Yao Chen, Wenbai Gao, Guowei Yanshan University School of Information Science and Engineering Qinhuangdao066004 China The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province Qinhuangdao066004 China Beijing Information Science and Technology University School of Automation Beijing100192 China

Current issues with neuromorphic visual-tactile perception include limited training network representation and inadequate cross-modal fusion. To address these two issues, we proposed a dual network called visual-tactile spiking graph neural network (VT-SGN) that combines graph neural networks and spiking neural networks to jointly utilize the neuromorphic visual and tactile source data. First, the neuromorphic visual-tactile data were expanded spatiotemporally to create a taxel-based tactile graph in the spatial domain, enabling the complete exploitation of the irregular spatial structure properties of tactile information. Subsequently, a method for converting images into graph structures was proposed, allowing the vision to be trained alongside graph neural networks and extracting graph-level features from the vision for fusion with tactile data. Finally, the data were expanded into the time domain using a spiking neural network to train the model and propagate it backwards. This framework effectively utilizes the structural differences between sample instances in the spatial dimension to improve the representational power of spiking neurons, while preserving the biodynamic mechanism of the spiking neural network. Additionally, it effectively solves the morphological variance between the two perceptions and further uses complementary data between visual and tactile. To demonstrate that our approach can improve the learning of neuromorphic perceptual information, we conducted comprehensive comparative experiments on three datasets to validate the benefits of the proposed VT-SGN framework by comparing it with state-of-the-art studies. © 2008-2011 IEEE.

关键词： Graph neural networks

来源：评论

学校读者我要写书评

暂无评论

Vulnerability Detection Based on Pre-trained Code Language Model and Convolutional Neural Network 36

Vulnerability Detection Based on Pre-trained Code Language M...

引用

36th International Conference on Software Engineering and Knowledge Engineering, SEKE 2024

作者： Liao, Tingfeng Lu, Lu Liang, Zhihong Suo, Siliang School of Computer Science and Engineering South China University of Technology Guangzhou China Pazhou Laboratory Guangzhou China Pengcheng Laboratory Shenzhen China Electric Power Research Institute CSG Guangzhou China Guangdong Provincial Key Laboratory of Power System Network Security Guangzhou China

ISBN: (纸本)1891706594

Software vulnerabilities damage the reliability of software systems. Recently, many methods based on deep learning have been proposed for vulnerability detection by learning features from code sequences or various property graphs. However, sequence-based methods frequently fail to consider the structural information of the code, whereas graph-based methods often encounter difficulties in capturing long-distance contextual semantic information. To overcome these limitations, we propose PTCN, a novel vulnerability detection method that integrates Pre-Trained code language model and Convolutional Neural Network (CNN). First, the code tokens sequence and the propagation chains are constructed from the source code in preparation for the subsequent feature extraction. Next, GraphCodeBERT, a graph-based pre-trained code language model, is introduced as a means of learning both the semantic and structural information contained in the code tokens sequence and the propagation chains. Then, a CNN architecture is designed to effectively extract the crucial vulnerability features from the hidden states of the last Transformer layer of GraphCodeBERT for vulnerability detection. The experiments on the public benchmark dataset REVEAL indicate that PTCN outperforms the state-of-the-art methods with respect to the Accuracy and F1-score metrics by 3.41%-15.80% and 22.68%-104.27%, respectively. © 2024 Knowledge systems Institute Graduate School. All rights reserved.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

SSCCPC-Net: Simultaneously Learning 2D and 3D Features with CLIP for Semantic Scene Completion on Point Cloud 41st

SSCCPC-Net: Simultaneously Learning 2D and 3D Features with...

引用

41st computer Graphics International Conference, CGI 2024

作者： Duan, Wantong Bao, Yongtang Qi, Yue State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China Shandong University of Science and Technology Qingdao266590 China Jingdezhen Research Institute of Beihang University Jingdezhen333000 China Qingdao Research Institute of Beihang University Qingdao266000 China

ISBN: (纸本)9783031820236

Compare to traditional Scene Completion (SC), Semantic Scene Completion (SSC) is a challenging task that aims to generate complete and semantically consistent 3D scene from partial and sparse input data, which is fundamental to fully understanding the scene and being able to interact with it. Consequently, the SSC task has received much attention in recent years. Most of the methods are voxel-based approaches, but they have high computational and memory requirements. A few works based on point cloud do not sufficiently exploit the correlation between semantic segmentation and geometric completion subtasks, while focusing too much on point cloud shape features and ignoring the rich texture information that RGB images can provide. In this paper, we present SSCCPC-Net (Semantic Scene Completion with CLIP on Point Cloud-Net), a novel network architecture for point cloud semantic scene completion using a combination of 2D and 3D features. Inspired by recent works of large pretrained vision-language models in semantic segmentation, we explore to accomplish SSC task with the help of Contrastive Language-Image Pre-Training (CLIP) model. Specifically, we use the CLIP features for guidance to fuse the 2D features extracted from the RGB image and the 3D features extracted from the point cloud. The fused features are then fed into our designed Semantic-Completion Decoder for per-point semantic prediction and semantic labeling-assisted point cloud completion. Finally, we obtain the complete semantically point cloud. Numerous experiments have demonstrated that our method has higher effectiveness and generalizability compared to state-of-the-art methods. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Dynamic detection technology of encryption algorithm based on Pin 9

Dynamic detection technology of encryption algorithm based o...

引用

9th IEEE International Conference on Data Science in Cyberspace, DSC 2024

作者： Qu, Junpeng Du, Gaolei Sun, Yunge Fu, Yong Shandong Computer Science Center National Supercomputer Center in Jinan Qilu University of Technology Shandong Academy of Sciences Key Laboratory of Computing Power Network and Information Security Ministry of Education Jinan250014 China Quan Cheng Laboratory Jinan250103 China Shandong Fundamental Research Center for Computer Science Shandong Provincial Key Laboratory of Industrial Network and Information System Security Jinan China

ISBN: (纸本)9798350391367

Aiming at the problem that malicious software uses encryption algorithm to hide its own malicious code and avoid detection, a dynamic detection technology based on Pin encryption algorithm is proposed. Use Pin to get the instruction flow of executable file running, then identify the function call in the instruction flow to get the function call framework, find the loop body in the calling function, and then carry out the encryption algorithm instruction detection and encryption algorithm constant detection on the loop body. If the detection passes, it can be considered that a component of the encryption algorithm is found. Then the complete encryption algorithm is found according to the generated function call framework. Experiments show that this method can effectively identify the encryption algorithms hidden in executable files. © 2024 IEEE.

关键词： Encryption algorithms

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：