检索结果-内蒙古大学图书馆

Weakly supervised action anticipation without object annotations

Frontiers of Computer Science 2023年第2期17卷 101-110页

作者： Yi ZHONG Jia-Hui PAN Haoxin LI Wei-Shi ZHENG School of Computer Science and Engineering Sun Yat-sen UniversityGuangzhou 510006China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of EducationGuangzhou 510006China

Anticipating future actions without observing any partial videos of future actions plays an important role in action prediction and is also a challenging *** obtain abundant information for action anticipation,some methods integrate multimodal contexts,including scene object ***,extensively labelling each frame in video datasets requires considerable *** this paper,we develop a weakly supervised method that integrates global motion and local finegrained features from current action videos to predict next action label without the need for specific scene context ***,we extract diverse types of local features with weakly supervised learning,including object appearance and human pose representations without ground ***,we construct a graph convolutional network for exploiting the inherent relationships of humans and objects under present *** evaluate the proposed model on two datasets,the MPII-Cooking dataset and the EPIC-Kitchens dataset,and we demonstrate the generalizability and effectiveness of our approach for action anticipation.

关键词： action anticipation weakly supervised learning relation modelling graph convolutional network

来源：评论

学校读者我要写书评

暂无评论

Binary Image Steganalysis Based on Symmetrical Local Residual Patterns

引用

Chinese Journal of Electronics 2022年第4期31卷 752-763页

作者： LUO Junwei YU Mujian YIN Xiaolin LU Wei School of Computer Science and Engineering Guangdong Province Key Laboratory of Information Security TechnologyMinistry of Education Key Laboratory of Machine Intelligence and Advanced Computing Sun Yat-sen University

Residual computation is an effective method for gray-scale image steganalysis. For binary images, the residual computation calculated by the XOR operation is also employed in the local residual patterns(LRP) model for steganalysis. A binary image steganalytic scheme based on symmetrical local residual patterns(SLRP) is proposed. The symmetrical relationships among residual patterns are introduced that make the features more compact while reducing the dimensionality of the features set. Multi-scale windows are utilized to construct three SLRP submodels which are further merged to construct the final features set instead of a single *** with higher probability to be modified after embedding are emphasized and selected to construct the feature sets for training the support vector machine classifier. The experimental results show that the proposed steganalytic scheme is effective for detecting binary image steganography.

关键词： Information hiding Steganalysis Symmetrical local residual patterns Multi-scale model

来源：评论

学校读者我要写书评

暂无评论

Characterization of Exact One-Query Quantum Algorithms for Partial Boolean Functions

引用

Journal of Computer Science & Technology 2023年第6期38卷 1423-1430页

作者：叶泽坤李绿周 Institute of Quantum Computing and Computer Theory School of Computer Science and EngineeringSun Yat-sen UniversityGuangzhou 510006China Ministry of Education Key Laboratory of Machine Intelligence and Advanced Computing Sun Yat-sen UniversityGuangzhou 510006China

The query model(or black-box model)has attracted much attention from the communities of both classical and quantum ***,quantum advantages are revealed by presenting a quantum algorithm that has a better query complexity than its classical *** the history of quantum algorithms,the Deutsch algorithm and the Deutsch-Jozsa algorithm play a fundamental role and both are exact one-query quantum *** leads us to con-sider the problem:what functions can be computed by exact one-query quantum algorithms?This problem has been ad-dressed in the literature for total Boolean functions and symmetric partial Boolean functions,but is still open for general partial Boolean ***,in this paper,we continue to characterize the computational power of exact one-query quantum algorithms for general partial Boolean ***,we present several necessary and sufficient conditions for a partial Boolean function to be computed by exact one-query quantum ***,inspired by these conditions,we discover some new representative functions that can be computed by exact one-query quantum algorithms but have an essential difference from the already known ***,it is worth pointing out that before our work,the known func-tions that can be computed by exact one-query quantum algorithms are all symmetric functions and the quantum algo-rithm used is essentially the Deutsch-Jozsa algorithm,whereas the functions discovered in this paper are generally asym-metric and new algorithms to compute these functions are ***,this expands the class of functions that can be computed by exact one-query quantum algorithms.

关键词： quantum computing quantum query complexity quantum algorithm

来源：评论

学校读者我要写书评

暂无评论

SpikingMiniLM: energy-efficient spiking transformer for natural language understanding

引用

Science China(Information Sciences) 2024年第10期67卷 115-128页

作者： Jiayu ZHANG Jiangrong SHEN Zeke WANG Qinghai GUO Rui YAN Gang PAN Huajin TANG College of Computer Science and Technology Zhejiang University The State Key Lab of Brain-Machine Intelligence Zhejiang University Collaborative Innovation Center of Artificial Intelligence Zhejiang University Advanced Computing and Storage Laboratory Huawei Technologies Co. Ltd. College of Computer Science and Technology Zhejiang University of Technology MOE Frontier Science Center for Brain Science and Brain-Machine Integration Zhejiang University

In the era of large-scale pretrained models, artificial neural networks（ANNs） have excelled in natural language understanding（NLU） tasks. However, their success often necessitates substantial computational resources and energy consumption. To address this, we explore the potential of spiking neural networks（SNNs） in NLU——a promising avenue with demonstrated advantages, including reduced power consumption and improved efficiency due to their event-driven characteristics. We propose the SpikingMiniLM,a novel spiking Transformer model tailored for natural language understanding. We first introduce a multi-step encoding method to convert text embeddings into spike trains. Subsequently, we redesign the attention mechanism and residual connections to make our model operate on the pure spike-based paradigm without any normalization technique. To facilitate stable and fast convergence, we propose a general parameter initialization method grounded in the stable firing rate principle. Furthermore, we apply an ANN-to-SNN knowledge distillation to overcome the challenges of pretraining SNNs. Our approach achieves a macro-average score of 75.5 on the dev sets of the GLUE benchmark, retaining 98% of the performance exhibited by the teacher model MiniLMv2. Our smaller model also achieves similar performance to BERTMINIwith fewer parameters and much lower energy consumption, underscoring its competitiveness and resource efficiency in NLU tasks.

关键词： spiking neural networks natural language understanding spiking Transformer spike-based attention multi-step encoding ANN-to-SNN distillation

来源：评论

学校读者我要写书评

暂无评论

Real-to-Sim Grasp: Rethinking the Gap between Simulation and Real World in Grasp Detection 8

Real-to-Sim Grasp: Rethinking the Gap between Simulation and...

引用

8th Conference on Robot Learning, CoRL 2024

作者： Cai, Jia-Feng Chen, Zibo Wu, Xiao-Ming Jiang, Jian-Jian Wei, Yi-Lin Zheng, Wei-Shi School of Computer Science and Engineering Sun Yat-sen University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

For 6-DoF grasp detection, simulated data is expandable to train more powerful model, but it faces the challenge of the large gap between simulation and real world. Previous works bridge this gap with a sim-to-real way1. However, this way explicitly or implicitly forces the simulated data to adapt to the noisy real data when training grasp detectors, where the positional drift and structural distortion within the camera noise will harm the grasp learning. In this work, we propose a Real-to-Sim framework for 6-DoF Grasp detection, named R2SGrasp, with the key insight of bridging this gap in a real-to-sim way2, which directly bypasses the camera noise in grasp detector training through an inference-time real-to-sim adaption. To achieve this real-to-sim adaptation, our R2SGrasp designs the Real-to-Sim Data Repairer (R2SRepairer) to mitigate the camera noise of real depth maps in data-level, and the Real-to-Sim Feature Enhancer (R2SEnhancer) to enhance real features with precise simulated geometric primitives in feature-level. To endow our framework with the generalization ability, we construct a large-scale simulated dataset cost-efficiently to train our grasp detector, which includes 64,000 RGB-D images with 14.4 million grasp annotations. Sufficient experiments show that R2SGrasp is powerful and our real-to-sim perspective is effective. The real-world experiments further show great generalization ability of R2SGrasp. Project page is available on https://***/R2SGrasp. © 2024 Proceedings of machine Learning Research.

关键词： Image annotation

来源：评论

学校读者我要写书评

暂无评论

Revealing Distribution Discrepancy by Sampling Transfer in Unlabeled Data 38

Revealing Distribution Discrepancy by Sampling Transfer in U...

引用

38th Conference on Neural Information Processing Systems, NeurIPS 2024

作者： Zhao, Zhilin Cao, Longbing Fan, Xuhui Zheng, Wei-Shi School of Computing Macquarie University Australia School of Computer Science and Engineering Sun Yat-sen University China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China

There are increasing cases where the class labels of test samples are unavailable, creating a significant need and challenge in measuring the discrepancy between training and test distributions. This distribution discrepancy complicates the assessment of whether the hypothesis selected by an algorithm on training samples remains applicable to test samples. We present a novel approach called Importance Divergence (I-Div) to address the challenge of test label unavailability, enabling distribution discrepancy evaluation using only training samples. I-Div transfers the sampling patterns from the test distribution to the training distribution by estimating density and likelihood ratios. Specifically, the density ratio, informed by the selected hypothesis, is obtained by minimizing the Kullback-Leibler divergence between the actual and estimated input distributions. Simultaneously, the likelihood ratio is adjusted according to the density ratio by reducing the generalization error of the distribution discrepancy as transformed through the two ratios. Experimentally, I-Div accurately quantifies the distribution discrepancy, as evidenced by a wide range of complex data scenarios and tasks. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

EB-SNN: An Ensemble Binary Spiking Neural Network for Visual Recognition 27th

EB-SNN: An Ensemble Binary Spiking Neural Network for Visua...

引用

27th International Conference on Pattern Recognition, ICPR 2024

作者： Li, Xinjie Tang, Jianxiong Lai, Jianhuang School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Guangzhou510555 China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education Guangzhou China

ISBN: (纸本)9783031781858

In recent years, spiking neural networks (SNNs) have gained significant attention in visual recognition tasks due to the low computational energy. However, most SNNs have a large number of parameters, which limits their use on resource-limited devices. In this paper, we propose an Ensemble Binary Spiking Neural Network (EB-SNN) for accurate and memory-friendly visual recognition. The EB-SNN is modeled by Ensemble Binary Weights (EBW) module, which integrates multiple binary weights for lightweight SNN modeling. Meanwhile, we propose Knowledge Alignment Strategy to ensure that the EB-SNN can approximate a well-trained SNN for good performance. Experimental results show that the EB-SNN can achieve accuracy of 95.39% on CIFAR10, using 9.3% memory of full-precision SNN. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Local binary pattern

来源：评论

学校读者我要写书评

暂无评论

Breaking Information Silos: Global Guided Task Prediction for Class-Incremental Learning 27th

Breaking Information Silos: Global Guided Task Prediction fo...

引用

27th International Conference on Pattern Recognition, ICPR 2024

作者： Hu, Chaoshun Ye, Biaohua Chen, Zixuan Lai, Jian-Huang School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Guangzhou510555 China Ministry of Education Key Laboratory of Machine Intelligence and Advanced Computing Guangzhou China

ISBN: (纸本)9783031781889

Class-incremental learning (CIL) aims to learn a series of tasks sequentially, each introducing several new categories. Because providing the task labels during inference can significantly increase accuracy, many approaches attempt to predict task labels in CIL. However, existing works focus on learning local information and overlook the importance of global information. The absence of global guidance leads to the formation of information silos across disparate tasks, resulting in potential inter-task interference. To break information silos, we propose a method called Global Guided Task Prediction (GGTP) to introduce global information. Our method consists of two modules. The local de-redundant module aims to reduce information redundancy across different tasks from a global perspective. We combine dual encoders and feature decorrelation loss to effectively reduce redundancy while minimizing catastrophic forgetting. The global information module explicitly extracts global information to serve as auxiliary information guiding task prediction. We extract the most important information from all local information through a global encoder and then aggregate them to form global information. Extensive experiments validate the effectiveness of our method, which achieves state-of-the-art results. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Redundancy

来源：评论

学校读者我要写书评

暂无评论

TexCIL: Text-Guided Continual Learning of Disease with Vision-Language Model

TexCIL: Text-Guided Continual Learning of Disease with Visio...

引用

2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024

作者： Zhang, Wentao Zhao, Defeng Zheng, Wei-Shi Wang, Ruixuan Sun Yat-sen University School of Computer Science and Engineering Guangzhou China Peng Cheng Laboratory Shenzhen China Moe Key Laboratory of Machine Intelligence and Advanced Computing Guangzhou China

ISBN: (纸本)9798350386226

Current intelligent diagnostic systems often catastrophically forget old knowledge when learning new diseases only from the training dataset of the new diseases. Inspired by human learning of visual classes with the effective help of language, we propose a continual learning framework based on a pre-trained visual-language model (VLM) without storing any image of previously learned diseases. In this framework, textual prior knowledge of each new disease can be obtained by utilizing the frozen VLM's text encoder, and then used to guide the visual learning of the new disease. This framework innovatively utilizes the textual prior knowledge of all previously learned diseases as out-of-distribution (OOD) information to help differentiate currently being-learned diseases from others. Extensive empirical evaluations on both medical and natural image datasets confirm the superiority of the proposed method over existing state-of-the-art methods in continual learning of new visual classes. The source code is available at https://***/OpenMedIA/TexCIL. © 2024 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Loc4Plan: Locating Before Planning for Outdoor Vision and Language Navigation 24

Loc4Plan: Locating Before Planning for Outdoor Vision and La...

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Tian, Huilin Meng, Jingke Zheng, Wei-Shi Li, Yuan-Ming Yan, Junkai Zhang, Yunong School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education Guangdong Provincial Key Laboratory of Information Security Technology Guangzhou China

ISBN: (纸本)9798400706868

Vision and Language Navigation (VLN) is a challenging task that requires agents to understand instructions and navigate to the destination in a visual environment. One of the key challenges in outdoor VLN is keeping track of which part of the instruction was completed. To alleviate this problem, previous works mainly focus on grounding the natural language to the visual input, but neglecting the crucial role of the agent's spatial position information in the grounding process. In this work, we first explore the substantial effect of spatial position locating on the grounding of outdoor VLN, drawing inspiration from human navigation. In real-world navigation scenarios, before planning a path to the destination, humans typically need to figure out their current location. This observation underscores the pivotal role of spatial localization in the navigation process. In this work, we introduce a novel framework, Locating before Planning (Loc4Plan), designed to incorporate spatial perception for action planning in outdoor VLN tasks. The main idea behind Loc4Plan is to perform the spatial localization before planning a decision action based on corresponding guidance, which comprises a block-aware spatial locating (BAL) module and a spatial-aware action planning (SAP) module. Specifically, to help the agent perceive its spatial location in the environment, we propose to learn a position predictor that measures how far the agent is from the next intersection for reflecting its position, which is achieved by the BAL module. After this locating process, we propose the PSA module to associate visual observations After the locating process, we propose the SAP module to incorporate spatial information to ground the corresponding guidance and enhance the precision of action planning. Extensive experiments on the Touchdown and map2seq datasets show that the proposed Loc4Plan outperforms the SOTA methods. © 2024 ACM.

关键词： Visual languages

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：