检索结果-内蒙古大学图书馆

ViGT: proposal-free video grounding with a learnable token in the transformer

Science China(Information Sciences) 2023年第10期66卷 196-212页

作者： Kun LI Dan GUO Meng WANG School of Computer Science and Information Engineering Hefei University of Technology Key Laboratory of Knowledge Engineering with Big Data Ministry of Education Intelligent Interconnected Systems Laboratory of Anhui Province Institute of Artificial Intelligence Hefei Comprehensive National Science Center

The video grounding(VG) task aims to locate the queried action or event in an untrimmed video based on rich linguistic descriptions. Existing proposal-free methods are trapped in the complex interaction between video and query, overemphasizing cross-modal feature fusion and feature correlation for VG. In this paper, we propose a novel boundary regression paradigm that performs regression token learning in a transformer. Particularly, we present a simple but effective proposal-free framework, namely video grounding transformer(ViGT), which predicts the temporal boundary using a learnable regression token rather than multi-modal or cross-modal features. In ViGT, the benefits of a learnable token are manifested as follows.(1) The token is unrelated to the video or the query and avoids data bias toward the original video and query.(2) The token simultaneously performs global context aggregation from video and query ***, we employed a sharing feature encoder to project both video and query into a joint feature space before performing cross-modal co-attention(i.e., video-to-query attention and query-to-video attention) to highlight discriminative features in each modality. Furthermore, we concatenated a learnable regression token [REG] with the video and query features as the input of a vision-language transformer. Finally, we utilized the token [REG] to predict the target moment and visual features to constrain the foreground and background probabilities at each timestamp. The proposed ViGT performed well on three public datasets:ANet-Captions, TACoS, and YouCookⅡ. Extensive ablation studies and qualitative analysis further validated the interpretability of ViGT.

关键词： video grounding temporal sentence grounding boundary regression token learning proposal-free

来源：评论

学校读者我要写书评

暂无评论

Ultra-large mode area multi-core orbital angular momentum transmission fiber designed by neural network and optimization algorithms

引用

Optoelectronics Letters 2023年第12期19卷 744-751页

作者： GU Zhiwei HUANG Wei ZHANG Ran FAN Junjie SONG Binbin Key Laboratory of Computer Vision and Systems(Ministry of Education) School of Computer Science and EngineeringTianjin University of TechnologyTianjin 300384China Engineering Research Center of Learning-Based Intelligent System(Ministry of Education) Tianjin University of TechnologyTianjin 300384China

A large mode area multi-core orbital angular momentum(OAM)transmission fiber is designed and optimized by neural network and optimization *** neural network model has been established first to predict the optical properties of multi-core OAM transmission fibers with high accuracy and speed,including mode area,nonlinear coefficient,purity,dispersion,and effective index *** the trained neural network model is combined with different particle swarm optimization(PSO)algorithms for automatic iterative optimization of multi-core structures *** to the structural advantages of multi-core fiber and the automatic optimization process,we designed a number of multi-core structures with high OAM mode purity(>95%)and ultra-large mode area(>3000µm^(2)),which is larger by more than an order of magnitude compared to the conventional ring-core OAM transmission fibers.

关键词： network fiber OAM

来源：评论

学校读者我要写书评

暂无评论

Optimal Linear Deception Attacks on Remote State Estimation with Constrained Alarm Rates: A Low-Dimensional Case 63

Optimal Linear Deception Attacks on Remote State Estimation ...

引用

63rd IEEE Conference on Decision and Control, CDC 2024

作者： Shang, Jun Zhang, Hanwen Zhou, Jing Chen, Tongwen Tongji University Shanghai Research Institute for Intelligent Autonomous Systems National Key Laboratory of Autonomous Intelligent Unmanned Systems Frontiers Science Center for Intelligent Autonomous Systems Department of Control Science and Engineering Shanghai200092 China University of Science and Technology Beijing Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education School of Automation and Electrical Engineering Beijing100083 China University of Alberta Department of Electrical and Computer Engineering EdmontonABT6G 1H9 Canada

ISBN: (纸本)9798350316339

This study addresses linear attacks on remote state estimation within the context of a constrained alarm rate. Smart sensors, which are equipped with local Kalman filters, transmit innovations instead of raw measurements through a wireless communication network. This transmission is vulnerable to malicious data interception and manipulation by attackers. The aim of this research is to identify the optimal attack strategy that degrades the system performance while adhering to stealthiness constraints. A notable innovation of this paper is the direct association of the attack's stealthiness with the alarm rate, diverging from traditional approaches that rely on the covariance of the innovation or the Kullback-Leibler divergence, which are conventional metrics that have been extensively explored in previous studies. Our findings reveal that the optimal attack strategy exhibits some structural characteristics in systems of low dimensions. The performance of the proposed attack strategy is demonstrated through numerical examples. © 2024 IEEE.

关键词：

来源：评论

学校读者我要写书评

暂无评论

UAV-Assisted Dynamic Avatar Task Migration for Vehicular Metaverse Services: A Multi-Agent Deep Reinforcement Learning Approach

引用

IEEE/CAA Journal of Automatica Sinica 2024年第2期11卷 430-445页

作者： Jiawen Kang Junlong Chen Minrui Xu Zehui Xiong Yutao Jiao Luchao Han Dusit Niyato Yongju Tong Shengli Xie IEEE School of Automation Guangdong University of TechnologyGuangzhou 510006China 111 Center for Intelligent Batch Manufacturing based on IoT Technology Guangzhou 510006China Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of EducationGuangzhou 510006China School of Computer Science and Engineering Nanyang Technological UniversitySingaporeSingapore Pillar of Information Systems Technology and Design Singapore University of Technology and DesignSingaporeSingapore College of Communication Engineering Army Engineering University of PLANanjing 210007China National Natural Science Foundation of China Beijing 100085China Key Laboratory of Intelligent Detection and IoT in Manufacturing Ministry of EducationGuangzhou 510006China Guangdong Key Laboratory of IoT Information Technology Guangzhou 510006China

Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach

关键词： Avatar blockchain metaverses multi-agent deep reinforcement learning transformer UAVs

来源：评论

学校读者我要写书评

暂无评论

Multiscale Bilateral Attention Fusion Network for Pansharpening

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2024年第11期5卷 5828-5843页

作者： Guo, Zhongyuan Li, Jiawei Lei, Jia Liu, Jinyuan Zhou, Shihua Wang, Bin Kasabov, Nikola K. Dalian University Key Laboratory of Advanced Design and Intelligent Computing Ministry of Education School of Software Engineering Dalian116622 China University of the Science and Technology Beijing School of Computer and Communication Engineering Beijing100083 China Dalian University of Technology School of Mechanical Engineering Dalian116024 China Auckland University of Technology Knowledge Engineering and Discovery Research Institute Auckland1061 New Zealand University of Ulster Intelligent Systems Research Center LondonderryBT48 7JL United Kingdom Bulgarian Academy of Sciences IICT Sofia1000 Bulgaria

High-resolution multispectral (HRMS) images combine spatial and spectral information originating from panchromatic (PAN) and reduced-resolution multispectral (LRMS) images. Pansharpening performs well and is widely used to obtain HRMS images. However, most pansharpening approaches determine the ratio of PAN and LRMS images through direct interpolation, which may introduce artifacts and distort the color of the fused results. To address this issue, an unsupervised progressive pansharpening framework, MSBANet, is proposed, which adopts a multistage fusion strategy. Each stage contains an attention interactive extraction module (AIEM) and a multiscale bilateral fusion module (MBFM). The AIEM extracts spatial and spectral features from input images and captures the correlations between features. The MBFM can efficiently integrate information from the AIEM and improve MSBANet context awareness. We design a hybrid loss function that enhances the ability of the fusion network to store spectral and texture details. In qualitative and quantitative experimental studies on four datasets, MSBANet outperformed state-of-the-art pansharpening techniques. The code will be released. © 2024 IEEE.

关键词： Data mining

来源：评论

学校读者我要写书评

暂无评论

Learning to see speckle in the weak laser field through multimode fiber

引用

Optoelectronics Letters 2025年

作者： JI Yunqi SONG Binbin LI Xueqing LI Yonghui The Engineering Research Center of Learning-Based Intelligent System (Ministry of Education)， the Key Laboratory of Computer Vision and Systems (Ministry of Education)， and the School of Computer Science and Engineering， Tianjin University of Technology

Multimode fibers (MMFs) have great potential for endoscopic imaging due to the high number of modes and a small core diameter. Deep learning based on neural networks has received increasing attention in the field of scattering image reconstruction. However， most studies focus on designing complex network architectures to improve reconstruction， but these network models struggle to reconstruct images in a weak laser field. In the paper， a lightweight generative adversarial network model combined with a histogram specification algorithm is designed to reconstruct speckles in the weak laser field through MMF. Experimental results show that the reconstruction results of our algorithm have better metrics. Moreover， the model demonstrates excellent cross-domain generalization ability with regards to the Fashion-MNIST dataset. It is worth mentioning that we found that the speckles after inactivation still retain the ability to be reconstructed， which enhances the robustness of the model

关键词：

来源：评论

学校读者我要写书评

暂无评论

Continuous-Time Prediction of Industrial Paste Thickener System With Differential ODE-Net

引用

IEEE/CAA Journal of Automatica Sinica 2022年第4期9卷 686-698页

作者： Zhaolin Yuan Xiaorui Li Di Wu Xiaojuan Ban Nai-Qi Wu Hong-Ning Dai Hao Wang the Beijing Advanced Innovation Center for Materials Genome Engineering Institute of Artificial IntelligenceBeijing Key Laboratory of Knowledge Engineering for Materials ScienceSchool of Computer and Communication EngineeringUniversity of Science and Technology Beijing the Department of ICT and Natural Science Norwegian University of Science and Technology IEEE the Institute of Systems Engineering and Collaborative Laboratory for Intelligent Science and SystemsMacao University of Science and Technology the Department of Computing and Decision Sciences Lingnan University the Department of Computer Science Norwegian University of Science and Technology

It is crucial to predict the outputs of a thickening system,including the underflow concentration(UC)and mud pressure,for optimal control of the *** proliferation of industrial sensors and the availability of thickening-system data make this ***,the unique properties of thickening systems,such as the non-linearities,long-time delays,partially observed data,and continuous time evolution pose challenges on building data-driven predictive *** address the above challenges,we establish an integrated,deep-learning,continuous time network structure that consists of a sequential encoder,a state decoder,and a derivative module to learn the deterministic state space model from thickening *** a case study,we examine our methods with a tailing thickener manufactured by the FLSmidth installed with massive sensors and obtain extensive experimental *** results demonstrate that the proposed continuous-time model with the sequential encoder achieves better prediction performances than the existing discrete-time models and reduces the negative effects from long time delays by extracting features from historical system *** proposed method also demonstrates outstanding performances for both short and long term prediction tasks with the two proposed derivative types.

关键词： Industrial 24 paste thickener ordinary differential equation(ODE)-net recurrent neural network time series prediction

来源：评论

学校读者我要写书评

暂无评论

Design of a lightweight and easy-to-wear hand glove with multi-modal tactile perception for digital human

Design of a lightweight and easy-to-wear hand glove with mul...

引用

作者： Pan, Zhigeng Ren, Hongyi Liu, Chang Chen, Ming Mukherjee, Mithun Yang, Wenzhen School of Artificial Intelligence Nanjing University of Information Science and Technology Nanjing China Center for Space-based Computing Systems Zhejiang Laboratory Hangzhou China College of Mechanical Engineering Zhejiang Sci-Tech University Zhejiang Sci-Tech University Hangzhou China Center for Intelligent Manufacturing Computing Zhejiang Laboratory Hangzhou China

Within the field of human–computer interaction, data gloves play an essential role in establishing a connection between virtual and physical environments for the realization of digital human. To enhance the credibility of human-virtual hand interactions, we aim to develop a system incorporating a data glove-embedded technology. Our proposed system collects a wide range of information (temperature, bending, and pressure of fingers) that arise during natural interactions and afterwards reproduce them within the virtual environment. Furthermore, we implement a novel traversal polling technique to facilitate the streamlined aggregation of multi-channel sensors. This mitigates the hardware complexity of the embedded system. The experimental results indicate that the data glove demonstrates a high degree of precision in acquiring real-time hand interaction information, as well as effectively displaying hand posture in real-time using Unity3D. The data glove's lightweight and compact design facilitates its versatile utilization in virtual reality interactions. © 2024 John Wiley & Sons Ltd.

关键词： Virtual reality

来源：评论

学校读者我要写书评

暂无评论

What is the intrinsic dimension of your binary data? - and how to compute it quickly

arXiv

引用

arXiv 2024年

作者： Hanika, Tom Hille, Tobias Intelligent Information Systems University of Hildesheim Hildesheim Germany Knowledge & Data Engineering Group University of Kassel Kassel Germany Interdisciplinary Research Center for Information System Design University of Kassel Kassel Germany

Dimensionality is an important aspect for analyzing and understanding (high-dimensional) data. In their 2006 ICDM paper Tatti et al. answered the question for a (interpretable) dimension of binary data tables by introducing a normalized correlation dimension. In the present work we revisit their results and contrast them with a concept based notion of intrinsic dimension (ID) recently introduced for geometric data sets. To do this, we present a novel approximation for this ID that is based on computing concepts only up to a certain support value. We demonstrate and evaluate our approximation using all available datasets from Tatti et al., which have between 469 and 41271 extrinsic *** Codes 68T05 06-08 68T01 68T09 Copyright © 2024, The Authors. All rights reserved.

关键词： Clustering algorithms

来源：评论

学校读者我要写书评

暂无评论

Optimal Linear Deception Attacks on Remote State Estimation with Constrained Alarm Rates: A Low-Dimensional Case

Optimal Linear Deception Attacks on Remote State Estimation ...

引用

IEEE Conference on Decision and Control

作者： Jun Shang Hanwen Zhang Jing Zhou Tongwen Chen Department of Control Science and Engineering Shanghai Research Institute for Intelligent Autonomous Systems National Key Laboratory of Autonomous Intelligent Unmanned Systems and Frontiers Science Center for Intelligent Autonomous Systems Tongji University Shanghai China Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education School of Automation and Electrical Engineering University of Science and Technology Beijing Beijing China Department of Electrical and Computer Engineering University of Alberta Edmonton AB Canada

ISBN: (数字)9798350316339

ISBN: (纸本)9798350316346

This study addresses linear attacks on remote state estimation within the context of a constrained alarm rate. Smart sensors, which are equipped with local Kalman filters, transmit innovations instead of raw measurements through a wireless communication network. This transmission is vulnerable to malicious data interception and manipulation by attackers. The aim of this research is to identify the optimal attack strategy that degrades the system performance while adhering to stealthiness constraints. A notable innovation of this paper is the direct association of the attack’s stealthiness with the alarm rate, diverging from traditional approaches that rely on the covariance of the innovation or the Kullback–Leibler divergence, which are conventional metrics that have been extensively explored in previous studies. Our findings reveal that the optimal attack strategy exhibits some structural characteristics in systems of low dimensions. The performance of the proposed attack strategy is demonstrated through numerical examples.

关键词： Wireless communication Measurement Technological innovation System performance Kalman filters State estimation intelligent sensors

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：