检索结果-内蒙古大学图书馆

Corrigendum to “Existence ofSolutions to Non-Coercivity Quasilinear Elliptic Problem”

学校读者我要写书评

暂无评论

Journal of Function Spaces 2021年第1期2021卷

作者： Jimao Xiawu Shuibo Huang Yingyuan Mi Maoji Ri School of Mathematics and Computer Science Northwest Minzu University Lanzhou Gansu 730030 *** Key Laboratory of Streaming Data Computing Technologies and Application Northwest Minzu University Lanzhou Gansu 730030 ***

Training of Spiking Neural Network joint Curriculum Learning Strategy

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Tang, Lingling Chu, Jielei Gong, Zhiguo Li, Tianrui The School of Computing and Artificial Intelligence Southwest Jiaotong University Chengdu611756 China National Engineering Laboratory of Integrated Transportation Big Data Application Technology Southwest Jiaotong University Chengdu611756 China The State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science University of Macau China

Starting with small and simple concepts, and gradually introducing complex and difficult concepts is the natural process of human learning. Spiking Neural Networks (SNNs) aim to mimic the way humans process information, but current SNNs models treat all samples equally, which does not align with the principles of human learning and overlooks the biological plausibility of SNNs. To address this, we propose a CL-SNN model that introduces Curriculum Learning(CL) into SNNs, making SNNs learn more like humans and providing higher biological interpretability. CL is a training strategy that advocates presenting easier data to models before gradually introducing more challenging data, mimicking the human learning process. We use a confidence-aware loss to measure and process the samples with different difficulty levels. By learning the confidence of different samples, the model reduces the contribution of difficult samples to parameter optimization automatically. We conducted experiments on static image datasets MNIST, Fashion-MNIST, CIFAR10, and neuromorphic datasets N-MNIST, CIFAR10-DVS, DVS-Gesture. The results are promising. To our best knowledge, this is the first proposal to enhance the biologically plausibility of SNNs by introducing CL. Copyright © 2023, The Authors. All rights reserved.

关键词： Curricula

Coordinate Attention Based 3D-CNN Using Ghost Multi-Scale for Diagnosing Alzheimer’s Disease

学校读者我要写书评

暂无评论

Coordinate Attention Based 3D-CNN Using Ghost Multi-Scale fo...

International Joint Conference on Neural Networks (IJCNN)

作者： Xiaolu Lin Pinya Lu Jie Pan Hongqin Yang Xuemei Ding Fujian Provincial Engineering Research Center for Public Service Big Data Mining and Application Fujian Provincial University Engineering Research Center for Big Data Analysis and Application Fujian Normal University Fuzhou China Xiamen Jingyi Zhikang Technology Co. Ltd Xiamen China Fujian Provincial Key Laboratory for Photonics Technology Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education Fujian Normal University Fuzhou China School of Computing Engineering and Intelligent Systems Ulster University Derry-Londonderry NI UK

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Alzheimer's disease (AD) is a neurodegenerative disease and mild cognitive impairment (MCI) is the early stage of AD. Previous studies have predominantly focused on binary classification using 3 dimensional - convolutional neural network (3D-CNN) for AD diagnosis, with limited progress in multi-classification. Moreover, the current 3D-CNNs often adopt a single-scale architecture with massive parameters growth. Additionally, obtaining precise location information of brain imaging data is crucial for improving the classification accuracy with 3D-CNN. Hence, we propose a multi-scale 3D-CNN based on coordinate attention mechanism to marvelously capture and integrate 3D features with fewer parameters, improving the accuracy of AD diagnosis. A total of 447 cognitively normal (CN), 512 MCI, and 358 AD sMRI images from the Alzheimer's Disease Neuroimaging Initiative datasets are used for multi-class classification task, yielding a classification accuracy of 92.8%. The model merely involves 2.41 M parameters and achieves the best classification results with the least number of parameters when compared to other representative CNN architectures including ResNet 18, ResNet 34, ConvNeXt tiny, and VGG 11. Through the ablation experiment, the addition of attention mechanism and the multi-scale classification enhances the classification performance by 4.5% and 1.5%, respectively. Furthermore, our model outperforms the other six existing studies in terms of accuracy for classifying AD vs. MCI vs. CN. Overall, this study underscores the efficacy of our approach for AD diagnosis, showcasing its utility in diagnosing AD patients and providing novel insights for diagnosing other neurological disorder diseases.

关键词： Neuroimaging Accuracy Attention mechanisms Three-dimensional displays Resonance Convolutional neural networks Alzheimer's disease

SDGFormer: An Efficient Convolution Network Structurally Similar to Transformer

学校读者我要写书评

暂无评论

SDGFormer: An Efficient Convolution Network Structurally Sim...

IEEE International Conference on Multimedia and Expo (ICME)

作者： Chaohao Wen Xun Gong School of Computing and Artificial Intelligence SWJTU Chengdu China Engineering Research Center of Sustainable Urban Intelligent Transportation Ministry of Education China National Engineering Laboratory of Integrated Transportation Big Data Application Technology SWJTU Chengdu China Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province SWJTU Chengdu China

Deep Neural Networks (DNN) have achieved extraordinary success in many visual recognition tasks. Visual Transformer (ViT), which is derived from Natural Language Processing (NLP), has achieved state-of-the-art (SOTA) results on many tasks due to its capability of capturing long-range dependencies in visual data. However, Existing ViT models are challenging to deploy on devices due to their massive computational consumption, huge memory overhead, and reliance on large datasets. In this work, we address these issues by replacing some computationally expensive and memory-intensive modules in ViT with standard Convolutional Neural Network (CNN) modules. Firstly, we propose an efficient Self-Attention module called SDG-Attention (SDGA) with linear space and time complexity, and an economical FeedForward Network (FFN) composed of group convolution and shuffle channel (SFFN). Then, we develop a lightweight CNN model with SDGA and SFFN, SDGFormer, which embraces several priors of ViT and is LayerNorm-Free. We evaluate SDGFormer on ImageNet-1K and Mini-ImageNet, and the SDGFormer-S achieves a comparable top-1 accuracy of 77.6% on ImageNet-1K with 9.1M parameters and 1.6 GFlops regimes. Moreover, our SDGFormer-T achieves SOTA performance on Mini-ImageNet with 83.3% accuracy, demonstrating good generalization on small datasets without extra data.

关键词：

Transformer-Based Hierarchical Dynamic Decoders for Salient Object Detection

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Zheng, Qingping Zheng, Ling Deng, Jiankang Li, Ying Shang, Changjing Shen, Qiang School of Computer Science National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology Shaanxi Provincial Key Laboratory of Speech & Image Information Processing Northewestern Polytechnical University Shaanxi Xi’an710129 China Fuzhou Institute of Data Technology Fujian350200 China Department of Computing Imperial College London LondonSW7 2AZ United Kingdom

HighlightsTransformer-Based Hierarchical Dynamic Decoders for Salient Object DetectionQingping Zheng, Ling Zheng, Jiankang Deng, Ying Li, Changjing Shang, Qiang Shen• T-HDDNet employs dynamic upsampling and fusion for data-driven salient object detection.• T-HDDNet uses a spatially sensitive loss to learn salient object structures, yielding a high-resolution map.• Our method exceeds benchmarks at 22.19G MACs and 27M Params, reducing costs compared to the top model. © 2023, The Authors. All rights reserved.

关键词： Object detection

StarGAT: Star-Shaped Hierarchical Graph Attentional Network for Heterogeneous Network Representation Learning

学校读者我要写书评

暂无评论

StarGAT: Star-Shaped Hierarchical Graph Attentional Network ...

IEEE International Conference on data Mining (ICDM)

作者： Wen-Zhi Li Ling Huang Chang-Dong Wang Yu-Xin Ye School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Guangdong Province Key Laboratory of Computational Science Guangzhou China Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education China College of Mathematics and Informatics South China Agricultural University Guangzhou China Guangdong Provincial Key Laboratory of Public Finance and Taxation with Big Data Application Guangzhou China College of Computer Science and Technology Jilin University Changchun China

ISBN: (纸本)9781665423991

Many real-world graphs can be viewed as Heterogeneous Networks or Heterogeneous Information Networks (HINs) for that they comprise a diversity of node types and relation types. Due to the efficient representation ability of Graph Neural Network and the idea of random walk, many recent studies apply graph representation learning to HINs and achieve satisfactory results. However, these works either treat different node types in a metapath equally, which is inconsistent with the original graph semantic information for that different node types should have different statuses, or only consider the first-order (node-level) and second-order (metapath-level, a.k.a. link-level) information aggregation while ignoring the higher-order relations. To tackle these two problems, we propose a novel Star-Shaped Hierarchical Graph Attentional Network (StarGAT) model to boost representation learning in HINs. Specifically, we assume nodes in HINs can be categorized into a star-shaped structure including one center node type and a bunch of auxiliary node types in a specific task; and we encode node-level, link-level and motif-level attentions in a hierarchical manner to capture richer semantic information. Extensive experiments on three datasets illustrate the model effectiveness.

关键词： Representation learning Conferences Semantics Heterogeneous networks Graph neural networks data mining Task analysis

DNN Task Assignment in UAV Networks: A Generative AI Enhanced Multi-Agent Reinforcement Learning Approach

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Tang, Xin Chen, Qian Weng, Wenjie Liao, Binhan Wang, Jiacheng Cao, Xianbin Li, Xiaohuan Guangxi University Key Laboratory of Intelligent Networking and Scenario System School of Information and Communication Guilin University of Electronic Technology Guilin541004 China The College of Computing and Data Science Nanyang Technological University 639798 Singapore School of Architecture and Transportation Engineering Guilin University of Electronic Technology Guilin541004 China National Engineering Laboratory for Comprehensive Transportation Big Data Application Technology Guangxi Nanning530001 China College of Computing and Data Science Nanyang Technological University 639798 Singapore School of Electronic and Information Engineering The Key Laboratory of Advanced Technology of Near Space Information System Ministry of Industry and Information Technology of China Beihang University Beijing100191 China

Unmanned Aerial Vehicles (UAVs) possess high mobility and flexible deployment capabilities, prompting the development of UAVs for various application scenarios within the Internet of Things (IoT). The unique capabilities of UAVs give rise to increasingly critical and complex tasks in uncertain and potentially harsh environments. The substantial amount of data generated from these applications necessitates processing and analysis through deep neural networks (DNNs). However, UAVs encounter challenges due to their limited computing resources when managing DNN models. This paper presents a joint approach that combines multiple-agent reinforcement learning (MARL) and generative diffusion models (GDM) for assigning DNN tasks to a UAV swarm, aimed at reducing latency from task capture to result output. To address these challenges, we first consider the task size of the target area to be inspected and the shortest flying path as optimization constraints, employing a greedy algorithm to resolve the subproblem with a focus on minimizing the UAV’s flying path and the overall system cost. In the second stage, we introduce a novel DNN task assignment algorithm, termed GDM-MADDPG, which utilizes the reverse denoising process of GDM to replace the actor network in multi-agent deep deterministic policy gradient (MADDPG). This approach generates specific DNN task assignment actions based on agents’ observations in a dynamic environment. Simulation results indicate that our algorithm performs favorably compared to benchmarks in terms of path planning, Age of Information (AoI), energy consumption, and task load balancing. Copyright © 2024, The Authors. All rights reserved.

关键词： Motion planning

Tensor Graph Convolutional Network for Dynamic Graph Representation Learning

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Ling Yuan, Ye The School of Computer Science and Technology Chongqing University of Posts and Telecommunications Chongqing400065 China The Chongqing Key Laboratory of Big Data and Intelligent Computing Chongqing Engineering Research Center of Big Data Application for Smart Cities Chongqing Institute of Green and Intelligent Technology Chinese Academy of Sciences Chongqing400714 China The College of Computer and Information Science Southwest University Chongqing400715 China

Dynamic graphs (DG) describe dynamic interactions between entities in many practical scenarios. Most existing DG representation learning models combine graph convolutional network and sequence neural network, which model spatial-temporal dependencies through two different types of neural networks. However, this hybrid design cannot well capture the spatial-temporal continuity of a DG. In this paper, we propose a tensor graph convolutional network to learn DG representations in one convolution framework based on the tensor product with the following two-fold ideas: a) representing the information of DG by tensor form;b) adopting tensor product to design a tensor graph convolutional network modeling spatial-temporal feature simultaneously. Experiments on real-world DG datasets demonstrate that our model obtains state-of-the-art performance. Copyright © 2024, The Authors. All rights reserved.

关键词： Tensors

Fast Latent Factor Analysis via a Fuzzy PID-Incorporated Stochastic Gradient Descent Algorithm

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Jinli Yuan, Ye School of Computer Science and Technology Chongqing University of Posts and Telecommunications Chongqing400065 China Chongqing Key Laboratory of Big Data and Intelligent Computing Chongqing Engineering Research Center of Big Data Application for Smart Cities Chongqing Institute of Green and Intelligent Technology Chinese Academy of Sciences Chongqing400714 China College of Computer and Information Science Southwest University Chongqing400715 China

A high-dimensional and incomplete (HDI) matrix can describe the complex interactions among numerous nodes in various big data-related applications. A stochastic gradient descent (SGD)-based latent factor analysis (LFA) model is remarkably effective in extracting valuable information from an HDI matrix. However, such a model commonly encounters the problem of slow convergence because a standard SGD algorithm learns a latent factor relying on the stochastic gradient of current instance error only without considering past update information. To address this critical issue, this paper innovatively proposes a Fuzzy PID-incorporated SGD (FPS) algorithm with two-fold ideas: 1) rebuilding the instance learning error by considering the past update information in an efficient way following the principle of PID, and 2) implementing hyper-parameters and gain parameters adaptation following the fuzzy rules. With it, an FPS-incorporated LFA model is further achieved for fast processing an HDI matrix. Empirical studies on six HDI datasets demonstrate that the proposed FPS-incorporated LFA model significantly outperforms the state-of-the-art LFA models in terms of computational efficiency for predicting the missing data of an HDI matrix with competitive accuracy. Copyright © 2023, The Authors. All rights reserved.

关键词： Matrix algebra