检索结果-内蒙古大学图书馆

Point Cloud Classification Using Content-Based Transformer via Clustering in Feature Space

IEEE/CAA Journal of Automatica Sinica 2024年第1期11卷 231-239页

作者： Yahui Liu Bin Tian Yisheng Lv Lingxi Li Fei-Yue Wang the State Key Laboratory for Management and Control of Complex Systems Institute of AutomationChinese Academy of SciencesBeijing 100190 the School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100190 IEEE the Transportation and Autonomous Systems Institute(TASI)and the Department of Electrical and Computer Engineering Purdue School of Engineering and TechnologyIndiana University-Purdue University Indianapolis(IUPUI)Indianapolis 46202 USA

Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention,but ignore their content and fail to establish relationships between distant but relevant points. To overcome the limitation of local spatial attention, we propose a point content-based Transformer architecture, called PointConT for short. It exploits the locality of points in the feature space(content-based), which clusters the sampled points with similar features into the same class and computes the self-attention within each class, thus enabling an effective trade-off between capturing long-range dependencies and computational complexity. We further introduce an inception feature aggregator for point cloud classification, which uses parallel structures to aggregate high-frequency and low-frequency information in each branch separately. Extensive experiments show that our PointConT model achieves a remarkable performance on point cloud shape classification. Especially, our method exhibits 90.3% Top-1 accuracy on the hardest setting of ScanObjectN N. Source code of this paper is available at https://***/yahuiliu99/PointC onT.

关键词： Content-based Transformer deep learning feature aggregator local attention point cloud classification

来源：评论

学校读者我要写书评

暂无评论

Learning to Communicate Among Agents for Large-Scale Dynamic Path Planning With Genetic Programming Hyperheuristic

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2025年第5期6卷 1269-1283页

作者： Liao, Xiao-Cheng Hu, Xiao-Min Chen, Xiang-Ling Mei, Yi Jia, Ya-Hui Chen, Wei-Neng Victoria University of Wellington Centre for Data Science and Artificial Intelligence School of Engineering and Computer Science Wellington6140 New Zealand Guangdong University of Technology School of Computer Science and Technology Guangzhou510006 China Hanyang University Department of Electrical and Electronic Engineering Ansan15588 Korea Republic of South China University of Technology School of Future Technology Guangzhou510006 China Pazhou Lab Guangzhou510005 China South China University of Technology School of Computer Science and Engineering State Key Laboratory of Subtropical Building and Urban Science Guangzhou510006 China

Genetic programming hyperheuristic (GPHH) has recently become a promising methodology for large-scale dynamic path planning (LDPP) since it can produce reusable heuristics rather than disposable solutions. However, in this methodology, the extracted local and decentralized heuristic for agents that lack a global systemic view sometimes may be problematic. Therefore, a new challenge is to strike a balance between conciseness to improve generalization ability and incorporation of more global information to obtain better performance. In this work, we target the LDPP problem and propose a communication learning mechanism (ComLGP) for GPHH to address the above difficulties. In ComLGP, a communication function is introduced to serve as a communication protocol and exist in the form of an extra terminal in GPHH. Compared to the classic terminals which are fixed in genetic programing, this communication function undergoes optimization along with the evolutionary process of GPHH. In this way, the communication function can be learned which enables agents to communicate without a predefined communication protocol. Then, a caching and lazy updating mechanism for ComLGP is presented to accelerate the calculation of communication content. Last, we verified our method on 22 scenarios including two real world road networks. The experimental results demonstrate that the proposed ComLGP can successfully learn to communicate. Although in the absence of any manually designed communication features, ComLGP is capable of achieving performance competitive to the state-of-the-art method that employs a predefined communication protocol and outperforms the remaining compared methods in most scenarios. © 2020 IEEE.

关键词： Genetic programming

来源：评论

学校读者我要写书评

暂无评论

StackAMP: Stacking-Based Ensemble Classifier for Antimicrobial Peptide Identification

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2024年第11期5卷 5666-5675页

作者： Karim, Tasmin Shaon, Md. Shazzad Hossain Ali, Md. Mamun Ahmed, Kawsar Bui, Francis M. Chen, Li Department of Computer Science and Engineering Birulia Dhaka Savar1216 Bangladesh University of Saskatchewan Division of Biomedical Engineering SaskatoonSKS7N 5A9 Canada University of Saskatchewan Department of Electrical and Computer Engineering SaskatoonSKS7N 5A9 Canada Health Informatics Research Laboratory Department of Computer Science and Engineering Birulia Dhaka Savar1216 Bangladesh Mawlana Bhashani Science and Technology University Group of Bio-photomati Information and Communication Technology Tangail Santosh1902 Bangladesh

Antimicrobial peptides (AMPs) play a vital role in the immune defence systems of various organisms and have garnered significant attention for their potential applications in biotechnology and medicine. There are several approaches to identifying AMPs including clinical isolation and characterization, functional genomics, microbiology techniques, and others. However, these methods are mostly expensive, time-consuming, and require well-equipped labs. To overcome these challenges, machine learning models are a potential solution due to their robustness and high predictive capability with less time and cost. In this study, we explored the efficacy of stacking-based ensemble machine-learning techniques to identify AMPs with higher accuracy and precision. Five distinct feature extraction methods, namely amino acid composition, dipeptide composition, moran autocorrelation, geary autocorrelation, and pseudoamino acid composition, were employed to represent the sequence characteristics of peptides. To build robust predictive models, different traditional machine learning algorithms were applied. Additionally, we developed a novel stacking classifier, aptly named StackAMP, to harness the collective power of these algorithms. Our results demonstrated the exceptional performance of the proposed StackAMP ensemble method in AMP identification, achieving an accuracy of 99.97%, 99.93% specificity, and 100% sensitivity. This high accuracy underscores the effectiveness of our approach, which has promising outcomes for the rapid and accurate identification of AMPs in various biological contexts. This study not only contributes to the growing body of knowledge in the field of AMP recognition but also offers a practical tool with potential applications in drug discovery, biotechnology, and disease prevention. © 2024 IEEE.

关键词： Amino acids

来源：评论

学校读者我要写书评

暂无评论

Data-Driven Digital Twins for Power Estimations of a Solar Photovoltaic Plant

Data-Driven Digital Twins for Power Estimations of a Solar P...

引用

2023 IEEE Symposium Series on Computational Intelligence, SSCI 2023

作者： Walters, Michael Yonce, John Venayagamoorthy, Ganesh K. Clemson University Realtime Power and Intelligent Systems Laboratory Holcombe Department of Electrical and Computer Engineering Clemson United States

ISBN: (纸本)9781665430654

Renewable energy generation sources (RESs) are gaining increased popularity due to global efforts to reduce carbon emissions and mitigate effects of climate change. Planning and managing increasing levels of RESs, specifically solar photovoltaic (PV) generation sources is becoming increasingly challenging. Estimations of solar PV power generations provide situational awareness in distribution system operations. A digital twin (DT) can replicate PV plant behaviors and characteristics in a virtual platform, providing realistic solar PV estimations. Furthermore, neural networks, a popular paradigm of artificial intelligence may be used to adequately learn and replicate the relationship between input and output variables for data-driven DTs (DD-DTs). In this paper, DD-DTs are developed for Clemson University's 1 MW solar PV plant located in South Carolina, USA to perform realistic solar PV power estimations. The DD-DTs are implemented utilizing multilayer perceptron (MLP) and Elman neural networks. Typical practical results for two DD-DT architectures are presented and validated. © 2023 IEEE.

关键词： Digital twin neural network power estimation solar photovoltaic

来源：评论

学校读者我要写书评

暂无评论

Low Power Network-on-Chip Architecture Design Technique 32

Low Power Network-on-Chip Architecture Design Technique

引用

32nd IFIP/IEEE International Conference on Very Large Scale Integration, VLSI-SoC 2024

作者： Musale, Tejas Ganti, Arun Gogoi, Ankur Manna, Kanchan Bits Pilani Department of Electrical and Electronics Engineering India Bits Pilani Department of Computer Science and Information Systems India Galgotias University Uttar Pradesh India

ISBN: (纸本)9798331539672

In the evolving landscape of many-core architectures, the Network on Chip (NoC) emerges as a pivotal inter-connection framework, accommodating the escalating number of cores on a single chip. Despite its widespread adoption, power consumption remains a critical challenge, significantly influenced by factors such as topology, bit toggling, and routing algorithms, with bit-switching power being a predominant concern. In this work, we have proposed an innovative technique in the cores aimed at reducing the power consumption of the NoC. To calculate our method's area, time, and power consumption, we have synthesized it on a Xilinx Virtex-7 FPGA board. We have modified the Noxim open-source simulator to validate our approach using synthetic traffic. Empirical results demonstrate a 29.64% reduction in dynamic power consumption and a 29.09% improvement in switching activity for the average case (Mode 1) traffic scenario. © 2024 IEEE.

关键词： Field programmable gate arrays (FPGA)

来源：评论

学校读者我要写书评

暂无评论

Berry Curvature engineering in Optical Resonator Networks using Long-Range Hopping

Berry Curvature Engineering in Optical Resonator Networks us...

引用

2023 Novel Optical Materials and Applications, NOMA 2023

作者： Kim, Gyunghun Suh, Joseph Lee, Ikbeom Yu, Sunkyu Intelligent Wave Systems Laboratory Department of Electrical and Computer Engineering Seoul National University Seoul08826 Korea Republic of

We propose the engineering of the Berry curvature in optical resonator networks by exploiting long-range hopping. By generalizing the Hofstadter model, we examine the effect of hopping orders for the design of topolog... 详细信息

关键词： Optical resonators

来源：评论

学校读者我要写书评

暂无评论

Greeting Gesture Analysis Using Boosting Algorithms and SHAP 13

Greeting Gesture Analysis Using Boosting Algorithms and SHAP

引用

Joint 13th International Conference on Soft Computing and Intelligent systems and 25th International Symposium on Advanced Intelligent systems, SCIS and ISIS 2024

作者： Wibowo, Angga Wahyu Sato-Shimokawara, Eri Kurnianingsih Graduate School of Systems Design Tokyo Metropolitan University Department of Computer Science Tokyo Japan Politeknik Negeri Semarang Department of Electrical Engineering Semarang Indonesia

ISBN: (纸本)9798350373332

Recently, studies related to human activity recognition have developed which have been applied in various fields. In that field Machine learning and deep learning techniques have been widely used for several classification and prediction tasks. However, the first problem is that there is rarely any research on human activities that reflect the culture of a region, such as greeting gestures. Second, there are few studies that do not provide models resulting from the classification or prediction process using machine learning, which can result in a lack of understanding of how a model from machine learning is generated. This study aims to predict Japanese greeting gestures (eshaku, keirei, saikeirei, waving hand) and Indonesian (placing both hands in front of the chest) using Light Gradient Boosting Machine (LightGBM), eXtreme Gradient Boosting (XGBoost), and Gradient Boosting. Then, represent the model of the learning machine using SHapley Additive exPlanations (SHAP) to find out how the learning machine obtain a model. Our findings show the efficacy of this method and show that the model not only predicts greeting gestures with high accuracy but also offers a transparent understanding of the factors influencing its predictions, thus enhancing the interpretability and applicability of machine learning in recognizing culturally significant human activities. In the future, we plan to use machine learning and other Explainable Artificial Intelligence (XAI) methods to study human activities with cultural concepts such as greeting gestures in different styles, create more greeting gesture-based human activity datasets, and examine the ethical implications or considerations of using machine learning in cultural contexts to respect cultural differences. © 2024 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Effective short text classification via the fusion of hybrid features for IoT social data

引用

Digital Communications and Networks 2022年第6期8卷 942-954页

作者： Xiong Luo Zhijian Yu Zhigang Zhao Wenbing Zhao Jenq-Haur Wang School of Computer and Communication Engineering University of Science and Technology BeijingBeijing100083China Shunde Innovation School University of Science and Technology BeijingFoshan528399China Beijing Key Laboratory of Knowledge Engineering for Materials Science Beijing100083China Department of Electrical Engineering and Computer Science Cleveland State UniversityClevelandOH44115USA Department of Computer Science and Information Engineering National Taipei University of TechnologyTaipei10608China

Nowadays short texts can be widely found in various social data in relation to the 5G-enabled Internet of Things (IoT). Short text classification is a challenging task due to its sparsity and the lack of context. Previous studies mainly tackle these problems by enhancing the semantic information or the statistical information individually. However, the improvement achieved by a single type of information is limited, while fusing various information may help to improve the classification accuracy more effectively. To fuse various information for short text classification, this article proposes a feature fusion method that integrates the statistical feature and the comprehensive semantic feature together by using the weighting mechanism and deep learning models. In the proposed method, we apply Bidirectional Encoder Representations from Transformers (BERT) to generate word vectors on the sentence level automatically, and then obtain the statistical feature, the local semantic feature and the overall semantic feature using Term Frequency-Inverse Document Frequency (TF-IDF) weighting approach, Convolutional Neural Network (CNN) and Bidirectional Gate Recurrent Unit (BiGRU). Then, the fusion feature is accordingly obtained for classification. Experiments are conducted on five popular short text classification datasets and a 5G-enabled IoT social dataset and the results show that our proposed method effectively improves the classification performance.

关键词： Information fusion Short text classi fication BERT Bidirectional encoder representations fr 0om transformers Deep learning Social data

来源：评论

学校读者我要写书评

暂无评论

Quantifying, Activating and Rewarding Flexibility in Renewable Energy Communities

Quantifying, Activating and Rewarding Flexibility in Renewab...

引用

2024 IEEE PES Innovative Smart Grid Technologies Europe Conference, ISGT EUROPE 2024

作者： Allard, Julien Vallée, François De Grève, Zacharie Stegen, Thomas Glavic, Mevludin Cornélusse, Bertrand University of Mons Power Systems and Markets Research Group Electrical Power Engineering Unit Mons Belgium University of Liège Department of Electrical Engineering and Computer Science Liège Belgium

ISBN: (纸本)9789531842976

Demand-side flexibility from renewable energy community members increases the benefits of local production and exchanges. To effectively harness this flexibility, end-users must be rewarded for their efforts regarding the shifted energy volumes and the associated discomfort. This work quantifies these last two quantities for three types of loads (electric vehicles, thermal loads and wet appliances). Then, a two-step model is proposed which first optimally activates the offered flexibility and then shares the benefits of this activation among the renewable energy community members through a rule-based or an optimization-based approach. Results show that the community framework can further increase the benefits brought by flexible demand. © 2024 IEEE.

关键词： Demand response

来源：评论

学校读者我要写书评

暂无评论

On the Design of Novel Attention Mechanism for Enhanced Efficiency of Transformers 24

On the Design of Novel Attention Mechanism for Enhanced Effi...

引用

61st ACM/IEEE Design Automation Conference, DAC 2024

作者： Jha, Sumit Kumar Jha, Susmit Ewetz, Rickard Velasquez, Alvaro Computer Science Department Florida International University MiamiFL United States Computer Science Laboratory Sri International Menlo ParkCA United States Electrical and Computer Engineering University of Central Florida OrlandoFL United States Department of Computer Science University of Colorado Boulder BoulderCO United States

ISBN: (纸本)9798400706011

We present a new xor-based attention function for efficient hardware implementation of transformers. While the standard attention mechanism relies on matrix multiplication between the key and the transpose of the query, we propose replacing the computation of this attention function with bitwise xor operations. We mathematically analyze the information-theoretic properties of the standard multiplication-based attention, demonstrating that it preserves input entropy, and then computationally show that the xor-based attention approximately preserves the entropy of its input despite small variations in correlations between the inputs. Across various admittedly simple tasks, including arithmetic, sorting, and text generation, we show comparable performance to baseline methods using scaled GPT models. The xor-based computation of the attention function shows substantial improvement in power consumption, latency, and circuit area compared to the corresponding multiplication-based attention function. This hardware efficiency makes xor-based attention more compelling for the deployment of transformers under tight resource constraints, opening new application domains in sustainable energy-efficient computing. Additional optimizations to the xor-based attention function can further improve efficiency of transformers. © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

关键词： Distribution transformers

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：