检索结果-内蒙古大学图书馆

A Gradient-Guided Evolutionary Approach to Training Deep Neural Networks

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022年第9期33卷 4861-4875页

作者： Yang, Shangshang Tian, Ye He, Cheng Zhang, Xingyi Tan, Kay Chen Jin, Yaochu Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Computer Science and Technology Anhui University Hefei China Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education Institutes of Physical Science and Information Technology Anhui University Hefei China Department of Computer Science and Engineering Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation Southern University of Science and Technology Shenzhen China Department of Computing The Hong Kong Polytechnic University Hong Kong SAR Department of Computer Science University of Surrey Guildford U.K

It has been widely recognized that the efficient training of neural networks (NNs) is crucial to classification performance. While a series of gradient-based approaches have been extensively developed, they are criticized for the ease of trapping into local optima and sensitivity to hyperparameters. Due to the high robustness and wide applicability, evolutionary algorithms (EAs) have been regarded as a promising alternative for training NNs in recent years. However, EAs suffer from the curse of dimensionality and are inefficient in training deep NNs (DNNs). By inheriting the advantages of both the gradient-based approaches and EAs, this article proposes a gradient-guided evolutionary approach to train DNNs. The proposed approach suggests a novel genetic operator to optimize the weights in the search space, where the search direction is determined by the gradient of weights. Moreover, the network sparsity is considered in the proposed approach, which highly reduces the network complexity and alleviates overfitting. Experimental results on single-layer NNs, deep-layer NNs, recurrent NNs, and convolutional NNs (CNNs) demonstrate the effectiveness of the proposed approach. In short, this work not only introduces a novel approach for training DNNs but also enhances the performance of EAs in solving large-scale optimization problems.

关键词： Artificial neural networks Training Optimization Search problems Scalability Complexity theory Genetic algorithms Deep neural networks (DNNs) evolutionary algorithm (EA) genetic operator gradient descent sparsity

来源：评论

学校读者我要写书评

暂无评论

A Fusion Shallow and Deep Features Network for Facial StO2 Stress Classification 6

A Fusion Shallow and Deep Features Network for Facial StO2 S...

引用

6th IEEE information technology, Networking, Electronic and Automation Control Conference, ITNEC 2023

作者： Xia, Haolin Sun, Sirui Liu, Xinyu Zhou, Ju Wang, Hanpu Chen, Tong School of Electronic and Information Engineering Southwest University Chongqing China Key Laboratory of Non-Linear Circuit and Intelligent Information Processing of Chongqing Chongqing China Institute of Legal Psychology and Intelligent Computing Chongqing China

ISBN: (纸本)9781665460033

Stress is an emotional state that affects our lives, so it is vital to detect it accurately. Numerous studies have shown that tissue oxygen saturation (StO2) is an effective physiological signal for identifying different stress states. However, previous StO2 feature extraction methods relied too heavily on baselines to be realized in practice. In this paper, a two-stream network combining shallow and deep features, called CRNet, is proposed for baseline-independent StO2 stress classification. In CRNet, shallow features are extracted using a CNN network and deep features are extracted using a ResNet network. For the extracted high-dimensional deep features, MLP module is employed for dimensionality reduction, which can effectively combine the two levels of features and improve the feature extraction capability of the network. Experimental results show that CRNet can significantly improve the performance of StO2 stress classification to the state-of-the-art (SOTA) even when using only raw imbalanced data. © 2023 IEEE.

关键词： Feature extraction

来源：评论

学校读者我要写书评

暂无评论

Imperceptible and Sparse Adversarial Attacks via a Dual-Population-Based Constrained Evolutionary Algorithm

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2023年第2期4卷 268-281页

作者： Tian, Ye Pan, Jingwen Yang, Shangshang Zhang, Xingyi He, Shuping Jin, Yaochu Anhui University Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education Institutes of Physical Science and Information Technology Hefei230601 China Hefei Comprehensive National Science Center Institute of Artificial Intelligence Hefei230088 China Anhui University School of Computer Science and Technology Hefei230601 China Anhui University Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education School of Artificial Intelligence Hefei230601 China Anhui University Anhui Engineering Laboratory of Human-Robot Integration System and Intelligent Equipment School of Electrical Engineering and Automation Hefei230601 China Bielefeld University Faculty of Technology Bielefeld33619 Germany

The sparse adversarial attack has attracted increasing attention due to the merit of a low attack cost via changing a small number of pixels. However, the generated adversarial examples are easily detected in vision since the perturbation to each pixel is relatively large. To achieve imperceptible and sparse adversarial attacks, this article formulates a bi-objective constrained optimization problem, simultaneously minimizing the 0 and 2 distances to the original image, and proposes a dual-population-based constrained evolutionary algorithm to solve it. The proposed method solves the optimization problem by evolving two populations, where one population is responsible for finding feasible solutions (i.e., successful attacks) and the other one is to minimize both the 0 and 2 distances. Moreover, a population initialization strategy and two genetic operators are customized to accelerate the convergence speed. Experimental results indicate that the proposed method can achieve high success rates with low attack costs, and strikes a better balance between the 0 and 2 distances than state-of-the-art methods. © 2020 IEEE.

关键词： Evolutionary algorithms

来源：评论

学校读者我要写书评

暂无评论

Development of a Universal RNA Dual-Terminal Labeling Method for Sensing RNA-Ligand Interactions

引用

CCS Chemistry 2023年第1期5卷 221-233页

作者： Longhuai Cheng Dejun Ma Jie Zhang Xueying Kang Yang Wu Yi Zhao Long Yi Zhen Xi State Key Laboratory of Elemento-Organic Chemistry Department of Chemical BiologyCollege of ChemistryNational Pesticide Engineering Research CenterCollaborative Innovation Center of Chemical Science and EngineeringNankai UniversityTianjin 300071 State Key Laboratory of Organic-Inorganic Composites and Beijing Key Laboratory of Bioprocess Beijing University of Chemical Technology(BUCT)Beijing 100029 Key Laboratory of Intelligent Information Processing Research Center for Ubiquitous Computing SystemsInstitute of Computing TechnologyChinese Academy of SciencesBeijing 100190

Dual labeling of an RNA can provide Förster resonance energy transfer(FRET)sensors for studying RNA folding,miRNA maturation,and RNA-protein ***,we report the development of a highly efficient strategy for direct dual-terminal labeling of any RNA of *** explored new Michael cycloaddition for facile labeling of 5′-terminal RNA with improved *** chemical tetrazinylation of RNA at the 3′-terminus was achieved with the highly efficient and catalysis-free tetrazine-cycloalkyne *** single-terminal labeling methods were combined for dual-terminal labeling of an RNA including short hairpin RNA,pre-miRNA,riboswitch,and noncoding ***,these dual-labeled RNA-based FRET sensors were used to monitor RNA-ligand interactions in vitro and in live *** is anticipated that these universal RNA labeling strategies will be useful to study RNA structures and functions.

关键词： dual labeling Förster resonance energy transfer sensor Michael cycloaddition tetrazinecycloalkyne ligation RNA-ligand interaction

来源：评论

学校读者我要写书评

暂无评论

Identity-Based Signature from Lattices Without Trapdoors 26th

Identity-Based Signature from Lattices Without Trapdoors

引用

26th International Conference on information and Communications Security, ICICS 2024

作者： Luo, Pingbin Chen, Xinjian Susilo, Willy Huang, Qiong College of Mathematics and Informatics South China Agricultural University Guangzhou China Guangzhou Key Laboratory of Intelligent Agriculture Guangzhou510642 China School of Computing and Information Technology University of Wollongong Wollongong Australia

ISBN: (纸本)9789819788002

Currently, the majority of lattice-base identity-based signature (LB-IBS) schemes rely on lattice trapdoor technique introduced by Gentry, Peikert, and Vaikuntanathan. However, this approach significantly impacts computational efficiency. In light of this, we present an alternative method for constructing LB-IBS that does not rely on lattice trapdoors and preimage sampling function. We construct an IBS scheme by employing Lyubashevsky’s signature twice, which is essentially a public key delegation from concatenated Schnorr signatures. In order to optimize the signature size, we describe an adaptation of our scheme in module lattices setting and compression technique. Moreover, our new LB-IBS can combine with Dilithium naturally so that it could carry the advantages of the latter such as side-channel attacks protection. We demonstrate that our construction is provably secure against existential forgery on adaptively chosen message and identity attacks in random oracle model. In comparison with the most efficient LB-IBS scheme (to the best of our knowledge), the signature size of our scheme is 52% smaller and runtime of our scheme is up to 32% faster. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Quantum cryptography

来源：评论

学校读者我要写书评

暂无评论

GP-Net: Global Perceptual Network with Adaptive Gradient Clipping for Emotional Image Classification 8

GP-Net: Global Perceptual Network with Adaptive Gradient Cli...

引用

8th International Conference on intelligent computing and Signal Processing, ICSP 2023

作者： Wang, Xiaohua Yang, Jie Hu, Min Wu, Xia Hefei University of Technology Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine School of Computer Science and Information Engineering Hefei China

ISBN: (纸本)9798350302455

Traditional image emotion recognition focuses only on the emotion information embedded in the subject or part of the image, while ignoring the global emotion information. In this paper, we propose a new network based on Vision Transformer: a global perception network, containing a main module and a background module. The main module enhances the weighting of objects by showing the interdependencies between modelled channels. The background module further searches for emotional information in the background. In addition, we employ multi-task learning and Adaptive Gradient Clipping to improve the network. Extensive experiments show that our proposed method outperforms the state-of-the-art methods for image sentiment analysis. © 2023 IEEE.

关键词： Image classification

来源：评论

学校读者我要写书评

暂无评论

Research on Dataset Preparation and Registration Methods for Multi-Temporal Airport SAR Images 2

Research on Dataset Preparation and Registration Methods for...

引用

2nd IEEE International Conference on Signal, information and Data Processing, ICSIDP 2024

作者： Wu, Guanghui Liu, Lujiao Li, Jianhao Pan, Hongxin Shi, Hao Beijing Institute of Technology Chongqing Innovation Center Chongqing China Aerospace Information Research Institute Chinese Academy of Sciences Beijing China Beijing Institute of Technology National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing Beijing China

ISBN: (纸本)9798331515669

Synthetic Aperture Radar (SAR) offers high-resolution imaging capabilities that are unaffected by weather and lighting conditions, making it ideal for complex environments. Recent advancements in spaceborne SAR technology have provided diverse high-resolution, multi-temporal SAR data, crucial for applications like airport monitoring. Despite these advancements, there is a notable lack of multi-temporal airport SAR datasets for research. This study addresses this gap by presenting a method to create a multi-temporal airport SAR image dataset. Utilizing known latitude and longitude information, the method converts geographic coordinates to image projection coordinates to locate airports in SAR images, followed by image conversion and alignment to construct the dataset. Additionally, this study introduces a registration method named SAR-SURF for multi-temporal SAR images, employing a SURF-based Feature Points Detector and an improved Fast Sample Consensus (FSC) algorithm. The experimental results demonstrate that this method effectively reduces speckle noise, ensures matching accuracy, and minimizes processing time, enabling rapid and precise registration of multi-temporal airport SAR images. © 2024 IEEE.

关键词： Image registration

来源：评论

学校读者我要写书评

暂无评论

A Cross-Domain Ontology Semantic Representation Based on NCBI-BlueBERT Embedding

引用

Chinese Journal of Electronics 2022年第5期31卷 860-869页

作者： ZHAO Lingling WANG Junjie WANG Chunyu GUO Maozu Faculty of Computing Harbin Institute of Technology Department of Medical Informatics School of Biomedical Engineering and InformaticsNanjing Medical University Beijing Key Laboratory of Intelligent Processing for Building Big Data School of Electrical and Information Engineering Beijing University of Civil Engineering and Architecture

A common but critical task in biological ontologies data analysis is to compare the difference between ontologies. There have been numerous ontologybased semantic-similarity measures proposed in specific ontology domain, but it still remains a challenge for crossdomain ontologies comparison. An ontology contains the scientific natural language description for the corresponding biological aspect. Therefore, we develop a new method based on natural language processing(NLP) representation model bidirectional encoder representations from transformers(BERT) for cross-domain semantic representation of biological ontologies. This article uses the BERT model to represent the word-level of the ontologies as a set of vectors, facilitating the semantic analysis or comparing the biomedical entities named in an ontology or associated with ontology terms. We evaluated the ability of our method in two experiments: calculating similarities of pair-wise disease ontology and human phenotype ontology terms and predicting the pair-wise of proteins interaction. The experimental results demonstrated the comparative performance. This gives promise to the development of NLP methods in biological data analysis.

关键词： human phenotype ontology cross-domain semantic representation natural language description pair-wise disease ontology data analysis bidirectional encoder representations NLP protein interaction diseases proteins natural language processing ontologies (artificial intelligence) natural language processing representation neural nets bioinformatics semantic-similarity measures cross-domain ontology semantic representation semantic analysis NCBI-BlueBERT embedding biological ontology data analysis

来源：评论

学校读者我要写书评

暂无评论

Correction of microwave pulse reflection by digital filters in superconducting quantum circuits

引用

Chinese Physics B 2024年第9期33卷 117-123页

作者： Liang-Liang Guo Peng Duan Lei Du Hai-Feng Zhang Hao-Ran Tao Yong Chen Xiao-Yan Yang Chi Zhang Zhi-Long Jia Wei-Cheng Kong Zhao-Yun Chen Guo-Ping Guo CAS Key Laboratory of Quantum Information University of Science and Technology of ChinaHefei 230026China CAS Center for Excellence and Synergetic Innovation Center in Quantum Information and Quantum Physics University of Science and Technology of ChinaHefei 230026China Origin Quantum Computing Company Limited Hefei 230088China Institute of Artificial Intelligence Hefei Comprehensive National Science CenterHefei 230088China

Reducing the control error is vital for high-fidelity digital and analog quantum *** superconducting circuits,one disagreeable error arises from the reflection of microwave signals due to impedance mismatch in the control ***,we demonstrate a reflection cancelation method when considering that there are two reflection nodes on the control *** propose to generate the pre-distortion pulse by passing the envelopes of the microwave signal through digital filters,which enables real-time reflection correction when integrated into the field-programmable gate array(FPGA).We achieve a reduction of single-qubit gate infidelity from 0.67%to 0.11%after eliminating microwave ***-time correction of microwave reflection paves the way for precise control and manipulation of the qubit state and would ultimately enhance the performance of algorithms and simulations executed on quantum processors.

关键词： reflection cancelation digital filter single-qubit gate superconducting circuit

来源：评论

学校读者我要写书评

暂无评论

Bi-Directional and Triangular Circulation Fusion Neural Networks for Small Object Detection

引用

IEEE Transactions on Circuits and Systems for Video technology 2024年第6期35卷 5140-5152页

作者： Li, Fangyu Duan, Junzhu Zhang, Qiyu Shan, Caifeng Han, Honggui the School of Information Science and Technology Beijing Key Laboratory of Computational Intelligence and Intelligent System Engineering Research Center of Digital Community Ministry of Education Beijing Artificial Intelligence Institute Beijing University of Technology Beijing100124 China the State Key Laboratory for Novel Software Technology Nanjing University Nanjing210023 China the School of Intelligence Science and Technology Nanjing University Suzhou215163 China

Deep learning-driven object detection models are capable of accurately identifying and localizing objects. However, small objects contain limited information relative to global features, resulting in the fact that detection models often do not learn small object features adequately. To enhance the precision in detecting small objects, we propose a bi-directional and triangular circulation fusion neural network (BTFN). First, to selectively strengthen the position features of small objects, we propose a feature circulation extraction module composed of a bi-directional triangular densely nested convolutional network (BTF), thus achieving repetitive multi-layer feature fusion. Second, to fill up the semantic gaps between different scales of features, we design a mixed dual attention module (MDA) in the bi-directional triangular densely nested network. Third, to mitigate the lost information in the neural networks with deep layers as well as improve the inference time, we design a re-parameterization bi-directional composite feature fusion module (Rep-BFM) that fuses the features of multiple scales. The proposed model is evaluated extensively on the MS COCO, Tsinghua-Tencent 100k, and Haier dismantled parts of used home appliances datasets. The experiment results show that the proposed model improves the AP on MS COCO by 4%, especially the APS of small objects is improved by 7.7% compared with SOTA models. © 2024 institute of Electrical and Electronics Engineers Inc.. All rights reserved.

关键词： Domestic appliances

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：