检索结果-内蒙古大学图书馆

Towards Making Unsupervised Graph Hashing Robust

学校读者我要写书评

暂无评论

Towards Making Unsupervised Graph Hashing Robust

IEEE International Conference on Multimedia and Expo (ICME)

作者： Xuesong Gu Guohua Dong Xiang Zhang Long Lan Zhigang Luo Science and Technology on Parallel and Distributed Laboratory NUDT NUDT Institute for Quantum Information & HPCL

ISBN: (数字)9781728113319

ISBN: (纸本)9781728113326

Unsupervised hashing without supervision easily deteriorates in the case of grossly corrupted data. Motivated by robust optimization, this paper proposes a dual-graph regularized robust hashing (DGRH) based on both manifold smoothness and robust estimators in a more intuitive manner. Orthogonal to existing robust hashing methods, DGRH directly removes the outliers of datasets with M-estimator to exert robustness. In specific, it intends to recover low-rank representation from corrupted data via l 1 loss while preserving neighborhood relationships among samples with dual-graph regularization. Although DGRH seems a simple extension of robust PCA on graphs with hashing trick, it is easy to implement yet effective. Theory analysis is provided to support our claim. Experiments of image retrieval on three popular benchmark datasets show the efficacy of DGRH as compared to several well-behaved representative counterparts.

关键词： Robustness Binary codes Image retrieval Optimization Manifolds Principal component analysis Measurement

A Risk-Averse Just-In-Time Scheme for Learning-Based Operation of Microgrids with Coupled Electricity-Hydrogen-Ammonia under Uncertainties

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Longyan Ning, Chao Pan, Guangsheng Zhang, Leiqi Gu, Wei Zhao, Liang Du, Wenli Shahidehpour, Mohammad Department of Automation Shanghai Jiao Tong University Shanghai200240 China Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China School of Electrical Engineering Southeast University Nanjing210096 China Zhejiang Key Laboratory of Distributed Generations and Microgrid Technology State Grid Zhejiang Electric Power Research Institute Hangzhou310014 China Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education East China University of Science and Technology China Department of Electrical and Computer Engineering Illinois Institute of Technology ChicagoIL60616 United States

This paper proposes a Risk-Averse Just-In-Time (RAJIT) operation scheme for Ammonia-Hydrogen-based Micro-Grids (AHMGs) to boost electricity-hydrogen-ammonia coupling under uncertainties. First, an off-grid AHMG model is developed, featuring a novel multi-mode ammonia synthesis process and a hydrogen-ammonia dual gas turbine with tunable feed-in ratios. Subsequently, a state-behavior mapping strategy linking hydrogen storage levels with the operation modes of ammonia synthesis is established to prevent cost-ineffective shutdowns. The proposed model substantially improves operational flexibility but results in a challenging nonlinear fractional program. Based upon this model, a data-driven RAJIT scheme is developed for the real-time rolling optimization of AHMGs. Unlike conventional one-size-fits-all schemes using one optimization method throughout, the data-driven RAJIT intelligently switches between cost-effective deterministic optimization and risk-averse online-learning distributionally robust optimization depending on actual risk profiles, thus capitalizing on the respective strengths of these two optimization methods. To facilitate the solution of the resulting nonlinear program, we develop an equivalent-reformulation-based solution methodology by leveraging a constraint-tightening technique. Numerical simulations demonstrate that the proposed scheme guarantees safety and yields an overall cost reduction up to 14.6% compared with several state-of-the-art methods. © 2024, CC BY.

关键词： Ammonia

Multi-representation knowledge distillation for audio classification

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Gao, Liang Xu, Kele Wang, Huaimin Peng, Yuxing National Key Laboratory of Parallel and Distributed Processing College of Computer National University of Defense Technology Changsha410073 China

As an important component of multimedia analysis tasks, audio classification aims to discriminate between different audio signal types and has received intensive attention due to its wide applications. Generally speaking, the raw signal can be transformed into various representations (such as Short Time Fourier Transform and Mel Frequency Cepstral Coefficients), and information implied in different representations can be complementary. Ensembling the models trained on different representations can greatly boost the classification performance, however, making inference using a large number of models is cumbersome and computationally expensive. In this paper, we propose a novel end-to-end collaborative learning framework for the audio classification task. The framework takes multiple representations as the input to train the models in parallel. The complementary information provided by different representations is shared by knowledge distillation. Consequently, the performance of each model can be significantly promoted without increasing the computational overhead in the inference stage. Extensive experimental results demonstrate that the proposed approach can improve the classification performance and achieve state-of-the-art results on both acoustic scene classification tasks and general audio tagging tasks. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolutional neural networks

A Prompting-based Approach for Adversarial Example Generation and Robustness Enhancement

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Yuting Huang, Pei Cao, Juan Li, Jintao Lin, Yun Dong, Jin Song Ma, Feifei Zhang, Jian Key Lab of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China Beijing China National University of Singapore Singapore Laboratory of Parallel Software and Computational Science ISCAS Beijing China

Recent years have seen the wide application of NLP models in crucial areas such as finance, medical treatment, and news media, raising concerns of the model robustness and vulnerabilities. In this paper, we propose a novel prompt-based adversarial attack to compromise NLP models and robustness enhancement technique. We first construct malicious prompts for each instance and generate adversarial examples via mask-and-filling under the effect of a malicious purpose. Our attack technique targets the inherent vulnerabilities of NLP models, allowing us to generate samples even without interacting with the victim NLP model, as long as it is based on pre-trained language models (PLMs). Furthermore, we design a prompt-based adversarial training method to improve the robustness of PLMs. As our training method does not actually generate adversarial samples, it can be applied to large-scale training sets efficiently. The experimental results show that our attack method can achieve a high attack success rate with more diverse, fluent and natural adversarial examples. In addition, our robustness enhancement method can significantly improve the robustness of models to resist adversarial attacks. Our work indicates that prompting paradigm has great potential in probing some fundamental flaws of PLMs and fine-tuning them for downstream tasks. Copyright © 2022, The Authors. All rights reserved.

关键词： Natural language processing systems

A Heterogeneous Processor Design for CNN-Based AI Applications on IoT Devices 8

学校读者我要写书评

暂无评论

A Heterogeneous Processor Design for CNN-Based AI Applicatio...

8th International Conference on Identification, Information and Knowledge in the Internet of Things, IIKI 2019

作者： Liu, Zhiqiang Jiang, Jingfei Lei, Guoqing Chen, Kai Qin, Buyue Zhao, Xiaoqiang Artificial Intelligence Research Center National Innovation Institute of Defense Technology Beijing China National Laboratory for Parallel and Distributed Processing National University of Defense Technology Changsha China College of Computer National University of Defense Technology Changsha China College of System Engineering National University of Defense Technology Changsha China

This paper proposes a heterogeneous processor design for CNN-based AI applications on IoT devices. The heterogeneous processor contains an embedded RISC-V CPU that works as a general processor and an efficient CNN-accelerator that supports a variety of CNN models with a list of macro instructions. For demonstration, we implement a prototype on an FPGA platform with the RISC-V CPU working under 20 MHz and the CNN accelerator working under 100 MHz. As a case study, we run a CNN-based face detection and recognition application on this prototype. The prototype can process one image in 0.72 seconds and an ASIC implementation working under 400 MHz can process one image in less than 0.15 seconds by estimation, which can satisfy the needs for many IoT scenarios such as access control systems and check-in systems. © 2020 The Authors. Published by Elsevier B.V.

关键词： Internet of things

A Survey on Approaches and Applications of Knowledge Representation Learning

学校读者我要写书评

暂无评论

A Survey on Approaches and Applications of Knowledge Represe...

IEEE International Conference on Data science in Cyberspace (DSC)

作者： Chenchen Li Aiping Li Ye Wang Hongkui Tu Yichen Song College of Computer National University of Defense Technology ChangSha China College of Computer Science and Technology on Parallel and Distributed Processing Laboratory National University of Defense Technology ChangSha China

ISBN: (数字)9781728195582

ISBN: (纸本)9781728195599

Knowledge representation learning (KRL) is one of the important research topics in artificial intelligence and Natural language processing. It can efficiently calculate the semantics of entities and relations in a low-dimensional space, and effectively solve the problem of data sparsity, which significantly improve the performance of knowledge acquisition, fusion and reasoning and so on. Starting from the five perspectives of distance-based, semantic matching, bilinear-based, neural network model and additional information model, this paper first introduces the overall framework and specific model design, and then correspondingly introduces the experimental evaluation tasks, metrics and benchmark datasets of each model. On this basis, how to apply KRL to various downstream tasks is summarized.

关键词：

Mini-batch cutting plane method for regularized risk minimization

学校读者我要写书评

暂无评论

Frontiers of Information technology & Electronic Engineering 2019年第11期20卷 1551-1563页

作者： Meng-long LU Lin-bo QIAO Da-wei FENG Dong-sheng LI Xi-cheng LU Science and Technology on Parallel and Distributed Laboratory National University of Defense TechnologyChangsha 410073China

Although concern has been recently expressed with regard to the solution to the non-convex problem, convex optimization is still important in machine learning, especially when the situation requires an interpretable model. Solution to the convex problem is a global minimum, and the final model can be explained mathematically. Typically, the convex problem is re-casted as a regularized risk minimization problem to prevent overfitting. The cutting plane method (CPM) is one of the best solvers for the convex problem, irrespective of whether the objective function is differentiable or not. However, CPM and its variants fail to adequately address large-scale data-intensive cases because these algorithms access the entire dataset in each iteration, which substantially increases the computational burden and memory cost. To alleviate this problem, we propose a novel algorithm named the mini-batch cutting plane method (MBCPM), which iterates with estimated cutting planes calculated on a small batch of sampled data and is capable of handling large-scale problems. Furthermore, the proposed MBCPM adopts a "sink" operation that detects and adjusts noisy estimations to guarantee convergence. Numerical experiments on extensive real-world datasets demonstrate the effectiveness of MBCPM, which is superior to the bundle methods for regularized risk minimization as well as popular stochastic gradient descent methods in terms of convergence speed.

关键词： Machine learning Optimization methods Gradient methods Cutting plane method

A mesh quality discrimination method based on convolutional neural network

学校读者我要写书评

暂无评论

A mesh quality discrimination method based on convolutional ...

IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA)

作者： Zhenpeng Xu Xinhai Chen Lihua Chi Jie Liu Chunye Gong Science and Technology on Parallel and Distributed Processing Laboratory & Laboratory of Software Engineering for Complex Systems National University of Defense Technology Changsha China College of Computer Science and Electronic Engineering Hunan University Changsha China

ISBN: (数字)9781728170053

ISBN: (纸本)9781728170060

With the rapid development of highperformance computing, computational fluid dynamics (CFD) has become an important part of hydrodynamics and aerodynamics. Mesh quality is the key factor that affects the accuracy and efficiency of CFD numerical calculation. However, the current the process of mesh quality discrimination is very time-consuming. The manpower time needed for this process takes up a large proportion in the whole numerical calculation process. A large number of artificial intelligence algorithms have been put forward to replace the human to efficiently complete all kinds of tedious tasks. In this paper, we propose a convolutional neural network (CNN) based mesh quality discrimination method, MeshNet. MeshNet uses residual neural network structure to learn mesh features and automatically judge the mesh quality. The experimental results show that the proposed network can greatly save labor time cost and achieve an accuracy of 94.41% for mesh quality discrimination.

关键词： Convolution Computational fluid dynamics Convolutional neural networks Jacobian matrices Artificial intelligence distributed processing Software engineering

Quantifying robustness to adversarial word substitutions

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Yuting Huang, Pei Ma, Fei Fei Cao, Juan Zhang, Meishan Zhang, Jian Li, Jintao Key Lab Of Intelligent Information Processing Institute Of Computing Technology Chinese Academy Of Sciences Beijing100190 China University Of Chinese Academy Of Sciences Beijing100049 China Beijing100190 China Laboratory Of Parallel Software And Computational Science ISCAS Beijing100190 China China

Deep-learning-based NLP models are found to be vulnerable to word substitution perturbations. Before they are widely adopted, the fundamental issues of robustness need to be addressed. Along this line, we propose a formal framework to evaluate word-level robustness. First, to study safe regions for a model, we introduce robustness radius which is the boundary where the model can resist any perturbation. As calculating the maximum robustness radius is computationally hard, we estimate its upper and lower bound. We repurpose attack methods as ways of seeking upper bound and design a pseudo-dynamic programming algorithm for a tighter upper bound. Then verification method is utilized for a lower bound. Further, for evaluating the robustness of regions outside a safe radius, we reexamine robustness from another view: quantification. A robustness metric with a rigorous statistical guarantee is introduced to measure the quantification of adversarial examples, which indicates the model's susceptibility to perturbations outside the safe radius. The metric helps us figure out why state-of-the-art models like BERT can be easily fooled by a few word substitutions, but generalize well in the presence of real-world noises. Copyright © 2022, The Authors. All rights reserved.

关键词： Dynamic programming