检索结果-内蒙古大学图书馆

Accurate Q-learning 25th

学校读者我要写书评

暂无评论

Accurate Q-learning

25th International Conference on Neural Information Processing, ICONIP 2018

作者： Hu, Zhihui Jiang, Yubin Ling, Xinghong Liu, Quan School of Computer Science and Technology Soochow University SuzhouJiangsu215006 China Collaborative Innovation Center of Novel Software Technology and Industrialization Nanjing210000 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China

ISBN: (纸本)9783030041816

In order to solve the problem that Q-learning can suffer from large overestimations in some stochastic environments, we first propose a new form of Q-learning, which proves that it is equivalent to the incremental form and analyze the reasons why the convergence rate of Q-learning will be affected by positive bias. We generalize the new form for the purpose of easy adaptations. By using the current value instead of the bias term, we present an accurate Q-learning algorithm and show that the new algorithm converges to an optimal policy. Experimentally, the new algorithm can avoid the effect of positive bias and the convergence rate is faster than Q-learning and its variants on several MDP problems. © Springer Nature Switzerland AG 2018.

关键词： Reinforcement learning

RiWalk: Fast structural node embedding via role identification

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Ma, Xuewei Qin, Geng Qiu, Zhiyang Zheng, Mingxin Wang, Zhe College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbol Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China

Nodes performing different functions in a network have different roles, and these roles can be gleaned from the structure of the network. Learning latent representations for the roles of nodes helps to understand the network and to transfer knowledge across networks. However, most existing structural embedding approaches suffer from high computation and space cost or rely on heuristic feature engineering. Here we propose RiWalk, a flexible paradigm for learning structural node representations. It decouples the structural embedding problem into a role identification procedure and a network embedding procedure. Through role identification, rooted kernels with structural dependencies kept are built to better integrate network embedding methods. To demonstrate the effectiveness of RiWalk, we develop two different role identification methods named RiWalk-SP and RiWalk-WL respectively and employ random walk based network embedding methods. Experiments on within-network classification tasks show that our proposed algorithms achieve comparable performance with other baselines while being an order of magnitude more efficient. Besides, we also conduct across-network role classification tasks. The results show potential of structural embeddings in transfer learning. RiWalk is also scalable, making it capable of capturing structural roles in massive networks. Copyright © 2019, The Authors. All rights reserved.

关键词： Network embeddings

Identification of Cancer Development Related Pathways Based on Co-Expression Analyses

学校读者我要写书评

暂无评论

Identification of Cancer Development Related Pathways Based ...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Hongyang Jiang Zhihang Wang Chaoyi Yin Peishuo Sun Ying Xu Huiyan Sun School of Artificial Intelligence Jilin University Changchun Innovation Group of Marine Engineering Materials and Corrosion Control Southern Marine Science and Engineering Guangdong Laboratory Zhuhai China College of Computer Science and Technology Jilin University Changchun China School of Artificial Intelligence Jilin University Changchun China Computational Systems Biology Lab Institute of Bioinformatics University of Georgia Athens USA School of Artificial Intelligence Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun

ISBN: (数字)9781728162157

ISBN: (纸本)9781728162164

Cancer is a rapidly evolving disease, with complex physiological changes throughout its development. Different patients of the same cancer type may require distinct treatments depending on the level of development. Hence it is essential to identify the genes and biological processes strongly associated with cancer progression to design an effective treatment plan. Our study has found that cancer samples of the same development stage (or grade, subtype) tend to share highly unique co-expression patterns, providing considerably stronger discerning power than differential expressions for cancer staging (and grading, subtyping). Based on this, we have developed a framework for identification and analyses of genes and pathways strongly associated with a cancer's development through identification of co-expression patterns that become increasingly stronger or weaker over cancer samples from early through advanced stages. Functional analyses of such co-expressed genes reveal that (1) cell-cycle, immune response, ribosome, proteasome and oxidative phosphorylation, among others, strongly associate with cancer development, (2) the co-expression patterns among ribosome, proteasome and oxidative phosphorylation genes tend to become increasingly weaker as a cancer advances, for almost all cancer types, and (3) the co-expression patterns among cell cycle and immune response genes tend to become increasingly stronger with cancer progression. We anticipate that co-expression-based analyses like we present here will become a key technique for functional studies of cancer development and evolution.

关键词： Cancer Correlation Indexes Biological processes Physiology Immune system Genetic expression

Hyperbolic node embedding for signed networks

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Song, Wenzhuo Chen, Hongxu Liu, Xueyan Jiang, Hongzhe Wang, Shengsheng College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China Advanced Analytics Institute School of Computer Science Faculty of Engineering and IT University of Technology Sydney NSW2007 Australia College of Mechanical and Electronic Engineering Nanjing Forestry University Nanjing210037 China

Signed network embedding methods aim to learn vector representations of nodes in signed networks. However, existing algorithms only managed to embed networks into low-dimensional Euclidean spaces whereas many intrinsic features of signed networks are reported more suitable for non-Euclidean spaces. For instance, previous works did not consider the hierarchical structures of networks, which is widely witnessed in real-world networks. In this work, we answer an open question that whether the hyperbolic space is a better choice to accommodate signed networks and learn embeddings that can preserve the corresponding special characteristics. We also propose a non-Euclidean signed network embedding method based on structural balance theory and Riemannian optimization, which embeds signed networks into a Poincar ball in a hyperbolic space. This space enables our approach to capture underlying hierarchy of nodes in signed networks because it can be seen as a continuous tree. We empirically compare our method against six Euclidean-based baselines in three tasks on seven real-world datasets, and the results show the effectiveness of our method. Copyright © 2019, The Authors. All rights reserved.

关键词： Geometry

SIoTFog:Byzantine-resilient IoT fog networking

学校读者我要写书评

暂无评论

Frontiers of Information Technology & Electronic engineering 2018年第12期19卷 1546-1557页

作者： Jian-wen XU Kaoru OTA Mian-xiong DONG An-feng LIU Qiang LI Department of Information and Electronic Engineering Muroran Institute of Technology School of Information Science and Engineering Central South University MOE Key Laboratory of Symbol Computation and Knowledge Engineering Jilin University

The current boom in the Internet of Things(IoT) is changing daily life in many ways, from wearable devices to connected vehicles and smart cities. We used to regard fog computing as an extension of cloud computing, but it is now becoming an ideal solution to transmit and process large-scale geo-distributed big data. We propose a Byzantine fault-tolerant networking method and two resource allocation strategies for IoT fog computing. We aim to build a secure fog network, called "SIoTFog," to tolerate the Byzantine faults and improve the efficiency of transmitting and processing IoT big data. We consider two cases, with a single Byzantine fault and with multiple faults, to compare the performances when facing different degrees of risk. We choose latency, number of forwarding hops in the transmission, and device use rates as the metrics. The simulation results show that our methods help achieve an efficient and reliable fog network.

关键词： Byzantine fault tolerance Fog computing Resource allocation Internet of Things(IoT)

A Simplified Rational Representation for Positive-Dimensional Polynomial Systems and SHEPWM Equations Solving

学校读者我要写书评

暂无评论

Journal of Systems Science & Complexity 2017年第6期30卷 1470-1482页

作者： SHANG Baoxin ZHANG Shugong TAN Chang XIA Peng School of Mathematics Key Laboratory of Symbolic Computation and Knowledge Engineering (Ministry of Education) Jilin University College of Science Northeast Electric Power University College of Science Northeast Forestry University School of Mathematics Liaoning University

The paper is concerned with the improvement of the rational representation theory for solving positive-dimensional polynomial systems. The authors simplify the expression of rational representation set proposed by Tan and Zhang(2010), obtain the simplified rational representation with less rational representation sets, and hence reduce the complexity for representing the variety of a positive-dimensional ideal. As an application, the authors compute a "nearly" parametric solution for the SHEPWM problem with a fixed number of switching angles.

关键词： Positive-dimensional polynomial system solving rational univariate representation SHEPWM simplified rational representation

Adversarial sampling and training for semi-supervised information retrieval

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Park, Dae Hoon Chang, Yi Huawei Research America California School of Artificial Intelligence Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education China

Ad-hoc retrieval models with implicit feedback often have problems, e.g., the imbalanced classes in the data set. Too few clicked documents may hurt generalization ability of the models, whereas too many non-clicked documents may harm effectiveness of the models and efficiency of training. In addition, recent neural networkbased models are vulnerable to adversarial examples due to the linear nature in them. To solve the problems at the same time, we propose an adversarial sampling and training framework to learn ad-hoc retrieval models with implicit feedback. Our key idea is (i) to augment clicked examples by adversarial training for better generalization and (ii) to obtain very informational non-clicked examples by adversarial sampling and training. Experiments are performed on benchmark data sets for common ad-hoc retrieval tasks such as Web search, item recommendation, and question answering. Experimental results indicate that the proposed approaches significantly outperformstrong baselines especially for high-ranked documents, and they outperform IRGAN in NDCG@5 using only 5% of labeled data for the Web search task. Copyright © 2018, The Authors. All rights reserved.

关键词： Information retrieval

Graph Bayesian optimization: Algorithms, evaluations and applications

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Cui, Jiaxu Yang, Bo Key Laboratory of Symbolic Computation and Knowledge Engineer Ministry of Education School of Computer Science and Technology Jilin University China

Network structure optimization is a fundamental task in complex network analysis. However, almost all the research on Bayesian optimization is aimed at optimizing the objective functions with vectorial inputs. In this work, we first present a flexible framework, denoted graph Bayesian optimization, to handle arbitrary graphs in the Bayesian optimization community. By combining the proposed framework with graph kernels, it can take full advantage of implicit graph structural features to supplement explicit features guessed according to the experience, such as tags of nodes and any attributes of graphs. The proposed framework can identify which features are more important during the optimization process. We apply the framework to solve four problems including two evaluations and two applications to demonstrate its efficacy and potential applications. Copyright © 2018, The Authors. All rights reserved.

关键词： Complex networks

A Cascaded Co-evolutionary Model for Attribute Reduction and Classification Based on Coordinating Architecture with Bidirectional Elitist Optimization

学校读者我要写书评

暂无评论

Chinese Journal of Electronics 2017年第1期26卷 13-21页

作者： DING Weiping WANG Jiandong LI Yuehua CHENG Xueyun School of Computer Science and Technology Nantong University Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Provincial Key Laboratory for Computer Information Processing Technology Soochow University College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics

A cascaded co-evolutionary model for Attribute reduction and classification based on Coordinating architecture with bidirectional elitist optimization(ARC-CABEO) is proposed for the more practical applications. The regrouping and merging coordinating strategy of ordinary-elitist-role-based population is introduced to represent a more holistic cooperative co-evolutionary framework of different populations for attribute reduction. The master-slave-elitist-based subpopulations are constructed to coordinate the behaviors of different elitists, and meanwhile the elitist optimization vector with the strongest balancing between exploration and exploitation is selected out to expedite the bidirectional attribute co-evolutionary reduction process. In addition, two coupled coordinating architectures and the elitist optimization vector are tightly cascaded to perform the co-evolutionary classification of reduction subsets. Hence the preferring classification optimization goal can be achieved better. Some experimental results verify that the proposed ARC-CABEO model has the better feasibility and more superior classification accuracy on different UCI datasets, compared with representative algorithms.

关键词： Attribute reduction for classification Bidirectional elitist optimization Coordinating architecture Cascaded co-evolutionary model