Learning control of dynamical systems based on Markov decision processes (MDPs) is an interdisciplinary research area of machine learning, control theory, and operations research. The main objective in this research a...
详细信息
Coupled nonlinear dynamical systems have been widely studied recently. However, the dynamical properties of these systems are difficult to deal with. The local activity of cellular neural network (CNN) has provided a ...
详细信息
Coupled nonlinear dynamical systems have been widely studied recently. However, the dynamical properties of these systems are difficult to deal with. The local activity of cellular neural network (CNN) has provided a powerful tool for studying the emergence of complex patterns in a homogeneous lattice, which is composed of coupled cells. In this paper, the analytical criteria for the local activity in reaction-diffusion CNN with five state variables and one port are presented, which consists of four theorems, including a serial of inequalities involving CNN parameters. These theorems can be used for calculating the bifurcation diagram to determine or analyze the emergence of complex dynamic patterns, such as chaos. As a case study, a reaction-diffusion CNN of hepatitis B Virus (HBV) mutation-selection model is analyzed and simulated, the bifurcation diagram is calculated. Using the diagram, numerical simulations of this CNN model provide reasonable explanations of complex mutant phenomena during therapy. Therefore, it is demonstrated that the local activity of CNN provides a practical tool for the complex dynamics study of some coupled nonlinear systems.
This issue marks the beginning of the IEEE Transactions on Neural Networks and Learning systems (TNNLS). By adding «Learning systems» to the title, we now state explicitly the scope of the TRANSACTIONS to in...
详细信息
Radio fingerprint matching localization method promises high localization accuracy but requires extensive infrastructural effort and search operations. This paper proposes a new search strategy for radio fingerprint m...
详细信息
In this paper, we study the budget-constrained bidding problems in sponsored search. Our findings illustrate that, compared to budget-irrespective bidding, advertisers can obtain equal even better return-on-investment...
详细信息
In this paper, we study the budget-constrained bidding problems in sponsored search. Our findings illustrate that, compared to budget-irrespective bidding, advertisers can obtain equal even better return-on-investment (ROI) when considering theirs and the competitor's budget constrains.
Reinforcement learning aims to obtain optimal/suboptimal strategy through trial-and-error and interaction with dynamic environment. After an introduction of basic knowledge of reinforcement learning, TD algorithm, Q-l...
详细信息
ISBN:
(纸本)9789881563811
Reinforcement learning aims to obtain optimal/suboptimal strategy through trial-and-error and interaction with dynamic environment. After an introduction of basic knowledge of reinforcement learning, TD algorithm, Q-learning algorithm, Dyna algorithm and Sarsa algorithm base on Markov decision model are discussed, respectively. Moreover, reinforcement learning based on partially observable Markov decision process and semi-Markov decision model for uncertain environment are analyzed, respectively. The research status of Q learning in the field of multi-robot systems is also presented. Finally, the main challenges and further research work are given.
Internet as the fertile ground of free speech, everyone can express their emotions, cognition and views of things via the internet, especially in the era of Web2.0, the occurrence of blog which provides a wider space ...
详细信息
Internet as the fertile ground of free speech, everyone can express their emotions, cognition and views of things via the internet, especially in the era of Web2.0, the occurrence of blog which provides a wider space for personal speech. Internet provides a broad platform for contemporary college students to express thought and emotion, at the same time it provides a channel for education workers to understand students' thought and mental. Through real-time monitoring information on school area network, we can get real-time status, mood and some dynamic data which can portray characteristics of emotion of the concerned entity; also we can abstract the characterization of psychological crisis information, and use this feature to do data mining on these data. In this way we can find group of students which have tendency of psychological CriSIS, and use corresponding psychological crisis intervention online and offline methods to ease students' psychological crisis and to prevent tragic events in timely.
With the fast development of Internet and its data scale, B2B (Business to Business), whose speed and high availability advantage is based on Internet, is eroding more and more market share of traditional business. In...
详细信息
With the fast development of Internet and its data scale, B2B (Business to Business), whose speed and high availability advantage is based on Internet, is eroding more and more market share of traditional business. In recent years, the new data processing technologies, such as cloud computing, assure the enhancement of computer's computing capacity; it has become possible for researchers to process and analyze the massive business data, including large scale customer data, and large scale commodity information. A new B2B platform frame, based on cloud computing with less running time and better response efficiency, is proposed here to promote transaction handle efficiency. By adoption of complex network theory and cloud computing technology, the new platform has been evaluated to decrease transaction handle time, and make more benefits.
Stripe-based wireless sensor networks can be deployed in many scenarios, such as roads, bridges, tunnels and metros. The deployment of this type of networks must he considered in detailed because the network is charac...
详细信息
ISBN:
(纸本)9781467313988
Stripe-based wireless sensor networks can be deployed in many scenarios, such as roads, bridges, tunnels and metros. The deployment of this type of networks must he considered in detailed because the network is characterized by the long distance and narrow width. The paper gives an analysis of balanced energy consumption deployment of this network. The discussion is presented according to two type of width of network. The main factors which affect the network lifetime are analyzed in detailed and the simulation is presented. The simulation result shows that the short width of networks has little effect on network lifetime. Also, the maximum network lifetime can not be reached when the nodes have short communication radius. The network lifetime can be affected by the long width of networks. The network lifetime can be maximized when the nodes have long communication range.
This paper proposes a novel budget model based on differential game to deal with budget allocation in competitive search advertisements under a finite time horizon, with consideration of budget constraints. We extend ...
详细信息
This paper proposes a novel budget model based on differential game to deal with budget allocation in competitive search advertisements under a finite time horizon, with consideration of budget constraints. We extend the advertising response function with the dynamical advertising effort u and quality score q to fit search advertising scenarios. We also discuss Nash equilibriums of our model, and study some desirable properties of two kinds of equilibriums in the case with budget constraints: "budget-stable" open-loop Nash equilibrium (BS-OLNE) and "budget-unstable" open-loop Nash equilibrium (BUS-OLNE). We have evaluated our budget model and identified properties with computational experiments. Experimental results show that budget strategies with dynamical advertising elasticity are superior to those with fixed one and our findings on OLNEs are helpful for advertisers to make budget decisions.
暂无评论