The multi-armed restless bandit problem is studied in the case where the pay-off distributions are stationary phi-mixing. This version of the problem provides a more realistic model for most real-world applications, b...
详细信息
The multi-armed restless bandit problem is studied in the case where the pay-off distributions are stationary phi-mixing. This version of the problem provides a more realistic model for most real-world applications, but cannot be optimally solved in practice, since it is known to be PSPACE-hard. The objective of this paper is to characterize a sub-class of the problem where good approximate solutions can be found using tractable approaches. Specifically, it is shown that under some conditions on the phi-mixing coefficients, a modified version of UCB can prove effective. The main challenge is that, unlike in the i.i.d. setting, the distributions of the sampled pay-offs may not have the same characteristics as those of the original bandit arms. In particular, the phi-mixing property does not necessarily carry over. This is overcome by carefully controlling the effect of a sampling policy on the pay-off distributions. Some of the proof techniques developed in this paper can be more generally used in the context of online sampling under dependence. Proposed algorithms are accompanied with corresponding regret analysis.
Regularization by denoising (RED) is a powerful framework for solving imaging inverse problems. Most RED algorithms are iterative batch procedures, which limits their applicability to very large datasets. In this pape...
详细信息
ISBN:
(纸本)9781728150239
Regularization by denoising (RED) is a powerful framework for solving imaging inverse problems. Most RED algorithms are iterative batch procedures, which limits their applicability to very large datasets. In this paper, we address this limitation by introducing a novel online RED (On-RED) algorithm, which processes a small subset of the data at a time. We establish the theoretical convergence of On-RED in convex settings and empirically discuss its effectiveness in non-convex ones by illustrating its applicability to phase retrieval. Our results suggest that On-RED is an effective alternative to the traditional RED algorithms when dealing with large datasets.
This paper addresses the challenge of Chinese cleft structures, involving a pairing of the particles shi and de, which in different combinations display a variety of focus-related effects and different potentials for ...
详细信息
This paper addresses the challenge of Chinese cleft structures, involving a pairing of the particles shi and de, which in different combinations display a variety of focus-related effects and different potentials for ambiguity: clefts and pseudo-clefts in particular differ only in order of the elements. We argue that retaining conventional assumptions necessarily involves positing unrelated structures and multiple ambiguities, leaving the systematicity of variation unexplained;and we go on to argue that it is only by turning to a dynamic framework in which syntax is defined as mechanisms for incremental build-up of interpretation that an integrated characterisation of these effects is made possible. Adopting the Dynamic Syntax framework (Cann etal 2005), we argue that shi and de induce procedures for incremental build-up of construal which feed and can be fed by other such procedures;and we show how the array of effects both in clefts and pseudo-clefts can be shown to follow from the dynamics of building up interpretation reflecting onlineprocessing.
The article offers information on the development of data-driven control (DDC) and learning systems. Topics discussed include method in which controller is designed by using online or offline data obtained from contro...
详细信息
The article offers information on the development of data-driven control (DDC) and learning systems. Topics discussed include method in which controller is designed by using online or offline data obtained from controlled system or dataprocessing; virtual equivalent dynamic linearization as a fundamental tool for the modelfree adaptive control; and output estimation problems for industrial process reported by finite impulse response model.
The state analysis method of a traditional distribution network operation is strictly dependent on the physical model of itself, but it varies as the geography changes, and it is difficult to find the abnormal state o...
详细信息
The state analysis method of a traditional distribution network operation is strictly dependent on the physical model of itself, but it varies as the geography changes, and it is difficult to find the abnormal state of a district network on real-time, especially the sudden change caused by the distributed energy and EV load. So, a method of the abnormal state detecting for the distribution network is proposed based on the maximum and minimum eigenvalues. Firstly, a high-dimensional random matrix is established by the big data from the distribution network management system to take abnormal state detection through a real-time sliding window. Then, themaximum and minimum eigenvalues of the distribution network are gained by calculating the sample covariancematrix of the random matrix and determining the maximum and minimum eigenvalues of the latter matrix. Finally, an 1177-node testing system was taken as an example, and the simulation results showed that the proposed method could detect the abnormal state in real-time without depending on the physical model and fault type of the grid.
Persistent scatterer interferometry (PS-InSAR) is a common technique used in surface motion estimation. However, it is not easy to fully analyse the results, especially for non-experts. Due to the complexity of the fo...
详细信息
Persistent scatterer interferometry (PS-InSAR) is a common technique used in surface motion estimation. However, it is not easy to fully analyse the results, especially for non-experts. Due to the complexity of the formation of Persistent Scatterers (PS) points as well as the large difference in scale and time-series characteristics, it is necessary to develop new visualization methods for a better understanding and analysis of PS-InSAR data. In this article, we implement a dynamic online visualization for PS-InSAR surface motion estimation results using WebGL. A 3D interactive visualization method gives users vivid experiences with interactive operations so that they can easily observe scene details. Animation is used to show the development of surface motion over time as estimated using PS-InSAR, presenting results in an intuitive way through scientific visualization methods. online visualization through our application makes PS-InSAR results accessible and relevant to dispersed users from diverse domains.
In many practical engineering applications, data are usually collected in online pattern. However, if the classes of these data are severely imbalanced, the classification performance will be restricted. In this paper...
详细信息
In many practical engineering applications, data are usually collected in online pattern. However, if the classes of these data are severely imbalanced, the classification performance will be restricted. In this paper, a novel classification approach is proposed to solve the onlinedata imbalance problem by integrating a fast and efficient learning algorithm, that is, Extreme Learning Machine (ELM), and a typical sampling strategy, that is, the synthetic minority oversampling technique (SMOTE). To reduce the severe imbalance, the granulation division for major-class samples is made according to the samples' distribution characteristic, and the original samples are replaced by the obtained granule core to prepare a balanced sample set. In online stage, we firstly make granulation division for minor-class and then conduct oversampling using SMOTE in the region around granule core and granule border. Therefore, the training sample set is gradually balanced and the online ELM model is dynamically updated. We also theoretically introduce fuzzy information entropy to prove that the proposed approach has the lower bound of model reliability after undersampling. Numerical experiments are conducted on two different kinds of datasets, and the results demonstrate that the proposed approach outperforms some state-of-the-art methods in terms of the generalization performance and numerical stability.
Effects of Field Independence, Computer Experience, and Dynamic Pictorial online Help Presentations on Learning Application Function in a Graphical User Interface by Tyler, John Gordon; published by Gainesville, Fl,
Effects of Field Independence, Computer Experience, and Dynamic Pictorial online Help Presentations on Learning Application Function in a Graphical User Interface by Tyler, John Gordon; published by Gainesville, Fl,
Applications of on-Line Computers to Library Problems : Papers Presented at the 1972 Clinic on Library Applications of dataprocessing, April 30-May 3, 1972 by Clinic on Library Applications of dataprocessing (9Th : ...
详细信息
Applications of on-Line Computers to Library Problems : Papers Presented at the 1972 Clinic on Library Applications of dataprocessing, April 30-May 3, 1972 by Clinic on Library Applications of dataprocessing (9Th : 1972 : University of Illinois); University of Illinois (Urbana-Champaign Campus). Graduate School of Library Science; Lancaster, F. Wilfrid (Frederick Wilfrid), 1933-; published by Urbana, Ill. : University of Illinois, Graduate School of Library Science
暂无评论