检索结果-内蒙古大学图书馆

online data processing: Comparison of Bayesian regularized particle filters

ELECTRONIC JOURNAL OF STATISTICS 2009年第none期3卷 239-258页

作者： Casarin, Roberto Marin, Jean-Michel Univ Montpellier 2 Inst Math & Modelisat F-34095 Montpellier 5 France Univ Brescia Dept Econ I-25122 Brescia Italy

The aim of this paper is to compare three regularized particle filters in an online data processing context. We carry out the comparison in terms of hidden states filtering and parameter estimation, considering a Bayesian paradigm and a univariate Stochastic Volatility (SV) model. We discuss the use of an improper prior distribution in the initialization of the filtering procedure and show that the regularized Auxiliary Particle Filter (APE) outperforms the regularized Sequential Importance Sampling (SIS) and the regularized Sampling Importance Resampling (SIR).

关键词： online data processing Bayesian estimation regularized particle filters Stochastic Volatility models

来源：评论

学校读者我要写书评

暂无评论

The Essence of online data processing

引用

PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL 2022年第OOPSLA期6卷 899–928页

作者： Dexter, Philip Liu, Yu David Chiu, Kenneth State Univ New York SUNY 4400 Vestal Pkwy East Binghamton NY 13902 USA

data processing systems are a fundamental component of the modern computing stack. These systems are routinely deployed online: they continuously receive the requests of data processing operations, and continuously return the results to end users or client applications. online data processing systems have unique features beyond conventional data processing, and the optimizations designed for them are complex, especially when data themselves are structured and dynamic. This paper describes DON Calculus, the first rigorous foundation for online data processing. It captures the essential behavior of both the backend data processing engine and the frontend application, with the focus on two design dimensions essential yet unique to online data processing systems: incremental operation processing (IOP) and temporal locality optimization (TLO). A novel design insight is that the operations continuously applied to the data can be defined as an operation stream flowing through the data structure, and this abstraction unifies diverse designs of IOP and TLO in one calculus. DON Calculus is endowed with a mechanized metatheory centering around a key observable equivalence property: despite the significant non-deterministic executions introduced by IOP and TLO, the observable result of DON Calculus data processing is identical to that of conventional data processing without IOP and TLO. Broadly, DON Calculus is a novel instance in the active pursuit of providing rigorous guarantees to the software system stack. The specification and mechanization of DON Calculus provide a sound base for the designers of future data processing systems to build upon, helping them embrace rigorous semantic engineering without the need of developing from scratch.

关键词： Formal Reasoning online data processing Incremental Evaluation online data Optimization

来源：评论

学校读者我要写书评

暂无评论

OPTIMAL-CONTROL OF AXIAL XENON OSCILLATION IN PWR BASED ON online data-processing OF AXIAL OFFSETS

JOURNAL OF THE ATOMIC ENERGY SOCIETY OF JAPAN

引用

JOURNAL OF THE ATOMIC ENERGY SOCIETY OF JAPAN 1991年第3期33卷 280-285页

作者： SHIMAZU, Y KANAGAWA, T Mitsubishi At. Power Ind. Inc.

In a large pressurized water reator (PWR), xenon oscillations can occur due to the variation of xenon distribution in the reactor. Horizontal and axial modes of oscillation are known. The former is of less concern because of its convergence but the latter can be divergent. Sometimes xenon oscillations are intentionally introduced to obtain recalibration data for the nuclear instrumentation system and in this case oscillations must be eliminated after the data acquisition as soon as possible. Many studies and experiments have been made on control of xenon oscillations, and this problem was solved clearly from the theoretical points of view on the reactor physics and control. However it is found that fine control is required within actual plant constraints to apply the principles and control laws to be indicated from the previous studies. From this point of view a new method has been developed for providing clear operating instructions to the reactor operator. Here, the new method is based on online data processing of axial offsets and the validity of the method has been evaluated through numerical simulations. Then the method has been applied to the experiments in actual PWRs and it has also been proved to be quite effective.

关键词： PWR TYPE REACTORS XENON INDUCED SPATIAL OSCILLATIONS XENON OSCILLATIONS OPTIMAL CONTROL METHOD AXIAL OFFSET XENON IODINE online data processing NUCLEAR INSTRUMENTATION SYSTEM online CONTROL SYSTEMS PERFORMANCE

来源：评论

学校读者我要写书评

暂无评论

RDMA data transfer and GPU acceleration methods for high-throughput online processing of serial crystallography images

引用

JOURNAL OF SYNCHROTRON RADIATION 2020年第5期27卷 1297-1306页

作者： Ponsard, Raphael Janvier, Nicolas Kieffer, Jerome Houzet, Dominique Fristot, Vincent ESRF European Synchrotron 71 Ave Martyrs F-38000 Grenoble France Grenoble Alpes Univ GIPSALAB 11 Rue Math F-38400 St Martin Dheres France

The continual evolution of photon sources and high-performance detectors drives cutting-edge experiments that can produce very high throughput data streams and generate large data volumes that are challenging to manage and store. In these cases, efficient data transfer and processing architectures that allow online image correction, data reduction or compression become fundamental. This work investigates different technical options and methods for data placement from the detector head to the processing computing infrastructure, taking into account the particularities of modern modular high-performance detectors. In order to compare realistic figures, the future ESRF beamline dedicated to macromolecular X-ray crystallography, EBSL8, is taken as an example, which will use a PSI JUNGFRAU 4M detector generating up to 16 GB of data per second, operating continuously during several minutes. Although such an experiment seems possible at the target speed with the 100 Gb s(-1) network cards that are currently available, the simulations generated highlight some potential bottlenecks when using a traditional software stack. An evaluation of solutions is presented that implements remote direct memory access (RDMA) over converged ethernet techniques. A synchronization mechanism is proposed between a RDMA network interface card (RNIC) and a graphics processing unit (GPU) accelerator in charge of the online data processing. The placement of the detector images onto the GPU is made to overlap with the computation carried out, potentially hiding the transfer latencies. As a proof of concept, a detector simulator and a backend GPU receiver with a rejection and compression algorithm suitable for a synchrotron serial crystallography (SSX) experiment are developed. It is concluded that the available transfer throughput from the RNIC to the GPU accelerator is at present the major bottleneck in online processing for SSX experiments.

关键词： online data processing RDMA RoCEv2 GPU SSX online data analysis

来源：评论

学校读者我要写书评

暂无评论

A horizontally scalable online processing system for trigger-less data acquisition

引用

NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT 2022年 1036卷

作者： Migliorini, Matteo Pazzini, Jacopo Triossi, Andrea Zanetti, Marco Zucchetta, Alberto Padova Univ Dept Phys & Astron Galileo Galilei Via Marzolo 8 I-35131 Padua Italy Natl Inst Nucl Phys Padova Div Via Marzolo 8 I-35131 Padua Italy

The vast majority of high energy physics experiments rely on data acquisition and hardware-based trigger systems performing a number of stringent selections before storing data for offline analysis. The online reconstruction and selection performed at the trigger level are bound to the synchronous nature of the data acquisition system, resulting in a trade-off between the amount of data collected and the complexity of the online reconstruction performed. Exotic physics processes, such as long-lived and slow-moving particles, are rarely targeted by online triggers as they require complex and nonstandard online reconstruction, usually incompatible with the time constraints of most data acquisition systems. The online trigger selection can thus impact as one of the main limiting factors to the experimental reach for exotic signatures. Alternative data acquisition solutions based on the continuous and asynchronous processing of the stream of data from the detectors are therefore foreseeable as a way to extend the experimental physics reach. Trigger-less data readout systems, paired with efficient streaming data processing solutions, can provide a viable alternative. In this document, an end-to-end implementation of a fully trigger-less data acquisition and online data processing system is discussed. An easily scalable and deployable implementation of such an architecture is proposed, based on open-source distributed computing frameworks capable of performing asynchronous online processing of streaming data. The proposed schema can be suitable for deployment as a fully integrated data acquisition system for small-scale experimental apparatus, or to complement the trigger-based data acquisition systems of larger experiments. A muon telescope setup consisting of a set of gaseous detectors is used as the experimental development testbed in this work, and a fully integrated online processing pipeline deployed on cloud computing resources is implemented and described.

关键词： data acquisition Trigger online data processing

来源：评论

学校读者我要写书评

暂无评论

Autopilot: An online data Acquisition Control System for the Enhanced High-Throughput Characterization of Intact Proteins

引用

ANALYTICAL CHEMISTRY 2014年第3期86卷 1485-1492页

作者： Durbin, Kenneth R. Fellers, Ryan T. Ntai, Loanna Kelleher, Neil L. Compton, Philip D. Northwestern Univ Dept Chem Evanston IL 60208 USA Northwestern Univ Dept Mol Biosci Evanston IL 60208 USA

The ability to study organisms by direct analysis of their proteomes without digestion via mass spectrometry has benefited greatly from recent advances in separation techniques, instrumentation, and bioinformatics. However, improvements to data acquisition logic have lagged in comparison. Past workflows for Top Down Proteomics (TDPs) have focused on high throughput at the expense of maximal protein coverage and characterization. This mode of data acquisition has led to enormous overlap in the identification of highly abundant proteins in subsequent LC-MS injections. Furthermore, a wealth of data is left underutilized by analyzing each newly targeted species as unique, rather than as part of a collection of fragmentation events on a distinct proteoform. Here, we present a major advance in software for acquisition of TDP data that incorporates a fully automated workflow able to detect intact masses, guide fragmentation to achieve maximal identification and characterization of intact protein species, and perform database search online to yield real-time protein identifications. On Pseudomonas aeruginosa, the software combines fragmentation events of the same precursor with previously obtained fragments to achieve improved characterization of the target form by an average of 42 orders of magnitude in confidence. When HCD fragmentation optimization Was applied to intact proteins ions, there was an 18.5 order of magnitude gain in confidence. These improved metrics set the stage for increased proteome coverage and characterization of higher order organisms in the future for sharply improved control over MS instruments in a project- and lab-wide context.

关键词： AUTOPILOT (Computer program language) online data processing RESEARCH data acquisition systems PROTEOMICS PSEUDOMONAS aeruginosa

来源：评论

学校读者我要写书评

暂无评论

online dynamic flat-field correction for MHz microscopy data at European XFEL

引用

JOURNAL OF SYNCHROTRON RADIATION 2023年第6期30卷 1030-1037页

作者： Birnsteinova, Sarlota de Lima, Danilo E. Ferreira Sobolev, Egor Kirkwood, Henry J. Bellucci, Valerio Bean, Richard J. Kim, Chan Koliyadu, Jayanath C. P. Sato, Tokushi Dall'Antonia, Fabio Asimakopoulou, Eleni Myrto Yao, Zisheng Buakor, Khachiwan Zhang, Yuhe Meents, Alke Chapman, Henry N. Mancuso, Adrian P. Villanueva-Perez, Pablo Vagovic, Patrik European XFEL GmbH Schenefeld Germany Lund Univ Synchrotron Radiat Res & NanoLund Lund Sweden DESY Ctr Free Electron Laser Sci CFEL Hamburg Germany Univ Hamburg Hamburg Germany Diamond Light Source Ltd Harwell Sci & Innovat Campus Harwell OX11 0DE Berks England La Trobe Univ La Trobe Inst Mol Sci Dept Chem & Phys Melbourne Vic Australia

The high pulse intensity and repetition rate of the European X-ray Free-Electron Laser (EuXFEL) provide superior temporal resolution compared with other X-ray sources. In combination with MHz X-ray microscopy techniques, it offers a unique opportunity to achieve superior contrast and spatial resolution in applications demanding high temporal resolution. In both live visualization and offline data analysis for microscopy experiments, baseline normalization is essential for further processing steps such as phase retrieval and modal decomposition. In addition, access to normalized projections during data acquisition can play an important role in decision-making and improve the quality of the data. However, the stochastic nature of X-ray free-electron laser sources hinders the use of standard flat-field normalization methods during MHz X-ray microscopy experiments. Here, an online (i.e. near real-time) dynamic flat-field correction method based on principal component analysis of dynamically evolving flat-field images is presented. The method is used for the normalization of individual X-ray projections and has been implemented as a near real-time analysis tool at the Single Particles, Clusters, and Biomolecules and Serial Femtosecond Crystallography (SPB/SFX) instrument of EuXFEL.

关键词： MHz X-ray microscopy flat-field correction online data processing X-ray free-electron laser

来源：评论

学校读者我要写书评

暂无评论

A Novel SMOTE-Based Classification Approach to online data Imbalance Problem

引用

MATHEMATICAL PROBLEMS IN ENGINEERING 2016年第1期2016卷 p1-14页

作者： Gong, Chunlin Gu, Liangxian Northwestern Polytech Univ Youyi West Rd 127 Xian 710072 Peoples R China Natl Aerosp Flight Dynam Key Lab Youyi West Rd 127 Xian 710072 Peoples R China

In many practical engineering applications, data are usually collected in online pattern. However, if the classes of these data are severely imbalanced, the classification performance will be restricted. In this paper, a novel classification approach is proposed to solve the online data imbalance problem by integrating a fast and efficient learning algorithm, that is, Extreme Learning Machine (ELM), and a typical sampling strategy, that is, the synthetic minority oversampling technique (SMOTE). To reduce the severe imbalance, the granulation division for major-class samples is made according to the samples' distribution characteristic, and the original samples are replaced by the obtained granule core to prepare a balanced sample set. In online stage, we firstly make granulation division for minor-class and then conduct oversampling using SMOTE in the region around granule core and granule border. Therefore, the training sample set is gradually balanced and the online ELM model is dynamically updated. We also theoretically introduce fuzzy information entropy to prove that the proposed approach has the lower bound of model reliability after undersampling. Numerical experiments are conducted on two different kinds of datasets, and the results demonstrate that the proposed approach outperforms some state-of-the-art methods in terms of the generalization performance and numerical stability.

关键词： online data processing PROBLEM solving MACHINE learning DISTRIBUTION (Probability theory) FUZZY logic ENTROPY (Information theory)

来源：评论

学校读者我要写书评

暂无评论

The Microanalysis of online data: The next stage

引用

JOURNAL OF PRAGMATICS 2017年 115卷 37-41页

作者： Giles, David Stommel, Wyke Paulus, Trena M. Univ Winchester Dept Psychol West Hill Winchester SO22 4NR Hants England Radboud Univ Nijmegen Ctr Language Studies Erasmuspl 1 NL-6500 HD Nijmegen Netherlands Univ Georgia Qualitat Res Program 310 Rivers Crossing850 Coll Stn Rd Athens GA 30606 USA

来源：评论

学校读者我要写书评

暂无评论

Comparison between protein-polyethylene glycol (PEG) interactions and the effect of PEG on protein-protein interactions using the liquid-liquid phase transition

引用

JOURNAL OF PHYSICAL CHEMISTRY B 2007年第5期111卷 1222-1230页

作者： Wang, Ying Annunziata, Onofrio Texas Christian Univ Dept Chem Ft Worth TX 76129 USA

Phase transitions of protein aqueous solutions are important for protein crystallization and biomaterials science in general. One source of thermodynamic complexity in protein solutions and their phase transitions is the required presence of additives such as polyethylene glycol (PEG). To investigate the effects of PEG on the thermodynamic behavior of protein solutions, we report measurements on the liquid-liquid phase separation (LLPS) of aqueous bovine serum albumin (BSA) in the presence of relatively small amounts of PEG with an average molecular weight of 1450 g/mol (PEG1450) as a model system. We experimentally characterize two thermodynamically independent properties of the phase boundary: (1) the effect of PEG1450 concentration on the LLPS temperature, (2) BSA/PEG1450 partitioning in the two liquid coexisting phases. We then use a thermodynamic perturbation theory to relate the first property to the effect of PEG concentration on protein-protein interactions and the second property to protein-PEG interactions. As criteria to determine the accuracy of a microscopic model, we examine the model's ability to describe both experimental thermodynamic properties. We believe that the parallel examination of these two properties is a valuable tool for verifying the validity of existing models and for developing more accurate ones. For our system, we have found that a depletion-interaction model satisfactorily explains both protein-PEG interactions and the effect of PEG concentration on protein-protein interactions. Finally, due to the general importance of LLPS, we will experimentally show that protein-PEG-buffer mixtures can exhibit two distinct types of liquid-liquid phase transitions.

关键词： online data processing POLYETHYLENE glycol POLYOLS ETHYLENE glycol

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：