This paper models a platooning system consisting of trucks and a third-party service provider (TPSP), which performs platoon coordination, distributes the platooning profit in platoons, and charges trucks in exchange ...
详细信息
In this paper, we aim to study safety specifications for a Markov decision process with stochastic stopping time in an almost model-free setting. Our approach involves characterizing a proxy set of the states that are...
In this paper, we aim to study safety specifications for a Markov decision process with stochastic stopping time in an almost model-free setting. Our approach involves characterizing a proxy set of the states that are near in a probabilistic sense to the set of unsafe states - forbidden set. We also provide results that relate safety function with reinforcement learning. Consequently, we develop an online algorithm based on the temporal difference method to compute the safety function. Finally, we provide simulation results that demonstrate our work in a simple example.
We propose a compositional framework for the stochastic safety of distributed Markov Decision Processes (MDPs) and Partially Observable Markov Decision Processes (POMDPs). We use MDP and POMDPs and their distributed v...
We propose a compositional framework for the stochastic safety of distributed Markov Decision Processes (MDPs) and Partially Observable Markov Decision Processes (POMDPs). We use MDP and POMDPs and their distributed versions as an appropriate modelling paradigm for computational ecosystems, understood in the context of distributed systems. We extend our work on stochastic safety from MDPs to POMDPs, and then to networked MDP/POMDPs. We propose a unifying mathematical framework for stochastic safety for MDPs, their partially observable version and their composition.
This paper addresses the output tracking problem of network control systems (NCSs) with random communication constraints, especially when the lower bound of the time delay induced by random communication constraints i...
详细信息
ISBN:
(数字)9789887581598
ISBN:
(纸本)9798331540845
This paper addresses the output tracking problem of network control systems (NCSs) with random communication constraints, especially when the lower bound of the time delay induced by random communication constraints is relatively large. Firstly, the output tracking problem is converted into the stabilization problem of an augmented system. Then, a networked predictive output tracking control scheme with time-varying control gains is proposed to compensate for the impact of the communication constraints so as to complete the desired output tracking performance under the large time delays. And, a set of control gains are calculated for each different time delay, which improves the adaptability of NCSs to time delays. Next, a sufficient condition is derived to keep the system stability. Finally, the effectiveness of the proposed method is verified by numerical simulations.
The problems associated with the operation of overhead power lines and ways of improving control over their condition with the help of UAVs are considered. A structural diagram of the system of technical diagnostics o...
详细信息
Inspired by box jellyfish that has distributed and complementary perceptive system,we seek to equip manipulator with a camera and an Inertial Measurement Unit(IMU)to perceive ego motion and surrounding unstructured **...
详细信息
Inspired by box jellyfish that has distributed and complementary perceptive system,we seek to equip manipulator with a camera and an Inertial Measurement Unit(IMU)to perceive ego motion and surrounding unstructured *** robot perception,a reliable and high-precision calibration between camera,IMU and manipulator is a critical *** paper introduces a novel calibration ***,we seek to correlate the spatial relationship between the sensing units and manipulator in a joint ***,the manipulator moving trajectory is elaborately designed in a spiral pattern that enables full excitations on yaw-pitch-roll rotations and x-y-z translations in a repeatable and consistent *** calibration has been evaluated on our collected visual inertial-manipulator *** systematic comparisons and analysis indicate the consistency,precision and effectiveness of our proposed calibration method.
The article provides a theoretical analysis of the ultrahigh frequency (microwave) method of humidity measurement, discusses the problems of instrumentation of the method in question, and proposes a scheme of an exper...
The article provides a theoretical analysis of the ultrahigh frequency (microwave) method of humidity measurement, discusses the problems of instrumentation of the method in question, and proposes a scheme of an experimental installation. Bulk cotton materials were selected as the objects of research. The electromagnetic wave radiation is analyzed during measurement and the evaluation of electrophysical characteristics requires the study of the functional dependence of the amplitude and phase shift on the mass ratio of humidity, mathematical models for various bulk cotton materials describing the joint effect of humidity, material density on the attenuation and phase shift of the passing wave are obtained.
The first course of control is under a critical review. Both the teaching material covered and the teaching methods require new considerations. Introducing interactivity in the education process makes the learning mor...
详细信息
ISBN:
(数字)9798331541811
ISBN:
(纸本)9798331541828
The first course of control is under a critical review. Both the teaching material covered and the teaching methods require new considerations. Introducing interactivity in the education process makes the learning more successful and enjoyable. MATLAB provides an effective environment for learning and applying different disciplines. control101 is a new MATLAB toolbox under development which provides tools for interactive learning of control disciplines. This paper presents the framework for teaching discrete control algorithms applied for processes containing large dead times.
The paper deals with the problems of grain wounding requires large energy costs, requiring a multi-stage process of grain processing, installation and perfect and reliable automation systems for the storage and proces...
The paper deals with the problems of grain wounding requires large energy costs, requiring a multi-stage process of grain processing, installation and perfect and reliable automation systems for the storage and processing of raw materials, theoretical and experimental studies and the results of the use of the microwave method in measuring the moisture content of grain and grain materials. The method under consideration is based on the principle of selective absorption of microwave radiation energy by water in materials and its derivatives. By the degree of absorption of radiation, the concentration of moisture is judged. The paper investigates the amplitude and phase methods of the passing wave in free space. The influence of the elastic properties of the material under study on the electrical characteristics of the microwave wave, suggesting fundamentally new ways of measuring the attenuation and phase shift of the electromagnetic wave, including discrete conversion of the signal of the primary converter, which does not require rigid metrological support and the use of a phase shift, is substantiated. Information on the values of the thickness of the material is analyzed in order to correct the influence of this value, consisting of two parameters: the signal of the passing wave, the attenuation and phase shift which characterizes the humidity and the additional signal - the phase wave reflected from the front surface of the materials and carrying information about its thickness.
In this paper, we consider the problem of safety assessment for Markov decision processes without explicit knowledge of the model. We aim to learn probabilistic safety specifications associated with a given policy wit...
详细信息
暂无评论