This paper presents some investigations on tradeoff between exploration and exploitation of opposition-based Q(lambda) with non-Markovian update (NOQ(lambda)) in a dynamic environment. In the previous work the authors...
详细信息
This paper presents some investigations on tradeoff between exploration and exploitation of opposition-based Q(lambda) with non-Markovian update (NOQ(lambda)) in a dynamic environment. In the previous work the authors applied NOQ(lambda) to the deterministic GridWorld problem. In this paper, we have implemented the NOQ(lambda) algorithm for a simple elevator control problem to test the behavior of the algorithm for non-deterministic and dynamic environment. We also extend the NOQ(lambda) algorithm by introducing the opposition weight to find a better tradeoff between exploration and exploitation for the NOQ(lambda) technique. The value of the opposition weight increases as the number of steps increases. Hence, it has more positive effects on the Q-value updates for opposite actions as the learning progresses. The performance of NOQ(lambda) method is compared with Q(lambda) technique. The experiments indicate that NOQ(lambda) performs better than Q(lambda).
Human listeners are able to understand speech in the presence of a noisy background. How to simulate this perceptual ability remains a great challenge. This paper describes a preliminary evaluation of intelligibility ...
详细信息
Batteries in a fuel cell power system are essential to provide the additional load demands during the sharp load transients. This necessitates a power electronics system, which would control the energy flow between th...
详细信息
Batteries in a fuel cell power system are essential to provide the additional load demands during the sharp load transients. This necessitates a power electronics system, which would control the energy flow between the fuel cell stack, the battery and the load during the transient and in the steady-state. In this paper, a cost-effective and efficient power electronic system is proposed for a fuel cell based hybrid power system based on a distributed power electronics topology. The system includes a hierarchical controlling architecture, in which the master control optimizes the control parameters of the individual subsystem controls, which in turn optimizes the performance and efficiency of the overall system while nullifying the effects of load transients on the fuel cell stack subsystem. The power electronics system concept is further experimentally validated using a four module bidirectional DC-DC converter with Nexa PEM stack.
In this paper, the scattering parameters of blackbox multiport networks are pre-processed in the frequency domain to satisfy causality. Next, they are approximated to yield weighted delta functions in the time domain ...
详细信息
In this paper, the scattering parameters of blackbox multiport networks are pre-processed in the frequency domain to satisfy causality. Next, they are approximated to yield weighted delta functions in the time domain thus allowing the fast simulation. The resulting procedure leads to a robust, accurate and efficient macromodel generation scheme.
In this paper, we present a VSS-based tracking control for a fixed point regulation of 2-DOF underactuated manipulators. The design approach is systematic and relies on the selection of appropriate choice of two slidi...
详细信息
In this paper, we present a VSS-based tracking control for a fixed point regulation of 2-DOF underactuated manipulators. The design approach is systematic and relies on the selection of appropriate choice of two sliding surface. The controller is designed for the both sliding surfaces are attractive. Lyapunov theory is used to study and demonstrate the stability of the system. Convergence of state space is proved and robustness issues to bounded disturbances are also investigated. Simulation results on 2-DOF whirling pendulum are presented to chow the effectiveness of this approach.
In this paper, we propose rapid control prototyping (RCP) for a robot soccer using the SIMTool that has been developed in Seoul National University, Korea for the control aided control system design (CACSD). The propo...
In this paper, we propose rapid control prototyping (RCP) for a robot soccer using the SIMTool that has been developed in Seoul National University, Korea for the control aided control system design (CACSD). The proposed RCP enables us to carry out the rapid design and the verification of controls for two-wheeled mobile robots (TWMRs), players in the robot soccer, without writing C codes directly and requiring a special H/W. On the basis of the proposed RCP, a blockset for the robot soccer is developed for easy design of a variety of mathematical and logical algorithms. All blocks in the blockset are made up of basic blocks offered by the SIMTool. User-defined algorithms can be easily and efficiently constructed with just a combination of the blocks in the blockset. In order to validate the proposed RCP in a real game, we employ an official simulation game for the robot soccer, the SimuroSot. Block diagrams are constructed for strategy, path calculation, and the interface to the SIMTool. We show that the algorithms implemented with the proposed RCP work well in the simulation game.
In this paper, interconnected retarded nonlinear systems are considered. Both the constant discrete and distributed time-delays in the subsystems and the interconnections are addressed. A sufficient small-gain type co...
详细信息
ISBN:
(纸本)9781424431236
In this paper, interconnected retarded nonlinear systems are considered. Both the constant discrete and distributed time-delays in the subsystems and the interconnections are addressed. A sufficient small-gain type condition for integral input-to-state stability with respect to external inputs is provided in the framework of Lyapunov-Krasovskii functionals.
Cross-layer optimization including congestion control, routing, and scheduling has shown dramatic throughput improvement over layered designs for wireless networks. In parallel, the paradigm-shifting network coding ha...
详细信息
Cross-layer optimization including congestion control, routing, and scheduling has shown dramatic throughput improvement over layered designs for wireless networks. In parallel, the paradigm-shifting network coding has empirically demonstrated substantial throughput improvement when coding operations are permitted at intermediate nodes and packets from different sessions are mixed. designing network codes and the associated flow in network coding presents new challenges for cross-layer optimization for wireless multi-hop networks. This work shows that with a new flow-based characterization of pairwise intersession network coding, a joint optimal scheduling and rate-control algorithm can be implemented distributively. Optimal scheduling is computationally expensive to achieve even in a purely routing-based (without network coding) paradigm, let alone with network coding. Thus, in this paper, the impact of imperfect scheduling is studied, which shows that pairwise intersession network coding can improve the throughput of routing-based solutions regardless of whether perfect/imperfect scheduling is used. Both the deterministic and stochastic packet arrivals and departures are considered. This work shows for the first time a striking resemblance between pairwise intersession network coding and routing, and thus advocates extensions of routing-based wisdoms to their network coding counterpart.
This paper suggests remote experiments using the internet for the control education. The remote experiment is composed of equipment server computers, networks accessible to internet, and real plants such as inverted p...
This paper suggests remote experiments using the internet for the control education. The remote experiment is composed of equipment server computers, networks accessible to internet, and real plants such as inverted pendulums and crane systems. Additionally, it requires a server program that has I/O functions with plants and calculate the control, an interface program bridging between web and the server program, and the home page including the detail explanation for the usage. For effective educations, how to perform experiments and how to combine the experiment with lectures will be discussed. The simple experiments by entering a few control parameters and the complex experiments by designing overall controls, will be explained. Technologies related with the remote experiment will be introduced. It is demonstrated that the remote experiment will be very useful, particular for control education where students have difficulties in performing the experiments for lack of experimental equipments.
Fractional-order systems have applications in the areas of Flight Control, Robotics, Missile Guidance, Control of Structural Vibrations of Space Platforms and Sensor Technology. Fractional-order transfer functions can...
详细信息
Fractional-order systems have applications in the areas of Flight Control, Robotics, Missile Guidance, Control of Structural Vibrations of Space Platforms and Sensor Technology. Fractional-order transfer functions can characterize complex nonlinear dynamics with many fewer parameters than integer-order functions. This paper addresses the use of a polymer-electrolyte transistor (PET) for use in implementating fractional-order algorithms for signal processing. The PET's advantage over the conventional RC and RL circuits is that it can be both functionally scaled and varied for dynamic fractional-order parameter controllability.
暂无评论