We address the autonomous control of a 6-legged robot using reinforcement learning. In general, a robot can be made to learn adaptive behavior through reinforcement learning. However, reinforcement learning, presents ...
详细信息
ISBN:
(纸本)9781457721366
We address the autonomous control of a 6-legged robot using reinforcement learning. In general, a robot can be made to learn adaptive behavior through reinforcement learning. However, reinforcement learning, presents a serious problem when it is applied to robots with many degrees of freedom, namely the state explosion problem. In our previous works, we proposed reinforcement learning with body image and discussed its effectiveness in applying the method to a multi-legged robot However, this was restricted to an ideal simulated world, and we did not address its effectiveness for real robots. In this paper, we report upon an actual 6-legged robot we developed, and discuss the effectiveness of applying reinforcement learning with body image to it. We conducted the learning process in a simulated world and then applied the obtained policy to the real robot The result was that effective locomotion was realized.
We report the selected-area epitaxy of rare-earth iron garnet crystalline and amorphous straight ridge patterns, from 4μm to 8μm in width, deposited on Gd3Ga5O12 single crystal substrates. These samples were fabrica...
We report the selected-area epitaxy of rare-earth iron garnet crystalline and amorphous straight ridge patterns, from 4μm to 8μm in width, deposited on Gd3Ga5O12 single crystal substrates. These samples were fabricated via a sputter epitaxial method on substrates that were partially etched by ion-beam bombardment. The strip pattern direction has given the considerable influence on the crystal-graphic formation of the sidewall of the grown ridge. The ridge shapes were similar to results that have been reported for the dissolution forms of garnet crystals in phosphoric acid and the facet of garnet crystals grown from flux. Furthermore, we have successfully grown both an epitaxial garnet film onto an amorphous film and an amorphous straight ridge with a triangular shape surrounded by crystal.
The present paper reports the experimental study on the dynamic behavior of a solid oxide fuel cell (SOFC). The cell stack consists of planar type cells with standard power output 300W. A Major subject of the present ...
The present paper reports the experimental study on the dynamic behavior of a solid oxide fuel cell (SOFC). The cell stack consists of planar type cells with standard power output 300W. A Major subject of the present study is characterization of the transient response to the electric current change, assuming load-following operation. The present studies particularly focus on fuel provision control to the load change. Optimized fuel provision improves power generation efficiency. However, the capability of SOFC must be restricted by a few operative parameters. Fuel utilization factor, which is defined as the ratio of the consumed fuel to the supplied fuel is adopted for a reference in the control scheme. The fuel flow rate was regulated to keep the fuel utilization at 50%, 60% and 70% during the current ramping. Lower voltage was observed with the higher fuel utilization, but achieved efficiency was higher. The appropriate mass flow control is required not to violate the voltage transient behavior. Appropriate fuel flow manipulation can contribute to moderate the overshoot on the voltage that may appear to the current change. The overshoot on the voltage response resulted from the gradual temperature behavior in the SOFC stack module.
This paper presents a new method for distributed vision-aided cooperative localization and navigation for multiple autonomous platforms based on constraints stemming from the three-view geometry of a general scene. Ea...
详细信息
We have been developing an omnidirectional walker (ODW) for walking support. In walking support, it is necessary control the ODW following the user's direction and velocity intentions. In this paper, a novel inter...
详细信息
ISBN:
(纸本)9781424441211
We have been developing an omnidirectional walker (ODW) for walking support. In walking support, it is necessary control the ODW following the user's direction and velocity intentions. In this paper, a novel interface is proposed to recognize the user's intentions according to the forearm pressures. The forearm pressures exerted to the ODW by the user with wrists and elbows are measured by 4 force sensors embedded in the ODW's armrest. The relationship between forearm pressure and user intentions was extracted as fuzzy rules and an algorithm was proposed for directional intention identification based on the distance-type fuzzy reasoning method. We conduct a path tracking experiment with the proposed method. The results show that the algorithm is applicable to control the ODW.
JAUS was originally defined by the United States department of Defense for enhanced interoperability between different types of unmanned systems and controllers. In order for unmanned systems to accomplish various mis...
详细信息
ISBN:
(纸本)9784907764388
JAUS was originally defined by the United States department of Defense for enhanced interoperability between different types of unmanned systems and controllers. In order for unmanned systems to accomplish various missions, messages are defined based on the JAUS Reference Architecture. In this paper, we describe a JAUS-compliant controller for the JAUS Challenge in the Intelligent Ground Vehicle Competition (IGVC). To achieve rapid controller version-up during the competition, we employed Python language and MATLAB, a combination that enabled rapid modification during the debugging process. The validity of the proposed approach was verified through the IGVC 2011 competition.
Biomass conversion by plasma has the advantage of mainly producing gaseous products, H2, CO and CO2. Though the thermal plasma has been used for this conversion, the plasma temperature is too high to be unfit for the ...
详细信息
Biomass conversion by plasma has the advantage of mainly producing gaseous products, H2, CO and CO2. Though the thermal plasma has been used for this conversion, the plasma temperature is too high to be unfit for the conversion biomass. The temperature of cold plasma, however, is lower under 3000 K. It expects to be adequate for biomass conversion. Cold plasma can be obtained with irradiation microwave (2.45 GHz) or radio frequency (13.5 MHz) under reduce gas pressure. Therefore, in present study, the effective decomposition of cellulose by microwave plasma (MWP) and radio frequency plasma (RFP) is examined. The conversion of cellulose by MWP (XMWP) is higher than that by RFP (XRFP), irrespective of the reaction time. XMWP and XRFP reach 92.8 wt% at 10 min and 68.1 wt% at 30 min. The maximum yield of gaseous products (Ygas) by MWP is 85.1 wt% at 10 min, higher by 23.2 wt% than Ygas by RFP at 30 min. The amount of H2 and CO obtained by MWP is 18.0 mmol/g and 23.5 mmol/g, it is larger than that obtained by RFP. Comparing the relationship between conversion and yield, Ygas of MWP is slightly higher than that of RFP under X of 60 wt%, and both Ygas is almost same over 60 wt%. The amount of H2 and CO obtained by MWP is larger by 9.3 mmol/g and 9.6 mmol/g than that obtained by RFP. C, H and O element in cellulose is mainly distributed to H2 and CO by MWP. RFP mainly distributes H and O element to the other gases without H2 and CO. In addition, a large amount of C element is remains in the residue. Those results is found that MWP was more suitable for cellulose gasification than RFP, since MWP can highly convert C, H and O element to H2 and CO by higher energy of microwave frequency in comparison with radio frequency.
Recently we have developed an eigenvector method (EVM) which can achieve the blind deconvolution (BD) for MIMO systems. One of attractive features of the proposed algorithm is that the BD can be achieved by calculatin...
详细信息
Recently we have developed an eigenvector method (EVM) which can achieve the blind deconvolution (BD) for MIMO systems. One of attractive features of the proposed algorithm is that the BD can be achieved by calculating the eigenvectors of a matrix relevant to it. However, the performance accuracy of the EVM depends highly on computational results of the eigenvectors. In this paper, by modifying the EVM, we propose an algorithm which can achieve the BD without calculating the eigenvectors. Then the pseudo-inverse which is needed to carry out the BD is calculated by our proposed matrix pseudo-inversion lemma. Moreover, using a combination of the conventional EVM and the modified EVM, we will show its performances comparing with each EVM. Simulation results will be presented for showing the effectiveness of the proposed methods.
Abstract In this paper we consider the problem of regulating a time-varying and uncertain linear discrete-time system to the origin. It is shown how, by applying an interpolation technique and minimizing an appropriat...
详细信息
Abstract In this paper we consider the problem of regulating a time-varying and uncertain linear discrete-time system to the origin. It is shown how, by applying an interpolation technique and minimizing an appropriate objective function, one can achieve feasibility and a robustly and asymptotically stable closed-loop behavior. Moreover, we show that the control is a piecewise affine and continuous function of state. A simulation result demonstrates the performance of our approach.
In recent years, visible light communication is attracting growing interest for wireless communications since it is low-cost and easily maintained by using high-speed switchable LEDs. We have developed a prototype to ...
详细信息
ISBN:
(纸本)9781457707148
In recent years, visible light communication is attracting growing interest for wireless communications since it is low-cost and easily maintained by using high-speed switchable LEDs. We have developed a prototype to demonstrate wireless visible light communications using RGB LEDs as both transmitter and light source. The RGB LEDs enable parallel signal communications, and a PSoC microcontroller is used to control them, thus significantly reducing the need for extra circuits and allowing rapid modification of communication software. A prototype system was developed and its validity was confirmed.
暂无评论