Single rope ascending technique is used in industrial alpinism, forestry, or various leisure activities. This paper presents a multi-body model of this technique involving an actuated 3D model of a humanoid, the climb...
详细信息
ISBN:
(纸本)9798350398830
Single rope ascending technique is used in industrial alpinism, forestry, or various leisure activities. This paper presents a multi-body model of this technique involving an actuated 3D model of a humanoid, the climbing gear, and the rope, modeled as a finite-element object. This model serves as a training ground for reinforcement learning agents trying to mimic humans in rope climbing. To demonstrate the environment, an agent with a state-of-the-art reinforcement learning algorithm (Soft Actor-Critic) was trained. Results suggest that the agent can learn how to ascend the rope with speed comparable to real humans. However, the learned technique is not human-like: the artificial agent uses its arms excessively to climb, which would be too tiring for a human. That is because the environment only rewards ascension and does not penalize the energy used. The presented learning environment is developed for humanoid robots in mind that can perform complex tasks while on the rope and can carry much heavier payloads compared to climbing robots in the literature.
The proceedings contain 43 papers. The topics discussed include: simulation aspects and challenges for space robotic systems;optimized class decomposition for fault detection;bacterial evolutionary algorithm-based fea...
ISBN:
(纸本)9781665426848
The proceedings contain 43 papers. The topics discussed include: simulation aspects and challenges for space robotic systems;optimized class decomposition for fault detection;bacterial evolutionary algorithm-based feature selection for word sentiment interpolation in Hungarian language;contextual integration of activities in virtual and field operating cyber physical systems;bifurcations in a closed-loop model of tumor growth control;applying genetic programming for the inverse Linden-Mayer problem;and development of machine learning based colorectal cancer subtype classificator.
This paper investigates the tracking control problem of a class of high-order distributed systems subjected to limited communication bandwidth. An event-triggered control method is proposed, where the controller is tr...
详细信息
ISBN:
(纸本)9781728190778
This paper investigates the tracking control problem of a class of high-order distributed systems subjected to limited communication bandwidth. An event-triggered control method is proposed, where the controller is triggered only when specific events happen. Moreover, the computational complexity is reduced by introducing command filters for virtual control signals. Specifically, the backstepping scheme is adopted as the main design framework, by which the n-th order nonlinear system is divided into n command-cascaded first order subsystems. And virtual control commands are sent through a second-order low-pass filter, by which the time derivatives of the virtual commands can be obtained directly. The theoretical analysis shows the stability of the proposed method. The tracking performance is illustrated by a simulation example.
Internet of Things (IoT) networking has attracted research with many emerging applications requiring remote control and automation. Effective deployment of IoT sensors is a major concern since it primarily determines ...
详细信息
ISBN:
(纸本)9791188428090
Internet of Things (IoT) networking has attracted research with many emerging applications requiring remote control and automation. Effective deployment of IoT sensors is a major concern since it primarily determines the performance of the IoT network. Since multiple mobile sensors are generally involved, it is possible that the sensors are randomly distributed in a remote region at the initial phase then later relocated to some pre-computed optimal location with their full autonomy enabled. In this paper, we propose a computation for the optimal location of water sprinkler sensors of an IoT smart farm network in terms of the relative physical distance between them. The resulting sensors locations ensure minimal overlap coverage area and no uncovered area exists in the candidate farming region. With the proposed strategic deployment of smart water sprinklers sensors, farmers can be assured of the right water distribution for any given area of their farm.
The hybrid active power filter (HAPF) emerges as a cost-effective remedy for power quality challenges in medium voltage power systems. The success of HAPF, crucially, hinges on the efficacy of its current control mech...
详细信息
ISBN:
(数字)9798350330991
ISBN:
(纸本)9798350331004
The hybrid active power filter (HAPF) emerges as a cost-effective remedy for power quality challenges in medium voltage power systems. The success of HAPF, crucially, hinges on the efficacy of its current control mechanism. This paper introduces a novel approach by proposing a deterministic policy gradient based reinforcement learning (DPG-RL) as the current control strategy for HAPF. In stark contrast to conventional model-based control methods, the DPG-RL leverages artificial intelligence (AI) technology, rendering it model-free and capable of dynamically seeking the optimal control policy to enhance HAPF performance. A notable advantage lies in its significantly lower computational burden during each sampling period, distinguishing it from other contemporary AI-aided control methods. The paper outlines a systematic design process, encompassing feature selection and reward function design, to formulate the RL problem. The comprehensive design procedure of DPG-RL is then detailed. Simulation results are subsequently presented, validating the effectiveness and reliability of the proposed DPG-RL across diverse operational scenarios.
This paper proposes a biased exploration based reinforcement learning, which uses expert experiences to avoid the exploration of all states. The method is applied to control redundant robots with expert experiences. A...
详细信息
ISBN:
(纸本)9781665487696
This paper proposes a biased exploration based reinforcement learning, which uses expert experiences to avoid the exploration of all states. The method is applied to control redundant robots with expert experiences. A 7-degree-of-freedom robot manipulator is used in experiments. The results show that expert demonstrations based robot control works well.
The magnetic drive-trains (MDTs) is widely employed in the various industrial fields because of its advantage of non-contact torque transfer. However, due to the non-linear torque transfer characteristics of permanent...
The magnetic drive-trains (MDTs) is widely employed in the various industrial fields because of its advantage of non-contact torque transfer. However, due to the non-linear torque transfer characteristics of permanent magnet couplings (PMC), the performance of the commonly used sensorless control strategy based on linear state observer dramatically decreases when it deviates from the linearization point. To solve this problem, a new sensorless control strategy based on adaptive nonlinear state observer is presented. By introducing an adjustable model, the system is transformed into a non-linear error feedback system consisting of linear forward and non-linear feedback paths. An asymptotically adaptive nonlinear stable observer is constructed by introducing an error feedback compensation matrix into the forward path and designing an appropriate adaptive law for the feedback path based on Popov stability criterion. The real-time observation of magnetic torque stiffness factor is achieved, and the estimation accuracy of electrical slip angle and load-side speed is improved. Finally, simulation experiments verify the validity and accuracy of the proposed scheme in load-side speed estimation.
In order to make the walking gait of biped robot more human like, this paper takes the human walking data as the expected gait of robot, and uses the periodic characteristics of gait, proposes a gait tracking control ...
详细信息
A lot of effort has gone into eradicating the pandemic caused by the COVID-19 outbreak. One initiative in the efficient control of the spread of it lies in the methods for its diagnosis. Numerous techniques for screen...
A lot of effort has gone into eradicating the pandemic caused by the COVID-19 outbreak. One initiative in the efficient control of the spread of it lies in the methods for its diagnosis. Numerous techniques for screening the disease have emerged to date, which, combined with social measures, have helped to diminish the spread. Nevertheless, two years after the outbreak, the virus continues to propagate and claim victims worldwide. Therefore, there is a need for inexpensive, efficient, and real-time screening methods. In this scenario, the use of coughing samples as audio signals is a potential way to provide clinicians with an automatic tool for pre-diagnosing COVID-19 using AI techniques. This study investigates the use of coughutterances of subjects for the automatic detection of COVID-19. Relying on x-vector embeddings obtained from custom-trained deep neural network extractors on cough audio recordings, we were able to get highly competitive classification performance. Furthermore, we analyze the sensitivity of the extractors to domain dependence; and the quality of the embeddings produced in this context.
Connectivity maintenance is crucial for the real world deployment of multi-robot systems, as it ultimately allows the robots to communicate, coordinate and perform tasks in a collaborative way. A connectivity maintena...
详细信息
ISBN:
(纸本)9781728190778
Connectivity maintenance is crucial for the real world deployment of multi-robot systems, as it ultimately allows the robots to communicate, coordinate and perform tasks in a collaborative way. A connectivity maintenance controller must keep the multi-robot system connected independently from the system's mission and in the presence of undesired real world effects such as communication delays, model errors, and computational time delays, among others. In this paper we present the implementation, on a real robotic setup, of a connectivity maintenance control strategy based on control Barrier Functions. During experimentation, we found that the presence of communication delays has a significant impact on the performance of the controlled system, with respect to the ideal case. We propose a heuristic to counteract the effects of communication delays, and we verify its efficacy both in simulation and with physical robot experiments.
暂无评论