检索结果-内蒙古大学图书馆

Learning the continuous-time optimal decision law from discrete-time rewards

学校读者我要写书评

暂无评论

National Science Open 2024年第5期3卷 130-147页

作者： Ci Chen Lihua Xie Kan Xie Frank Leroy Lewis Yilu Liu Shengli Xie School of Automation Guangdong University of TechnologyGuangdong Key Laboratory of IoT Information TechnologyGuangzhou 510006China Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of EducationGuangzhou 510006China School of Electrical and Electronic Engineering Nanyang Technological UniversitySingapore 639798Singapore 111 Center for Intelligent Batch Manufacturing Based on IoT Technology Guangzhou 510006China UTA Research Institute the University of Texas at ArlingtonFort Worth 76118USA Department of Electrical Engineering and Computer Science University of TennesseeKnoxville 37996USA Oak Ridge National Laboratory Oak Ridge 37830USA Guangdong-HongKong-Macao Joint Laboratory for Smart Discrete Manufacturing Guangzhou 510006China

The concept of reward is fundamental in reinforcement learning with a wide range of applications in natural and social *** an interpretable reward for decision-making that largely shapes the system's behavior has always been a challenge in reinforcement *** this work,we explore a discrete-time reward for reinforcement learning in continuous time and action spaces that represent many phenomena captured by applying physical *** find that the discrete-time reward leads to the extraction of the unique continuous-time decision law and improved computational efficiency by dropping the integrator operator that appears in classical results with integral *** apply this finding to solve output-feedback design problems in power *** results reveal that our approach removes an intermediate stage of identifying dynamical *** work suggests that the discrete-time reward is efficient in search of the desired decision law,which provides a computational tool to understand and modify the behavior of large-scale engineering systems using the optimal learned decision.

关键词： continuous-time state and action decision law learning discrete-time reward dynamical systems reinforcement learning

Real-Time Imitation of Human Head Motions, Blinks and Emotions by Nao Robot: A Closed-Loop Approach

学校读者我要写书评

暂无评论

Real-Time Imitation of Human Head Motions, Blinks and Emotio...

RSI/ISM International Conference on robotics and Mechatronics (ICROM)

作者： Keyhan Rayati Amirhossein Feizi Alireza Beigy Pourya Shahverdi Mehdi Tale Masouleh Ahmad Kalhor Wing-Yue Geoffrey Louie Human and Robot Interaction Lab Electrical and Computer Engineering University of Tehran Tehran Iran Department of Electrical Engineering Shahrood University of Technology Shahrood Iran Intelligent Robotics Laboratory Oakland University Michigan USA

This paper introduces a novel approach for enabling real-time imitation of human head motion by a Nao robot, with a primary focus on elevating human-robot interactions. By using the robust capabilities of the MediaPipe as a computer vision library and the DeepFace as an emotion recognition library, this research endeavors to capture the subtleties of human head motion, including blink actions and emotional expressions, and seamlessly incorporate these indicators into the robot’s responses. The result is a comprehensive framework which facilitates precise head imitation within human-robot interactions, utilizing a closed-loop approach that involves gathering real-time feedback from the robot’s imitation performance. This feedback loop ensures a high degree of accuracy in modeling head motion, as evidenced by an impressive R2 score of 96.3 for pitch and 98.9 for yaw. Notably, the proposed approach holds promise in improving communication for children with autism, offering them a valuable tool for more effective interaction. In essence, proposed work explores the integration of real-time head imitation and real-time emotion recognition to enhance human-robot interactions, with potential benefits for individuals with unique communication needs.

关键词：

Learning Goal-based Movement via Motivational-based Models in Cognitive Mobile Robots

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Berto, Letícia Costa, Paula Simões, Alexandre Gudwin, Ricardo Colombini, Esther Laboratory of Robotics and Cognitive Systems Institute of Computing University of Campinas Brazil Dept. of Computer Engineering and Industrial Automation School of Electrical and Computer Engineering University of Campinas Brazil Dept. of Control and Automation Engineering Institute of Science and Technology São Paulo State University Sorocaba Brazil University of Campinas Brazil

Humans have needs motivating their behavior according to intensity and context. However, we also create preferences associated with each action’s perceived pleasure, which is susceptible to changes over time. This makes decision-making more complex, requiring learning to balance needs and preferences according to the context. To understand how this process works and enable the development of robots with a motivational-based learning model, we computationally model a motivation theory proposed by Hull. In this model, the agent (an abstraction of a mobile robot) is motivated to keep itself in a state of homeostasis. We added hedonic dimensions to see how preferences affect decision-making, and we employed reinforcement learning to train our motivated-based agents. We run three agents with energy decay rates representing different metabolisms in two different environments to see the impact on their strategy, movement, and behavior. The results show that the agent learned better strategies in the environment that enables choices more adequate according to its metabolism. The use of pleasure in the motivational mechanism significantly impacted behavior learning, mainly for slow metabolism agents. When survival is at risk, the agent ignores pleasure and equilibrium, hinting at how to behave in harsh scenarios. Copyright © 2023, The Authors. All rights reserved.

关键词： Metabolism

Partially Occluded Face Expression Recognition with CBAM-Based Residual Network for Teaching Scene

学校读者我要写书评

暂无评论

Partially Occluded Face Expression Recognition with CBAM-Bas...

2023 China automation Congress, CAC 2023

作者： Bai, Yanxing Chen, Luefeng Li, Min Wu, Min Pedrycz, Witold Hirota, Kaoru School of Automation China University of Geosciences Wuhan430074 China School of Automation Ministry of Education China University of Geosciences Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems Engineering Research Center of Intelligent Technology for Geo-Exploration Wuhan430074 China University of Alberta Department of Electrical and Computer Engineering EdmontonABT6G 2R3 Canada Systems Research Institute Polish Academy of Sciences Warsaw00-901 Poland Istinye University Department of Computer Engineering Sariyer Istanbul34396 Turkey Tokyo Institute of Technology Yokohama226-8502 Japan

ISBN: (纸本)9798350303759

In this paper, a deep residual network based on convolutional block attention module (CBAM) is proposed, which is utilized for feature extraction of partially occluded face expression data. The proposed method overcomes the problem of localized occlusion face feature extraction by focusing on the regions and channels containing important information in the occluded face data through CBAM. Multi-task cascaded convolutional networks (MTCNN) are firstly utilized to localize the key regions of face emotion, and then deep emotion features are extracted by CBAM-ResNet network. The final emotion labels are generated. The effectiveness of this paper's method is verified on the RAF-DB dataset and the occluded CK+ dataset. The experimental accuracy in the RAF-DB dataset is 76.3%, which is 3.74% and 1.64% higher than the accuracy produced by the method of RGBT, and the WLS-RF, respectively. Application experiments are carried out in the real teaching scenario, which verifies the applicability of the algorithm in the real teaching scene. © 2023 IEEE.

关键词： Emotion Recognition

PROSPECT: Precision Robot Spectroscopy Exploration and Characterization Tool

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Hanson, Nathaniel Lvov, Gary Rautela, Vedant Hibbard, Samuel Holand, Ethan DiMarzio, Charles Padır, Taşkın Institute for Experiential Robotics Electrical and Computer Engineering Department Northeastern University BostonMA United States Robotics Institute Carnegie Mellon University PittsburghPA United States Lincoln Laboratory Massachusetts Institute of Technology LexingtonMA United States

Near Infrared (NIR) spectroscopy is widely used in industrial quality control and automation to test the purity and grade of items. In this research, we propose a novel sensorized end effector and acquisition strategy to capture spectral signatures from objects and register them with a 3D point cloud. Our methodology first takes a 3D scan of an object generated by a time-of-flight depth camera and decomposes the object into a series of planned viewpoints covering the surface. We generate motion plans for a robot manipulator and end-effector to visit these viewpoints while maintaining a fixed distance and surface normal. This process is enabled by the spherical motion of the end-effector and ensures maximal spectral signal quality. By continuously acquiring surface reflectance values as the end-effector scans the target object, the autonomous system develops a four-dimensional model of the target object: position in an R3 coordinate frame, and a reflectance vector denoting the associated spectral signature. We demonstrate this system in building spectral-spatial object profiles of increasingly complex geometries. We show the proposed system and spectral acquisition planning produce more consistent spectral signals than naïve point scanning strategies. Our work represents a significant step towards high-resolution spectral-spatial sensor fusion for automated quality assessment. © 2024, CC BY-NC-SA.

关键词： Infrared devices

MINER-RRT*: A Hierarchical and Fast Trajectory Planning Framework in 3D Cluttered Environments

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Pengyu Tang, Jiawei Lin, Hin Wang Zhang, Fan Wang, Chaoqun Wang, Jiankun Shi, Ling Meng, Max Q.-H. Shenzhen Key Laboratory of Robotics Perception and Intelligence The Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China The Department of Electronic and Computer Engineering Hong Kong University of Science and Technology Hong Kong The Department of Electronic Engineering The Chinese University of Hong Kong Hong Kong The Department of Electrical and Computer Engineering The University of Alberta Canada The School of Control Science and Engineering Shandong University Shandong China

—Trajectory planning for quadrotors in cluttered environments has been challenging in recent years. While many trajectory planning frameworks have been successful, there still exists potential for improvements, particularly in enhancing the speed of generating efficient trajectories. In this paper, we present a novel hierarchical trajectory planning framework to reduce computational time and memory usage called MINER-RRT*, which consists of two main components. First, we propose a sampling-based path planning method boosted by neural networks, where the predicted heuristic region accelerates the convergence of rapidly-exploring random trees. Second, we utilize the optimal conditions derived from the quadrotor’s differential flatness properties to construct polynomial trajectories that minimize control effort in multiple stages. Extensive simulation and real-world experimental results demonstrate that, compared to several state-of-the-art (SOTA) approaches, our method can generate high-quality trajectories with better performance in 3D cluttered environments. (Video1) Note to Practitioners—The motivation is the problem of planning trajectories for quadrotor autonomous flight in 3D cluttered and complex scenarios such as wild forest exploration and subterranean environment search-and-rescue. Sampling-based path planning methods are suitable for dealing with the complexity of the physical environment but are not convenient for computing dynamics and their differentials. Optimization-based trajectory generation methods are appropriate for handling various high-order constraints but rely on high-quality initial path solutions. Therefore, this paper combines the advantages of the two methods to propose a novel trajectory planning framework that can generate high-quality trajectories for quadrotors faster than many previous algorithms. We conduct numerous simulations and real-world experiments to verify that our method can be effectively deployed in real scenarios and empo

关键词： Deep neural networks

Adaptive Stiffness Control of Series Elastic Actuator Manipulators Based on Dynamic System

学校读者我要写书评

暂无评论

Adaptive Stiffness Control of Series Elastic Actuator Manipu...

IEEE International Conference on automation Science and engineering (CASE)

作者： Kunlin Guo Chao Zeng Weiyong Si Ning Wang Chenguang Yang Key Laboratory of Autonomous Systems and Networked Control School of Automation Science and Engineering South China University of Technology Guangzhou China Department of Computer Science University of Liverpool Liverpool UK School of Computer Science and Electronic Engineering University of Essex Colchester Bristol Robotics Laboratory University of the West of England Bristol UK

ISBN: (数字)9798350358513

ISBN: (纸本)9798350358520

In traditional control methods, Series Elastic Actuator (SEA) joint manipulators are limited by their hardware and can only perform simple tasks with low stiffness. To address this issue, we propose a stiffness adjustment control strategy for SEA manipulators based on Dynamic Systems (DS) with good generalization performance. By enhancing the generalization capability of DS in complex tasks and combining posture control, the SEA manipulators can autonomously adjust control gains and postures according to task requirements to achieve higher stiffness at the end-effector. Experimental results involving the activation of air switches with different stiffness levels and installation angles have demonstrated the effectiveness of our proposed method. The results indicate that compared to traditional methods of adjusting the control gain and retraining DS for similar tasks, our approach exhibits superior generalization performance while maintaining end-effector stiffness during interactions.

关键词： Actuators computer aided software engineering automation Adaptive systems Control systems End effectors Hardware Dynamical systems Manipulator dynamics

Realtime Particulate Matter and Bacteria Analysis of Peritoneal Dialysis Fluid using Digital Inline Holography

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Bravo-Frank, Nicholas Mesyngier, Nicolas Feng, Lei Hong, Jiarong Department of Electrical and Computer Engineering University of Minnesota United States Saint Anthony Falls Laboratory University of Minnesota United States Minnesota Robotics Institute University of Minnesota United States Department of Mechanical Engineering University of Minnesota United States

We developed a digital inline holography (DIH) system integrated with deep learning algorithms for real-time detection of particulate matter (PM) and bacterial contamination in peritoneal dialysis (PD) fluids. The system comprises a microfluidic sample delivery module and a DIH imaging module that captures holograms using a pulsed laser and a digital camera with a 40× objective. Our data processing pipeline enhances holograms, reconstructs images, and employs a YOLOv8nbased deep learning model for particle identification and classification, trained on labeled holograms of generic PD particles, Escherichia coli (E. coli), and Pseudomonas aeruginosa (P. aeruginosa). The system effectively detected and classified generic particles in sterile PD fluids, revealing diverse morphologies predominantly sized 1–5 µm with an average concentration of 61 particles/µL. In PD fluid samples spiked with high concentrations of E. coli and P. aeruginosa, our system achieved high sensitivity (>90%) in detecting and classifying these bacteria at clinically relevant low false positive rates (~0.5%). Further validation against standard colony-forming unit (CFU) methods using PD fluid spiked with bacterial concentrations from approximately 100 to 10,000 bacteria/mL demonstrated a clear one-to-one correspondence between our measurements and CFU counts. Our DIH system provides a rapid, accurate alternative to traditional culture-based methods for assessing bacterial contamination in PD fluids. By enabling real-time sterility monitoring, it can significantly improve patient outcomes in PD treatment, facilitate point-of-care fluid production, reduce logistical challenges, and be extended to quality control in pharmaceutical production. © 2024, CC BY.

关键词： Escherichia coli

Rock-Climbing Fish Inspired Skeleton-Embedded Rigid-Flexible Coupling Suction Disc Design for Adhesion Enhancement 16th

学校读者我要写书评

暂无评论

Rock-Climbing Fish Inspired Skeleton-Embedded Rigid-Flexible...

16th International Conference on Intelligent robotics and Applications, ICIRA 2023

作者： Tan, Wenjun Qin, Hengshen Zhang, Chuang Wang, Ruiqian Zhang, Yiwei Yang, Lianchao Chen, Qin Wang, Feifei Xi, Ning Liu, Lianqing State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110169 China University of Chinese Academy of Sciences Beijing100049 China Chengdu Institute of Biology Chinese Academy of Sciences Sichuan Chengdu610042 China Department of Electrical and Electronic Engineering University of Hong Kong 999077 Hong Kong Emerging Technologies Institute Department of Industrial and Manufacturing Systems Engineering University of Hong Kong Pokfulam999077 Hong Kong

ISBN: (纸本)9789819964888

Underwater high-performance biological adhesion systems have attracted increasing research interest to inspire engineered adhesion systems. Switchable underwater adhesion systems typically employ suction adhesion. However, achieving low pre-pressure negative pressure adhesion is still a challenge. An inspiring nature mode is provided by the rock-climbing fish, which needs little preload and can resist a pull-off force of 1000 times its own body weight. The pectoral and abdominal fins of rock-climbing fish have evolved to almost a flat suction cup. Through micro CT, we found that a unique skeletal network is embedded in the suction cup. This unique structure increases the stiffness of the suction cup and enhances its adhesion performance. Through numerical simulation, it was revealed that this rigid, flexible coupling structure enhances the ability of the suction cup to resist lateral pressure and increases the energy dissipation of the edge detachment of the suction cup. This work can shed light on the design of novel underwater adhesion systems and inspire underwater adhesion crawling robots. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2023.

关键词： Adhesion