检索结果-内蒙古大学图书馆

arXiv 2022年

作者： Tao, Lingfeng Zhang, Jiucai Bowman, Michael Zhang, Xiaoli Colorado School of Mines Intelligent Robotics and Systems Lab 1500 Illinois St GoldenCO80401 United States The GAC R&D Center Silicon Valley SunnyvaleCA94085 United States

In-hand manipulation is challenging for a multi-finger robotic hand due to its high degrees of freedom and the complex interaction with the object. To enable in-hand manipulation, existing deep reinforcement learning based approaches mainly focus on training a single robot-structure-specific policy through the centralized learning mechanism, lacking adaptability to changes like robot malfunction. To solve this limitation, this work treats each finger as an individual agent and trains multiple agents to control their assigned fingers to complete the in-hand manipulation task cooperatively. We propose the Multi-Agent Global-Observation Critic and Local-Observation Actor (MAGCLA) method, where the critic can observe all agents' actions globally, and the actor only locally observes its neighbors' actions. Besides, conventional individual experience replay may cause unstable cooperation due to the asynchronous performance increment of each agent, which is critical for in-hand manipulation tasks. To solve this issue, we propose the Synchronized Hindsight Experience Replay (SHER) method to synchronize and efficiently reuse the replayed experience across all agents. The methods are evaluated in two in-hand manipulation tasks on the Shadow dexterous hand. The results show that SHER helps MAGCLA achieve comparable learning efficiency to a single policy, and the MAGCLA approach is more generalizable in different tasks. The trained policies have higher adaptability in the robot malfunction test compared to the baseline multi-agent and single-agent approaches. Copyright © 2022, The Authors. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Deep Reinforcement Learning with Adaptive Hierarchical Reward for MultiMulti-Phase Multi Multi-Objective Dexterous Manipulation

arXiv

引用

arXiv 2022年

作者： Tao, Lingfeng Zhang, Jiucai Zhang, Xiaoli Colorado School of Mines Intelligent Robotics and Systems Lab 1500 Illinois St GoldenCO80401 United States The GAC R&D Center Silicon Valley SunnyvaleCA94085 United States

Dexterous manipulation tasks usually have multiple objectives, and the priorities of these objectives may vary at different phases of a manipulation task. Varying priority makes a robot hardly or even failed to learn an optimal policy with a deep reinforcement learning (DRL) method. To solve this problem, we develop a novel Adaptive Hierarchical Reward Mechanism (AHRM) to guide the DRL agent to learn manipulation tasks with multiple prioritized objectives. The AHRM can determine the objective priorities during the learning process and update the reward hierarchy to adapt to the changing objective priorities at different phases. The proposed method is validated in a multi-objective manipulation task with a JACO robot arm in which the robot needs to manipulate a target with obstacles surrounded. The simulation and physical experiment results show that the proposed method improved robot learning in task performance and learning efficiency. Copyright © 2022, The Authors. All rights reserved.

关键词： Robots

来源：评论

学校读者我要写书评

暂无评论

A Trustable LSTM-Autoencoder Network for Cyberbullying Detection on Social Media Using Synthetic Data

A Trustable LSTM-Autoencoder Network for Cyberbullying Detec...

引用

IEEE International Conference on Big Data

作者： Mst Shapna Akter Hossain Shahriar Alfredo Cuzzocrea Fan Wu Juanjose Rodriguez-Cardenas Department of Intelligent Systems and Robotics University of West Florida USA Center of Cybersecurity University of West Florida USA iDEA Lab University of Calabria Rende Italy Dept. of Computer Science Tuskegee University Tuskegee USA Dept. of Information Technology Kennesaw State University Georgia USA

Social media cyberbullying has a detrimental effect on human life. As online social networking grows daily, the amount of hate speech also increases. Such terrible content can cause depression and actions related to suicide. This paper proposes a trustable LSTM-Autoencoder Network for cyberbullying detection on social media using synthetic data. We have demonstrated a cutting-edge method to address data availability difficulties by producing machine-translated data. However, several languages such as Hindi and Bangla still lack adequate investigations due to a lack of datasets. We carried out experimental identification of aggressive comments on Hindi, Bangla, and English datasets using the proposed model and traditional models, including Long Short-Term Memory (LSTM), Bidirectional Long ShortTerm Memory (BiLSTM), LSTM-Autoencoder, Word2vec, Bidirectional Encoder Representations from Transformers (BERT), and Generative Pre-trained Transformer 2 (GPT-2) models. We employed evaluation metrics such as f1-score, accuracy, precision, and recall to assess the models’ performance. Our proposed model outperformed all the models on all datasets, achieving the highest accuracy of 95%. Our model achieves state-of-the-art results among all the previous works on the dataset we used in this paper.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Tactile grasp stability classification based on graph convolutional networks

Tactile grasp stability classification based on graph convol...

引用

2021 IEEE International Conference on Real-Time Computing and robotics, RCAR 2021

作者： Mi, Tingting Que, Dashun Fang, Senlin Zhou, Zhenning Ye, Chaoxiang Liu, Chengliang Yi, Zhengkun Wu, Xinyu School of Information Engineering Wuhan University of Technology Wuhan430070 China Shenzhen Institute of Advanced Technology CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen518055 China Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China Shenzhen Key Laboratory of Smart Sensing and Intelligent Systems Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518055 China

ISBN: (纸本)9781665436786

One of the challenges for robots to grasp unknown objects is to predict whether objects will fall at the beginning of grasping. Evaluating robotic grasp state accurately and efficiently is a significant step to address this issue. In this paper, based on the different fusion approaches of multi-sensor tactile signals, we propose two novel methods based on Graph Convolution Network (GCN) for robotic stability classification. Specifically, we propose two deep learning methods including GCN based on data-level fusion (GCN-DF) and GCN based on feature-level fusion (GCN-FF). We explore the optimal parameters for transforming sensor signals into a graph structure. Furthermore, we verify the effectiveness of the proposed methods on the BioTac Grasp Stability (BiGS) dataset. The experimental results prove that the proposed approaches achieve higher classification accuracy than Support Vector Machine (SVM) and Long Short-Term Memory (LSTM). © 2021 IEEE.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

Curriculum-based Sensing Reduction in Simulation to Real-World Transfer for In-hand Manipulation

arXiv

引用

arXiv 2023年

作者： Tao, Lingfeng Zhang, Jiucai Zheng, Qiaojie Zhang, Xiaoli Oklahoma State University 563 Engineering North StillwaterOK74075 United States GAC R&D Center Silicon Valley SunnyvaleCA94085 United States Colorado School of Mines Intelligent Robotics and Systems Lab 1500 Illinois St GoldenCO80401 United States

Simulation to Real-World Transfer allows affordable and fast training of learning-based robots for manipulation tasks using Deep Reinforcement Learning methods. Currently, Sim2Real uses Asymmetric Actor-Critic approaches to reduce the rich idealized features in simulation to the accessible ones in the real world. However, the feature reduction from the simulation to the real world is conducted through an empirically defined one-step curtail. Small feature reduction does not sufficiently remove the actor’s features, which may still cause difficulty setting up the physical system, while large feature reduction may cause difficulty and inefficiency in training. To address this issue, we proposed Curriculum-based Sensing Reduction to enable the actor to start with the same rich feature space as the critic and then get rid of the hard-to-extract features step-by-step for higher training performance and better adaptation for real-world feature space. The reduced features are replaced with random signals from a Deep Random Generator to remove the dependency between the output and the removed features and avoid creating new dependencies. The methods are evaluated on the Allegro robot hand in a real-world in-hand manipulation task. The results show that our methods have faster training and higher task performance than baselines and can solve real-world tasks when selected tactile features are reduced. Copyright © 2023, The Authors. All rights reserved.

关键词： Curricula

来源：评论

学校读者我要写书评

暂无评论

Design and Development of the FlexBE WebUI with Introductory Tutorials

Journal of Computing Sciences in Colleges

引用

Journal of Computing Sciences in Colleges 2024年第3期40卷

作者： Samuel Raymond Grace Walters Josh Luzier David C. Conner Capable Humanitarian Robotics and Intelligent Systems Lab Department of Physics Computer Science and Engineering Christopher Newport University Newport News VA

Hierarchical Finite State Machines (HFSMs) continue to be a popular strategy for high-level behavioral control in robotics. Within the Robot Operating System (ROS) ecosystem, the Flexible Behavior Engine (FlexBE) provides an easy to use Python implementation with an intuitive user interface for runtime monitoring and "collaborative autonomy." In this paper, we describe the latest evolution of the FlexBE UI, that leverages FastAPI to provide a Python-based native ROS node interface, to a web-based user interface. Additionally, the paper describes a "quick-start" introductory tutorial to state machines using FlexBE. This system provides a natural introduction to HFSM-based techniques.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Stable In-hand Manipulation with Finger Specific Multi-agent Shadow Reward

arXiv

引用

arXiv 2023年

作者： Tao, Lingfeng Zhang, Jiucai Zhang, Xiaoli Oklahoma State University 563 Engineering North StillwaterOK74075 United States Colorado School of Mines Intelligent Robotics and Systems Lab 1500 Illinois St GoldenCO80401 United States The GAC R&D Center Silicon Valley SunnyvaleCA94085 United States

Deep Reinforcement Learning has shown its capability to solve the high degrees of freedom in control and the complex interaction with the object in the multi-finger dexterous in-hand manipulation tasks. Current DRL approaches prefer sparse rewards to dense rewards for the ease of training but lack behavior constraints during the manipulation process, leading to aggressive and unstable policies that are insufficient for safety-critical in-hand manipulation tasks. Dense rewards can regulate the policy to learn stable manipulation behaviors with continuous reward constraints but are hard to empirically define and slow to converge optimally. This work proposes the Finger-specific Multi-agent Shadow Reward (FMSR) method to determine the stable manipulation constraints in the form of dense reward based on the state-action occupancy measure, a general utility of DRL that is approximated during the learning process. Information Sharing (IS) across neighboring agents enables consensus training to accelerate the convergence. The methods are evaluated in two in-hand manipulation tasks on the Shadow Hand. The results show FMSR+IS converges faster in training, achieving a higher task success rate and better manipulation stability than conventional dense reward. The comparison indicates FMSR+IS achieves a comparable success rate even with the behavior constraint but much better manipulation stability than the policy trained with a sparse reward. Copyright © 2023, The Authors. All rights reserved.

关键词： Degrees of freedom (mechanics)

来源：评论

学校读者我要写书评

暂无评论

Short-time Fourier transform covariance and selection, a feature extraction method for binary motor imagery classification

Short-time Fourier transform covariance and selection, a fea...

引用

2021 IEEE International Conference on Real-Time Computing and robotics, RCAR 2021

作者： Ma, Yue Zheng, Liangsheng Yi, Zhengkun Xiao, Yang Wang, Can Wu, Xinyu Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems Chongqing University of Posts and Telecommunications

ISBN: (纸本)9781665436786

The brain-computer interfaces (BCI) technology is able to help dysfunctional people recover their motor functions. Electroencephalography (EEG) is an effective noninvasive method to construct BCI. Motor imagery (MI) paradigm can directly reflect the motor intention of user without additional stimulation equipment in EEG-BCI. The feature extraction methods are the key components to improve the accuracy of MI classification. Traditional feature extraction methods like CSP that only extract features in a single domain or two domains. In this study, we propose two novel feature selection method, short-time Fourier transform covariance and its selection method, which are aiming to extract spatial-time-frequency features simultaneously. In order to evaluate the proposed features, the BCI Competition IV Data Set IIb is employed to test the classification accuracy. By comparing the average accuracy of novel TSGSP method, the proposed method is more stable than TSGSP about 6% and the accuracy is just decrease about 0.5% at the same time. The average accuracy of 83.8% over all subjects is obtained. Superior classification performance results show that our proposed method has great potential, which is helpful for the further development and application of BCI technology for motor imaging in the field of neurorehabilitation. © 2021 IEEE.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

Gamification of Physical Therapy Exercises Using Commercial Entertainment Content: A Safety and Feasibility Study

Gamification of Physical Therapy Exercises Using Commercial ...

引用

IEEE International Conference on Rehabilitation robotics (ICORR)

作者： Giulia Amos David Rode Nicola A. Maffiuletti Mario Bizzini Marlene Mauch Chris Awai Easthope Florian Haufe Michele Xiloyannis Peter Wolf Robert Riener Sensory-Motor Systems (SMS) Lab Institute of Robotics and Intelligent Systems (IRIS) ETH Zurich Switzerland Schulthess Clinic Human Performance Lab Zurich Switzerland Rennbahnklinik Muttenz Switzerland Department of Orthopaedics and Traumatology University Hospital Basel Switzerland cereneo Foundation Center for Interdisciplinary Research Vitznau Switzerland Lake Lucerne Institute Vitznau Switzerland Spinal Cord Injury Center Medical Faculty Balgrist University Hospital University of Zurich Switzerland

Independent physiotherapy at home is a crucial element of rehabilitative care for a wide range of conditions as it constitutes a large portion of the overall therapy dose. However, up to 80% of individuals who are prescribed at-home physiotherapy do not consistently adhere to their treatment schedule, resulting in poor treatment outcomes. This is likely due to a lack of motivation and progress tracking in the current standard of care. We have developed a novel software prototype that allows users to control commercial entertainment content, such as video games or interactive music videos, with their movements during physiotherapy. By connecting therapy to proven entertainment content, we aim to improve on the current motivational deficits. This study investigated the safety and feasibility of this concept in a controlled environment over four physical therapy sessions with seven patients suffering from musculoskeletal and neurological conditions. As a secondary outcome, patients were asked about their enjoyment, perceived competence and effort using the Intrinsic Motivation Inventory (IMI) questionnaire. All participants were able to interact with the presented entertainment content and completed the study with no adverse events. Despite the diversity in pathology, age and training scenarios, the entertainment content maintained the patients' enjoyment with a high average rate of 6/7 on the IMI scale. Interacting with commercial entertainment content by doing physical therapy exercises was feasible, safe, and well-received over the six-week study period.

关键词：

来源：评论

学校读者我要写书评

暂无评论

A Novel Multi-Stream Informer Used for Lower Extremity Joint Angle Estimation 12

A Novel Multi-Stream Informer Used for Lower Extremity Joint...

引用

12th International Conference on CYBER Technology in Automation, Control, and intelligent systems, CYBER 2022

作者： Zhou, Xin Zhang, Liming Liu, Jiaqing Ye, Jiancong Wang, Can Wu, Xinyu Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China Cas Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen Institutes of Advanced Technology China University of Science and Technology of China China University of Chinese Academy of Sciences China South China University of Technology China Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Hong Kong

ISBN: (数字)9781665472678

ISBN: (纸本)9781665472678

In lower extremity exoskeleton rehabilitation systems, synergy and proportionality between the human lower extremity and the exoskeleton robot have been a critical goal to pursue. In recent years, changeable deep learning models based on multi-source signals have been used for lower limb continuous motion estimation. During the process, multimode signals are fed into the time processing model as time series. However, there are some deficiencies in this framework, on the one hand, what kind of multi-source combination can be more efficient;on the other hand, most of the existing models need several iterations or network stacking to complete the extraction of temporal information. This study set out to address the above problems, we put forward Multi-Stream Informer (MS-Informer), using Multi-Stream combination and sparse attention mechanisms for lower limb continuous motion estimation. In the experiment, we compare MS-Informer and Temporal Convolutional Network (TCN) and Long Short-term Memory (LSTM) under distinctive multi-source combinations. In summary, MS-informer performs well in multiple evaluations compared with other models. Experimental results illustrate that the MS-Informer is more efficacious in lower limb joint angle estimation and is a promising method for achieving coordinated control of lower limb exoskeletons. © 2022 IEEE.

关键词： Motion estimation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：