Automating fruit recognition and classification is an important computer vision application that can improve efficiency and consistency in the fruit industry. Manual sorting methods based on visual inspection are tedi...
详细信息
In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising fie...
详细信息
ISBN:
(纸本)9798350342291
In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising field for tasks like scene interpretation, leveraging flexible graph structures to concisely describe complex features and relationships. As traditional explainability methods used in eXplainable AI (XAI) cannot be directly applied to such structures, graph-specific approaches are introduced. Attention has been previously employed to estimate the importance of input features in GDL, however, the fidelity of this method in generating accurate and consistent explanations has been questioned. To evaluate the validity of using attention weights as feature importance indicators, we introduce semantically-informed perturbations and correlate predicted attention weights with the accuracy of the model. Our work extends existing attentionbased graph explainability methods by analysing the divergence in the attention distributions in relation to semantically sorted feature sets and the behaviour of a GNN model, efficiently estimating feature importance. We apply our methodology on a lidar pointcloud estimation model successfully identifying key semantic classes that contribute to enhanced performance, effectively generating reliable post-hoc semantic explanations.
The perception system in personalized mobile agents requires developing indoor scene understanding models, which can understand 3D geometries, capture objectiveness, analyze human behaviors, etc. Nonetheless, this dir...
详细信息
A fruitful collaboration is based on the mutual knowledge of each other skills and on the possibility of communicating their own limits and proposing alternatives to adapt the execution of a task to the capabilities o...
详细信息
ISBN:
(纸本)9781728196817
A fruitful collaboration is based on the mutual knowledge of each other skills and on the possibility of communicating their own limits and proposing alternatives to adapt the execution of a task to the capabilities of the collaborators. This paper aims at reproducing such a scenario in a human-robot collaboration setting by proposing a novel communication control architecture. Exploiting control barrier functions, the robot is made aware of its (dynamic) skills and limits and, thanks to a local predictor, it is able to assess if it is possible to execute a requested task and, if not, to propose alternative by relaxing some constraints. The controller is interfaced with a communication infrastructure that enables human and robot to set up a bidirectional communication about the task to execute and the human to take an informed decision on the behavior of the robot. A comparative experimental validation is proposed.
In the last few years, there has been remarkable progress in the domain of natural language generation & understanding. This has led to the development of enhanced text generation capability of machines that can g...
详细信息
With a growing population, global food demand continues to rise. Many crops depend on wild and managed pollinators that are experiencing steep population declines. This directly impacts growers' ability to increas...
详细信息
ISBN:
(纸本)9781665483834
With a growing population, global food demand continues to rise. Many crops depend on wild and managed pollinators that are experiencing steep population declines. This directly impacts growers' ability to increase food production and is compounded by a lack of systems for monitoring and understanding pollinator behavior. Here, we present task allocation methods that would allow us to leverage existing agricultural robots to monitor both natural and wild pollinator behavior. This would supply growers with information key to improving orchard management such as the interaction between foragers and the orchard as well as the effect of foragers on crop growth. We compare three different task allocation methods for visual monitoring of pollinators designed around the type of activities necessary for an agricultural robot. Our approach is tested in a comprehensive simulator that considers the structure and bloom of an orchard and the time-evolving nature of honey bee flights. Our results indicate that intermittently monitoring an orchard permits estimations with a small (3-9 out of 25) pollinator error margin and that this strategy can also be used to detect spontaneous events.
Industrial robots can be controlled by a CNC controller instead of the native robot controller. This approach provides several advantages, including robot operation synchronous with the machine tools and facilitated a...
详细信息
ISBN:
(纸本)9783031744815;9783031744822
Industrial robots can be controlled by a CNC controller instead of the native robot controller. This approach provides several advantages, including robot operation synchronous with the machine tools and facilitated automation applications. However, CNC control of robots also has drawbacks compared to the robot controller: Its control technology is less advanced and implementing solutions through available interfaces is difficult due to the required expertise from different engineering domains. The primary novelty of this paper is to offer a solution for this by using digital twins (DT) from virtual commissioning (VC) with extended dynamic behaviour to improve the trajectory planning of CNC-based control. An interface between the DT platform and the CNC is developed to communicate acceleration limits based on the dynamic capabilities of the robot while the DT ensures an easily applicable method for different robot models. This method is validated in a VC simulation and on a real robot.
We address the risk bounded trajectory optimization problem of stochastic nonlinear robotic systems. More precisely, we consider the motion planning problem in which the robot has stochastic nonlinear dynamics and unc...
详细信息
ISBN:
(纸本)9781728196817
We address the risk bounded trajectory optimization problem of stochastic nonlinear robotic systems. More precisely, we consider the motion planning problem in which the robot has stochastic nonlinear dynamics and uncertain initial locations, and the environment contains multiple dynamic uncertain obstacles with arbitrary probabilistic distributions. The goal is to plan a sequence of control inputs for the robot to navigate to the target while bounding the probability of colliding with obstacles. Existing approaches to address risk bounded trajectory optimization problems are limited to particular classes of models and uncertainties such as Gaussian linear problems. In this paper, we deal with stochastic nonlinear models, nonlinear safety constraints, and arbitrary probabilistic uncertainties, the most general setting ever considered. To address the risk bounded trajectory optimization problem, we first formulate the problem as an optimization problem with stochastic dynamics equations and chance constraints. We then convert probabilistic constraints and stochastic dynamics constraints on random variables into a set of deterministic constraints on the moments of state probability distributions. Finally, we solve the resulting deterministic optimization problem using nonlinear optimization solvers and get a sequence of control inputs. To our best knowledge, it is the first time that the motion planning problem to such a general extent is considered and solved. To illustrate the performance of the proposed method, we provide several robotics examples.
Reinforcement learning (RL) has become an interesting topic in robotics applications as it can solve complex problems in specific scenarios. The small amount of RL-tools focused on robotics, plus the lack of features ...
详细信息
ISBN:
(数字)9781665490429
ISBN:
(纸本)9781665490429
Reinforcement learning (RL) has become an interesting topic in robotics applications as it can solve complex problems in specific scenarios. The small amount of RL-tools focused on robotics, plus the lack of features such as easy transfer of simulated environments to real hardware, are obstacles to the widespread use of RL in robotic applications. FRobs _RL is a Python library that aims to facilitate the implementation, testing, and deployment of RL algorithms in intelligent robotic applications using robot operating system (ROS), Gazebo, and OpenAI Gym. FRobs _RL provides an Application Programming Interface (API) to simplify the creation of RL environments, where users can import a wide variety of robot models as well as different simulated environments. With the FRobs _RL library, users do not need to be experts in ROS, Gym, or Gazebo to create a realistic RL application. Using the library, we created and tested two environments containing common robotic tasks;one is a reacher task using a robotic manipulator, and the other is a mapless navigation task using a mobile robot. The library is available in GitHub.
In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the...
详细信息
ISBN:
(纸本)9781728196817
In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the maximum entropy Bellman equations with a particular approximation of the cost function, we are able to obtain a new formulation of Differential Dynamic Programming which is able to escape from local minima via exploration with a multimodal policy. To demonstrate the efficacy of the proposed algorithm, we provide experimental results using four systems on tasks that are represented by cost functions with multiple local minima and compare them against vanilla Differential Dynamic Programming. Furthermore, we discuss connections with previous work on the linearly solvable stochastic control framework and its extensions in relation to compositionality. Link to Video.
暂无评论