To enable robots to understand a specific assistive task during human-robot interactions under complex home scenes, at the center is the problem of human-object interaction (HOI) recognition. In particular, aiming at ...
To enable robots to understand a specific assistive task during human-robot interactions under complex home scenes, at the center is the problem of human-object interaction (HOI) recognition. In particular, aiming at identifying efficiently, this paper proposes a graph convolutional network (GCN) by considering the similarity and proximity of human and object nodes, based on which the geometric positions and morphological relationships are explored. Also, a supplementary convolutional neural network (CNN) is fused to GCN to extract the global semantic features, which also ensures the recognition applicability for the cases where detectors fall into failure. Experiments on V-COCO demonstrate our approach, and results in real-world scenes on our assistive robot – Xiaozhi II verify its robustness.
This paper showcases a real-world example of a system that achieves collaborative localization and mapping of multiple agents within a building. The proposed system processes the odometry and 3D point cloud data colle...
This paper showcases a real-world example of a system that achieves collaborative localization and mapping of multiple agents within a building. The proposed system processes the odometry and 3D point cloud data collected by the agents moving around the building to automatically generate the building’s floorplan on which the agent trajectories are overlaid. The wearable hardware consists of a low-cost passive integrated sensor that includes both a camera and an IMU (Inertial Measurement Unit) and an embedded compute unit. The system’s capabilities are shown through real-world experiments.
Existing action detection approaches do not take spatio-temporal structural relationships of action clips into account, which leads to a low applicability in real-world scenarios and can benefit detecting if exploited...
Existing action detection approaches do not take spatio-temporal structural relationships of action clips into account, which leads to a low applicability in real-world scenarios and can benefit detecting if exploited. To this end, this paper proposes to formulate the action detection problem as a reinforcement learning process which is rewarded by observing both the clip sampling and classification results via adjusting the detection schemes. In particular, our framework consists of a heterogeneous graph convolutional network to represent the spatio-temporal features capturing the inherent relation, a policy network which determines the probabilities of a predefined action sampling spaces, and a classification network for action clip recognition. We accomplish the network joint learning by considering the temporal intersection over union and Euclidean distance between detected clips and ground-truth. Experiments on ActivityNet v1.3 and THUMOS14 demonstrate our method.
Current genotype-to-phenotype models, such as polygenic risk scores, only account for linear relationships between genotype and phenotype and ignore epistatic interactions, limiting the complexity of the diseases that...
详细信息
ISBN:
(数字)9798350356632
ISBN:
(纸本)9798350356649
Current genotype-to-phenotype models, such as polygenic risk scores, only account for linear relationships between genotype and phenotype and ignore epistatic interactions, limiting the complexity of the diseases that can be properly characterized. Protein-protein interaction networks have the potential to improve the performance of the models. Moreover, interactions at the protein level can have profound implications in understanding the genetic etiology of diseases and, in turn, for drug development. In this article, we propose a novel approach for phenotype prediction based on graph neural networks (GNNs) that naturally incorporates existing protein interaction networks into the model. As a result, our approach can naturally discover relevant epistatic interactions. We assess the potential of this approach using simulations and comparing it to linear and other non-linear approaches. We also study the performance of the proposed GNN-based methods in predicting Alzheimer’s disease, one of the most complex neurodegenerative diseases, where our GNN approach outperform state of the art methods. In addition, we show that our proposal is able to discover critical interactions in the Alzheimer’s disease. Our findings highlight the potential of GNNs in predicting phenotypes and discovering the underlying mechanisms of complex diseases.
Kinodynamic motion planning for non-holomonic mobile robots is a challenging problem that is lacking a universal solution. One of the computationally efficient ways to solve it is to build a geometric path first and t...
Kinodynamic motion planning for non-holomonic mobile robots is a challenging problem that is lacking a universal solution. One of the computationally efficient ways to solve it is to build a geometric path first and then transform this path into a kinematically feasible one. Gradient-informed Path Smoothing (GRIPS) [1] is a recently introduced method for such transformation. GRIPS iteratively deforms the path and adds/deletes the waypoints while trying to connect each consecutive pair of them via the provided steering function that respects the kinematic constraints. The algorithm is relatively fast but, unfortunately, does not provide any guarantees that it will succeed. In practice, it often fails to produce feasible trajectories for car-like robots with large turning radius. In this work, we introduce a range of modifications that are aimed at increasing the success rate of GRIPS for car-like robots. The main enhancement is adding an additional step that heuristically samples the waypoints along the bottleneck parts of the geometric paths (such as sharp turns). The results of the experimental evaluation provide a clear evidence that the success rate of the suggested algorithm is up to 40% higher compared to the original GRIPS and hits the bar of 90%, while its runtime is lower.
The paper presents the method of optimal geometric parameters synthesis for a robotic rehabilitation system of the lower limbs as based on a passive orthosis in the form of a serial RRRR mechanism and an active parall...
详细信息
As a crucial component of multi-energy systems (MES), the energy hub significantly enhances their performance and reliability. In the energy system, the utilization of renewable energy sources (RES) can presents a sig...
详细信息
ISBN:
(数字)9798350361322
ISBN:
(纸本)9798350361339
As a crucial component of multi-energy systems (MES), the energy hub significantly enhances their performance and reliability. In the energy system, the utilization of renewable energy sources (RES) can presents a significant optimization problem, capable of substantially reducing environmental pollution and lowering energy costs for users. This paper presents an optimal load dispatch model incorporating a collection of wind turbines, aimed at reducing the overall cost of operating an energy hub. It is also proposes a hub structure based on wind, natural gas, and electricity as a combined heat and power system, utilizing converters and energy storage mechanisms to obtain electricity, thermal, and cooling energy. To accomplish this, two situations are executed in the network, aiming to minimize costs by applying a problem-solving approach to the installation of wind turbines at an energy hub. After implementing energy hub management in the optimal mode, the system’s operating costs are reduced by $16 \%$, demonstrating its advantage.
In this paper we investigate the optimal controller synthesis problem, so that the system under the controller can reach a specified target set while satisfying given constraints. Existing model predictive control (MP...
详细信息
Changes in topological spatial relations of objects are often strong indicators for state transitions in the underlying processes they are involved in. While various aspects of semantic mapping have been extensively r...
Changes in topological spatial relations of objects are often strong indicators for state transitions in the underlying processes they are involved in. While various aspects of semantic mapping have been extensively researched, the reasoning about the temporal development of spatial relations of instances is often neglected. This paper presents a concept to combine a semantic map with a stream processing framework for live analysis of the spatio-temporal relation of objects, based on the map and information inferred from sensors streams. To demonstrate the functionality of our concept, we implemented a proof-of-concept system to track everyday events in an office environment. The presented application scenario clearly demonstrates the benefits of the proposed architecture for detecting and handling complex spatio-temporal events.
The effects of individual physiological phenomena play an important role considering the accuracy of artificial pancreas systems. An example of these phenomena is the heart rate which is easy to measure. There is a co...
详细信息
暂无评论