Spatial computing and intuitive interaction: Bringing mixed reality and robotics together

作     者：Delmerico, Jeffrey Poranne, Roi Bogo, Federica Oleynikova, Helen Vollenweider, Eric Coros, Stelian Nieto, Juan Pollefeys, Marc 

作者机构：Microsoft Mixed Reality And AI Lab Zürich Switzerland Computational Robotics Lab ETH Zürich Switzerland Department Of Computer Science The University Of Haifa Israel NVIDIA United States 

出 版 物：《arXiv》 (arXiv)

年 卷 期：2022年

核心收录：

主　　题：Human robot interaction 

摘      要：Spatial computing-the ability of devices to be aware of their surroundings and to represent this digitally-offers novel capabilities in human-robot interaction. In particular, the combination of spatial computing and egocentric sensing on mixed reality devices enables them to capture and understand human actions and translate these to actions with spatial meaning, which offers exciting new possibilities for collaboration between humans and robots. This paper presents several human-robot systems that utilize these capabilities to enable novel robot use cases: mission planning for inspection, gesture-based control, and immersive teleoperation. These works demonstrate the power of mixed reality as a tool for human-robot interaction, and the potential of spatial computing and mixed reality to drive the future of human-robot interaction. Copyright © 2022, The Authors. All rights reserved.