检索结果-内蒙古大学图书馆

Scene Consistency Representation Learning for Video Scene Segmentation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wu, Haoqian Chen, Keyu Luo, Yanan Qiao, Ruizhi Ren, Bo Liu, Haozhe Xie, Weicheng Shen, Linlin Computer Vision Institute Shenzhen University China Tencent YouTu Lab Shenzhen Institute of Artificial Intelligence and Robotics for Society China Guangdong Key Laboratory of Intelligent Information Processing China KAUST Saudi Arabia

A long-term video, such as a movie or TV show, is composed of various scenes, each of which represents a series of shots sharing the same semantic story. Spotting the correct scene boundary from the long-term video is a challenging task, since a model must understand the storyline of the video to figure out where a scene starts and ends. To this end, we propose an effective Self-Supervised Learning (SSL) framework to learn better shot representations from unlabeled long-term videos. More specifically, we present an SSL scheme to achieve scene consistency, while exploring considerable data augmentation and shuffling methods to boost the model generalizability. Instead of explicitly learning the scene boundary features as in the previous methods, we introduce a vanilla temporal model with less inductive bias to verify the quality of the shot features. Our method achieves the state-of-the-art performance on the task of Video Scene Segmentation. Additionally, we suggest a more fair and reasonable benchmark to evaluate the performance of Video Scene Segmentation methods. The code is made available. © 2022, CC BY.

关键词： Semantics

Detection and depth estimation for domestic waste in outdoor environments by sensors fusion

学校读者我要写书评

暂无评论

arXiv 2022年

作者： de Páez-Ubieta, Ignacio L. Velasco-Sánchez, Edison Puente, Santiago T. Candelas, Francisco A. AUtomatics RObotics and Artificial Vision Lab Computer Science Research Institute University of Alicante San Vicente del Raspeig University Campus s/n San Vicente del Raspeig Alicante03690 Spain

In this work, we estimate the depth in which domestic waste are located in space from a mobile robot in outdoor scenarios. As we are doing this calculus on a broad range of space (0.3 - 6.0 m), we use RGB-D camera and LiDAR fusion. With this aim and range, we compare several methods such as average, nearest, median and center point, applied to those which are inside a reduced or non-reduced Bounding Box (BB). These BB are obtained from segmentation and detection methods which are representative of these techniques like Yolact, SOLO, You Only Look Once (YOLO)v5, YOLOv6 and YOLOv7. Results shown that, applying a detection method with the average technique and a reduction of BB of 40%, returns the same output as segmenting the object and applying the average method. Indeed, the detection method is faster and lighter in comparison with the segmentation one. The committed median error in the conducted experiments was 0.0298 ± 0.0544 m. © 2022, CC BY-NC-ND.

关键词： Mobile robots

Geometry sharing network for 3D point cloud classification and segmentation

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Xu, Mingye Zhou, Zhipeng Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences University of Chinese Academy of Sciences Siat Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

In spite of the recent progresses on classifying 3D point cloud with deep CNNs, large geometric transformations like rotation and translation remain challenging problem and harm the final classification performance. To address this challenge, we propose Geometry Sharing Network (GS-Net) which effectively learns point descriptors with holistic context to enhance the robustness to geometric transformations. Compared with previous 3D point CNNs which perform convolution on nearby points, GS-Net can aggregate point features in a more global way. Specially, GS-Net consists of Geometry Similarity Connection (GSC) modules which exploit Eigen-Graph to group distant points with similar and relevant geometric information, and aggregate features from nearest neighbors in both Euclidean space and Eigenvalue space. This design allows GS-Net to efficiently capture both local and holistic geometric features such as symmetry, curvature, convexity and connectivity. Theoretically, we show the nearest neighbors of each point in Eigenvalue space are invariant to rotation and translation. We conduct extensive experiments on public datasets, ModelNet40, ShapeNet Part. Experiments demonstrate that GS-Net achieves the state-of-the-art performances on major datasets, 93.3% on ModelNet40, and are more robust to geometric transformations. Code is released on https://***/MingyeXu/GS-Net. Copyright © 2019, The Authors. All rights reserved.

关键词： Geometry

A general framework for lifelong localization and mapping in changing environment

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhao, Min Guo, Xin Song, Le Qin, Baoxing Shi, Xuesong Lee, Gim Hee Sun, Guanghui Gaussian Robotics Shanghai China Intel Labs China Beijing China Computer Vision and Robotic Perception Lab Department of Computer Science School of Computing National University of Singapore Singapore Singapore Department of Control Science and Engineering Harbin Institute of Technology China

The environment of most real-world scenarios such as malls and supermarkets changes at all times. A prebuilt map that does not account for these changes becomes out-of-date easily. Therefore, it is necessary to have an up-todate model of the environment to facilitate long-term operation of a robot. To this end, this paper presents a general lifelong simultaneous localization and mapping (SLAM) framework. Our framework uses a multiple session map representation, and exploits an efficient map updating strategy that includes map building, pose graph refinement and sparsification. To mitigate the unbounded increase of memory usage, we propose a maptrimming method based on the Chow-Liu maximum-mutualinformation spanning tree. The proposed SLAM framework has been comprehensively validated by over a month of robot deployment in real supermarket environment. Furthermore, we release the dataset collected from the indoor and outdoor changing environment with the hope to accelerate lifelong SLAM research in the community. Our dataset is available at https://***/sanduan168/lifelong-SLAM-dataset. © 2021, CC BY.

关键词： Retail stores

IEEE Transactions on Haptics: Editorial

学校读者我要写书评

暂无评论

IEEE Transactions on Haptics 2008年第1期1卷 2-8页

作者： Edward Colgate, J. Lederman, Susan Prattichizzo, Domenico Barbagli, Federico Basdogan, Cagatay Buss, Martin Ernst, Marc Frisoli, Antonio Gillespie, Brent Grant, Danny Harders, Matthias Hayward, Vincent Jones, Lynette Kajimoto, Hiroyuki Kappers, Astrid Kheddar, Abderrahmane Lin, Ming C. MacLean, Karon Miller, Brian Noma, Haruo Okamura, Allison M. O'Malley, Mareia Ryu, Jeha Tan, Hong Z. Yokokohji, Yasuyoshi Department of Psychology School of Computing Queen's University Canada IEEE Robotics and Automation Society Tübingen Germany Stanford University's Computer Science Department Tübingen Germany Institute of Automatic Control Engineering Technische Universität München Germany Independent Research Group Multisensory Perception and Action Max Planck Institute for Biological Cybernetics Tübingen Germany Department of Applied Mechanics SSSA Japan Research Division Virtual Reality and Telerobotic Systems PERCRO Laboratory Japan Department of Mechanical Engineering Japan Department of Robotics McGill University Canada Computer Vision Lab ETH Zurich Japan Virtual Reality in Medicine Group Japan IEEE CS/RAS Technical Committee on Haptics Japan Department of Electrical and Computer Engineering McGill University Canada Department of Mechanical Engineering MIT Japan University of Electro-Communications Japan Department of Physics and Astronomy Utrecht University Netherlands University of Evry France Chapel Hill United States Department of Computer Science University of British Columbia Canada ATR Knowledge Science Lab United Kingdom Department of Mechanical Engineering Denmark Johns Hopkins University United States Laboratory for Computational Sensing and Robotics United Kingdom Engineering Research Center for Computer-Integrated Surgical Systems and Technology United States Mechanical Engineering and Materials Science Department Rice University United States Korea Republic of Department of Electrical and Computer Engineering Mechanical Engineering and Psychological Sciences Purdue University United States Department of Mechanical Engineering and Science Graduate School of Engineering Kyoto University Japan

No abstract available

关键词：

Context-transformer: Tackling object confusion for few-shot detection

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Yang, Ze Wang, Yali Chen, Xianyu Liu, Jianzhuang Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab. Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Huawei Noah’s Ark Lab. SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

Few-shot object detection is a challenging but realistic scenario, where only a few annotated training images are available for training detectors. A popular approach to handle this problem is transfer learning, i.e., fine-tuning a detector pretrained on a source-domain benchmark. However, such transferred detector often fails to recognize new objects in the target domain, due to low data diversity of training samples. To tackle this problem, we propose a novel Context-Transformer within a concise deep transfer framework. Specifically, Context-Transformer can effectively leverage source-domain object knowledge as guidance, and automatically exploit contexts from only a few training images in the target domain. Subsequently, it can adaptively integrate these relational clues to enhance the discriminative power of detector, in order to reduce object confusion in few-shot scenarios. Moreover, Context-Transformer is flexibly embedded in the popular SSD-style detectors, which makes it a plug-and-play module for end-to-end few-shot learning. Finally, we evaluate Context-Transformer on the challenging settings of few-shot detection and incremental few-shot detection. The experimental results show that, our framework outperforms the recent state-of-the-art approaches. The codes are available at https://***/Ze-Yang/ContextTransformer. Copyright © 2020, The Authors. All rights reserved.

关键词： Object detection

Do Sensory Preferences of Children with Autism Impact an lmitation Task with a Robot?

学校读者我要写书评

暂无评论

Do Sensory Preferences of Children with Autism Impact an lmi...

ACM/IEEE International Conference on Human-Robot Interaction (HRI)

作者： Pauline Chevalier Gennaro Raiola Jean-Claude Martin Brice Isableu Christophe Bazile Adriana Tapus U2IS Robotics & Computer Vision Lab Palaiseau France LIMSI Université Paris-Saclay Orsay France PSYCLE Aix-Marseille Univ Aix-en France Groupement des Associations Sociale France

ISBN: (纸本)9781450343367

Imitation is of major importance during social interactions, would it be between humans or between a human and a robot. This is even more true when considering users with special needs. In this paper, we describe an experimental imitation task protocol using a robot Nao that we designed to assess whether sensory profiles of children with Autistic Spectrum Disorder (ASD) influence their capabilities to imitate or to initiate gestures that are going to be imitated. We based our work on the hypothesis that children with an overreliance on proprioceptive cues and hyporeactivity to visual cues have a greater difficulty imitating and improve their skills more slowly than children with an overreliance on visual cues and hyporeactivity to proprioceptive cues. Twelve children and teenagers with ASD participated in seven imitation sessions over eight weeks. As expected, we observed that children with an overreliance on proprioceptive cues and hyporeactivity to visual cues had more difficulties imitating the robot than the other children. Moreover, the repeated sessions revealed to have positive effects on social behaviors displayed by all children (gaze to the partner, imitations) toward a human partner after the sessions with the robot. We conclude on the possible impacts of such results on the design of social human-robot interactions for users with ASD.

关键词： Visualization Variable speed drives Task analysis Robot sensing systems Autism Medical treatment

94 GHz Three-Dimensional Imaging Radar for Environmental Detection 8

学校读者我要写书评

暂无评论

94 GHz Three-Dimensional Imaging Radar for Environmental Det...

8th Asia-Pacific Conference on Antennas and Propagation, APCAP 2019

作者： Wu, HongMing Qi, Feng Wang, Jinkuan Northeastern University College of Information Science and Engineering Shenyang110819 China Chinese Academy of Sciences Shenyang Institute of Automation Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110016 China Key Laboratory of Opto-Electronic Information Processing Chinese Academy of Sciences Shenyang110016 China Key Lab of Image Understanding and Computer Vision Liaoning Province Shenyang110016 China

ISBN: (纸本)9781665400541

At present, With the development of technology, the high resolution of millimeter wave (terahertz) can be applied to environmental sensing imaging. In this paper, Using the frequency-modulated continuous-wave (FMCW) radar technique with a 1GHz bandwidth, we show experimentally that a high-resolution real time imaging radar operating at 93.5-94.5GHz is capable of detecting different car models at standoff ranges of 12 m. We also achieved 3D high-resolution imaging of the building. at 140 meters. © 2019 IEEE.

关键词： Millimeter waves

Impact of personality on the recognition of emotion expressed via human, virtual, and robotic embodiments

学校读者我要写书评

暂无评论

Impact of personality on the recognition of emotion expresse...

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Pauline Chevalier Jean-Claude Martin Brice Isableu Adriana Tapus Robotics and Computer Vision Lab ENSTA-ParisTech Palaiseau France Jean-Claude Martin is with Cognition Perception Use LIMSI-CNRS Orsay France ClAMS-Motor Control and Perception Univ Paris Sud Orsav France

In this paper, we describe the elaboration and the validation of a body and face database 1 , of 96 videos of 1 to 2 seconds of duration, expressing 4 emotions (i.e., anger, happiness, fear, and sadness) elicited through 4 platforms of increased visual complexity and level of embodiment. The final aim of this database is to develop an individualized training program designed for individuals suffering of autism in order to help them recognize various emotions on different test platforms: two robots, a virtual agent, and a human. Before assessing the recognition capabilities of individuals with ASD, we validated our video database on typically developed individuals (TD). Moreover, we also looked at the relationship between the recognition rate and their personality traits (extroverted (EX) vs. introverted (IN)). We found that the personality of our TD participants did not lead to a different recognition behavior. However, introverted individuals better recognized emotions from less visually complex characters than extroverted individuals.

关键词： Emotion recognition Videos Databases Robots Animation Face Face recognition