检索结果-内蒙古大学图书馆

Efficient Object Rearrangement via Multi-view Fusion

学校读者我要写书评

暂无评论

Efficient Object Rearrangement via Multi-view Fusion

IEEE International Conference on robotics and Automation (ICRA)

作者： Dehao Huang Chao Tang Hong Zhang Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

The prospect of assistive robots aiding in object organization has always been compelling. In an image-goal setting, the robot rearranges the current scene to match the single image captured from the goal scene. The key to an image-goal rearrangement system is estimating the desired placement pose of each object based on the single goal image and observations from the current scene. In order to establish sufficient associations for accurate estimation, the system should observe an object from a viewpoint similar to that in the goal image. Existing image-goal rearrangement systems, due to their reliance on a fixed viewpoint for perception, often require redundant manipulations to randomly adjust an object’s pose for a better perspective. Addressing this inefficiency, we introduce a novel object rearrangement system that employs multi-view fusion. By observing the current scene from multiple viewpoints before manipulating objects, our approach can estimate a more accurate pose without redundant manipulation times. A standard visual localization pipeline at the object level is developed to capitalize on the advantages of multi-view observations. Simulation results demonstrate that the efficiency of our system outperforms existing single-view systems. The effectiveness of our system is further validated in a physical experiment. For videos, please visit https: //***/view/multi-view-rearr.

关键词： Visualization Accuracy Databases Simulation Standards organizations Pose estimation Pipelines

LiDAR-based drone navigation with reinforcement learning

学校读者我要写书评

暂无评论

arXiv 2023年

关键词： Robot Operating System

HeRo 2.0: A Low-Cost Robot for Swarm robotics Research

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Rezeck, Paulo Azpúrua, Héctor Corrêa, Maurício F.S. Chaimowicz, Luiz Graduate Program in Computer Science Computer Vision and Robotics Laboratory Department of Computer Science Universidade Federal de Minas Gerais Brazil Instituto Tecnológico Vale MG Ouro Preto Brazil Vision and Robotics Laboratory Department of Computer Science Universidade Federal de Minas Gerais Brazil Computer Vision and Robotics Laboratory Department of Computer Science Universidade Federal de Minas Gerais Brazil

The current state of electronic component miniaturization coupled with the increasing efficiency in hardware and software allow the development of smaller and compact robotic systems. The convenience of using these small, simple, yet capable robots has gathered the research community's attention towards practical applications of swarm robotics. This paper presents the design of a novel platform for swarm robotics applications that is low cost, easy to assemble using off-the-shelf components, and deeply integrated with the most used robotic framework available today: ROS (Robot Operating System). The robotic platform is entirely open, composed of a 3D printed body and open-source software. We describe its architecture, present its main features, and evaluate its functionalities executing experiments using a couple of robots. Results demonstrate that the proposed mobile robot is very effective given its small size and reduced cost, being suitable for swarm robotics research and education. © 2022, CC BY.

关键词： Swarm intelligence

Optimizing NeRF-based SLAM with Trajectory Smoothness Constraints

学校读者我要写书评

暂无评论

arXiv 2024年

作者： He, Yicheng Chen, Guangcheng Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The joint optimization of Neural Radiance Fields (NeRF) and camera trajectories has been widely applied in SLAM tasks due to its superior dense mapping quality and consistency. NeRF-based SLAM learns camera poses using constraints by implicit map representation. A widely observed phenomenon that results from the constraints of this form is jerky and physically unrealistic estimated camera motion, which in turn affects the map quality. To address this deficiency of current NeRF-based SLAM, we propose in this paper TS-SLAM (TS for Trajectory Smoothness). It introduces smoothness constraints on camera trajectories by representing them with uniform cubic B-splines with continuous acceleration that guarantees smooth camera motion. Benefiting from the differentiability and local control properties of B-splines, TS-SLAM can incrementally learn the control points end-to-end using a sliding window paradigm. Additionally, we regularize camera trajectories by exploiting the dynamics prior to further smooth trajectories. Experimental results demonstrate that TS-SLAM achieves superior trajectory accuracy and improves mapping quality versus NeRF-based SLAM that does not employ the above smoothness constraints. © 2024, CC BY.

关键词： Mapping

RTAGrasp: Learning Task-Oriented Grasping from Human Videos via Retrieval, Transfer, and Alignment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Dong, Wenlong Huang, Dehao Liu, Jiangshan Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

Task-oriented grasping (TOG) is crucial for robots to accomplish manipulation tasks, requiring the determination of TOG positions and directions. Existing methods either rely on costly manual TOG annotations or only extract coarse grasping positions or regions from human demonstrations, limiting their practicality in real-world applications. To address these limitations, we introduce RTAGrasp, a Retrieval, Transfer, and Alignment framework inspired by human grasping strategies. Specifically, our approach first effortlessly constructs a robot memory from human grasping demonstration videos, extracting both TOG position and direction constraints. Then, given a task instruction and a visual observation of the target object, RTAGrasp retrieves the most similar human grasping experience from its memory and leverages semantic matching capabilities of vision foundation models to transfer the TOG constraints to the target object in a training-free manner. Finally, RTAGrasp aligns the transferred TOG constraints with the robot’s action for execution. Evaluations on the public TOG benchmark, TaskGrasp dataset, show the competitive performance of RTAGrasp on both seen and unseen object categories compared to existing baseline methods. Real-world experiments further validate its effectiveness on a robotic arm. Our code, appendix, and video are available at https: //***/view/rtagrasp/home. © 2024, CC BY.

关键词： Robotic arms

Multi-Scale Point Octree Encoding Network for Point Cloud Based Place Recognition

学校读者我要写书评

暂无评论

Multi-Scale Point Octree Encoding Network for Point Cloud Ba...

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Zhilong Tang Hanjing Ye Hong Zhang Department of Electrical and Electronic Engineering Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology (SUSTech) SUSTech Shenzhen China

Over the past decades, point cloud-based place recognition has garnered significant attention. This research paper presents a pioneering approach, denoted as the Multi-scale Point Octree Encoding Network (MPOE-Net), designed to acquire a discriminative global descriptor for efficient retrieval of places. The key element of the MPOE-Net is the point octree encoding module, which adeptly captures local information for each point by considering its nearest and farthest neighbors. Further enhancing local relationships, a multi-transformer network is introduced, utilizing a novel grouped offset-attention mechanism. To amalgamate the multi-scale attention maps into a comprehensive global descriptor, a multi-NetVLAD layer is incorporated. Through rigorous experimentation across diverse benchmark datasets, our proposed method unequivocally outperforms existing techniques in the realm of point cloud-based place recognition tasks, achieving state-of-the-art results. Our code is released publicly at https://***/Zhilong-Tang/MPOE-Net.

关键词：

Toward Lung Ultrasound Automation: Fully Autonomous Robotic Longitudinal and Transverse Scans Along Intercostal Spaces

学校读者我要写书评

暂无评论

IEEE Transactions on Medical Robotics and Bionics

IEEE Transactions on Medical robotics and Bionics 2025年第2期7卷 768-781页

作者： Lei, Long Hu, Yingbai Jiang, Zixing Miao, Juzheng Luo, Xiao Zhang, Yu Wang, Qiong Wang, Shujun Li, Zheng Heng, Pheng-Ann The Chinese University of Hong Kong Department of Computer Science and Engineering Hong Kong Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China The Chinese University of Hong Kong Multi-Scale Medical Robotics Centre Ltd. Hong Kong The Chinese University of Hong Kong Department of Surgery Hong Kong Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen518055 China The Hong Kong Polytechnic University Department of Biomedical Engineering Hong Kong Chow Yuk Ho Technology Centre for Innovative Medicine Li Ka Shing Institute of Health Sciences Multiscale Medical Robotics Centre Ltd. The Chinese University of Hong Kong Department of Surgery Hong Kong

Lung ultrasound scanning is essential for diagnosing lung diseases. The scan effectiveness critically depends on both longitudinal and transverse scans through intercostal spaces to reduce rib shadowing interference, as well as maintaining the probe perpendicular to pleura for pathological artifact generation. Achieving this level of scan quality often depends heavily on the experience of doctors. Robotic ultrasound scanning shows promise, but currently lacks a direct path planning method for intercostal scanning, and probe orientation does not consider imaging differences between lungs and solid organs. In this paper, we aim to fully automate two fundamental operations in lung ultrasound scanning: longitudinal and transverse scans. We propose pioneering path planning methods along intercostal spaces and innovative solutions for adaptive probe posture adjustment using real-time pleural line feedback, specifically addressing the unique characteristics of lung ultrasound scanning. This ensures the acquisition of high-quality, diagnostically meaningful ultrasound images. In addition, we develop a robotic lung ultrasound system to validate the proposed methods. Extensive experimental results on two volunteers and a chest phantom confirm the efficacy of our methods, and demonstrate the system's feasibility in automated lung ultrasound examinations. Our work lays a solid foundation for automated robotic complete lung scanning. © 2018 IEEE.

关键词： Motion planning

Data-Driven Analysis of Skin Cancer Classification with Convolutional Neural Networks for E-Health Applications

学校读者我要写书评

暂无评论

Data-Driven Analysis of Skin Cancer Classification with Conv...

2024 IEEE Global Communications Conference, GLOBECOM 2024

作者： Ahmed, Imran Ahmad, Misbah Chehri, Abdellah Jeon, Gwanggil Anglia Ruskin University School of Computing and Information Science Cambridge United Kingdom Hartpury University Animal and Agriculture Department Gloucester United Kingdom University of the West of England Centre for Machine Vision Bristol Robotics Laboratory Bristol United Kingdom Department of Mathematics and Computer Science Canada Incheon National University Department of Embedded Systems Engineering Incheon Korea Republic of

ISBN: (纸本)9798350351255

This study explores the effectiveness of Convolutional Neural Networks (CNNs) in automatically classifying skin cancer for e-health applications. The trained model showcases impressive performance by leveraging the HAM10000 dataset, which includes a wide range of skin lesion images from seven different classes. The parameters and architecture of the CNN model are presented in a systematic manner, providing valuable insights into the reasoning behind its design. The model is optimized using the Adam optimizer and annealing techniques to ensure efficient convergence. The model's performance is assessed on validation and test datasets, showcasing an accuracy of 78.55% and 76.49%, respectively, for skin cancer classification. This study highlights the significant potential of CNN as a powerful tool for automating the diagnosis of skin cancer, which is in line with the growing trend of using deep learning for medical image analysis. © 2024 IEEE.

关键词： Electronic health record

Image saliency detection method based on multi-feature maps fusion 4

学校读者我要写书评

暂无评论

Image saliency detection method based on multi-feature maps ...

4th International Conference on computer Graphics, Image, and Virtualization, ICCGIV 2024

作者： Li, Xiaoli Liu, Yunpeng Zhao, Huaici Shenyang Institute of Automation Chinese Academy of Sciences Shenyang China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang China University of Chinese Academy of Sciences Beijing China Key Laboratory of Opto-Electronic Information Processing Shenyang China The Key Lab of Image Understanding and Computer Vision Shenyang China Shenyang Jianzhu University Shenyang China

ISBN: (纸本)9781510683242

In this research, we introduce an innovative saliency detection algorithm, comprising three essential steps. Firstly, leveraging fully convolutional networks with aggregation interaction modules, we generate an initial saliency map. Secondly, we extract hand-craft and deep features to express the image, then use manifold ranking method to construct saliency maps. Ultimately, by integrating the outcomes from preceding stages, we generate the final saliency map. Experimental findings demonstrate that our method surpasses twelve cutting-edge saliency detection techniques in terms of precision, recall, F-measure, and MAE value metrics." © 2024 SPIE.

关键词： Feature extraction