检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Esfandiari, Mojtaba Gehlbach, Peter Taylor, Russell H. Iordachita, Iulian I. The Department of Mechanical Engineering The Laboratory for Computational Sensing and Robotics The Johns Hopkins University BaltimoreMD21218 United States The Wilmer Eye Institute Johns Hopkins Hospital BaltimoreMD21287 United States The Department of Computer Science The Laboratory for Computational Sensing and Robotics The Johns Hopkins University BaltimoreMD21218 United States

Performing retinal vein cannulation (RVC) as a potential treatment for retinal vein occlusion (RVO) without the assistance of a surgical robotic system is very challenging to do safely. The main limitation is the physiological hand tremor of surgeons. Robot-assisted eye surgery technology may resolve the problems of hand tremors and fatigue and improve the safety and precision of RVC. The Steady-Hand Eye Robot (SHER) is an admittance-based robotic system that can filter out hand tremors and enables ophthalmologists to manipulate a surgical instrument inside the eye cooperatively. However, the admittance-based cooperative control mode does not safely minimize the contact force between the surgical instrument and the sclera to prevent tissue damage. Additionally, features like haptic feedback or hand motion scaling, which can improve the safety and precision of surgery, require a teleoperation control framework. This work presents a bimanual adaptive teleoperation (BMAT) control framework using SHER 2.0 and SHER 2.1 robotic systems. We integrate them with an adaptive force control (AFC) algorithm to automatically minimize the tool-sclera interaction force. The scleral forces are measured using two fiber Bragg grating (FBG)-based force-sensing tools. We compare the performance of the BMAT mode with a bimanual adaptive cooperative (BMAC) mode in a vessel-following experiment under a surgical microscope. Experimental results demonstrate the effectiveness of the proposed BMAT control framework in performing a safe bimanual telemanipulation of the eye without over-stretching it, even in the absence of registration between the two robots. © 2024, CC BY.

关键词： Fiber Bragg gratings

来源：评论

学校读者我要写书评

暂无评论

Shape Manipulation of Bevel-Tip Needles for Prostate Biopsy Procedures: A Comparison of Two Resolved-Rate Controllers

Shape Manipulation of Bevel-Tip Needles for Prostate Biopsy ...

引用

Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

作者： Yanzhou Wang Lidia Al-Zogbi Jiawei Liu Lauren Shepard Ahmed Ghazi Junichi Tokuda Simon Leonard Axel Krieger Iulian Iordachita Department of Mechanical Engineering and the Laboratory for Computational Sensing and Robotics Johns Hopkins University Baltimore MD USA Laboratory of Computational Sensing and Robotics Johns Hopkins University Baltimore MD USA Brady Urological Institute Johns Hopkins University Baltimore MD USA Department of Radiology Brigham and Women’s Hospital Harvard Medical School Boston MA USA Department of Computer Science Laboratory for Computational Sensing and Robotics Johns Hopkins University Baltimore MD USA

ISBN: (数字)9798350371499

ISBN: (纸本)9798350371505

Prostate cancer diagnosis continues to encounter challenges, often due to imprecise needle placement in standard biopsies. Several control strategies have been developed to compensate for needle tip prediction inaccuracies, however none were compared against each other, and it is unclear whether any of them can be safely and universally applied in clinical settings. This paper compares the performance of two resolved-rate controllers, derived from a mechanics-based and a data-driven approach, for bevel-tip needle control using needle shape manipulation through a template. We demonstrate for a simulated 12-core biopsy procedure under model parameter uncertainty that the mechanics-based controller can better reach desired targets when only the final goal configuration is presented even with uncertainty on model parameters estimation, and that providing a feasible needle path is crucial in ensuring safe surgical outcomes when either controller is used for needle shape manipulation.

关键词： Uncertain systems Uncertainty Parameter estimation Medical robotics Shape Biological system modeling Biopsy Needles Prostate cancer Standards

来源：评论

学校读者我要写书评

暂无评论

Augmenting Efficient Real-time Surgical Instrument Segmentation in Video with Point Tracking and Segment Anything

arXiv

引用

arXiv 2024年

作者： Wu, Zijian Schmidt, Adam Kazanzides, Peter Salcudean, Septimiu E. Robotics and Control Laboratory Department of Electrical and Computer Engineering The University of British Columbia VancouverBCV6T 1Z4 Canada Department of Computer Science Johns Hopkins University BaltimoreMD21218 United States

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in robotically assisted surgery. Applications, such as augmented reality guidance, require little user intervention along with efficient inference to be usable clinically. In this study, we address these limitations by adopting lightweight SAM variants to meet the efficiency requirement and employing fine-tuning techniques to enhance their generalization in surgical scenes. Recent advancements in Tracking Any Point (TAP) have shown promising results in both accuracy and efficiency, particularly when points are occluded or leave the field of view. Inspired by this progress, we present a novel framework that combines an online point tracker with a lightweight SAM model that is fine-tuned for surgical instrument segmentation. Sparse points within the region of interest are tracked and used to prompt SAM throughout the video sequence, providing temporal consistency. The quantitative results surpass the state-of-the-art semi-supervised video object segmentation method XMem on the EndoVis 2015 dataset with 84.8 IoU and 91.0 Dice. Our method achieves promising performance that is comparable to XMem and transformer-based fully supervised segmentation methods on ex vivo UCL dVRK and in vivo CholecSeg8k datasets. In addition, the proposed method shows promising zero-shot generalization ability on the label-free STIR dataset. In terms of efficiency, we tested our method on a single GeForce RTX 4060/4090 GPU respectively, achieving an over 25/90 FPS inference speed. Code is available at: https://***/wuzijian1997/SIS-PT-SAM © 2024, CC BY.

关键词： Surgical equipment

来源：评论

学校读者我要写书评

暂无评论

FeCAM: exploiting the heterogeneity of class distributions in exemplar-free continual learning 23

FeCAM: exploiting the heterogeneity of class distributions i...

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Dipam Goswami Yuyang Liu Bartłomiej Twardowski Joost van de Weijer Department of Computer Science Universitat Autònoma de Barcelona and Computer Vision Center Barcelona University of Chinese Academy of Sciences and State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences and Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Department of Computer Science Universitat Autònoma de Barcelona and Computer Vision Center Barcelona and IDEAS-NCBR

Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting. Recent approaches to incrementally learning the classifier by freezing the feature extractor after the first task have gained much attention. In this paper, we explore prototypical networks for CIL, which generate new class prototypes using the frozen feature extractor and classify the features based on the Euclidean distance to the prototypes. In an analysis of the feature distributions of classes, we show that classification based on Euclidean metrics is successful for jointly trained features. However, when learning from non-stationary data, we observe that the Euclidean metric is suboptimal and that feature distributions are heterogeneous. To address this challenge, we revisit the anisotropic Mahalanobis distance for CIL. In addition, we empirically show that modeling the feature covariance relations is better than previous attempts at sampling features from normal distributions and training a linear classifier. Unlike existing methods, our approach generalizes to both many- and few-shot CIL settings, as well as to domain-incremental settings. Interestingly, without updating the backbone network, our method obtains state-of-the-art results on several standard continual learning benchmarks. Code is available at https://***/dipamgoswami/FeCAM.

关键词：

来源：评论

学校读者我要写书评

暂无评论

ViTacTip: Design and Verification of a Novel Biomimetic Physical Vision-Tactile Fusion Sensor

ViTacTip: Design and Verification of a Novel Biomimetic Phys...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Wen Fan Haoran Li Weiyong Si Shan Luo Nathan Lepora Dandan Zhang Department of Bioengineering Imperial College London School of Engineering Mathematics and Technology and Bristol Robotics Laboratory University of Bristol School of Computer Science and Electronic Engineering University of Essex Department of Engineering King’s College London

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

Tactile sensing is significant for robotics since it can obtain physical contact information during manipulation. To capture multimodal contact information within a compact framework, we designed a novel sensor called ViTacTip, which seamlessly integrates both tactile and visual perception capabilities into a single, integrated sensor unit. ViTacTip features a transparent skin to capture fine features of objects during contact, which can be known as the see-through-skin mechanism. In the meantime, the biomimetic tips embedded in ViTacTip can amplify touch motions during tactile perception. For comparative analysis, we also fabricated a ViTac sensor devoid of biomimetic tips, as well as a TacTip sensor with opaque skin. Furthermore, we develop a Generative Adversarial Network (GAN)-based approach for modality switching between different perception modes, effectively alternating the emphasis between vision and tactile perception modes. We conducted a performance evaluation of the proposed sensor across three distinct tasks: i) grating identification, ii) pose regression, iii) contact localization and force estimation. In the grating identification task, ViTacTip demonstrated an accuracy of 99.72%, surpassing TacTip, which achieved 94.60%. It also exhibited superior performance in both pose and force estimation tasks with the minimum error of 0.08 mm and 0.03N, respectively, in contrast to ViTac’s 0.12 mm and 0.15N. Results indicate that ViTacTip outperforms single-modality sensors.

关键词： Biomimetics Force Estimation Switches Robot sensing systems Skin Sensors

来源：评论

学校读者我要写书评

暂无评论

SocNavGym: A Reinforcement Learning Gym for Social Navigation

SocNavGym: A Reinforcement Learning Gym for Social Navigatio...

引用

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Aditya Kapoor Sushant Swamy Pilar Bachiller Luis J. Manso Tata Consultancy Services Research & Innovation India Birla Institute of Technology and Science Goa India Computer and Communication Technology Department Universidad de Extremadura Spain Computer Science Department Autonomous Robotics and Perception Laboratory Aston University UK

It is essential for autonomous robots to be socially compliant while navigating in human-populated environments. Machine Learning and, especially, Deep Reinforcement Learning have recently gained considerable traction in the field of Social Navigation. This can be partially attributed to the resulting policies not being bound by human limitations in terms of code complexity or the number of variables that are handled. Unfortunately, the lack of safety guarantees and the large data requirements by DRL algorithms make learning in the real world unfeasible. To bridge this gap, simulation environments are frequently used. We propose SocNavGym, an advanced simulation environment for social navigation that can generate a wide variety of social navigation scenarios and facilitates the development of intelligent social agents. SocNavGym is lightweight, fast, easy to use, and can be effortlessly configured to generate different types of social navigation scenarios. It can also be configured to work with different hand-crafted and data-driven social reward signals and to yield a variety of evaluation metrics to benchmark agents’ performance. Further, we also provide a case study where a Dueling-DQN agent is trained to learn social-navigation policies using SocNavGym. The results provide evidence that SocNavGym can be used to train an agent from scratch to navigate in simple as well as complex social scenarios. Our experiments also show that the agents trained using the data-driven reward function display more advanced social compliance in comparison to the heuristic-based reward function.

关键词：

来源：评论

学校读者我要写书评

暂无评论

SocNavGym: A Reinforcement Learning Gym for Social Navigation

arXiv

引用

arXiv 2023年

作者： Kapoor, Aditya Swamy, Sushant Bachiller, Pilar Manso, Luis J. Tata Consultancy Services Research & Innovation India Birla Institute of Technology and Science Goa India Computer and Communication Technology Department Universidad de Extremadura Spain Autonomous Robotics and Perception Laboratory Computer Science Department Aston University United Kingdom

It is essential for autonomous robots to be socially compliant while navigating in human-populated environments. Machine Learning and, especially, Deep Reinforcement Learning have recently gained considerable traction in the field of Social Navigation. This can be partially attributed to the resulting policies not being bound by human limitations in terms of code complexity or the number of variables that are handled. Unfortunately, the lack of safety guarantees and the large data requirements by DRL algorithms make learning in the real world unfeasible. To bridge this gap, simulation environments are frequently used. We propose SocNavGym, an advanced simulation environment for social navigation that can generate a wide variety of social navigation scenarios and facilitates the development of intelligent social agents. SocNavGym is lightweight, fast, easy to use, and can be effortlessly configured to generate different types of social navigation scenarios. It can also be configured to work with different hand-crafted and data-driven social reward signals and to yield a variety of evaluation metrics to benchmark agents' performance. Further, we also provide a case study where a Dueling-DQN agent is trained to learn social-navigation policies using SocNavGym. The results provide evidence that SocNavGym can be used to train an agent from scratch to navigate in simple as well as complex social scenarios. Our experiments also show that the agents trained using the data-driven reward function display more advanced social compliance in comparison to the heuristic-based reward function. Copyright © 2023, The Authors. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior

arXiv

引用

arXiv 2025年

作者： Li, Mingrui Liu, Shuhong Deng, Tianchen Wang, Hongyu the Department of Computer Science Dalian University of Technology Dalian China the Department of Mechano-informatics Information Science and Technology The University of Tokyo Tokyo Japan Institute of Medical Robotics Department of Automation Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education China

Gaussian SLAM systems excel in real-time rendering and fine-grained reconstruction compared to NeRF-based systems. However, their reliance on extensive keyframes is impractical for deployment in real-world robotic systems, which typically operate under sparse-view conditions that can result in substantial holes in the map. To address these challenges, we introduce DenseSplat, the first SLAM system that effectively combines the advantages of NeRF and 3DGS. DenseSplat utilizes sparse keyframes and NeRF priors for initializing primitives that densely populate maps and seamlessly fill gaps. It also implements geometry-aware primitive sampling and pruning strategies to manage granularity and enhance rendering efficiency. Moreover, DenseSplat integrates loop closure and bundle adjustment, significantly enhancing frame-to-frame tracking accuracy. Extensive experiments on multiple large-scale datasets demonstrate that DenseSplat achieves superior performance in tracking and mapping compared to current state-of-the-art methods. © 2025, CC BY.

关键词： Real time systems

来源：评论

学校读者我要写书评

暂无评论

Dynamic Subgoal based Path Formation and Task Allocation: A NeuroFleets Approach to Scalable Swarm robotics

arXiv

引用

arXiv 2024年

作者： Peter, Robinroy Ratnabala, Lavanya Andrew Charles, Eugene Yugarajah Tsetserukou, Dzmitry LTD Jaffna Sri Lanka Intelligent Space Robotics Laboratory Skolkovo Institute of Science and Technology Bolshoy Boulevard 30 bld. 1 Moscow121205 Russia Department of Computer Science University of Jaffna Jaffna Sri Lanka

This paper addresses the challenges of exploration and navigation in unknown environments from the perspective of evolutionary swarm robotics. A key focus is on path formation, which is essential for enabling cooperative swarm robots to navigate effectively. We designed the task allocation and path formation process based on a finite state machine, ensuring systematic decision-making and efficient state transitions. The approach is decentralized, allowing each robot to make decisions independently based on local information, which enhances scalability and robustness. We present a novel subgoal-based path formation method that establishes paths between locations by leveraging visually connected subgoals. Simulation experiments conducted in the Argos simulator show that this method successfully forms paths in the majority of trials. However, inter-collision (traffic) among numerous robots during path formation can negatively impact performance. To address this issue, we propose a task allocation strategy that uses local communication protocols and light signal-based communication to manage robot deployment. This strategy assesses the distance between points and determines the optimal number of robots needed for the path formation task, thereby reducing unnecessary exploration and traffic congestion. The performance of both the subgoal-based path formation method and the task allocation strategy is evaluated by comparing the path length, time, and resource usage against the A* algorithm. Simulation results demonstrate the effectiveness of our approach, highlighting its scalability, robustness, and fault tolerance. Copyright © 2024, The Authors. All rights reserved.

关键词： Traffic congestion

来源：评论

学校读者我要写书评

暂无评论

An End-to-End Human Simulator for Task-Oriented Multimodal Human-Robot Collaboration

arXiv

引用

arXiv 2023年

作者： Shervedani, Afagh Mehri Li, Siyu Monaikul, Natawut Abbasi, Bahareh Di Eugenio, Barbara Žefran, Miloš The Robotics Laboratory Department of Electrical and Computer Engineering University of Illinois Chicago ChicagoIL60607 United States The Natural Language Processing Laboratory Department of Computer Science University of Illinois Chicago ChicagoIL60607 United States The Computer Science Department California State University Channel Islands CamarilloCA93012 United States

This paper proposes a neural network-based user simulator that can provide a multimodal interactive environment for training Reinforcement Learning (RL) agents in collaborative tasks involving multiple modes of communication. The simulator is trained on the existing ELDERLY-AT-HOME corpus and accommodates multiple modalities such as language, pointing gestures, and haptic-ostensive actions. The paper also presents a novel multimodal data augmentation approach, which addresses the challenge of using a limited dataset due to the expensive and time-consuming nature of collecting human demonstrations. Overall, the study highlights the potential for using RL and multimodal user simulators in developing and improving domestic assistive robots. Copyright © 2023, The Authors. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：