检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Wu, Zijian Schmidt, Adam Kazanzides, Peter Salcudean, Septimiu E. Robotics and Control Laboratory Department of Electrical and Computer Engineering The University of British Columbia VancouverBCV6T 1Z4 Canada Department of Computer Science Johns Hopkins University BaltimoreMD21218 United States

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in robotically assisted surgery. Applications, such as augmented reality guidance, require little user intervention along with efficient inference to be usable clinically. In this study, we address these limitations by adopting lightweight SAM variants to meet the efficiency requirement and employing fine-tuning techniques to enhance their generalization in surgical scenes. Recent advancements in Tracking Any Point (TAP) have shown promising results in both accuracy and efficiency, particularly when points are occluded or leave the field of view. Inspired by this progress, we present a novel framework that combines an online point tracker with a lightweight SAM model that is fine-tuned for surgical instrument segmentation. Sparse points within the region of interest are tracked and used to prompt SAM throughout the video sequence, providing temporal consistency. The quantitative results surpass the state-of-the-art semi-supervised video object segmentation method XMem on the EndoVis 2015 dataset with 84.8 IoU and 91.0 Dice. Our method achieves promising performance that is comparable to XMem and transformer-based fully supervised segmentation methods on ex vivo UCL dVRK and in vivo CholecSeg8k datasets. In addition, the proposed method shows promising zero-shot generalization ability on the label-free STIR dataset. In terms of efficiency, we tested our method on a single GeForce RTX 4060/4090 GPU respectively, achieving an over 25/90 FPS inference speed. Code is available at: https://***/wuzijian1997/SIS-PT-SAM © 2024, CC BY.

关键词： Surgical equipment

来源：评论

学校读者我要写书评

暂无评论

Tunable Rectification of Diffusion-Wave Fields by Spatiotemporal Metamaterials

引用

Physical Review Letters 2022年第25期129卷 256601-256601页

作者： Jiaxin Li Zhanxiang Zhang Guoqiang Xu Haoran Sun Lizhou Dai Tianlong Li Cheng-Wei Qiu Department of Electrical and Computer Engineering National University of Singapore Singapore 117583 Singapore State Key Laboratory of Robotics and System Harbin Institute of Technology Harbin 150001 China

The diffusion process is the basis of many branches of science and engineering, and generally obeys reciprocity between two ports of a linear time-invariant medium. Recent research on classical wave dynamics has explored the spatiotemporal modulation to exhibit preferred directions in photons and plasmons. Here we report a distinct rectification effect on diffusion-wave fields by modulating the conductivity and observe nonreciprocal transport of charges. We experimentally create a spatiotemporal diffusion metamaterial, in which a mode transition to zero frequency is realized. A direct current component thereby emerges, showcasing a biased effect on the charge diffusion when the incident fundamental frequency is a multiple of the system modulation frequency. These results may find applications spanning a plethora of diffusive fields in general.

关键词： Diffusion Metamaterials Bloch-Floquet theorem

来源：评论

学校读者我要写书评

暂无评论

Graph-Based Visual-Kinematic Fusion and Monte Carlo Initialization for Fast-Deployable Cable-Driven Robots

Graph-Based Visual-Kinematic Fusion and Monte Carlo Initiali...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： R. Khorrambakht H. Damirchi M.R. Dindarloo A. Saki S.A. Khalilpour Hamid D. Taghirad Stephan Weiss Electrical & Computer Engineering Department Control/Robotics Research Laboratory Tandon School of Engineering New York University Brooklyn NY School of Computer Science University of Adelaide Australia Faculty of Electrical Engineering University of Technology Tehran Iran Department of Smart Systems Technologies University of Klagenfurt Austria

Ease of calibration and high-accuracy task-space state-estimation purely based on onboard sensors is a key requirement for enabling easily deployable cable robots in real-world applications. In this work, we incorporate the onboard camera and kinematic sensors to drive a statistical fusion framework that presents a unified localization and calibration system which requires no initial values for the kinematic parameters. This is achieved by formulating a Monte-Carlo algorithm that initializes a factor-graph representation of the calibration and localization problem. With this, we are able to jointly identify both the kinematic parameters and the visual odometry scale alongside their corresponding uncertainties. We demonstrate the practical applicability of the framework using our state-estimation dataset recorded with the ARAS-CAM suspended cable driven parallel robot, and published as part of this manuscript.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Dependency-aware Task Offloading and Resource Pricing in Vehicular Edge Computing: A Stackelberg Game Approach

Dependency-aware Task Offloading and Resource Pricing in Veh...

引用

International Symposium on Parallel and Distributed Processing with Applications, ISPA

作者： Liang Zhao Shuai Huang Yuxiang Cao Huan Zhou Victor C. M. Leung Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering College of Computer and Information Technology China Three Gorges University Yichang China School of Computer Science Northwestern Polytechnical University Xi’an China Department of Electrical and Computer Engineering The University of British Columbia Vancouver Canada

ISBN: (数字)9798331509712

ISBN: (纸本)9798331509729

Vehicular Edge Computing (VEC) allows vehicles to offload their delay-sensitive tasks to nearby Road Side Units (RSUs) for processing, which improves network quality of service (QoS). However, the self-interested SDN controller is unwilling to ask RSUs to provide free computing resources for vehicles. At the same time, complicated dependencies between vehicular subtasks may cause non-ideal task delay and energy consumption. In order to solve these problems, this paper proposes a Stackelberg game-based Dependency-aware task Offloading and resource Pricing framework (SDOP). Specifically, we first model a vehicular edge network that partially offloads dependency-aware tasks. Then, we depict the interaction between the SDN controller and vehicles as a Stackelberg game, with the goal of maximizing the utility of both parties. Next, we present a Gradient Ascent Plus Genetic algorithm (GAPG) to solve the problem. Finally, numerous simulations are performed, and the results show that compared with other baseline schemes, the proposed GAPG can significantly improve the utility of both the SDN controller and vehicles under various scenarios.

关键词： Energy consumption Computational modeling Road side unit Process control Games Pricing Quality of service Delays Edge computing Genetic algorithms

来源：评论

学校读者我要写书评

暂无评论

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutiona...

引用

IEEE International Conference on robotics and Biomimetics

作者： Shanshan Ji Qiwei Meng Wen Wang Zheyuan Lin Te Li Minhong Wan Chunlong Zhang Jason Gu Research Center for Intelligent Robotics Research Institute of Interdisciplinary Innovation Zhejiang Laboratory Hangzhou China Department of Electrical and Computer Engineering Dalhousie University Halifax NS Canada

In human-robot interaction (HRI), human pose estimation is a necessary technology for the robot to perceive the dynamic environment and make interactive actions. Recently, graph convolutional networks (GCNs) have been increasingly used for 2D to 3D pose estimation tasks since the skeleton topologies can be viewed as graph structures. In this paper, we propose a novel graph convolutional network architecture, Multi-scale Multi-branch Fusion Graph Convolutional Networks (MSMB-GCN), for 3D Human Pose Estimation(3D HPE) task. The proposed model consists of multiple GCN blocks with a multi-branch architecture. This multi-branch architecture enables the model to get multi-scale features for human skeletal representations. The group of GCN blocks, which has strong multi-level feature extraction capabilities, allows the model to learn global and local features, lower-level and higher-level features. Experiment results on the HumanPose benchmark demonstrate that our model outperforms the state-of-the-art and ablation studies validate the effectiveness of our approach.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Game-Theoretic Dependent Task Offloading and Resource Pricing in Vehicular Edge Computing

Game-Theoretic Dependent Task Offloading and Resource Pricin...

引用

International Workshop on Quality of Service

作者： Liang Zhao Shuai Huang Huan Zhou Zilong Bai Victor C. M. Leung Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering College of Computer and Information Technology China Three Gorges University Yichang China School of Computer Science Northwestern Polytechnical University Xi’an China Department of Electrical and Computer Engineering The University of British Columbia Vancouver Canada

ISBN: (数字)9798350350128

ISBN: (纸本)9798350350135

This paper proposes a Stacklberg game-based Dependent task Offloading and resource Pricing framework (SDOP), where vehicles partially offload their dependent substaks to the SDN controller and pays corresponding fees. Firstly, we model the interaction between the SDN controller and vehicles as a Stackelberg game, where both parties wish to maximize their utility. Then, we employ the backward induction approach to analyze the investigated problem, and prove the existence and uniqueness of Nash and Stackelberg equilibrium. Next, we propose a Gradient Ascent Plus Genetic algorithm (GAPG) to solve the considered problem. Finally, extensive simulation results show that the proposed GAPG outperforms other baseline schemes under various scenarios.

关键词： Simulation Computational modeling Pricing Games Quality of service Benchmark testing Optimization

来源：评论

学校读者我要写书评

暂无评论

FRAME: Fast and Robust Autonomous 3D Point Cloud Map-Merging for Egocentric Multi-Robot Exploration

FRAME: Fast and Robust Autonomous 3D Point Cloud Map-Merging...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Nikolaos Stathoulopoulos Anton Koval Ali-akbar Agha-mohammadi George Nikolakopoulos Department of Computer Electrical and Space Engineering Robotics and AI Group Luleå University of Technology Luleå Sweden Jet Propulsion Laboratory California Institute of Technology Pasadena CA

This article presents a 3D point cloud map-merging framework for egocentric heterogeneous multi-robot exploration, based on overlap detection and alignment, that is independent of a manual initial guess or prior knowledge of the robots' poses. The novel proposed solution utilizes state-of-the-art place recognition learned descriptors, that through the framework's main pipeline, offer a fast and robust region overlap estimation, hence eliminating the need for the time-consuming global feature extraction and feature matching process that is typically used in 3D map integration. The region overlap estimation provides a homogeneous rigid transform that is applied as an initial condition in the point cloud registration algorithm Fast-GICP, which provides the final and refined alignment. The efficacy of the proposed framework is experimentally evaluated based on multiple field multi-robot exploration missions in underground environments, where both ground and aerial robots are deployed, with different sensor configurations.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Fuzzy Object Ambiguity Determination and Human Attention Assessment for Domestic Service Robots

Fuzzy Object Ambiguity Determination and Human Attention Ass...

引用

International Conference on Soft Computing and Machine Intelligence (ISCMI)

作者： Kevin Fan Melanie Jouaiti Kerstin Dautenhahn Chrystopher L. Nehaniv Department of Electrical & Computer Engineering and Systems Design Engineering Social and Intelligent Robotics Research Laboratory (SIRRL) University of Waterloo Waterloo Canada Departments of Electrical & Computer Engineering and Systems Design Engineering Social and Intelligent Robotics Research Laboratory (SIRRL) University of Waterloo Waterloo Canada

Domestic service robots have the promising potential of bringing significant services to the general population, and more importantly, successful applications of universal domestic service robots can potentially help mitigate critical societal issues such as senior care. In order to do so, domestic service robots need to integrate seamlessly into home environments. However, home environments are dynamic, complex and filled with personal items. Therefore, ambiguity can quickly arise for robots operating in such rich environments. In this paper, we propose an object ambiguity determination system that can determine the level of ambiguity in robot object selection tasks with fuzzy logic data integration. Additionally, we propose a functional human attention assessment system with fuzzy logic that enables the robot to determine user attention before committing to general disambiguation processes. Our preliminary results show that the proposed fuzzy logic inference systems can reliably estimate the robot object selection task ambiguity from object confidence level and the number of potential target objects that satisfy the user's command. Furthermore, fuzzy inference is applied to decide human eye gaze direction robustly. These subsystems can be utilized in the context of human-robot interaction to guide the robot when to seek feedback from a human partner in order to disambiguate reference in domestic service tasks. The source code of all proposed systems is available publicly on GitHub. 1

关键词： Fuzzy logic Service robots Source coding Sociology Human-robot interaction Data integration Reliability

来源：评论

学校读者我要写书评

暂无评论

DAMPER: A Dual-Stage Medical Report Generation Framework with Coarse-Grained MeSH Alignment and Fine-Grained Hypergraph Matching

arXiv

引用

arXiv 2024年

作者： Huang, Xiaofei Chen, Wenting Liu, Jie Lu, Qisheng Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen China Department of Electrical Engineering City University of Hong Kong Kowloon Hong Kong National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing, where physicians typically conduct an initial quick review followed by a detailed examination. Moreover, current alignment methods may lead to misaligned relationships. To address these issues, we propose DAMPER, a dual-stage framework for medical report generation that mimics the clinical pipeline of report writing in two stages. In the first stage, a MeSH-Guided Coarse-Grained Alignment (MCG) stage that aligns chest X-ray (CXR) image features with medical subject headings (MeSH) features to generate a rough keyphrase representation of the overall impression. In the second stage, a Hypergraph-Enhanced Fine-Grained Alignment (HFG) stage that constructs hypergraphs for image patches and report annotations, modeling high-order relationships within each modality and performing hypergraph matching to capture semantic correlations between image regions and textual phrases. Finally,the coarse-grained visual features, generated MeSH representations, and visual hypergraph features are fed into a report decoder to produce the final medical report. Extensive experiments on public datasets demonstrate the effectiveness of DAMPER in generating comprehensive and accurate medical reports, outperforming state-of-the-art methods across various evaluation metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Coarse-grained modeling

来源：评论

学校读者我要写书评

暂无评论

Learning a Better Control Barrier Function

Learning a Better Control Barrier Function

引用

IEEE Conference on Decision and Control

作者： Bolun Dai Prashanth Krishnamurthy Farshad Khorrami Electrical & Computer Engineering Department Control/Robotics Research Laboratory Tandon School of Engineering New York University Brooklyn NY

ISBN: (数字)9781665467612

ISBN: (纸本)9781665467629

Control barrier functions (CBFs) are widely used in safety-critical controllers. However, constructing a valid CBF is challenging, especially under nonlinear or non-convex constraints and for high relative degree systems. Meanwhile, finding a conservative CBF that only recovers a portion of the true safe set is usually possible. In this work, starting from a "conservative" handcrafted CBF (HCBF), we develop a method to find a CBF that recovers a reasonably larger portion of the safe set. Since the learned CBF controller is not guaranteed to be safe during training iterations, we use a model predictive controller (MPC) to ensure safety during training. Using the collected trajectory data containing safe and unsafe interactions, we train a neural network to estimate the difference between the HCBF and a CBF that recovers a closer solution to the true safe set. With our proposed approach, we can generate safe controllers that are less conservative and computationally more efficient. We validate our approach on two systems: a second-order integrator and a ball-on-beam.

关键词： Training Heuristic algorithms Neural networks Predictive models Data collection Data models Safety

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：