检索结果-内蒙古大学图书馆

21st International Symposium on Applied Reconfigurable Computing, ARC 2025

作者： Danilowicz, Michal Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (纸本)9783031879944

Multi-object tracking (MOT) is one of the most important problems in computer vision and a key component of any vision-based perception system used in advanced autonomous mobile robotics. Therefore, its implementation on low-power and real-time embedded platforms is highly desirable. Modern MOT algorithms should be able to track objects of a given class (e.g. people or vehicles). In addition, the number of objects to be tracked is not known in advance, and they may appear and disappear at any time, as well as be obscured. For these reasons, the most popular and successful approaches have recently been based on the tracking paradigm. Therefore, the presence of a high quality object detector is essential, which in practice accounts for the vast majority of the computational and memory complexity of the whole MOT system. In this paper, we propose an FPGA (Field-Programmable Gate Array) implementation of an embedded MOT system based on a quantized YOLOv8 detector and the SORT (Simple Online Realtime Tracker) tracker. We use a modified version of the FINN framework to utilize external memory for model parameters and to support operations necessary required by YOLOv8. We discuss the evaluation of detection and tracking performance using the COCO and MOT15 datasets, where we achieve 0.21 mAP and 38.9 MOTA respectively. As the computational platform, we use an MPSoC system (Zynq UltraScale+ device from AMD/Xilinx) where the detector is deployed in reprogrammable logic and the tracking algorithm is implemented in the processor system. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： System-on-chip

来源：评论

学校读者我要写书评

暂无评论

Analytic Inverse Kinematics Model and Trajectory Planning for an 18 DoF Quadruped Robot 27

Analytic Inverse Kinematics Model and Trajectory Planning fo...

引用

27th International Conference on System Theory, Control and Computing, ICSTCC 2023

作者： Muntean, Bogdan Zaha, Mihai Grigorescu, Sorin The Robotics Vision and Control Laboratory RovisLab Transilvania University of Brasov Romania

ISBN: (纸本)9798350337983

Kinematics modelling of robotic systems is a fundamental requirement used by the underling control system. In this paper, we introduce a complete and analytic direct and inverse kinematic model for an 18 DoF quadruped robot. The proposed solution, based on simple trigonometric functions, is analytically determined, allowing the full control of the translation and orientation of the footholds and of the body. Considering the fact that the dynamic model of the robot requires position, velocity and angular acceleration profiles as references, this article also presents the applicability of a trajectory generator with zero initial and zero final conditions for the first and second derivatives. As performance evaluation, we have determined the accuracy of the model by implementing a static gait controller on a A1 Unitree quadrupped robot, where the trajectory of each foot is calculated based on B-splines, given as reference to the inverse kinematics model. © 2023 IEEE.

关键词： Inverse kinematics

来源：评论

学校读者我要写书评

暂无评论

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

Energy Efficient Hardware Acceleration of Neural Networks wi...

引用

International Conference on Computer vision and Graphics, ICCVG 2022

作者： Przewlocka-Rus, Dominika Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (纸本)9783031220241

Deep neural networks virtually dominate the domain of most modern vision systems, providing high performance at a cost of increased computational complexity. Since for those systems it is often required to operate both in real-time and with minimal energy consumption (e.g., for wearable devices or autonomous vehicles, edge Internet of Things (IoT), sensor networks), various network optimisation techniques are used, e.g., quantisation, pruning, or dedicated lightweight architectures. Due to the logarithmic distribution of weights in neural network layers, a method providing high performance with significant reduction in computational precision (for 4-bit weights and less) is the Power-of-Two (PoT) quantisation (and therefore also with a logarithmic distribution). This method introduces additional possibilities of replacing the typical for neural networks Multiply and ACcumulate (MAC—performing, e.g., convolution operations) units, with more energy-efficient Bitshift and ACcumulate (BAC). In this paper, we show that a hardware neural network accelerator with PoT weights implemented on the Zynq UltraScale + MPSoC ZCU104 SoC FPGA can be at least 1.4x more energy efficient than the uniform quantisation version. To further reduce the actual power requirement by omitting part of the computation for zero weights, we also propose a new pruning method adapted to logarithmic quantisation. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： System-on-chip

来源：评论

学校读者我要写书评

暂无评论

Traffic Sign Classification Using Deep and Quantum Neural Networks

Traffic Sign Classification Using Deep and Quantum Neural Ne...

引用

International Conference on Computer vision and Graphics, ICCVG 2022

作者： Kuros, Sylwia Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (纸本)9783031220241

Quantum Neural Networks (QNNs) are an emerging technology that can be used in many applications including computer vision. In this paper, we presented a traffic sign classification system implemented using a hybrid quantum-classical convolutional neural network. Experiments on the German Traffic Sign Recognition Benchmark dataset indicate that currently QNN do not outperform classical DCNN (Deep Convolutuional Neural Networks), yet still provide an accuracy of over 90% and are a definitely promising solution for advanced computer vision. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Traffic signs

来源：评论

学校读者我要写书评

暂无评论

PointPillars Backbone Type Selection for Fast and Accurate LiDAR Object Detection

PointPillars Backbone Type Selection for Fast and Accurate L...

引用

International Conference on Computer vision and Graphics, ICCVG 2022

作者： Lis, Konrad Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Al. Mickiewicza 30 Krakow30-059 Poland

ISBN: (纸本)9783031220241

3D object detection from LiDAR sensor data is an important topic in the context of autonomous cars and drones. In this paper, we present the results of experiments on the impact of backbone selection of a deep convolutional neural network on detection accuracy and computation speed. We chose the PointPillars network, which is characterised by a simple architecture, high speed, and modularity that allows for easy expansion. During the experiments, we paid particular attention to the change in detection efficiency (measured by the mAP metric) and the total number of multiply-addition operations needed to process one point cloud. We tested 10 different convolutional neural network architectures that are widely used in image-based detection problems. For a backbone like MobilenetV1, we obtained an almost 4x speedup at the cost of a 1.13% decrease in mAP. On the other hand, for CSPDarknet we got an acceleration of more than 1.5x at an increase in mAP of 0.33%. We have thus demonstrated that it is possible to significantly speed up a 3D object detector in LiDAR point clouds with a small decrease in detection efficiency. This result can be used when PointPillars or similar algorithms are implemented in embedded systems, including SoC FPGAs. The code is available at https://***/vision-agh/pointpillars-backbone. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

Joint Design of Receiving Filters and Complementary set of Sequences for ISAC With Sidelobe Level Suppression

IEEE Journal of Selected Areas in Sensors

引用

IEEE Journal of Selected Areas in Sensors 2024年 1卷 211-223页

作者： Zhang, Kecheng Wu, Jun Dong, Fuwang Lu, Shihang Li, Xiang Yuan, Weijie Southern University of Science and Technology Shenzhen518055 China School of Interdisciplinary Studies Lingnan University Tuen Mun Hong Kong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China

The integrated sensing and communication (ISAC) waveform with a low sidelobe level on all delay indices is important for probing targets in the ISAC scenario. In this article, we consider the problem of jointly designing receiving filters and unimodular complementary sets of sequences (CSS) by minimizing the weighted sum of complementary integrated sidelobe level (CISL) and ISAC interference term at the communication receiver. We propose an optimization algorithm based on the majorization minimization scheme to solve the formulated nonconvex problem with a promised convergence. Fast Fourier transform (FFT) operations are performed in each iteration to improve the computation efficiency. Simulation results demonstrate that the crosscorrelation between the optimized receiving filters and CSS can achieve very low autocorrelation sidelobe levels on all time delay indices. The proposed algorithm has better convergence performance and the same computation complexity compared to the gradient descent algorithm. © 2023 IEEE.

关键词： Fast Fourier transforms

来源：评论

学校读者我要写书评

暂无评论

Commonsense Scene Graph-based Target Localization for Object Search

arXiv

引用

arXiv 2024年

作者： Ge, Wenqi Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision SUSTech Shenzhen China

Object search is a fundamental skill for household robots, yet the core problem lies in the robot's ability to locate the target object accurately. The dynamic nature of household environments, characterized by the arbitrary placement of daily objects by users, makes it challenging to perform target localization. To efficiently locate the target object, the robot needs to be equipped with knowledge at both the object and room level. However, existing approaches rely solely on one type of knowledge, leading to unsatisfactory object localization performance and, consequently, inefficient object search processes. To address this problem, we propose a commonsense scene graph-based target localization, CSG-TL, to enhance target object search in the household environment. Given the pre-built map with stationary items, the robot models the room-level spatial knowledge with object-level commonsense knowledge generated by a large language model (LLM) to a commonsense scene graph (CSG), supporting both types of knowledge for CSG-TL. To demonstrate the superiority of CSG-TL on target localization, extensive experiments are performed on the real-world ScanNet dataset and the AI2THOR simulator. Moreover, we have extended CSG-TL to an object search framework, CSG-OS, validated in both simulated and real-world environments. Code and videos are available at https://***/view/csg-os. Copyright © 2024, The Authors. All rights reserved.

关键词： Knowledge graph

来源：评论

学校读者我要写书评

暂无评论

Commonsense Scene Graph-based Target Localization for Object Search

Commonsense Scene Graph-based Target Localization for Object...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Wenqi Ge Chao Tang Hong Zhang Shenzhen Key Laboratory of Robotics and Computer Vision SUSTech Shenzhen China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Object search is a fundamental skill for household robots, yet the core problem lies in the robot’s ability to locate the target object accurately. The dynamic nature of household environments, characterized by the arbitrary placement of daily objects by users, makes it challenging to perform target localization. To efficiently locate the target object, the robot needs to be equipped with knowledge at both the object and room level. However, existing approaches rely solely on one type of knowledge, leading to unsatisfactory object localization performance and, consequently, inefficient object search processes. To address this problem, we propose a commonsense scene graph-based target localization, CSG-TL, to enhance target object search in the household environment. Given the pre-built map with stationary items, the robot models the room-level spatial knowledge with object-level commonsense knowledge generated by a large language model (LLM) to a commonsense scene graph (CSG), supporting both types of knowledge for CSG-TL. To demonstrate the superiority of CSG-TL on target localization, extensive experiments are performed on the real-world ScanNet dataset and the AI2THOR simulator. Moreover, we have extended CSG-TL to an object search framework, CSG-OS, validated in both simulated and real-world environments. Code and videos are available at https://***/view/csg-os.

关键词： Location awareness Codes Large language models Laboratories Search problems Commonsense reasoning Intelligent robots Videos

来源：评论

学校读者我要写书评

暂无评论

Real-Time Multi-Object Tracking using YOLOv8 and SORT on a SoC FPGA

arXiv

引用

arXiv 2025年

作者： Danilowicz, Michal Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Krakow Poland

关键词： System-on-chip

来源：评论

学校读者我要写书评

暂无评论

Segment-Based Trajectory Prediction and Risk Assessment for RSU-assisted CAVs at Signalized Intersections

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年 1-19页

作者： Cao, Yue Shangguan, Wei Visser, Arnoud Chen, Junjie Chai, Linguo Cai, Baigen School of Automation and Intelligence Beijing Jiaotong University Beijing China School of Automation and Intelligence and State Key Laboratory of Rail Traffic Control and Safety Beijing Jiaotong University Beijing China Intelligent Robotics and Computer Vision Lab of the Informatics Institute Faculty of Science University of Amsterdam The Netherlands

Detecting surrounding situations and reacting accordingly to avoid collisions remains a challenging task for autonomous driving. This task requires predicting the trajectories of surrounding agents and assessing the potential risk of future situations, which can be difficult to achieve solely through onboard vehicle devices. Therefore, this paper proposes a cooperative architecture for trajectory prediction and risk assessment conducted on roadside devices (RSUs) to assist Connected and Autonomous Vehicles (CAVs). Firstly, we develop a segmentbased prediction model (SegNet) tailored to hub signalized intersections. Intersections are divided into multiple segments, and the Curvilinear coordinates are utilized to indicate the geometric road features. The model leverages individual interaction cues in the ego segment and group features in the merging segments, while also incorporating traffic signal information to generate multimodal prediction results. In terms of risk assessment, we utilize the prediction results to provide hierarchical assistance, such as risk values, risk maps, and reference trajectories. Offline experimental results demonstrate that our SegNet model achieves competitive and well-balanced performance compared to stateof-the-art methods on the CitySim Database, with more accurate and smooth prediction trajectories. Through real-time CARLA and SUMO co-simulation, the performance of assisted CAVs indicates that they can safely and effectively navigate with the support of the proposed architecture. IEEE

关键词： Real time systems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：