检索结果-内蒙古大学图书馆

21st International Symposium on Applied Reconfigurable Computing, ARC 2025

作者： Danilowicz, Michal Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (纸本)9783031879944

Multi-object tracking (MOT) is one of the most important problems in computer vision and a key component of any vision-based perception system used in advanced autonomous mobile robotics. Therefore, its implementation on low-power and real-time embedded platforms is highly desirable. Modern MOT algorithms should be able to track objects of a given class (e.g. people or vehicles). In addition, the number of objects to be tracked is not known in advance, and they may appear and disappear at any time, as well as be obscured. For these reasons, the most popular and successful approaches have recently been based on the tracking paradigm. Therefore, the presence of a high quality object detector is essential, which in practice accounts for the vast majority of the computational and memory complexity of the whole MOT system. In this paper, we propose an FPGA (Field-Programmable Gate Array) implementation of an embedded MOT system based on a quantized YOLOv8 detector and the SORT (Simple Online Realtime Tracker) tracker. We use a modified version of the FINN framework to utilize external memory for model parameters and to support operations necessary required by YOLOv8. We discuss the evaluation of detection and tracking performance using the COCO and MOT15 datasets, where we achieve 0.21 mAP and 38.9 MOTA respectively. As the computational platform, we use an MPSoC system (Zynq UltraScale+ device from AMD/Xilinx) where the detector is deployed in reprogrammable logic and the tracking algorithm is implemented in the processor system. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： System-on-chip

来源：评论

学校读者我要写书评

暂无评论

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

Energy Efficient Hardware Acceleration of Neural Networks wi...

引用

International Conference on computer vision and Graphics, ICCVG 2022

作者： Przewlocka-Rus, Dominika Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (纸本)9783031220241

Deep neural networks virtually dominate the domain of most modern vision systems, providing high performance at a cost of increased computational complexity. Since for those systems it is often required to operate both in real-time and with minimal energy consumption (e.g., for wearable devices or autonomous vehicles, edge Internet of Things (IoT), sensor networks), various network optimisation techniques are used, e.g., quantisation, pruning, or dedicated lightweight architectures. Due to the logarithmic distribution of weights in neural network layers, a method providing high performance with significant reduction in computational precision (for 4-bit weights and less) is the Power-of-Two (PoT) quantisation (and therefore also with a logarithmic distribution). This method introduces additional possibilities of replacing the typical for neural networks Multiply and ACcumulate (MAC—performing, e.g., convolution operations) units, with more energy-efficient Bitshift and ACcumulate (BAC). In this paper, we show that a hardware neural network accelerator with PoT weights implemented on the Zynq UltraScale + MPSoC ZCU104 SoC FPGA can be at least 1.4x more energy efficient than the uniform quantisation version. To further reduce the actual power requirement by omitting part of the computation for zero weights, we also propose a new pruning method adapted to logarithmic quantisation. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： System-on-chip

来源：评论

学校读者我要写书评

暂无评论

Traffic Sign Classification Using Deep and Quantum Neural Networks

Traffic Sign Classification Using Deep and Quantum Neural Ne...

引用

International Conference on computer vision and Graphics, ICCVG 2022

作者： Kuros, Sylwia Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (纸本)9783031220241

Quantum Neural Networks (QNNs) are an emerging technology that can be used in many applications including computer vision. In this paper, we presented a traffic sign classification system implemented using a hybrid quantum-classical convolutional neural network. Experiments on the German Traffic Sign Recognition Benchmark dataset indicate that currently QNN do not outperform classical DCNN (Deep Convolutuional Neural Networks), yet still provide an accuracy of over 90% and are a definitely promising solution for advanced computer vision. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Traffic signs

来源：评论

学校读者我要写书评

暂无评论

Joint Design of Receiving Filters and Complementary set of Sequences for ISAC With Sidelobe Level Suppression

IEEE Journal of Selected Areas in Sensors

引用

IEEE Journal of Selected Areas in Sensors 2024年 1卷 211-223页

作者： Zhang, Kecheng Wu, Jun Dong, Fuwang Lu, Shihang Li, Xiang Yuan, Weijie Southern University of Science and Technology Shenzhen518055 China School of Interdisciplinary Studies Lingnan University Tuen Mun Hong Kong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China

The integrated sensing and communication (ISAC) waveform with a low sidelobe level on all delay indices is important for probing targets in the ISAC scenario. In this article, we consider the problem of jointly designing receiving filters and unimodular complementary sets of sequences (CSS) by minimizing the weighted sum of complementary integrated sidelobe level (CISL) and ISAC interference term at the communication receiver. We propose an optimization algorithm based on the majorization minimization scheme to solve the formulated nonconvex problem with a promised convergence. Fast Fourier transform (FFT) operations are performed in each iteration to improve the computation efficiency. Simulation results demonstrate that the crosscorrelation between the optimized receiving filters and CSS can achieve very low autocorrelation sidelobe levels on all time delay indices. The proposed algorithm has better convergence performance and the same computation complexity compared to the gradient descent algorithm. © 2023 IEEE.

关键词： Fast Fourier transforms

来源：评论

学校读者我要写书评

暂无评论

PointPillars Backbone Type Selection for Fast and Accurate LiDAR Object Detection

PointPillars Backbone Type Selection for Fast and Accurate L...

引用

International Conference on computer vision and Graphics, ICCVG 2022

作者： Lis, Konrad Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Al. Mickiewicza 30 Krakow30-059 Poland

ISBN: (纸本)9783031220241

3D object detection from LiDAR sensor data is an important topic in the context of autonomous cars and drones. In this paper, we present the results of experiments on the impact of backbone selection of a deep convolutional neural network on detection accuracy and computation speed. We chose the PointPillars network, which is characterised by a simple architecture, high speed, and modularity that allows for easy expansion. During the experiments, we paid particular attention to the change in detection efficiency (measured by the mAP metric) and the total number of multiply-addition operations needed to process one point cloud. We tested 10 different convolutional neural network architectures that are widely used in image-based detection problems. For a backbone like MobilenetV1, we obtained an almost 4x speedup at the cost of a 1.13% decrease in mAP. On the other hand, for CSPDarknet we got an acceleration of more than 1.5x at an increase in mAP of 0.33%. We have thus demonstrated that it is possible to significantly speed up a 3D object detector in LiDAR point clouds with a small decrease in detection efficiency. This result can be used when PointPillars or similar algorithms are implemented in embedded systems, including SoC FPGAs. The code is available at https://***/vision-agh/pointpillars-backbone. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

An Experimental Study of Keypoint Descriptor Fusion

An Experimental Study of Keypoint Descriptor Fusion

引用

2022 IEEE International Conference on robotics and Biomimetics, ROBIO 2022

作者： Pan, Yaling He, Li Guan, Yisheng Zhang, Hong Guangzhou China Southern University of Science and Technology Shenzhen Key Laboratory of Robotics and Computer Vision Shenzhen China

ISBN: (纸本)9781665481090

Local feature descriptors play a crucial role in computer vision problems, especially robot motion. Existing descriptors are highly accurate, but their performance de-pends on the influence of distracting factors, such as illumi-nation and viewpoint. There is room for further improvement of these descriptors. In this paper, we provide an in-depth analysis of several exciting features of the descriptor fusion model (DFM) we have proposed in our recent work, which uses an autoencoder to combine descriptors and exploit their respective advantages. With this DFM framework, we fur-ther validate that fused descriptors can retain advantageous properties and that our DFM is a generally applicable method with respect to various component descriptors. Specifically, we evaluate multiple combinations of hand-crafted and CNN descriptors concerning their performance on a benchmark dataset with illumination and viewpoint changes to obtain comprehensive experimental results. The results show that the fused descriptors have better matching accuracy than their component descriptors. © 2022 IEEE.

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion 38

HairDiffusion: Vivid Multi-Colored Hair Editing via Latent D...

引用

38th Conference on Neural Information Processing Systems, NeurIPS 2024

作者： Zeng, Yu Zhang, Yang Liu, Jiachen Shen, Linlin Deng, Kaijun He, Weizhao Wang, Jinbao Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Hair editing is a critical image synthesis task that aims to edit hair color and hairstyle using text descriptions or reference images, while preserving irrelevant attributes (e.g., identity, background, cloth). Many existing methods are based on StyleGAN to address this task. However, due to the limited spatial distribution of StyleGAN, it struggles with multiple hair color editing and facial preservation. Considering the advancements in diffusion models, we utilize Latent Diffusion Models (LDMs) for hairstyle editing. Our approach introduces Multi-stage Hairstyle Blend (MHB), effectively separating control of hair color and hairstyle in diffusion latent space. Additionally, we train a warping module to align the hair color with the target region. To further enhance multi-color hairstyle editing, we fine-tuned a CLIP model using a multi-color hairstyle dataset. Our method not only tackles the complexity of multi-color hairstyles but also addresses the challenge of preserving original colors during diffusion editing. Extensive experiments showcase the superiority of our method in editing multi-color hairstyles while preserving facial attributes given textual descriptions and reference images. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects

arXiv

引用

arXiv 2024年

作者： Chen, Guangcheng He, Yicheng He, Li Zhang, Hong Southern University of Science and Technology Shenzhen China Shenzhen Key Laboratory of Robotics and Computer Vision China

Neural implicit surface reconstruction has achieved remarkable progress recently. Despite resorting to complex radiance modeling, state-of-the-art methods still struggle with textureless and specular surfaces. Different from RGB images, polarization images can provide direct constraints on the azimuth angles of the surface normals. In this paper, we present PISR, a novel method that utilizes a geometrically accurate polarimetric loss to refine shape independently of appearance. In addition, PISR smooths surface normals in image space to eliminate severe shape distortions and leverages the hash-grid-based neural signed distance function to accelerate the reconstruction. Experimental results demonstrate that PISR achieves higher accuracy and robustness, with an L1 Chamfer distance of 0.5 mm and an F-score of 99.5% at 1 mm, while converging 4 ∼ 30× faster than previous polarimetric surface reconstruction methods. Copyright © 2024, The Authors. All rights reserved.

关键词： Surface reconstruction

来源：评论

学校读者我要写书评

暂无评论

Activation Template Matching Loss for Explainable Face Recognition 17

Activation Template Matching Loss for Explainable Face Recog...

引用

17th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2023

作者： Lin, Huawei Liu, Haozhe Li, Qiufu Shen, Linlin Computer Vision Institute School of Computer Science and Softwre Enginnering Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen China

ISBN: (纸本)9798350345445

Can we construct an explainable face recognition network able to learn a facial part-based feature like eyes, nose, mouth and so forth, without any manual annotation or additionalsion datasets? In this paper, we propose a generic Explainable Channel Loss (ECLoss) to construct an explainable face recognition network. The explainable network trained with ECLoss can easily learn the facial part-based representation on the target convolutional layer, where an individual channel can detect a certain face part. Our experiments on dozens of datasets show that ECLoss achieves superior explainability metrics, and at the same time improves the performance of face verification without face alignment. In addition, our visualization results also illustrate the effectiveness of the proposed ECLoss. © 2023 IEEE.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Variable-Speed Dubins Orienteering Problem

Variable-Speed Dubins Orienteering Problem

引用

IEEE Latin American robotics Symposium, LARS

作者： L. C. Vinícius Faria C. G. Caio Ribeiro Douglas G. Macharet Department of Computer Science Computer Vision and Robotics Laboratory (VeRLab) Universidade Federal de Minas Gerais Belo Horizonte MG Brazil

ISBN: (数字)9798331508807

ISBN: (纸本)9798331508814

The class of vehicle routing problems plays an important role in optimizing logistics and transportation strategies across various sectors. In this context, the Orienteering Problem (OP) seeks to determine an optimized path through a set of locations with associated rewards, aiming to maximize the total collected reward while respecting constraints such as time or distance limits. Nonholonomic motion planning, particularly considering Dubins vehicles, is crucial in real-world applications due to its ability to accurately capture the constraints and dynamics of many physical vehicles. In this paper, we extend the Dubins Orienteering Problem (DOP), where unlike the classical Dubins model with constant speed, the vehicle can vary its speed during navigation, enabling the discovery of more effective paths. Experiments comparing both the DOP and our novel formulation show that the VS-DOP achieves higher total collected rewards within the same budget compared to the conventional DOP.

关键词： Navigation Vehicle routing Dynamics Transportation Planning Time factors Vehicle dynamics Robots Logistics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：