检索结果-内蒙古大学图书馆

Traffic Sign Detection With Event Cameras and DCNN

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wzorek, Piotr Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Kraków Poland Department of Digital Systems Silesian University of Technology Gliwice Poland

In recent years, event cameras (DVS – Dynamic vision Sensors) have been used in vision systems as an alternative or supplement to traditional cameras. They are characterised by high dynamic range, high temporal resolution, low latency, and reliable performance in limited lighting conditions – parameters that are particularly important in the context of advanced driver assistance systems (ADAS) and self-driving cars. In this work, we test whether these rather novel sensors can be applied to the popular task of traffic sign detection. To this end, we analyse different representations of the event data: event frame, event frequency, and the exponentially decaying time surface, and apply video frame reconstruction using a deep neural network called FireNet. We use the deep convolutional neural network YOLOv4 as a detector. For particular representations, we obtain a detection accuracy in the range of 86.9-88.9% mAP@0.5. The use of a fusion of the considered representations allows us to obtain a detector with higher accuracy of 89.9% mAP@0.5. In comparison, the detector for the frames reconstructed with FireNet is characterised by an accuracy of 72.67% mAP@0.5. The results obtained illustrate the potential of event cameras in automotive applications, either as standalone sensors or in close cooperation with typical frame-based cameras. © 2022, CC BY.

关键词： Cameras

Optimisation of a Siamese Neural Network for Real-Time Energy Efficient Object Tracking 1

学校读者我要写书评

暂无评论

International Conference on computer vision and Graphics, ICCVG 2020

作者： Przewlocka, Dominika Wasala, Mateusz Szolc, Hubert Blachut, Krzysztof Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (数字)9783030590062

ISBN: (纸本)9783030590055

In this paper the research on optimisation of visual object tracking using a Siamese neural network for embedded vision systems is presented. It was assumed that the solution shall operate in real-time, preferably for a high resolution video stream, with the lowest possible energy consumption. To meet these requirements, techniques such as the reduction of computational precision and pruning were considered. Brevitas, a tool dedicated for optimisation and quantisation of neural networks for FPGA implementation, was used. A number of training scenarios were tested with varying levels of optimisations – from integer uniform quantisation with 16 bits to ternary and binary networks. Next, the influence of these optimisations on the tracking performance was evaluated. It was possible to reduce the size of the convolutional filters up to 10 times in relation to the original network. The obtained results indicate that using quantisation can significantly reduce the memory and computational complexity of the proposed network while still enabling precise tracking, thus allow to use it in embedded vision systems. Moreover, quantisation of weights positively affects the network training by decreasing overfitting. © 2020, Springer Nature Switzerland AG.

关键词： Field programmable gate arrays (FPGA)

A vision Based Hardware-Software Real-Time Control System for the Autonomous Landing of an UAV 1

学校读者我要写书评

暂无评论

International Conference on computer vision and Graphics, ICCVG 2020

作者： Blachut, Krzysztof Szolc, Hubert Wasala, Mateusz Kryjak, Tomasz Gorgon, Marek Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

ISBN: (数字)9783030590062

ISBN: (纸本)9783030590055

In this paper we present a vision based hardware-software control system enabling the autonomous landing of a multirotor unmanned aerial vehicle (UAV). It allows for the detection of a marked landing pad in real-time for a 1280 720 @ 60 fps video stream. In addition, a LiDAR sensor is used to measure the altitude above ground. A heterogeneous Zynq SoC device is used as the computing platform. The solution was tested on a number of sequences and the landing pad was detected with 96% accuracy. This research shows that a reprogrammable heterogeneous computing system is a good solution for UAVs because it enables real-time data stream processing with relatively low energy consumption. © 2020, Springer Nature Switzerland AG.

关键词： System-on-chip

Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Luo, Cheng Song, Siyang Xie, Weicheng Shen, Linlin Gunes, Hatice Computer Vision Institute Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China Guangdong Key Laboratory of Intelligent Information Processing China Department of Computer Science and Technology University of Cambridge United Kingdom

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair of AUs in each facial display. This paper proposes an AU relationship modelling approach that deep learns a unique graph to explicitly describe the relationship between each pair of AUs of the target facial display. Our approach first encodes each AU’s activation status and its association with other AUs into a node feature. Then, it learns a pair of multi-dimensional edge features to describe multiple task-specific relationship cues between each pair of AUs. During both node and edge feature learning, our approach also considers the influence of the unique facial display on AUs’ relationship by taking the full face representation as an input. Experimental results on BP4D and DISFA datasets show that both node and edge feature learning modules provide large performance improvements for CNN and transformer-based backbones, with our best systems achieving the state-of-the-art AU recognition results. Our approach not only has a strong capability in modelling relationship cues for AU recognition but also can be easily incorporated into various backbones. Our PyTorch code is made available at https://***/CVI-SZU/ME-GraphAU. Copyright © 2022, The Authors. All rights reserved.

关键词： Chemical activation

Towards AI-Powered Edge Intelligence for Object Detection in Self-Driving Cars: Enhancing IoV Efficiency and Safety

学校读者我要写书评

暂无评论

IEEE Internet of Things Journal 2025年

作者： Ahmed, Imran Ahmad, Misbah Siddiqi, Muftooh Ur Rehman Chehri, Abdellah Jeon, Gwangill Anglia Ruskin University School of Computing and Information Science Cambridge United Kingdom University of West of England Centre for Machine Vision Bristol Robotics Laboratory Bristol United Kingdom Hartpury University Department of Animal and Agriculture Gloucester United Kingdom Aston University College of Engineering and Physical Sciences Birmingham United Kingdom Department of Mathematics and Computer Science Canada Incheon National University Department of Embedded Systems Engineering Incheon Korea Republic of

In the rapidly advancing field of intelligent transportation systems, integrating Artificial Intelligence (AI) with edge computing presents a promising way to enhance the safety and efficiency of the Internet of Vehicles (IoV). This study explores and presents a deep learning based object detection model within an edge computing framework which aims to facilitate real time object detection in self driving cars. Using an urban traffic scenarios based dataset, our research shows the ability of the model to accurately detect and classify various objects important for autonomous driving. The YOLOv8 model is used in this work due to its optimal balance between accuracy and computational efficiency. This model has also demonstrated its worth by achieving good performance results, including an average precision of 0.79, a recall of 0.62, and an F1-score of 0.69. The results are demonstrated by a detailed confusion matrix, highlighting the model's effectiveness in complex driving environments and underscoring its reliability for in-vehicle deployment. By implementing AI directly on edge devices within vehicles, our approach might be helpful in significantly reducing latency, boosting decision-making speed, and enhancing data privacy by minimising dependence on cloud processing. The findings not only support the model's capabilities but also illustrate the practical benefits of edge intelligence in autonomous vehicles. These benefits, such as faster decision-making and improved data privacy, contribute effectively to the IoV infrastructure. This study marks a substantial step towards recognising the possibility of AI-enhanced edge computing in driving the next generation of autonomous vehicle technology. © 2025 IEEE.

关键词： Artificial Intelligence Autonomous Vehicles Deep leaning Edge Computing Internet of Vehicles

Joint Design of Radar Receive Filter and Unimodular ISAC Waveform with Sidelobe Level Control

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Kecheng Liu, Ya-Feng Wang, Zhongbin Yuan, Weijie Keskin, Musa Furkan Wymeersch, Henk Xia, Shuqiang School of System Design and Intelligent Manufacturing The Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China State Key Laboratory of Scientific and Engineering Computing Institute of Computational Mathematics and Scientific/Engineering Computing Academy of Mathematics and Systems Science Chinese Academy of Sciences Beijing100190 China Department of Electrical Engineering Chalmers University of Technology Gothenburg41296 Sweden ZTE Corporation The State Key Laboratory of Mobile Network and Mobile Multimedia Technology Shenzhen518055 China

Integrated sensing and communication (ISAC) has been considered a key feature of next-generation wireless networks. This paper investigates the joint design of the radar receive filter and dual-functional transmit waveform for the multiple-input multiple-output (MIMO) ISAC system. While optimizing the mean square error (MSE) of the radar receive spatial response and maximizing the achievable rate at the communication receiver, besides the constraints of full-power radar receiving filter and unimodular transmit sequence, we control the maximum range sidelobe level, which is often overlooked in existing ISAC waveform design literature, for better radar imaging performance. To solve the formulated optimization problem with convex and nonconvex constraints, we propose an inexact augmented Lagrangian method (ALM) algorithm. For each subproblem in the proposed inexact ALM algorithm, we custom-design a block successive upper-bound minimization (BSUM) scheme with closed-form solutions for all blocks of variable to enhance the computational efficiency. Convergence analysis shows that the proposed algorithm is guaranteed to provide a stationary and feasible solution. Extensive simulations are performed to investigate the impact of different system parameters on communication and radar imaging performance. Comparison with the existing works shows the superiority of the proposed algorithm. © 2025, CC BY-NC-SA.

关键词： Mean square error

Augmented Box Replay: Overcoming Foreground Shift for Incremental Object Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liu, Yuyang Cong, Yang Goswami, Dipam Liu, Xialei van de Weijer, Joost State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences China University of Chinese Academy of Sciences China South China University of Technology China Computer Vision Center Barcelona Spain VCIP CS Nankai University China Department of Computer Science Universitat Autònoma de Barcelona Spain

In incremental learning, replaying stored samples from previous tasks together with current task samples is one of the most efficient approaches to address catastrophic forgetting. However, unlike incremental classification, image replay has not been successfully applied to incremental object detection (IOD). In this paper, we identify the overlooked problem of foreground shift as the main reason for this. Foreground shift only occurs when replaying images of previous tasks and refers to the fact that their background might contain foreground objects of the current task. To overcome this problem, a novel and efficient Augmented Box Replay (ABR) method is developed that only stores and replays foreground objects and thereby circumvents the foreground shift problem. In addition, we propose an innovative Attentive RoI Distillation loss that uses spatial attention from region-of-interest (RoI) features to constrain current model to focus on the most important information from old model. ABR significantly reduces forgetting of previous classes while maintaining high plasticity in current classes. Moreover, it considerably reduces the storage requirements when compared to standard image replay. Comprehensive experiments on Pascal-VOC and COCO datasets support the state-of-the-art performance of our model 1 © 2023, CC BY.

关键词： Object detection

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Rosano, Marco Furnari, Antonino Gulino, Luigi Santoro, Corrado Farinella, Giovanni Maria FPV@IPLAB - Department of Mathematics and Computer Science University of Catania Catania Italy Robotics Laboratory Department of Mathematics and Computer Science University of Catania Catania Italy OrangeDev s.r.l. Firenze Italy Cognitive Robotics and Social Sensing Laboratory ICAR-CNR Palermo Italy Next Vision s.r.l. Catania Italy

Robot visual navigation is a relevant research topic. Current deep navigation models conveniently learn the navigation policies in simulation, given the large amount of experience they need to collect. Unfortunately, the resulting models show a limited generalization ability when deployed in the real world. In this work we explore solutions to facilitate the development of visual navigation policies trained in simulation that can be successfully transferred in the real world. We first propose an efficient evaluation tool to reproduce realistic navigation episodes in simulation. We then investigate a variety of deep fusion architectures to combine a set of mid-level representations, with the aim of finding the best merge strategy that maximize the real world performances. Our experiments, performed both in simulation and on a robotic platform, show the effectiveness of the considered mid-level representations-based models and confirm the reliability of the evaluation tool. The 3D models of the environment and the code of the validation tool are publicly available at the following link: https://***/EmbodiedVN/ © 2022, CC BY-NC-SA.

关键词： Reinforcement learning

Image-Based Navigation in Real-World Environments Via Multiple Mid-Level Representations: Fusion Models, Benchmark and Efficient Evaluation

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Rosano, Marco Furnari, Antonino Gulino, Luigi Santoro, Corrado Farinella, Giovanni Maria FPV@IPLAB Department of Mathematics and Computer Science University of Catania Catania Italy Robotics Laboratory Department of Mathematics and Computer Science University of Catania Catania Italy OrangeDev s.r.l. Firenze Italy Cognitive Robotics and Social Sensing Laboratory ICAR-CNR Palermo Italy Next Vision s.r.l. Catania Italy

Robot visual navigation is a relevant research topic. Current deep navigation models mostly learn the navigation policies in simulation. This is convenient, given the efficiency offered by simulators to collect the required training experience. Unfortunately, the resulting models show a limited generalization ability when deployed in the real world. In this work we investigate the problem of learning robust visual navigation policies in simulation that can successfully transferred in the real world. We propose an evaluation tool to reproduce realistic navigation episodes in simulation. We then study whether the mid-level visual representations, that have proven to be effective in previous applications, can be successfully used in simulation to solve the domain gap. Our experiments, performed both in simulation and on a robotic platform, show the proposed evaluation tool can provide results which are consistent with the ones obtained in the real world. © 2022, The Authors. All rights reserved.

关键词： Reinforcement learning