检索结果-内蒙古大学图书馆

Toward AI-Powered Edge Intelligence for Object Detection in Self-Driving Cars: Enhancing IoV Efficiency and Safety

学校读者我要写书评

暂无评论

IEEE Internet of Things Journal 2025年第11期12卷 16990-16997页

作者： Ahmed, Imran Ahmad, Misbah Siddiqi, Muftooh Ur Rehman Chehri, Abdellah Jeon, Gwangill Anglia Ruskin University School of Computing and Information Science CambridgeCB1 1PT United Kingdom University of the West of England Centre for Machine Vision Bristol Robotics Laboratory BristolBS16 1QY United Kingdom Hartpury University Department of Animal and Agriculture GloucesterGL19 3BE United Kingdom Aston University College of Engineering and Physical Sciences BirminghamB4 7ET United Kingdom Royal Military College of Canada Department of Mathematics and Computer Science KingstonONK7K 7B4 Canada Incheon National University Department of Embedded Systems Engineering Incheon22012 Korea Republic of

In the rapidly advancing field of intelligent transportation systems, integrating artificial intelligence (AI) with edge computing presents a promising way to enhance the safety and efficiency of the Internet of Vehicles (IoV). This study explores and presents a deep learning-based object detection model within an edge computing framework which aims to facilitate real time object detection in self driving cars. Using an urban traffic scenarios-based dataset, our research shows the ability of the model to accurately detect and classify various objects important for autonomous driving. The YOLOv8 model is used in this work due to its optimal balance between accuracy and computational efficiency. This model has also demonstrated its worth by achieving good performance results, including an average precision of 0.79, a recall of 0.62, and an F1-score of 0.69. The results are demonstrated by a detailed confusion matrix, highlighting the model’s effectiveness in complex driving environments and underscoring its reliability for in-vehicle deployment. By implementing AI directly on edge devices within vehicles, our approach might be helpful in significantly reducing latency, boosting decision-making speed, and enhancing data privacy by minimising dependence on cloud processing. The findings not only support the model’s capabilities but also illustrate the practical benefits of edge intelligence in autonomous vehicles. These benefits, such as faster decision making and improved data privacy, contribute effectively to the IoV infrastructure. This study marks a substantial step toward recognizing the possibility of AI-enhanced edge computing in driving the next generation of autonomous vehicle technology. © 2014 IEEE.

关键词： Artificial intelligence (AI) autonomous vehicles deep leaning edge computing Internet of Vehicles (IoV)

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Przewlocka-Rus, Dominika Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

Deep neural networks virtually dominate the domain of most modern vision systems, providing high performance at a cost of increased computational complexity. Since for those systems it is often required to operate both in real-time and with minimal energy consumption (e.g., for wearable devices or autonomous vehicles, edge Internet of Things (IoT), sensor networks), various network optimisation techniques are used, e.g., quantisation, pruning, or dedicated lightweight architectures. Due to the logarithmic distribution of weights in neural network layers, a method providing high performance with significant reduction in computational precision (for 4-bit weights and less) is the Power-of-Two (PoT) quantisation (and therefore also with a logarithmic distribution). This method introduces additional possibilities of replacing the typical for neural networks Multiply and ACcumulate (MAC – performing, e.g., convolution operations) units, with more energy-efficient Bitshift and ACcumulate (BAC). In this paper, we show that a hardware neural network accelerator with PoT weights implemented on the Zynq UltraScale + MPSoC ZCU104 SoC FPGA can be at least 1.4x more energy efficient than the uniform quantisation version. To further reduce the actual power requirement by omitting part of the computation for zero weights, we also propose a new pruning method adapted to logarithmic quantisation. © 2022, CC BY.

关键词： System-on-chip

Hardware-in-the-loop simulation of a UAV autonomous landing algorithm implemented in SoC FPGA

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Szolc, Hubert Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

This paper presents a system for hardware-in-the-loop (HiL) simulation of unmanned aerial vehicle (UAV) control algorithms implemented on a heterogeneous SoC FPGA computing platforms. The AirSim simulator running on a PC and an Arty Z7 development board with a Zynq SoC chip from AMD Xilinx were used. Communication was carried out via a serial USB link. An application for autonomous landing on a specially marked landing strip was selected as a case study. A landing site detection algorithm was implemented on the Zynq SoC platform. This allowed processing a 1280 × 720 @ 60 fps video stream in real time. Performed tests showed that the system works correctly and there are no delays that could negatively affect the stability of the control. The proposed concept is characterised by relative simplicity and low implementation cost. At the same time, it can be applied to test various types of high-level perception and control algorithms for UAV implemented on embedded platforms. We provide the code developed on GitHub, which includes both Python scripts running on the PC and C code running on Arty Z7. © 2022, CC BY.

关键词： System-on-chip

An Isomerism Learning Model to Solve Time-Varying Problems Through Intelligent Collaboration

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2023年第8期10卷 1772-1774页

作者： Zhihao Hao Guancheng Wang Bob Zhang Leyuan Fang Haisheng Li the Department of Computer and Information Science University of MacaoMacao 999078China the School of Data Science the Chinese University of Hong KongShenzhen 518172 Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen 518000 China Industrial Control Systems Cyber Emergency Response Team Beijing 100040China IEEE the College of Electrical and Information Engineering Hunan UniversityChangsha 410082 the Peng Cheng Laboratory Shenzhen 518000China the Beijing Key Laboratory of Big Data Technology for Food Safety Beijing Technology and Business UniversityBeijing 100048 the School of Computer Science and Engineering Beijing Technology and Business UniversityBeijing 100048China

Dear Editor,This letter deals with a solution for time-varying problems using an intelligent computational(IC)algorithm driven by a novel decentralized machine learning approach called isomerism *** order to meet the challenges of the model’s privacy and security brought by traditional centralized learning models,a private permissioned blockchain is utilized to decentralize the model in order to achieve an effective coordination,thereby ensuring the credibility of the overall model without exposing the specific parameters and solution process.

关键词： ism thereby letter

Towards real-time and energy efficient Siamese tracking - a hardware-software approach

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

Siamese trackers have been among the state-of-the-art solutions in each Visual Object Tracking (VOT) challenge over the past few years. However, with great accuracy comes great computational complexity: to achieve real-time processing, these trackers have to be massively parallelised and are usually run on high-end GPUs. Easy to implement, this approach is energy consuming, and thus cannot be used in many low-power applications. To overcome this, one can use energy-efficient embedded devices, such as heterogeneous platforms joining the ARM processor system with programmable logic (FPGA). In this work, we propose a hardware-software implementation of the well-known fully connected Siamese tracker (SiamFC). We have developed a quantised Siamese network for the FINN accelerator, using algorithm-accelerator co-design, and performed design space exploration to achieve the best efficiency-to-energy ratio (determined by FPS and used resources). For our network, running in the programmable logic part of the Zynq UltraScale+ MPSoC ZCU104, we achieved the processing of almost 50 frames-per-second with tracker accuracy on par with its floating point counterpart, as well as the original SiamFC network. The complete tracking system, implemented in ARM with the network accelerated on FPGA, achieves up to 17 fps. These results bring us towards bridging the gap between the highly accurate but energy-demanding algorithms and energy-efficient solutions ready to be used in low-power, edge systems. © 2022, CC BY.

关键词： Field programmable gate arrays (FPGA)

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

关键词： System-on-chip

Playing cards and bidding calls detection for automatic registration of a duplicate bridge game

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

作者： Wzorek, Piotr Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

In this work, the implementation of a playing cards and bidding calls detection system for the automatic registration of a duplicate bridge game is presented. For this purpose, two YOLOv4 deep convolutional neural networks were used. During the training process, which was carried out using an automatically generated dataset, we obtained a detector characterised by more than 99.9% accuracy on the test set. The prepared system has been evaluated on videos collected during bridge competitions and is characterised by high accuracy. The application has been implemented and evaluated on a CPU and an embedded GPU. © 2022, CC BY.

关键词： Deep neural networks

Towards real-time and energy efficient Siamese tracking - a hardware-software approach

学校读者我要写书评

暂无评论

arXiv 2022年

关键词： Energy efficiency

HPPS: A Hierarchical Progressive Perception System for Luggage Trolley Detection and Localization at Airports

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sun, Zhirui Zhang, Zhe Zhao, Jieting Ye, Hanjing Wang, Jiankun Shenzhen Key Laboratory of Robotics Perception and Intelligence Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Jiaxing Research Institute Southern University of Science and Technology Jiaxing China Shenzhen Key Laboratory of Robotics and Computer Vision Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The robotic autonomous luggage trolley collection system employs robots to gather and transport scattered luggage trolleys at airports. However, existing methods for detecting and locating these luggage trolleys often fail when they are not fully visible. To address this, we introduce the Hierarchical Progressive Perception System (HPPS), which enhances the detection and localization of luggage trolleys under partial occlusion. The HPPS processes the luggage trolley’s position (x, y) and orientation (θ) separately, which requires only RGB images for labeling and training, eliminating the need for 3D coordinates and alignment. The HPPS can accurately determine the position of the luggage trolley with just one well-detected keypoint and estimate the luggage trolley’s orientation when it is partially occluded. Once the luggage trolley’s initial pose is detected, HPPS updates this information continuously to refine its accuracy until the robot begins grasping. The experiments on detection and localization demonstrate that HPPS is more reliable under partial occlusion compared to existing methods. Its effectiveness and robustness have also been confirmed through practical tests in actual luggage trolley collection tasks. A website about this work is available at HPPS. Copyright © 2024, The Authors. All rights reserved.

关键词： robotics