检索结果-内蒙古大学图书馆

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Przewlocka-Rus, Dominika Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

Deep neural networks virtually dominate the domain of most modern vision systems, providing high performance at a cost of increased computational complexity. Since for those systems it is often required to operate both in real-time and with minimal energy consumption (e.g., for wearable devices or autonomous vehicles, edge Internet of Things (IoT), sensor networks), various network optimisation techniques are used, e.g., quantisation, pruning, or dedicated lightweight architectures. Due to the logarithmic distribution of weights in neural network layers, a method providing high performance with significant reduction in computational precision (for 4-bit weights and less) is the Power-of-Two (PoT) quantisation (and therefore also with a logarithmic distribution). This method introduces additional possibilities of replacing the typical for neural networks Multiply and ACcumulate (MAC – performing, e.g., convolution operations) units, with more energy-efficient Bitshift and ACcumulate (BAC). In this paper, we show that a hardware neural network accelerator with PoT weights implemented on the Zynq UltraScale + MPSoC ZCU104 SoC FPGA can be at least 1.4x more energy efficient than the uniform quantisation version. To further reduce the actual power requirement by omitting part of the computation for zero weights, we also propose a new pruning method adapted to logarithmic quantisation. © 2022, CC BY.

关键词： System-on-chip

Towards real-time and energy efficient Siamese tracking - a hardware-software approach

学校读者我要写书评

暂无评论

arXiv 2022年

Siamese trackers have been among the state-of-the-art solutions in each Visual Object Tracking (VOT) challenge over the past few years. However, with great accuracy comes great computational complexity: to achieve real-time processing, these trackers have to be massively parallelised and are usually run on high-end GPUs. Easy to implement, this approach is energy consuming, and thus cannot be used in many low-power applications. To overcome this, one can use energy-efficient embedded devices, such as heterogeneous platforms joining the ARM processor system with programmable logic (FPGA). In this work, we propose a hardware-software implementation of the well-known fully connected Siamese tracker (SiamFC). We have developed a quantised Siamese network for the FINN accelerator, using algorithm-accelerator co-design, and performed design space exploration to achieve the best efficiency-to-energy ratio (determined by FPS and used resources). For our network, running in the programmable logic part of the Zynq UltraScale+ MPSoC ZCU104, we achieved the processing of almost 50 frames-per-second with tracker accuracy on par with its floating point counterpart, as well as the original SiamFC network. The complete tracking system, implemented in ARM with the network accelerated on FPGA, achieves up to 17 fps. These results bring us towards bridging the gap between the highly accurate but energy-demanding algorithms and energy-efficient solutions ready to be used in low-power, edge systems. © 2022, CC BY.

关键词： Energy efficiency

Traffic Sign Classification Using Deep and Quantum Neural Networks

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Kuros, Sylwia Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Kraków Poland

Quantum Neural Networks (QNNs) are an emerging technology that can be used in many applications including computer vision. In this paper, we presented a traffic sign classification system implemented using a hybrid quantum-classical convolutional neural network. Experiments on the German Traffic Sign Recognition Benchmark dataset indicate that currently QNN do not outperform classical DCNN (Deep Convolutuional Neural Networks), yet still provide an accuracy of over 90% and are a definitely promising solution for advanced computer vision. © 2022, CC BY.

关键词： Traffic signs

Traffic Sign Classification Using Deep and Quantum Neural Networks

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

作者： Kuros, Sylwia Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Kraków Poland

关键词： Traffic signs

A review: Challenges and opportunities for artificial intelligence and robotics in the offshore wind sector

学校读者我要写书评

暂无评论

Energy and AI 2022年第2期8卷 177-212页

作者： Daniel Mitchell Jamie Blanche Sam Harper Theodore Lim Ranjeetkumar Gupta Osama Zaki Wenshuo Tang Valentin Robu Simon Watson David Flynn Smart Systems Group Institute of SensorsSignals and SystemsSchool of Engineering and Physical SciencesHeriot-Watt UniversityEdinburghEH144ASUnited Kingdom Centre for Mathematics and Computer Science Intelligent and Autonomous Systems GroupCWIAmsterdam1098 XG Netherlands Algorithms Group Faculty of Electrical EngineeringMathematics and Computer Science(EEMCS)Delft University of Technology(TU Delft)Delft2628 XE Netherlands The University of Manchester Department of Electrical and Electronic EngineeringOxford RoadManchesterM139PL United Kingdom James Watt School of Engineering University of GlasgowG128QQUnited Kingdom

The UK has set plans to increase offshore wind capacity from 22GW to 154GW by 2030. With such tremendous growth, the sector is now looking to robotics and Artificial Intelligence (RAI) in order to tackle lifecycle service barriers as to support sustainable and profitable offshore wind energy production. Today, RAI applications are predominately being used to support short term objectives in operation and maintenance. However, moving forward, RAI has the potential to play a critical role throughout the full lifecycle of offshore wind infrastructure, from surveying, planning, design, logistics, operational support, training and decommissioning. This paper presents one of the first systematic reviews of RAI for the offshore renewable energy sector. The state-of-the-art in RAI is analyzed with respect to offshore energy requirements, from both industry and academia, in terms of current and future requirements. Our review also includes a detailed evaluation of investment, regulation and skills development required to support the adoption of RAI. The key trends identified through a detailed analysis of patent and academic publication databases provide insights to barriers such as certification of autonomous platforms for safety compliance and reliability, the need for digital architectures for scalability in autonomous fleets, adaptive mission planning for resilient resident operations and optimization of human machine interaction for trusted partnerships between people and autonomous assistants. Our study concludes with identification of technological priorities and outlines their integration into a new ‘symbiotic digital architecture’ to deliver the future of offshore wind farm lifecycle management.

关键词： Artificial intelligence Autonomous systems Digitalization Offshore renewable energy Offshore wind farms robotics

Toward AI-Powered Edge Intelligence for Object Detection in Self-Driving Cars: Enhancing IoV Efficiency and Safety

学校读者我要写书评

暂无评论

IEEE Internet of Things Journal 2025年第11期12卷 16990-16997页

作者： Ahmed, Imran Ahmad, Misbah Siddiqi, Muftooh Ur Rehman Chehri, Abdellah Jeon, Gwangill Anglia Ruskin University School of Computing and Information Science CambridgeCB1 1PT United Kingdom University of the West of England Centre for Machine Vision Bristol Robotics Laboratory BristolBS16 1QY United Kingdom Hartpury University Department of Animal and Agriculture GloucesterGL19 3BE United Kingdom Aston University College of Engineering and Physical Sciences BirminghamB4 7ET United Kingdom Royal Military College of Canada Department of Mathematics and Computer Science KingstonONK7K 7B4 Canada Incheon National University Department of Embedded Systems Engineering Incheon22012 Korea Republic of

In the rapidly advancing field of intelligent transportation systems, integrating artificial intelligence (AI) with edge computing presents a promising way to enhance the safety and efficiency of the Internet of Vehicles (IoV). This study explores and presents a deep learning-based object detection model within an edge computing framework which aims to facilitate real time object detection in self driving cars. Using an urban traffic scenarios-based dataset, our research shows the ability of the model to accurately detect and classify various objects important for autonomous driving. The YOLOv8 model is used in this work due to its optimal balance between accuracy and computational efficiency. This model has also demonstrated its worth by achieving good performance results, including an average precision of 0.79, a recall of 0.62, and an F1-score of 0.69. The results are demonstrated by a detailed confusion matrix, highlighting the model’s effectiveness in complex driving environments and underscoring its reliability for in-vehicle deployment. By implementing AI directly on edge devices within vehicles, our approach might be helpful in significantly reducing latency, boosting decision-making speed, and enhancing data privacy by minimising dependence on cloud processing. The findings not only support the model’s capabilities but also illustrate the practical benefits of edge intelligence in autonomous vehicles. These benefits, such as faster decision making and improved data privacy, contribute effectively to the IoV infrastructure. This study marks a substantial step toward recognizing the possibility of AI-enhanced edge computing in driving the next generation of autonomous vehicle technology. © 2014 IEEE.

关键词： Artificial intelligence (AI) autonomous vehicles deep leaning edge computing Internet of Vehicles (IoV)

Convolutional Cross-View Pose Estimation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Xia, Zimin Booij, Olaf Kooij, Julian F.P. The Intelligent Vehicles Group Department of Cognitive Robotics Delft University of Technology Leeghwaterstraat Delft2628 CN Netherlands The Computer Vision Lab Delft University of Technology Mekelweg 4 Delft2628 CD Netherlands

We propose a novel end-to-end method for cross-view pose estimation. Given a ground-level query image and an aerial image that covers the query’s local neighborhood, the 3 Degrees-of-Freedom camera pose of the query is estimated by matching its image descriptor to descriptors of local regions within the aerial image. The orientation-aware descriptors are obtained by using a translationally equivariant convolutional ground image encoder and contrastive learning. The Localization Decoder produces a dense probability distribution in a coarse-to-fine manner with a novel Localization Matching Upsampling module. A smaller Orientation Decoder produces a vector field to condition the orientation estimate on the localization. Our method is validated on the VIGOR and KITTI datasets, where it surpasses the state-of-the-art baseline by 72% and 36% in median localization error for comparable orientation estimation accuracy. The predicted probability distribution can represent localization ambiguity, and enables rejecting possible erroneous predictions. Without re-training, the model can infer on ground images with different field of views and utilize orientation priors if available. On the Oxford RobotCar dataset, our method can reliably estimate the ego-vehicle’s pose over time, achieving a median localization error under 1 meter and a median orientation error of around 1 degree at 14 FPS. Copyright © 2023, The Authors. All rights reserved.

关键词： Cameras

ON ACCELERATING EDGE AI: OPTIMIZING RESOURCE-CONSTRAINED ENVIRONMENTS

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Sander, Jacob Cohen, Achraf Dasari, Venkat R. Venable, Brent Jalaian, Brian Department of Computer Science University of West Florida PensacolaFL United States Department of Mathematics and Statistics University of West Florida PensacolaFL United States DEVCOM Army Research Laboratory Aberdeen Proving Ground MD United States Department of Intelligent Systems and Robotics University of West Florida Institute for Human & Machine Cognition PensacolaFL United States Department of Computer Science Department of Intelligent Systems and Robotics University of West Florida Institute for Human & Machine Cognition PensacolaFL United States

Resource-constrained edge deployments demand AI solutions that balance high performance with stringent compute, memory, and energy limitations. In this survey, we present a comprehensive overview of the primary strategies for accelerating deep learning models under such constraints. First, we examine model compression techniques-pruning, quantization, tensor decomposition, and knowledge distillation-that streamline large models into smaller, faster, and more efficient variants. Next, we explore Neural Architecture Search (NAS), a class of automated methods that discover architectures inherently optimized for particular tasks and hardware budgets. We then discuss compiler and deployment frameworks, such as TVM, TensorRT, and OpenVINO, which provide hardware-tailored optimizations at inference time. By integrating these three pillars into unified pipelines, practitioners can achieve multi-objective goals, including latency reduction, memory savings, and energy efficiency-all while maintaining competitive accuracy. We also highlight emerging frontiers in hierarchical NAS, neurosymbolic approaches, and advanced distillation tailored to large language models, underscoring open challenges like pre-training pruning for massive networks. Our survey offers practical insights, identifies current research gaps, and outlines promising directions for building scalable, platform-independent frameworks to accelerate deep learning models at the edge. © 2025, CC BY.

关键词： Budget control

GraspGPT: Leveraging Semantic Knowledge from a Large Language Model for Task-Oriented Grasping

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Tang, Chao Huang, Dehao Ge, Wenqi Liu, Weiyu Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Institute for Robotics and Intelligent Machines Georgia Institute of Technology Atlanta United States

Task-oriented grasping (TOG) refers to the problem of predicting grasps on an object that enable subsequent manipulation tasks. To model the complex relationships between objects, tasks, and grasps, existing methods incorporate semantic knowledge as priors into TOG pipelines. However, the existing semantic knowledge is typically constructed based on closed-world concept sets, restraining the generalization to novel concepts out of the pre-defined sets. To address this issue, we propose GraspGPT, a large language model (LLM) based TOG framework that leverages the open-end semantic knowledge from an LLM to achieve zero-shot generalization to novel concepts. We conduct experiments on Language Augmented TaskGrasp (LA-TaskGrasp) dataset and demonstrate that GraspGPT outperforms existing TOG methods on different held-out settings when generalizing to novel concepts out of the training set. The effectiveness of GraspGPT is further validated in real-robot experiments. Our code, data, appendix, and video are publicly available at https://***/view/graspgpt. Copyright © 2023, The Authors. All rights reserved.

关键词： Zero-shot learning