检索结果-内蒙古大学图书馆

A review: Challenges and opportunities for artificial intelligence and robotics in the offshore wind sector

学校读者我要写书评

暂无评论

Energy and AI 2022年第2期8卷 177-212页

作者： Daniel Mitchell Jamie Blanche Sam Harper Theodore Lim Ranjeetkumar Gupta Osama Zaki Wenshuo Tang Valentin Robu Simon Watson David Flynn Smart Systems Group Institute of SensorsSignals and SystemsSchool of Engineering and Physical SciencesHeriot-Watt UniversityEdinburghEH144ASUnited Kingdom Centre for Mathematics and Computer Science Intelligent and Autonomous Systems GroupCWIAmsterdam1098 XG Netherlands Algorithms Group Faculty of Electrical EngineeringMathematics and Computer Science(EEMCS)Delft University of Technology(TU Delft)Delft2628 XE Netherlands The University of Manchester Department of Electrical and Electronic EngineeringOxford RoadManchesterM139PL United Kingdom James Watt School of Engineering University of GlasgowG128QQUnited Kingdom

The UK has set plans to increase offshore wind capacity from 22GW to 154GW by 2030. With such tremendous growth, the sector is now looking to robotics and Artificial Intelligence (RAI) in order to tackle lifecycle service barriers as to support sustainable and profitable offshore wind energy production. Today, RAI applications are predominately being used to support short term objectives in operation and maintenance. However, moving forward, RAI has the potential to play a critical role throughout the full lifecycle of offshore wind infrastructure, from surveying, planning, design, logistics, operational support, training and decommissioning. This paper presents one of the first systematic reviews of RAI for the offshore renewable energy sector. The state-of-the-art in RAI is analyzed with respect to offshore energy requirements, from both industry and academia, in terms of current and future requirements. Our review also includes a detailed evaluation of investment, regulation and skills development required to support the adoption of RAI. The key trends identified through a detailed analysis of patent and academic publication databases provide insights to barriers such as certification of autonomous platforms for safety compliance and reliability, the need for digital architectures for scalability in autonomous fleets, adaptive mission planning for resilient resident operations and optimization of human machine interaction for trusted partnerships between people and autonomous assistants. Our study concludes with identification of technological priorities and outlines their integration into a new ‘symbiotic digital architecture’ to deliver the future of offshore wind farm lifecycle management.

关键词： Artificial intelligence Autonomous systems Digitalization Offshore renewable energy Offshore wind farms robotics

Convolutional Cross-View Pose Estimation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Xia, Zimin Booij, Olaf Kooij, Julian F.P. The Intelligent Vehicles Group Department of Cognitive Robotics Delft University of Technology Leeghwaterstraat Delft2628 CN Netherlands The Computer Vision Lab Delft University of Technology Mekelweg 4 Delft2628 CD Netherlands

We propose a novel end-to-end method for cross-view pose estimation. Given a ground-level query image and an aerial image that covers the query’s local neighborhood, the 3 Degrees-of-Freedom camera pose of the query is estimated by matching its image descriptor to descriptors of local regions within the aerial image. The orientation-aware descriptors are obtained by using a translationally equivariant convolutional ground image encoder and contrastive learning. The Localization Decoder produces a dense probability distribution in a coarse-to-fine manner with a novel Localization Matching Upsampling module. A smaller Orientation Decoder produces a vector field to condition the orientation estimate on the localization. Our method is validated on the VIGOR and KITTI datasets, where it surpasses the state-of-the-art baseline by 72% and 36% in median localization error for comparable orientation estimation accuracy. The predicted probability distribution can represent localization ambiguity, and enables rejecting possible erroneous predictions. Without re-training, the model can infer on ground images with different field of views and utilize orientation priors if available. On the Oxford RobotCar dataset, our method can reliably estimate the ego-vehicle’s pose over time, achieving a median localization error under 1 meter and a median orientation error of around 1 degree at 14 FPS. Copyright © 2023, The Authors. All rights reserved.

关键词： Cameras

GraspGPT: Leveraging Semantic Knowledge from a Large Language Model for Task-Oriented Grasping

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Tang, Chao Huang, Dehao Ge, Wenqi Liu, Weiyu Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Institute for Robotics and Intelligent Machines Georgia Institute of Technology Atlanta United States

Task-oriented grasping (TOG) refers to the problem of predicting grasps on an object that enable subsequent manipulation tasks. To model the complex relationships between objects, tasks, and grasps, existing methods incorporate semantic knowledge as priors into TOG pipelines. However, the existing semantic knowledge is typically constructed based on closed-world concept sets, restraining the generalization to novel concepts out of the pre-defined sets. To address this issue, we propose GraspGPT, a large language model (LLM) based TOG framework that leverages the open-end semantic knowledge from an LLM to achieve zero-shot generalization to novel concepts. We conduct experiments on Language Augmented TaskGrasp (LA-TaskGrasp) dataset and demonstrate that GraspGPT outperforms existing TOG methods on different held-out settings when generalizing to novel concepts out of the training set. The effectiveness of GraspGPT is further validated in real-robot experiments. Our code, data, appendix, and video are publicly available at https://***/view/graspgpt. Copyright © 2023, The Authors. All rights reserved.

关键词： Zero-shot learning

Deep Learning and computer vision Techniques for Estimating Snow Coverage on Roads using Surveillance Cameras

学校读者我要写书评

暂无评论

Deep Learning and Computer Vision Techniques for Estimating ...

IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS)

作者： François-Guillaume Landry Moulay A. Akhloufi Department of Computer Science Perception Robotics and Intelligent Machines Research Group (PRIME) Université de Moncton Moncton NB Canada

ISBN: (数字)9781665463829

ISBN: (纸本)9781665463836

Road surface monitoring in winter conditions is of great importance to ensure the safety of road users. Estimation of snow coverage on roads can be included in intelligent transportation systems to alert drivers or improve snow removal processes. Several models have been proposed for estimating snow coverage using surveillance cameras, but these models have focused on predicting few snow levels, which limits their usefulness in practice. In this paper, we present a model that allows a more granular estimation of the percentage of road surface covered by snow by predicting snow coverage from 0% (no snow) to 100% (fully snow-covered) using increments of 10%. We propose an ensemble learning model combining a deep convolutional neural network (CNN) and a support-vector machine (SVM). The accuracy of our model is similar to the state-of-the-art accuracy despite the higher task complexity associated with the increased granularity of predictions.

关键词： Support vector machines Image segmentation Snow Computational modeling Roads Surveillance Predictive models

P1AC: Revisiting Absolute Pose From a Single Affine Correspondence

学校读者我要写书评

暂无评论

P1AC: Revisiting Absolute Pose From a Single Affine Correspo...

International Conference on computer vision (ICCV)

作者： Jonathan Ventura Zuzana Kukelova Torsten Sattler Dániel Baráth Department of Computer Science & Software Engineering Cal Poly San Luis Obispo Visual Recognition Group Faculty of Electrical Engineering Czech Technical University in Prague Czech Institute of Informatics Robotics and Cybernetics Czech Technical University in Prague Computer Vision and Geometry Group ETH Zürich

Affine correspondences have traditionally been used to improve feature matching over wide baselines. While recent work has successfully used affine correspondences to solve various relative camera pose estimation problems, less attention has been given to their use in absolute pose estimation. We introduce the first general solution to the problem of estimating the pose of a calibrated camera given a single observation of an oriented point and an affine correspondence. The advantage of our approach (P1AC) is that it requires only a single correspondence, in comparison to the traditional point-based approach (P3P), significantly reducing the combinatorics in robust estimation. P1AC provides a general solution that removes restrictive assumptions made in prior work and is applicable to large-scale image-based localization. We propose a minimal solution to the P1AC problem and evaluate our novel solver on synthetic data, showing its numerical stability and performance under various types of noise. On standard image-based localization benchmarks we show that P1AC achieves more accurate results than the widely used P3P algorithm. Code for our method is available at https://***/jonathanventura/P1AC/.

关键词：

Augmented Box Replay: Overcoming Foreground Shift for Incremental Object Detection

学校读者我要写书评

暂无评论

Augmented Box Replay: Overcoming Foreground Shift for Increm...

International Conference on computer vision (ICCV)

作者： Yuyang Liu Yang Cong Dipam Goswami Xialei Liu Joost van de Weijer State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences University of Chinese Academy of Sciences South China University of Technology Computer Vision Center Barcelona VCIP CS Nankai University Department of Computer Science Universitat Autònoma de Barcelona

In incremental learning, replaying stored samples from previous tasks together with current task samples is one of the most efficient approaches to address catastrophic forgetting. However, unlike incremental classification, image replay has not been successfully applied to incremental object detection (IOD). In this paper, we identify the overlooked problem of foreground shift as the main reason for this. Foreground shift only occurs when replaying images of previous tasks and refers to the fact that their background might contain foreground objects of the current task. To overcome this problem, a novel and efficient Augmented Box Replay (ABR) method is developed that only stores and replays foreground objects and thereby circumvents the foreground shift problem. In addition, we propose an innovative Attentive RoI Distillation loss that uses spatial attention from region-of-interest (RoI) features to constrain current model to focus on the most important information from old model. ABR significantly reduces forgetting of previous classes while maintaining high plasticity in current classes. Moreover, it considerably reduces the storage requirements when compared to standard image replay. Comprehensive experiments on Pascal-VOC and COCO datasets support the state-of-the-art performance of our model 1 .

关键词：

Entropy-Guided Reinforced Open World Active 3D Object Detection Learning

学校读者我要写书评

暂无评论

Entropy-Guided Reinforced Open World Active 3D Object Detect...

Chinese Automation Congress (CAC)

作者： Haozhe Zhang Liyan Ma Shihui Ying Institute of Artificial Intelligence Shanghai University Shanghai China Shanghai Key Laboratory of Intelligent Manufacturing and Robotics School of Computer Engineering and Science School of Mechatronic Engineering and Automation Shanghai University Shanghai China Department of Mathematics School of Science Shanghai University Shanghai China

ISBN: (数字)9798350368604

ISBN: (纸本)9798350368611

Traditional fully annotated closed set 3D object detection methods improve model performance but are impractical in real-world settings due to the emergence of new categories and the complexity of 3D annotations. Open-World Object Detection (OWOD) addresses these issues but relies heavily on manual labeling, which is costly. This paper focuses on open world active learning and proposes an entropy-guided reinforced open world active 3D object detection (EROA). EROA regards active learning as a reinforcement learning problem tailored for open driving scenarios. We use entropy as a reward metric for efficient reinforcement learning. We also leverage knowledge from the 2D domain using object-level large-scale vision-language models to enhance sample selection. Extensive experiments evidence that the proposed EROA meets the dynamic and cost-sensitive requirements of autonomous driving, enabling real-time detection of both known and unknown objects.

关键词： Measurement Solid modeling Three-dimensional displays Active learning Object detection Reinforcement learning Entropy Real-time systems Labeling Autonomous vehicles

FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learning

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Goswami, Dipam Liu, Yuyang Twardowski, Bartlomiej van de Weijer, Joost Department of Computer Science Universitat Autònoma de Barcelona Spain Computer Vision Center Barcelona Spain University of Chinese Academy of Sciences China State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences China IDEAS-NCBR

Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting. Recent approaches to incrementally learning the classifier by freezing the feature extractor after the first task have gained much attention. In this paper, we explore prototypical networks for CIL, which generate new class prototypes using the frozen feature extractor and classify the features based on the Euclidean distance to the prototypes. In an analysis of the feature distributions of classes, we show that classification based on Euclidean metrics is successful for jointly trained features. However, when learning from non-stationary data, we observe that the Euclidean metric is suboptimal and that feature distributions are heterogeneous. To address this challenge, we revisit the anisotropic Mahalanobis distance for CIL. In addition, we empirically show that modeling the feature covariance relations is better than previous attempts at sampling features from normal distributions and training a linear classifier. Unlike existing methods, our approach generalizes to both many- and few-shot CIL settings, as well as to domain-incremental settings. Interestingly, without updating the backbone network, our method obtains state-of-the-art results on several standard continual learning benchmarks. Code is available at https://***/dipamgoswami/FeCAM. © 2023, CC BY.

关键词： Normal distribution

Fast-moving object counting with an event camera

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Bialik, Kamil Kowalczyk, Marcin Blachut, Krzysztof Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Al. Mickiewicza 30 Krakow30-059 Poland

This paper proposes the use of an event camera as a component of a vision system that enables counting of fast-moving objects – in this case, falling corn grains. These type of cameras transmit information about the change in brightness of individual pixels and are characterised by low latency, no motion blur, correct operation in different lighting conditions, as well as very low power consumption. The proposed counting algorithm processes events in real time. The operation of the solution was demonstrated on a stand consisting of a chute with a vibrating feeder, which allowed the number of grains falling to be adjusted. The objective of the control system with a PID controller was to maintain a constant average number of falling objects. The proposed solution was subjected to a series of tests to determine the correctness of the developed method operation. On their basis, the validity of using an event camera to count small, fast-moving objects and the associated wide range of potential industrial applications can be confirmed. © 2022, CC BY.

关键词： Cameras