检索结果-内蒙古大学图书馆

HIPA: Hierarchical Patch Transformer for Single Image Super Resolution

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Cai, Qing Qian, Yiming Li, Jinxing Lyu, Jun Yang, Yee-Hong Wu, Feng Zhang, David The Faculty of Information Science and Engineering Ocean University of China Shandong Qingdao266100 China The Department of Computer Science University of Manitoba WinnipegMBR3T 2N2 Canada The School of Computer Science and Technology Harbin Institute of Technology Guangdong Shenzhen518055 China The School of Nursing The Hong Kong Polytechnic University Hong Kong The Department of Computing Science University of Alberta EdmontonABT6G 2E9 Canada The School of Information Science and Technology University of Science and Technology of China Anhui Hefei230026 China The School of Data Science The Chinese University of Hong Kong Guangdong Shenzhen518172 China The Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518000 China Linklogis Joint Laboratory of Computer Vision and Artificial Intelligence Guangdong Shenzhen518172 China

Transformer-based architectures start to emerge in single image super resolution (SISR) and have achieved promising performance. However, most existing vision Transformer-based SISR methods still have two shortcomings: (1) they divide images into the same number of patches with a fixed size, which may not be optimal for restoring patches with different levels of texture richness;and (2) their position encodings treat all input tokens equally and hence, neglect the dependencies among them. This paper presents a HIPA, which stands for a novel Transformer architecture that progressively recovers the high resolution image using a hierarchical patch partition. Specifically, we build a cascaded model that processes an input image in multiple stages, where we start with tokens with small patch sizes and gradually merge them to form the full resolution. Such a hierarchical patch mechanism not only explicitly enables feature aggregation at multiple resolutions but also adaptively learns patch-aware features for different image regions, e.g., using a smaller patch for areas with fine details and a larger patch for textureless regions. Meanwhile, a new attention-based position encoding scheme for Transformer is proposed to let the network focus on which tokens should be paid more attention by assigning different weights to different tokens, which is the first time to our best knowledge. Furthermore, we also propose a multi-receptive field attention module to enlarge the convolution receptive field from different branches. The experimental results on several public datasets demonstrate the superior performance of the proposed HIPA over previous methods quantitatively and qualitatively. We will share our code and models when the paper is accepted. Copyright © 2022, The Authors. All rights reserved.

关键词： Image reconstruction

Automation of Predictive Maintenance: An Experimental Framework for Aircraft Landing Gear

学校读者我要写书评

暂无评论

Engineering Reports

Engineering Reports 2025年第6期7卷

作者： Izaak Stanton Kamran Munir Ahsan Ikram Murad El-Bakry Centre for Machine Vision Bristol Robotics Laboratory (BRL) University of the West of England (UWE) Bristol UK Computer Science Research Centre (CSRC) School of Computing and Creative Technologies (SCC) College of Arts Technology and Environment (CATE) University of the West of England (UWE) Bristol UK Airbus Operations Ltd. Filton Bristol UK

Terabytes of data are recorded per flight by modern aircraft, providing a goldmine for predictive maintenance modeling, however, the required domain knowledge to build ML tools limits the number developed by airline manufacturers each year. Automated machine learning (AutoML) libraries can simplify model development, providing features such as automated preprocessing, model selection, and hyperparameter tuning to improve the efficiency and accessibility of the development workflow. This research presents an experimental analysis comparing industry-selected machine learning models and a hand-picked selection of automated machine-learning tools. The selected models were evaluated against real and synthetic time series datasets for different Airbus landing gear components across six datasets. The traditional and automated models obtained comparable MAE and F1 scores on regression and classification problems, accordingly, demonstrating the effectiveness of their use in this field. Based on these findings, a robust framework is proposed to utilize automated ML to optimize predictive maintenance tool development. This research is a stepping stone towards greater use of automation for predictive maintenance and presents insights into the field and AutoML. By integrating greater automation, AutoML can exploit more of the available data and deskill the development process to enable non-data scientists to produce health monitoring models for a more diverse pool of aircraft components.

关键词： aircraft maintenance automated machine learning machine learning predictive maintenance

Self-slimmed vision Transformer

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zong, Zhuofan Li, Kunchang Song, Guanglu Wang, Yali Qiao, Yu Leng, Biao Liu, Yu School of Computer Science and Engineering Beihang University China SenseTime Research China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China Shanghai AI Laboratory China

vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bring a huge computation burden, because of the exhausting token-to-token comparison. The previous works focus on dropping insignificant tokens to reduce the computational cost of ViTs. But when the dropping ratio increases, this hard manner will inevitably discard the vital tokens, which limits its efficiency. To solve the issue, we propose a generic self-slimmed learning approach for vanilla ViTs, namely SiT. Specifically, we first design a novel Token Slimming Module (TSM), which can boost the inference efficiency of ViTs by dynamic token aggregation. As a general method of token hard dropping, our TSM softly integrates redundant tokens into fewer informative ones. It can dynamically zoom visual attention without cutting off discriminative token relations in the images, even with a high slimming ratio. Furthermore, we introduce a concise Feature Recalibration Distillation (FRD) framework, wherein we design a reverse version of TSM (RTSM) to recalibrate the unstructured token in a flexible auto-encoder manner. Due to the similar structure between teacher and student, our FRD can effectively leverage structure knowledge for better convergence. Finally, we conduct extensive experiments to evaluate our SiT. It demonstrates that our method can speed up ViTs by 1.7× with negligible accuracy drop, and even speed up ViTs by 3.6× while maintaining 97% of their performance. Surprisingly, by simply arming LV-ViT with our SiT, we achieve new state-of-the-art performance on ImageNet. Code is available at https://***/Sense-X/SiT. © 2021, CC BY.

关键词： Distillation

Millimeter-wave radar image analysis for the traffic sensing 2

学校读者我要写书评

暂无评论

Millimeter-wave radar image analysis for the traffic sensing

2nd Spring International Conference on Defence Technology, ICDT 2020

作者： Wu, H.M. Qi, F. Wang, J.K. Wang, Y. School of Communication Science and Engineering Northeastern University Liaoning Province Shenyang110819 China Shenyang Institute of Automation Chinese Academy of Sciences China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences China Key Laboratory of Opto-Electronic Information Processing Chinese Academy of Sciences China Key Lab of Image Understanding and Computer Vision Liaoning Province Shenyang110016 China

Millimeter-wave(MMW) radar sensing is one of the most promising technologies to provide safe navigation for autonomous vehicles due to its expected high-resolution imaging capability However, driverless cars have higher request for different environment and light conditions. Therefore, millimetre-wave imaging is of paramount importance for complex load scenario. In this paper, we have built models of pavement pits and bulges and analysed their with differences ways of antennas. A comparison of the imaging performance of experimental systems operating at a MMW radar and a Lidar is presented with the analysis of features for initial image interpretation Experimental images of the complex road surface are made by a 94GHz frequency-modulated continuous-wave (FMCW) radar technique with 3mm wavelength. © Published under licence by IOP Publishing Ltd.

关键词： Optical radar

A Novel LOS Rate Estimation Method Based on Images for Strap-down Inertial Guidance 3

学校读者我要写书评

暂无评论

A Novel LOS Rate Estimation Method Based on Images for Strap...

2020 3rd International Conference on Advanced Algorithms and Control Engineering, ICAACE 2020

作者： Xu, Zheng Luo, Haibo Hui, Bin Chang, Zheng Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110016 China University of Chinese Academy of Sciences Beijing100049 China Key Laboratory of Opto-Electronic Information Processing Chinese Academy of Science Shenyang110016 China Key Lab of Image Understanding and Computer Vision Shenyang110016 China

With the development of technology, precision guided weapon is becoming more and more important in modern war. In order to launch our recent guidance system on medium and small guided weapons, we propose a method to obtain the LOS rate by combining information from both camera and gyroscope. To be specific, we firstly calculate the body LOS angle through transforming the image pixel coordinate system into the image physical coordinate system according to camera internal parameters;then subtract the missile motion information contained in the measurement signal of the seeker and finally the LOS rate is deduced. Comparing with traditional gimballed seekers, our strap-down seekers with camera have significantly reduced costs and influences caused by external environments on platform. © Published under licence by IOP Publishing Ltd.

关键词： Cameras

A toolkit to generate social navigation datasets

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Baghel, Rishabh Kapoor, Aditya Bachiller, Pilar Jorvekar, Ronit R. Rodriguez-Criado, Daniel Manso, Luis J. Dept. of Computer Science and Engineering Indian Institute of Information Technology Guwahati India Dept. of Computer Science and Information Systems Birla Institute of Technology and Science Goa India Robotics and Artificial Vision Laboratory University of Extremadura Spain Dept. of Computer Engineering Pune Institute of Computer Technology India Dept. of Computer Science College of Engineering and Physical Sciences Aston University United Kingdom

Social navigation datasets are necessary to assess social navigation algorithms and train machine learning algorithms. Most of the currently available datasets target pedestrians’ movements as a pattern to be replicated by robots. It can be argued that one of the main reasons for this to happen is that compiling datasets where real robots are manually controlled, as they would be expected to behave when moving, is a very resource-intensive task. Another aspect that is often missing in datasets is symbolic information that could be relevant, such as human activities, relationships or interactions. Unfortunately, the available datasets targeting robots and supporting symbolic information are restricted to static scenes. This paper argues that simulation can be used to gather social navigation data in an effective and cost-efficient way and presents a toolkit for this purpose. A use case studying the application of graph neural networks to create learned control policies using supervised learning is presented as an example of how it can be used. Copyright © 2020, The Authors. All rights reserved.

关键词： Navigation

Risk-averse MPC via visual-inertial input and recurrent networks for online collision avoidance

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Schperberg, Alexander Chen, Kenny Tsuei, Stephanie Jewett, Michael Hooks, Joshua Soatto, Stefano Mehta, Ankur Hong, Dennis The Robotics and Mechanisms Laboratory Department of Mechanical and Aerospace Engineering United States The Laboratory for Embedded Machines and Ubiquitous Robots Department of Electrical and Computer Engineering United States The UCLA Vision Lab Department of Computer Science United States The University of California Los Angeles Los AngelesCA90095 United States

In this paper, we propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties for safer navigation through cluttered environments. Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates through each step of our MPC's finite time horizon. The RNN model is trained on a dataset that comprises of robot and landmark poses generated from camera images and inertial measurement unit (IMU) readings via a state-of-the-art visual-inertial odometry framework. To detect and extract object locations for avoidance, we use a custom-trained convolutional neural network model in conjunction with a feature extractor to retrieve 3D centroid and radii boundaries of nearby obstacles. The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms, demonstrating autonomous behaviors that can plan fast and collision-free paths towards a goal point. Copyright © 2020, The Authors. All rights reserved.

关键词： Model predictive control

Underwater image super-resolution using deep residual multipliers

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Islam, Md Jahidul Enan, Sadman Sakib Luo, Peigen Sattar, Junaed Interactive Robotics and Vision Laboratory Department of Computer Science and Engineering Minnesota Robotics Institute University of Minnesota Twin Cities United States

We present a deep residual network-based generative model for single image super-resolution (SISR) of underwater imagery for use by autonomous underwater robots. We also provide an adversarial training pipeline for learning SISR from paired data. In order to supervise the training, we formulate an objective function that evaluates the perceptual quality of an image based on its global content, color, and local style information. Additionally, we present USR-248, a large-scale dataset of three sets of underwater images of ‘high’ (640 × 480) and ‘low’ (80 × 60, 160 × 120, and 320 × 240) resolution. USR-248 contains over 7K paired instances in each set of data for supervised training of 2×, 4×, or 8× SISR models. Furthermore, we validate the effectiveness of our proposed model through qualitative and quantitative experiments and compare the results with several state-of-the-art models’ performances. We also analyze its practical feasibility for applications such as scene understanding and attention modeling in noisy visual conditions. Copyright © 2019, The Authors. All rights reserved.

关键词： Large dataset

Robot-To-robot relative pose estimation using humans as markers

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Islam, Md Jahidul Mo, Jiawei Sattar, Junaed Interactive Robotics and Vision Laboratory Department of Computer Science and Engineering University of Minnesota Twin Cities United States

In this paper, we propose a method to determine the 3D relative pose of pairs of communicating robots by using human pose-based key-points as correspondences. We adopt a -leader-follower' framework, where at first, the leader robot visually detects and triangulates the key-points using the state-of-The-Art pose detector named OpenPose. Afterward, the follower robots match the corresponding 2D projections on their respective calibrated cameras and find their relative poses by solving the perspective-n-point (PnP) problem. In the proposed method, we design an efficient person re-identification technique for associating the mutually visible humans in the scene. Additionally, we present an iterative optimization algorithm to refine the associated key-points based on their local structural properties in the image space. We demonstrate that these refinement processes are essential to establish accurate key-point correspondences across viewpoints. Furthermore, we evaluate the performance of the proposed relative pose estimation method through several experiments conducted in terrestrial and underwater environments. Finally, we discuss the relevant operational challenges of this approach and analyze its feasibility for multi-robot cooperative systems in humandominated social settings and feature-deprived environments such as underwater. Copyright © 2019, The Authors. All rights reserved.

关键词： Iterative methods