检索结果-内蒙古大学图书馆

GRATIS: Deep Learning Graph Representation with Task-specific Topology and Multi-dimensional Edge Features

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Song, Siyang Song, Yuxin Luo, Cheng Song, Zhiyuan Kuzucu, Selim Jia, Xi Guo, Zhijiang Xie, Weicheng Shen, Linlin Gunes, Hatice The Department of Computer Science and Technology University of Cambridge CambridgeCB3 0FT United Kingdom Baidu Inc Beijing100193 China Computer Vision Institute School of Computer Science & Software Engineering Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China Department of Computer Engineering Middle East Technical University Ankara Turkey School of Computer Science University of Birmingham Birmingham United Kingdom

Graph is powerful for representing various types of real-world data. The topology (edges’ presence) and edges’ features of a graph decides the message passing mechanism among vertices within the graph. While most existing approaches only manually define a single-value edge to describe the connectivity or strength of association between a pair of vertices, task-specific and crucial relationship cues may be disregarded by such manually defined topology and single-value edge features. In this paper, we propose the first general graph representation learning framework (called GRATIS) which can generate a strong graph representation with a task-specific topology and task-specific multi-dimensional edge features from any arbitrary input (i.e., graph or non-graph data). To learn each edge’s presence and multi-dimensional feature, our framework takes both of the corresponding vertices pair and their global contextual information into consideration, enabling the generated graph representation to have a globally optimal message passing mechanism for different down-stream tasks. The principled investigation results achieved for various graph analysis tasks (e.g., graph classification, vertex classification, and link prediction) on 11 graph and non-graph datasets show that our GRATIS can not only largely enhance pre-defined graphs but also learns a strong graph representation for non-graph data, with clear performance improvements on all tasks. In particular, the learned topology and multi-dimensional edge features provide complementary task-related cues for graph analysis tasks. Our framework is effective, robust and flexible, and is a plug-and-play module that can be combined with different backbones and Graph Neural Networks (GNNs) to generate a task-specific graph representation from various graph and non-graph data. Our code is made publicly available at https://***/SSYSteve/Learning-Graph-Representation-with-Task-specific-Topology-and-Multi-dimensional-Edge-Feature

关键词： Graph neural networks

A Unified Framework for Event-based Frame Interpolation with Ad-hoc Deblurring in the Wild

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Sun, Lei Gehrig, Daniel Sakaridis, Christos Gehrig, Mathias Liang, Jingyun Sun, Peng Xu, Zhijie Wang, Kaiwei Van Gool, Luc Scaramuzza, Davide National Research Center for Optical Instrumentation Zhejiang University Hangzhou310027 China Robotics and Perception Group University of Zurich Zurich8050 Switzerland Computer Vision Lab ETH Zurich Zurich8092 Switzerland Centre for Visual and Immersive Computing Huddersfield University HD1 3DH United Kingdom INSAIT Sofia University "St. Kliment Ohridski" Bulgaria

Effective video frame interpolation hinges on the adept handling of motion in the input scene. Prior work acknowledges asynchronous event information for this, but often overlooks whether motion induces blur in the video, limiting its scope to sharp frame interpolation. We instead propose a unified framework for event-based frame interpolation that performs deblurring ad-hoc and thus works both on sharp and blurry input videos. Our model consists in a bidirectional recurrent network that incorporates the temporal dimension of interpolation and fuses information from the input frames and the events adaptively based on their temporal proximity. To enhance the generalization from synthetic data to real event cameras, we integrate self-supervised framework with the proposed model to enhance the generalization on real-world datasets in the wild. At the dataset level, we introduce a novel real-world high-resolution dataset with events and color videos named HighREV, which provides a challenging evaluation setting for the examined task. Extensive experiments show that our network consistently outperforms previous state-of-the-art methods on frame interpolation, single image deblurring, and the joint task of both. Experiments on domain transfer reveal that self-supervised training effectively mitigates the performance degradation observed when transitioning from synthetic data to real-world data. Code and datasets are available at https://***/AHupuJR/REFID. Copyright © 2023, The Authors. All rights reserved.

关键词： Self-supervised learning

NTIRE 2023 HR NonHomogeneous Dehazing Challenge Report

学校读者我要写书评

暂无评论

NTIRE 2023 HR NonHomogeneous Dehazing Challenge Report

2023 IEEE/CVF Conference on computer vision and Pattern Recognition Workshops, CVPRW 2023

作者： Ancuti, Codruta O. Ancuti, Cosmin Vasluianu, Florin-Alexandru Timofte, Radu Zhou, Han Dong, Wei Liu, Yangyi Chen, Jun Liu, Huan Li, Liangyan Wu, Zijun Dong, Yubo Li, Yuyan Qiu, Tian He, Yu Lu, Yonghong Wu, Yinwei Jiang, Zhenxiang Liu, Songhua Yang, Xingyi Jing, Yongcheng Benjdira, Bilel Ali, Anas M. Koubaa, Anis Yang, Hao-Hsiang Chen, I-Hsiang Chen, Wei-Ting Huang, Zhi-Kai Chen, Yi-Chung Hsieh, Chia-Hsuan Chang, Hua-En Chiang, Yuan-Chun Kuo, Sy-Yen Guo, Yu Gao, Yuan Liu, Ryan Wen Lu, Yuxu Qu, Jingxiang He, Shengfeng Ren, Wenqi Hoang, Trung Zhang, Haichuan Yazdani, Amirsaeed Monga, Vishal Yang, Lehan Wu, Alex Jiahao Mai, Tiancheng Cong, Xiaofeng Yin, Xuemeng Yin, Xuefei Emad, Hazim Abdallah, Ahmed Yasser, Yahya Elshahat, Dalia Elbaz, Esraa Li, Zhan Kuang, Wenqing Luo, Ziwei Gustafsson, Fredrik K. Zhao, Zheng Sjölund, Jens Schön, Thomas B. Zhang, Zhao Wei, Yanyan Wang, Junhu Zhao, Suiyi Zheng, Huan Guo, Jin Sun, Yangfan Liu, Tianli Hao, Dejun Jiang, Kui Sarvaiya, Anjali Prajapati, Kalpesh Patra, Ratnadeep Barik, Pragnesh Rathod, Chaitanya Upla, Kishor Raja, Kiran Ramachandra, Raghavendra Busch, Christoph ETcTI Universitatea Politehnica Timisoara Romania ICTEAM UCL Belgium Computer Vision Lab University of Wuerzburg Germany Computer Vision Lab ETH Zurich Switzerland Department of Electrical and Computer Engineering McMaster University Canada Department of Electrical and Computer Engineering University of Alberta Canada McMaster University Canada Xidian University China Research Institute Singapore National University of Singapore Singapore University of Sydney Australia Robotics and Internet-of-Things Laboratory Prince Sultan University Riyadh12435 Saudi Arabia Department of Electrical Engineering National Taiwan University Taiwan Graduate Institute of Electronics Engineering National Taiwan University Taiwan Graduate Institute of Communication Engineering National Taiwan University Taiwan Wuhan University of Technology China Singapore Management University Singapore Singapore Sun Yat-sen University China Electrical Engineering Department Pennsylvania State University United States The University of Sydney Australia Southeast University China University of California Los Angeles United States Beijing Jiaotong University China Mansoura Univeristy Egypt College of Information Science and Technology Jinan University China Department of Information Technology Uppsala University Sweden Hefei University of Technology China Zhejiang Dahua Technology China Sardar Vallabhbhai National Institute of Technology India Norwegian University of Science and Technology Norway

ISBN: (纸本)9798350302493

This study assesses the outcomes of the NTIRE 2023 Challenge on Non-Homogeneous Dehazing, wherein novel techniques were proposed and evaluated on new image dataset called HD-NH-HAZE. The HD-NH-HAZE dataset contains 50 high resolution pairs of real-life outdoor images featuring nonhomogeneous hazy images and corresponding haze-free images of the same scene. The nonhomogeneous haze was simulated using a professional setup that replicated real-world conditions of hazy scenarios. The competition had 246 participants and 17 teams submitted solutions for the final testing phase. The proposed solutions demonstrated the cutting-edge in image dehazing technology. © 2023 IEEE.

关键词： Demulsification

Anytime Fault-tolerant Adaptive Routing for Multi-Robot Teams

学校读者我要写书评

暂无评论

Anytime Fault-tolerant Adaptive Routing for Multi-Robot Team...

IEEE International Conference on robotics and Automation (ICRA)

作者： Ronaldo F. dos Santos Erickson R. Nascimento Douglas G. Macharet Computer Vision and Robotics Laboratory (VeRLab) Universidade Federal de Minas Gerais MG Brazil Tres Lagoas Campus Universidadeˆ Federal de Mato Grosso do Sul MS Brazil

The Correlated Team Orienteering Problem (CTOP) is a routing problem where the objective is to determine a set of routes that maximizes the summation of collected rewards in the environment while respecting the vehicles’ budget. However, solutions to this problem usually consider static instances and may produce poor results in dynamic real-world scenarios. In this paper, we propose an approach to deal with the execution of missions planned as a CTOP instance, especially when vehicles of the team are prone to failure and may not complete their routes. The main contribution of this paper is a novel anytime heuristic that iteratively adapts the initial set of routes, allowing to increase the overall robustness of the mission and still collect the most profitable rewards. The methodology was thoroughly evaluated considering different scenarios and in all the cases was able to achieve comparable or better results in terms of reward than planning a new set of routes, however, spending considerably less time.

关键词： Fault tolerance Automation Conferences Fault tolerant systems Routing Robustness Planning

Optimisation of a siamese neural network for real-time energy efficient object tracking

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2020年

作者： Przewlocka, Dominika Wasala, Mateusz Szolc, Hubert Blachut, Krzysztof Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

In this paper the research on optimisation of visual object tracking using a Siamese neural network for embedded vision systems is presented. It was assumed that the solution shall operate in real-time, preferably for a high resolution video stream, with the lowest possible energy consumption. To meet these requirements, techniques such as the reduction of computational precision and pruning were considered. Brevitas, a tool dedicated for optimisation and quantisation of neural networks for FPGA implementation, was used. A number of training scenarios were tested with varying levels of optimisations – from integer uniform quantisation with 16 bits to ternary and binary networks. Next, the influence of these optimisations on the tracking performance was evaluated. It was possible to reduce the size of the convolutional filters up to 10 times in relation to the original network. The obtained results indicate that using quantisation can significantly reduce the memory and computational complexity of the proposed network while still enabling precise tracking, thus allow to use it in embedded vision systems. Moreover, quantisation of weights positively affects the network training by decreasing overfitting. © 2020, CC BY-NC-SA.

关键词： Field programmable gate arrays (FPGA)

Optimisation of a siamese neural network for real-time energy efficient object tracking

学校读者我要写书评

暂无评论

arXiv 2020年

In this paper the research on optimisation of visual object tracking using a Siamese neural network for embedded vision systems is presented. It was assumed that the solution shall operate in real-time, preferably for a high resolution video stream, with the lowest possible energy consumption. To meet these requirements, techniques such as the reduction of computational precision and pruning were considered. Brevitas, a tool dedicated for optimisation and quantisation of neural networks for FPGA implementation, was used. A number of training scenarios were tested with varying levels of optimisations - from integer uniform quantisation with 16 bits to ternary and binary networks. Next, the influence of these optimisations on the tracking performance was evaluated. It was possible to reduce the size of the convolutional filters up to 10 times in relation to the original network. The obtained results indicate that using quantisation can significantly reduce the memory and computational complexity of the proposed network while still enabling precise tracking, thus allow to use it in embedded vision systems. Moreover, quantisation of weights positively affects the network training by decreasing overfitting. Copyright © 2020, The Authors. All rights reserved.

关键词： Field programmable gate arrays (FPGA)

Joint Design of Radar Receive Filter and Unimodular ISAC Waveform with Sidelobe Level Control

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Kecheng Liu, Ya-Feng Wang, Zhongbin Yuan, Weijie Keskin, Musa Furkan Wymeersch, Henk Xia, Shuqiang School of System Design and Intelligent Manufacturing The Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China State Key Laboratory of Scientific and Engineering Computing Institute of Computational Mathematics and Scientific/Engineering Computing Academy of Mathematics and Systems Science Chinese Academy of Sciences Beijing100190 China Department of Electrical Engineering Chalmers University of Technology Gothenburg41296 Sweden ZTE Corporation The State Key Laboratory of Mobile Network and Mobile Multimedia Technology Shenzhen518055 China

Integrated sensing and communication (ISAC) has been considered a key feature of next-generation wireless networks. This paper investigates the joint design of the radar receive filter and dual-functional transmit waveform for the multiple-input multiple-output (MIMO) ISAC system. While optimizing the mean square error (MSE) of the radar receive spatial response and maximizing the achievable rate at the communication receiver, besides the constraints of full-power radar receiving filter and unimodular transmit sequence, we control the maximum range sidelobe level, which is often overlooked in existing ISAC waveform design literature, for better radar imaging performance. To solve the formulated optimization problem with convex and nonconvex constraints, we propose an inexact augmented Lagrangian method (ALM) algorithm. For each subproblem in the proposed inexact ALM algorithm, we custom-design a block successive upper-bound minimization (BSUM) scheme with closed-form solutions for all blocks of variable to enhance the computational efficiency. Convergence analysis shows that the proposed algorithm is guaranteed to provide a stationary and feasible solution. Extensive simulations are performed to investigate the impact of different system parameters on communication and radar imaging performance. Comparison with the existing works shows the superiority of the proposed algorithm. © 2025, CC BY-NC-SA.

关键词： Mean square error

Automated industrial quality control of pipe stacks using computer vision 4th

学校读者我要写书评

暂无评论

Automated industrial quality control of pipe stacks using co...

4th International Conference on computer vision and Image Processing, CVIP 2019

作者： Chatterjee, Sayantan Chaudhuri, Bidyut B. Nandi, Gora C. Department of Robotics and Artificial Intelligence Indian Institute of Information Technology Allahabad AllahabadUttar Pradesh211012 India Department of Computer Vision and Pattern Recognition Indian Statistical Institute Kolkata KolkataWest Bengal700108 India

ISBN: (纸本)9789811540141

In this work, we describe an automated quality assurance system for pipes in warehouses and yards using simple handheld and mobile equipment like smartphone cameras. Currently, quality inspection for bent and crooked pipe ends is done manually, which entails additional labour costs and is relatively slower than a mechanised approach. We propose an efficient and robust method of detecting the perfectly circular cross-sections of the pipes in stacks using an adaptive variation of Hough Transform algorithm. As a multistage approach, our proposed method first intensifies the foreground features relative to the background and then applies Canny edge detection to obtain the gradient details. The gradient directions are in turn fed to the modified Hough Transform algorithm using Hough gradient to detect the cross-sections. The novel Hough Transform modification features a region-based processing in a "coarse to fine" manner by dividing the image into smaller grids and detecting circular cross-sections per grid, which has computational advantages of using a smaller accumulator and is less memory intensive. Experiments were performed on real industrial images to validate the efficiency of the proposed algorithm and the results show that the proposed method can successfully and accurately highlight the perfectly circular cross-sections while leaving the faulty pipe-ends undetected. © Springer Nature Singapore Pte Ltd 2020.

关键词： Hough transforms

Ridge polynomial neural network with error feedback for recursive multi-step forecast strategy: A case study of carbon dioxide emissions forecasting 2

学校读者我要写书评

暂无评论

Ridge polynomial neural network with error feedback for recu...

2nd International Conference on computer and Information Sciences, ICCIS 2020

作者： Waheeb, Waddah Shah, Habib Jabreel, Mohammed Puig, Domenec School of Computing Asia Pacific University of Technology Innovation Kuala Lumpur Bukit Jalil57000 Malaysia College of Computer Science King Khalid University Department of Computer Science Abha62529 Saudi Arabia IRCV - Intelligent Robotics and Computer Vision Group Universitat Rovira i Virgili Tarragona43007 Spain

ISBN: (数字)9781728154671

ISBN: (纸本)9781728154671

Neural networks (NNs) have been used extensively for forecasting problems. NN with error feedbacks is a type of NNs that showed more accurate forecasts compared to feedforward NNs and NNs with output feedbacks with some forecasting problems. The main issue with NN s with error feedbacks appears when there is a need for recursive multi-step forecast strategy because the observed values must be known in order to calculate network errors. This paper proposes to use the last calculated error after finishing training NNs with error feedbacks because the observed values are unknown. This last calculated error is used as a fixed value when producing forecasts using recursive multi-step forecast strategy. For that, this paper investigated this simple solution with a NN with error feedback called the ridge polynomial neural network with error feedback (RPNN-EF). Carbon dioxide emissions for three countries in the organization of the petroleum exporting countries (OPEC) were used in this investigation. The forecasting accuracy of RPNN-EF was compared with seven forecasting methods. According to the obtained results, on average, the proposed solution produces reasonable forecasts compared to the seven forecasting methods. Therefore, this solution can be suggested for NNs with error feedbacks for recursive multi-step forecast strategy. © 2020 IEEE.

关键词： Polynomials