检索结果-内蒙古大学图书馆

Fast Candidate Region Extraction for SAR Ship Target

学校读者我要写书评

暂无评论

Fast Candidate Region Extraction for SAR Ship Target

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Panpan Zhang Haibo Luo Zheng Xu Miao He Shenyang Institute of Automation Shenyang China Institutes for Robotics and Intelligent Manufacturing Shenyang China University of Chinese Academy of Sciences Beijing China Key Laboratory of Opto-Electronic Information Processing Shenyang China The Key Lab of Image Understanding and Computer Vision Shenyang China

ISBN: (纸本)9781665465373

At present, deep learning technology is widely used in ship target detection in synthetic aperture radar (SAR) images. However, high-resolution remote sensing SAR images cover a larger area and have larger image sizes. To be able to use the deep learning model for training and testing, the image needs to be cropped to the appropriate size. In a high-resolution SAR ship image, the ship target usually takes only a small part of the whole image. As a result, only part of the cropped image contains the target, and most of the rest are background regions. This will cause a lot of computational redundancy in the model inference stage. To solve this problem, a fast candidate region extraction algorithm is proposed in this paper for ship target extraction. The algorithm consists of three parts: firstly, extract the saliency map of the SAR ship image, secondly, perform median filtering on the segmented image, and thirdly, extract candidate regions. The superiority of the algorithm was demonstrated by experiments on the AIR-SARShip-1.0 dataset.

关键词： Deep learning Training Redundancy Radar polarimetry Inference algorithms Indexes Marine vehicles

Vision-Language Consistency Guided Multi-modal Prompt Learning for Blind AI Generated image Quality Assessment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Fu, Jun Zhou, Wei Jiang, Qiuping Liu, Hantao Zhai, Guangtao The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The School of Computer Science and Informatics Cardiff University CardiffCF24 4AG United Kingdom The School of Information Science and Engineering Ningbo University Ningbo315211 China The Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China

Recently, textual prompt tuning has shown inspirational performance in adapting Contrastive Language-image Pre-training (CLIP) models to natural image quality assessment. However, such uni-modal prompt learning method only tunes the language branch of CLIP models. This is not enough for adapting CLIP models to AI generated image quality assessment (AGIQA) since AGIs visually differ from natural images. In addition, the consistency between AGIs and user input text prompts, which correlates with the perceptual quality of AGIs, is not investigated to guide AGIQA. In this letter, we propose vision-language consistency guided multi-modal prompt learning for blind AGIQA, dubbed CLIP-AGIQA. Specifically, we introduce learnable textual and visual prompts in language and vision branches of CLIP models, respectively. Moreover, we design a text-to-image alignment quality prediction task, whose learned vision-language consistency knowledge is used to guide the optimization of the above multi-modal prompts. Experimental results on two public AGIQA datasets demonstrate that the proposed method outperforms state-of-the-art quality assessment models. The source code is available at https://***/JunFu1995/CLIP-AGIQA. © 2024, CC BY-NC-ND.

关键词： Learning systems

Adversarial Semantic Data Augmentation for Human Pose Estimation 16th

学校读者我要写书评

暂无评论

Adversarial Semantic Data Augmentation for Human Pose Estima...

16th European Conference on Computer Vision, ECCV 2020

作者： Bin, Yanrui Cao, Xuan Chen, Xinya Ge, Yanhao Tai, Ying Wang, Chengjie Li, Jilin Huang, Feiyue Gao, Changxin Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Tencent Youtu Lab Shanghai China

ISBN: (纸本)9783030585280

Human pose estimation is the task of localizing body keypoints from still images. The state-of-the-art methods suffer from insufficient examples of challenging cases such as symmetric appearance, heavy occlusion and nearby person. To enlarge the amounts of challenging cases, previous methods augmented images by cropping and pasting image patches with weak semantics, which leads to unrealistic appearance and limited diversity. We instead propose Semantic Data Augmentation (SDA), a method that augments images by pasting segmented body parts with various semantic granularity. Furthermore, we propose Adversarial Semantic Data Augmentation (ASDA), which exploits a generative network to dynamically predict tailored pasting configuration. Given off-the-shelf pose estimation network as discriminator, the generator seeks the most confusing transformation to increase the loss of the discriminator while the discriminator takes the generated sample as input and learns from it. The whole pipeline is optimized in an adversarial manner. State-of-the-art results are achieved on challenging benchmarks. The code has been publicly available at https://***/Binyr/ASDA. © 2020, Springer Nature Switzerland AG.

关键词： Semantics

Understanding the Robustness of 3D Object Detection with Bird’s-Eye-View Representations in Autonomous Driving

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhu, Zijian Zhang, Yichi Chen, Hai Dong, Yinpeng Zhao, Shu Ding, Wenbo Zhong, Jiachen Zheng, Shibao Institute of Image Communication and Network Engineering Shanghai Jiao Tong University China Dept. of Comp. Sci. and Tech. Institute for AI THBI Lab BNRist Center Tsinghua University China Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education School of Computer Science and Technology Anhui University Information Materials and Intelligent Sensing Laboratory of Anhui Province China SAIC Motor AI Lab China Zhongguancun Laboratory China

3D object detection is an essential perception task in autonomous driving to understand the environments. The Bird’s-Eye-View (BEV) representations have significantly improved the performance of 3D detectors with camera inputs on popular benchmarks. However, there still lacks a systematic understanding of the robustness of these vision-dependent BEV models, which is closely related to the safety of autonomous driving systems. In this paper, we evaluate the natural and adversarial robustness of various representative models under extensive settings, to fully understand their behaviors influenced by explicit BEV features compared with those without BEV. In addition to the classic settings, we propose a 3D consistent patch attack by applying adversarial patches in the 3D space to guarantee the spatiotemporal consistency, which is more realistic for the scenario of autonomous driving. With substantial experiments, we draw several findings: 1) BEV models tend to be more stable than previous methods under different natural conditions and common corruptions due to the expressive spatial representations;2) BEV models are more vulnerable to adversarial noises, mainly caused by the redundant BEV features;3) Camera-LiDAR fusion models have superior performance under different settings with multi-modal inputs, but BEV fusion model is still vulnerable to adversarial noises of both point cloud and image. These findings alert the safety issue in the applications of BEV detectors and could facilitate the development of more robust models. Code available at https: //***/zzj403/BEV_Robust. Copyright © 2023, The Authors. All rights reserved.

关键词： Birds

A Coding Framework and Benchmark towards Low-Bitrate Video Understanding

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Tian, Yuan Lu, Guo Yan, Yichao Zhai, Guangtao Chen, Li Gao, Zhiyong The Institute of Image Communication and Network Engineering Shanghai Jiao Tong University China The Shanghai Artificial Intelligence Laboratory Shanghai China The MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University China

Video compression is indispensable to most video analysis systems. Despite saving the transportation bandwidth, it also deteriorates downstream video understanding tasks, especially at low-bitrate settings. To systematically investigate this problem, we first thoroughly review the previous methods, revealing that three principles, i.e., task-decoupled, label-free, and data-emerged semantic prior, are critical to a machine-friendly coding framework but are not fully satisfied so far. In this paper, we propose a traditional-neural mixed coding framework that simultaneously fulfills all these principles, by taking advantage of both traditional codecs and neural networks (NNs). On one hand, the traditional codecs can efficiently encode the pixel signal of videos but may distort the semantic information. On the other hand, highly non-linear NNs are proficient in condensing video semantics into a compact representation. The framework is optimized by ensuring that a transportation-efficient semantic representation of the video is preserved w.r.t. the coding procedure, which is spontaneously learned from unlabeled data in a self-supervised manner. The videos collaboratively decoded from two streams (codec and NN) are of rich semantics, as well as visually photo-realistic, empirically boosting several mainstream downstream video analysis task performances without any post-adaptation procedure. Furthermore, by introducing the attention mechanism and adaptive modeling scheme, the video semantic modeling ability of our approach is further enhanced. Finally, we build a low-bitrate video understanding benchmark with three downstream tasks on eight datasets, demonstrating the notable superiority of our approach. All codes, data, and models will be available at https://***/tianyuan168326/VCS-Pytorch. Copyright © 2022, The Authors. All rights reserved.

关键词：

Tiny noise, big mistakes: adversarial perturbations induce errors in brain–computer interface spellers

学校读者我要写书评

暂无评论

National Science Review 2021年第4期8卷 78-90页

作者： Xiao Zhang Dongrui Wu Lieyun Ding Hanbin Luo Chin-Teng Lin Tzyy-Ping Jung Ricardo Chavarriaga Ministry of Education Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and AutomationHuazhong University of Science and Technology School of Civil Engineering and Mechanics Huazhong University of Science and Technology Centre of Artificial Intelligence Faculty of Engineering and Information Technology University of Technology Sydney Swartz Center for Computational Neuroscience Institute for Neural ComputationUniversity of California San Diego Center for Advanced Neurological Engineering Institute of Engineering in Medicine University of California San Diego ZHAW Data Lab Zürich University of Applied Sciences

An electroencephalogram(EEG)-based brain–computer interface(BCI) speller allows a user to input text to a computer by thought. It is particularly useful to severely disabled individuals, e.g. amyotrophic lateral sclerosis patients, who have no other effective means of communication with another person or a *** studies so far focused on making EEG-based BCI spellers faster and more reliable; however, few have considered their security. This study, for the first time, shows that P300 and steady-state visual evoked potential BCI spellers are very vulnerable, i.e. they can be severely attacked by adversarial perturbations,which are too tiny to be noticed when added to EEG signals, but can mislead the spellers to spell anything the attacker wants. The consequence could range from merely user frustration to severe misdiagnosis in clinical applications. We hope our research can attract more attention to the security of EEG-based BCI spellers, and more broadly, EEG-based BCIs, which has received little attention before.

关键词： electroencephalogram brain-computer interfaces BCI spellers adversarial examples

End-to-End Human-Gaze-Target Detection with Transformers

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Tu, Danyang Min, Xiongkuo Duan, Huiyu Guo, Guodong Zhai, Guangtao Shen, Wei Institute of Image Communication and Network Engineering Shanghai Jiao Tong University China Institute of Deep Learning Baidu Research Beijing China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University China

In this paper, we propose an effective and efficient method for Human-Gaze-Target (HGT) detection, i.e., gaze following. Current approaches decouple the HGT detection task into separate branches of salient object detection and human gaze prediction, employing a two-stage framework where human head locations must first be detected and then be fed into the next gaze target prediction sub-network. In contrast, we redefine the HGT detection task as detecting human head locations and their gaze targets, simultaneously. By this way, our method, named Human-Gaze-Target detection TRansformer or HGTTR, streamlines the HGT detection pipeline by eliminating all other additional components. HGTTR reasons about the relations of salient objects and human gaze from the global image context. Moreover, unlike existing two-stage methods that require human head locations as input and can predict only one human's gaze target at a time, HGTTR can directly predict the locations of all people and their gaze targets at one time in an end-to-end manner. The effectiveness and robustness of our proposed method are verified with extensive experiments on the two standard benchmark datasets, GazeFollowing and VideoAttentionTarget. Without bells and whistles, HGTTR outperforms existing state-of-the-art methods by large margins (6.4 mAP gain on GazeFollowing and 10.3 mAP gain on VideoAttentionTarget) with a much simpler architecture. Copyright © 2022, The Authors. All rights reserved.

关键词： Object detection

Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows

学校读者我要写书评

暂无评论

arXiv 2022年

This paper presents a new vision Transformer, named Iwin Transformer, which is specifically designed for human-object interaction (HOI) detection, a detailed scene understanding task involving a sequential process of human/object detection and interaction recognition. Iwin Transformer is a hierarchical Transformer which progressively performs token representation learning and token agglomeration within irregular windows. The irregular windows, achieved by augmenting regular grid locations with learned offsets, 1) eliminate redundancy in token representation learning, which leads to efficient human/object detection, and 2) enable the agglomerated tokens to align with humans/objects with different shapes, which facilitates the acquisition of highly-abstracted visual semantics for interaction recognition. The effectiveness and efficiency of Iwin Transformer are verified on the two standard HOI detection benchmark datasets, HICO-DET and V-COCO. Results show our method outperforms existing Transformers-based methods by large margins (3.7 mAP gain on HICO-DET and 2.0 mAP gain on V-COCO) with fewer training epochs (0.5×). Copyright © 2022, The Authors. All rights reserved.

关键词： Semantics

Coordinated Guiding Vector Field Design for Ordering-Flexible Multi-Robot Surface Navigation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Hu, Bin-Bin Zhang, Hai-Tao Yao, Weijia Sun, Zhiyong Cao, Ming The School of Artificial Intelligence and Automation The Engineering Research Center of Autonomous Intelligent Unmanned Systems The Key Laboratory of Image Processing and Intelligent Control The State Key Lab of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan430074 China The School of Robotics Hunan University Hunan410082 China The Institute of Engineering and Technology University of Groningen Groningen9747 AG Netherlands Department of Electrical Engineering Eindhoven University of Technology Netherlands

We design a distributed coordinated guiding vector field (CGVF) for a group of robots to achieve ordering-flexible motion coordination while maneuvering on a desired two-dimensional (2D) surface. The CGVF is characterized by three terms, i.e., a convergence term to drive the robots to converge to the desired surface, a propagation term to provide a traversing direction for maneuvering on the desired surface, and a coordinated term to achieve the surface motion coordination with an arbitrary ordering of the robotic group. By setting the surface parameters as additional virtual coordinates, the proposed approach eliminates potential singularity of the CGVF and enables both the global convergence to the desired surface and the maneuvering on the surface from all possible initial conditions. The ordering-flexible surface motion coordination is realized by each robot to share with its neighbors only two virtual coordinates, i.e. that of a given target and that of its own, which reduces the communication and computation cost in multi-robot surface navigation. Finally, the effectiveness of the CGVF is substantiated by extensive numerical simulations. Copyright © 2024, The Authors. All rights reserved.

关键词： Navigation