检索结果-内蒙古大学图书馆

Physical Adversarial Attack Meets computer vision: A Decade Survey

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wei, Hui Tang, Hao Jia, Xuemei Wang, Zhixiang Yu, Hanxun Li, Zhubo Satoh, Shin'ichi Van Gool, Luc Wang, Zheng School of Computer Science National Engineering Research Center for Multimedia Software Wuhan University Wuhan China National Key Laboratory for Multimedia Information Processing School of Computer Science Peking University Beijing100871 China Colleage of Software and Technology Zhejiang University Hangzhou China School of Cyber Science and Engineering Wuhan University Wuhan China Digital Content and Media Sciences Research Division National Institute of Informatics Japan Department of Information and Communication Engineering Graduate School of Information Science and Technology The University of Tokyo Japan Computer Vision Lab of ETH Zurich Zürich8092 Switzerland KU Leuven Leuven3000 Belgium INSAIT Sofia Bulgaria

Despite the impressive achievements of Deep Neural Networks (DNNs) in computer vision, their vulnerability to adversarial attacks remains a critical concern. Extensive research has demonstrated that incorporating sophisticated perturbations into input images can lead to a catastrophic degradation in DNNs’ performance. This perplexing phenomenon not only exists in the digital space but also in the physical world. Consequently, it becomes imperative to evaluate the security of DNNs-based systems to ensure their safe deployment in real-world scenarios, particularly in security-sensitive applications. To facilitate a profound understanding of this topic, this paper presents a comprehensive overview of physical adversarial attacks. Firstly, we distill four general steps for launching physical adversarial attacks. Building upon this foundation, we uncover the pervasive role of artifacts carrying adversarial perturbations in the physical world. These artifacts influence each step. To denote them, we introduce a new term: adversarial medium. Then, we take the first step to systematically evaluate the performance of physical adversarial attacks, taking the adversarial medium as a first attempt. Our proposed evaluation metric, hiPAA, comprises six perspectives: Effectiveness, Stealthiness, Robustness, Practicability, Aesthetics, and Economics. We also provide comparative results across task categories, together with insightful observations and suggestions for future research directions. Copyright © 2022, The Authors. All rights reserved.

关键词： Deep neural networks

SABER: Data-driven motion planner for autonomously navigating heterogeneous robots

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Schperberg, Alexander Tsuei, Stephanie Soatto, Stefano Hong, Dennis The Robotics and Mechanisms Laboratory Department of Mechanical and Aerospace Engineering University of California Los AngelesCA90095 United States The UCLA Vision Lab Department of Computer Science University of California Los AngelesCA90095 United States

We present an end-to-end online motion planning framework that uses a data-driven approach to navigate a heterogeneous robot team towards a global goal while avoiding obstacles in uncertain environments. First, we use stochastic model predictive control (SMPC) to calculate control inputs that satisfy robot dynamics, and consider uncertainty during obstacle avoidance with chance constraints. Second, recurrent neural networks are used to provide a quick estimate of future state uncertainty considered in the SMPC finite-time horizon solution, which are trained on uncertainty outputs of various simultaneous localization and mapping algorithms. When two or more robots are in communication range, these uncertainties are then updated using a distributed Kalman filtering approach. Lastly, a Deep Q-learning agent is employed to serve as a high-level path planner, providing the SMPC with target positions that move the robots towards a desired global goal. Our complete methods are demonstrated on a ground and aerial robot simultaneously (code available at: https://***/AlexS28/SABER). Copyright © 2021, The Authors. All rights reserved.

关键词： Stochastic systems

vision-Based Goal-Conditioned policies for underwater navigation in the presence of obstacles

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Manderson, Travis Gamboa, Juan Camilo Wapnick, Stefan Tremblay, Jean-François Shkurti, Florian Meger, Dave Dudek, Gregory Mobile Robotics Laboratory School of Computer Science McGill University Montreal Canada Robot Vision & Learning Lab Department of Computer Science University of Toronto Canada

We present Nav2Goal, a data-efficient and end-to-end learning method for goal-conditioned visual navigation. Our technique is used to train a navigation policy that enables a robot to navigate close to sparse geographic waypoints provided by a user without any prior map, all while avoiding obstacles and choosing paths that cover user-informed regions of interest. Our approach is based on recent advances in conditional imitation learning. General-purpose safe and informative actions are demonstrated by a human expert. The learned policy is subsequently extended to be goal-conditioned by training with hindsight relabelling, guided by the robot’s relative localization system, which requires no additional manual annotation. We deployed our method on an underwater vehicle in the open ocean to collect scientifically relevant data of coral reefs, which allowed our robot to operate safely and autonomously, even at very close proximity to the coral. Our field deployments have demonstrated over a kilometer of autonomous visual navigation, where the robot reaches on the order of 40 waypoints, while collecting scientifically relevant data. This is done while travelling within 0.5 m altitude from sensitive corals and exhibiting significant learned agility to overcome turbulent ocean conditions and to actively avoid collisions. Copyright © 2020, The Authors. All rights reserved.

关键词： Navigation

LocalViT: Analyzing Locality in vision Transformers

学校读者我要写书评

暂无评论

LocalViT: Analyzing Locality in Vision Transformers

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Yawei Li Kai Zhang Jiezhang Cao Radu Timofte Michele Magno Luca Benini Luc Van Goo Computer Vision Lab D-ITET ETH Zurich Switzerland Center for Artificial Intelligence and Data Science (CAIDAS) University of Wurzburg Germany Center for Project-Based Learning D-ITET ETH Zurich Switzerland Integrated Systems Laboratory D-ITET ETH Zurich Switzerland Department of Electrical Electronic and Information Engineering University of Bologna Italy Processing Speech and Images (PSI) KU Leuven Belgium

The aim of this paper is to study the influence of locality mechanisms in vision transformers. Transformers originated from machine translation and are particularly good at modelling long-range dependencies within a long sequence. Although the global interaction between the token embeddings could be well modelled by the self-attention mechanism of transformers, what is lacking is a locality mechanism for infor-mation exchange within a local region. In this paper, locality mechanism is systematically investigated by carefully designed controlled experiments. We add locality to vision transformers into the feed-forward network. This seemingly simple solution is inspired by the comparison between feed-forward networks and inverted residual blocks. The importance of locality mechanisms is validated in two ways: 1) A wide range of design choices (activation function, layer placement, expansion ratio) are available for incorporating locality mechanisms and proper choices can lead to a performance gain over the baseline, and 2) The same locality mechanism is successfully applied to vision transformers with different architecture designs, which shows the generalization of the locality concept. For ImageNet2012 classification, the locality-enhanced transformers outperform the baselines Swin-T [1], DeiT-T [2] and PVT-T [3] by 1.0%, 2.6 % and 3.1 % with a negligible increase in the number of parameters and computational effort. Code is available at https://***/ofsoundof/LocalViT.

关键词：

Group-wise inhibition based feature regularization for robust classification

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Haozhe Wu, Haoqian Xie, Weicheng Liu, Feng Shen, Linlin 1Computer Vision Institute College of Computer Science and Software Engineering 2SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society 3National Engineering Laboratory for Big Data System Computing Technology 4Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen 518060 China

The convolutional neural network (CNN) is vulnerable to degraded images with even very small variations (e.g. corrupted and adversarial samples). One of the possible reasons is that CNN pays more attention to the most discriminative regions, but ignores the auxiliary features when learning, leading to the lack of feature diversity for final judgment. In our method, we propose to dynamically suppress significant activation values of CNN by group-wise inhibition, but not fixedly or randomly handle them when training. The feature maps with different activation distribution are then processed separately to take the feature independence into account. CNN is finally guided to learn richer discriminative features hierarchically for robust classification according to the proposed regularization. Our method is comprehensively evaluated under multiple settings, including classification against corruptions, adversarial attacks and low data regime. Extensive experimental results show that the proposed method can achieve significant improvements in terms of both robustness and generalization performances, when compared with the state-of-the-art methods. Code is available at https://***/LinusWu/TENET_Training. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolutional neural networks

The increasing rate of net carbon uptake in Eurasia has been declining since the early 2000s

学校读者我要写书评

暂无评论

science of the Total Environment 2024年 955卷 176890页

作者： Xie, Mingjuan Luo, Geping Frankl, Amaury Van Weverberg, Kwinten Huang, Yuanyuan Ma, Xiaofei Wang, Yuangang Li, Chaofan Yuan, Xiuliang Hellwich, Olaf Zhang, Wenqiang Zhang, Yu Ling, Qing Gao, Ruixiang Ochege, Friday Uchenna De Maeyer, Philippe State Key Laboratory of Desert and Oasis Ecology Key Laboratory of Ecological Safety and Sustainable Development in Arid Lands Xinjiang Institute of Ecology and Geography Chinese Academy of Sciences Xinjiang Urumqi830011 China Department of Geography Ghent University Ghent9000 Belgium College of Resources and Environment University of Chinese Academy of Sciences Beijing100049 China Key Laboratory of Ecosystem Network Observation and Modeling Institute of Geographic Sciences and Natural Resources Research Chinese Academy of Sciences Beijing China Sino-Belgian Joint Laboratory for Geo-Information Urumqi China Sino-Belgian Joint Laboratory for Geo-Information Ghent Belgium School of Geographical Sciences Nanjing University of Information Science and Technology Nanjing210044 China Department of Computer Vision & Remote Sensing Technische Universität Berlin Berlin10587 Germany Department of Geography and Environmental Management University of Port Harcourt PMB 5323 Choba East-West Port Harcourt Nigeria Royal Meteorological Institute of Belgium Brussels1180 Belgium

The analysis of terrestrial ecosystem carbon dynamics, based on scarce carbon flux observations or carbon flux products simulated by reanalysis meteorological data, has great uncertainties. A more accurate understanding of carbon dynamics in Eurasia was achieved by using a carbon flux dataset (CFD) from meteorological stations with quasi-observational characteristics. The growth of net carbon uptake of ecosystems over Eurasia has been decreasing since the early 2000s. The net ecosystem productivity (NEP) increased significantly with the growth rate of 8.7 × 10−3 g C m−2d−1 yr−1 in spring, summer, and autumn (SSA) during 2003–2011 (p −2d−1 in SSA during 2003–2018, and almost all stations demonstrated carbon uptake. During 2011–2018, the number of stations experiencing reduced NEP exceeded those with increased NEP, and this ratio was higher compared to 2003–2011, mainly due to the decrease in EVI and LSWI. The rate of NEP decline at stations with reduced NEP was 5.2 × 10−3 g C m−2d−1 yr−1 faster during 2011–2018 than in the previous period (p © 2024

关键词： Carbon sequestration

HIPA: Hierarchical Patch Transformer for Single Image Super Resolution

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Cai, Qing Qian, Yiming Li, Jinxing Lyu, Jun Yang, Yee-Hong Wu, Feng Zhang, David The Faculty of Information Science and Engineering Ocean University of China Shandong Qingdao266100 China The Department of Computer Science University of Manitoba WinnipegMBR3T 2N2 Canada The School of Computer Science and Technology Harbin Institute of Technology Guangdong Shenzhen518055 China The School of Nursing The Hong Kong Polytechnic University Hong Kong The Department of Computing Science University of Alberta EdmontonABT6G 2E9 Canada The School of Information Science and Technology University of Science and Technology of China Anhui Hefei230026 China The School of Data Science The Chinese University of Hong Kong Guangdong Shenzhen518172 China The Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518000 China Linklogis Joint Laboratory of Computer Vision and Artificial Intelligence Guangdong Shenzhen518172 China

Transformer-based architectures start to emerge in single image super resolution (SISR) and have achieved promising performance. However, most existing vision Transformer-based SISR methods still have two shortcomings: (1) they divide images into the same number of patches with a fixed size, which may not be optimal for restoring patches with different levels of texture richness;and (2) their position encodings treat all input tokens equally and hence, neglect the dependencies among them. This paper presents a HIPA, which stands for a novel Transformer architecture that progressively recovers the high resolution image using a hierarchical patch partition. Specifically, we build a cascaded model that processes an input image in multiple stages, where we start with tokens with small patch sizes and gradually merge them to form the full resolution. Such a hierarchical patch mechanism not only explicitly enables feature aggregation at multiple resolutions but also adaptively learns patch-aware features for different image regions, e.g., using a smaller patch for areas with fine details and a larger patch for textureless regions. Meanwhile, a new attention-based position encoding scheme for Transformer is proposed to let the network focus on which tokens should be paid more attention by assigning different weights to different tokens, which is the first time to our best knowledge. Furthermore, we also propose a multi-receptive field attention module to enlarge the convolution receptive field from different branches. The experimental results on several public datasets demonstrate the superior performance of the proposed HIPA over previous methods quantitatively and qualitatively. We will share our code and models when the paper is accepted. Copyright © 2022, The Authors. All rights reserved.

关键词： Image reconstruction

Few-shot learning based histopathological image classification of colorectal cancer

学校读者我要写书评

暂无评论

Intelligent Medicine 2024年第4期4卷 256-267页

作者： Rui Li Xiaoyan Li Hongzan Sun Jinzhu Yang Md Rahaman Marcin Grzegozek Tao Jiang Xinyu Huang Chen Li Key Laboratory of Intelligent Computing in Medical Image Ministry of EducationNortheastern UniversityShenyangLiaoning 110167China Cancer Hospital China Medical UniversityShenyangLiaoning 110122China Shengjing Hospital China Medical UniversityShenyang.Liaoning 110000China Institute for Medical Informatics University of LuebeckGermany Department of Knowledge Engineering University of Economics in KatowicePoland School of Intelligent Medicine Chengdu University of Traditional Chinese MedicineChengduSichuan 610075China International Joint Institute of Robotics and Intelligent Systems Chengdu University of Information TechnologyChengduSichuan 610225China School of Computer Science and Engineering University of New South WalesSydneyNSW 2052Australia

Background Colorectal cancer is a prevalent and deadly disease worldwide,posing significant diagnostic *** histopathologic image classification is often inefficient and *** some histopathologists use computer-aided diagnosis to improve efficiency,these methods depend heavily on exten-sive data and specific annotations,limiting their *** address these challenges,this paper proposes a method based on few-shot *** This study introduced a few-shot learning approach that combines transfer learning and contrastive learning to classify colorectal cancer histopathology images into benign and malignant *** model comprises modules for feature extraction,dimensionality reduction,and classification,trained using a combi-nation of contrast loss and cross-entropy *** this paper,we detailed the setup of hyperparameters:n-way,κ-shot,β,and the creation of support,query,and test *** Our method achieved over 98% accuracy on a query dataset with 35 samples per category using only 10 training samples per *** documented the model’s loss,accuracy,and the confusion matrix of the ***,we employed the t-SNE algorithm to analyze and assess the model’s classification *** The proposed model may demonstrate significant advantages in accuracy and minimal data depen-dency,performing robustly across all tested n-way,κ-shot *** consistently achieved over 93% accuracy on comprehensive test datasets,including 1916 samples,confirming its high classification accuracy and strong generalization *** research could advance the use of few-shot learning in medical diagnostics and also lays the groundwork for extending it to deal with rare,difficult-to-diagnose cases.

关键词： Colorectal cancer Few-shot learning Transfer learning Contrastive learning Histopathological images Benign and malignant categories

Semantic segmentation of underwater imagery: Dataset and benchmark

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Islam, Md Jahidul Edge, Chelsey Xiao, Yuyang Luo, Peigen Mehtaz, Muntaqim Morse, Christopher Enan, Sadman Sakib Sattar, Junaed Interactive Robotics and Vision Laboratory Department of Computer Science and Engineering Minnesota Robotics Institute University of Minnesota Twin CitiesMN United States

In this paper, we present the first large-scale dataset for semantic Segmentation of Underwater IMagery (SUIM). It contains over 1500 images with pixel annotations for eight object categories: fish (vertebrates), reefs (invertebrates), aquatic plants, wrecks/ruins, human divers, robots, and sea-floor. The images are rigorously collected during oceanic explorations and human-robot collaborative experiments, and annotated by human participants. We also present a comprehensive benchmark evaluation of several state-of-the-art semantic segmentation approaches based on standard performance metrics. Additionally, we present SUIM-Net, a fully-convolutional deep residual model that balances the tradeoff between performance and computational efficiency. It offers competitive performance while ensuring fast end-to-end inference, which is essential for its use in the autonomy pipeline by visually-guided underwater robots. In particular, we demonstrate its usability benefits for visual servoing, saliency prediction, and detailed scene understanding. With a variety of use cases, the proposed model and benchmark dataset open up promising opportunities for future research on underwater robot vision. Copyright © 2020, The Authors. All rights reserved.

关键词： Semantic Segmentation