检索结果-内蒙古大学图书馆

Incorporating Hidden Layer representation into Adversarial Attacks and Defences

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Shen, Haojing Chen, Sihong Wang, Ran Wang, Xizhao Big Data Institute College of Computer Science and Software Engineering Guangdong Key Lab. of Intelligent Information Processing Shenzhen University Guangdong Shenzhen518060 China The College of Mathematics and Statistics Shenzhen University Shenzhen518060 China The Shenzhen Key Laboratory of Advanced Machine Learning and Applications Shenzhen University Shenzhen518060 China

In this paper, we propose a defence strategy to improves adversarial robustness incorporating hidden layer representation. The key of this defence strategy aims to compress or filter input’s information including adversarial perturbation. And this defence strategy can be regarded as an activation function which can be applied any kind of neural networks. We also prove theoretically the effectiveness of this defense strategy under certain conditions. Besides, incorporating hidden layer representation we propose three types of adversarial attacks to generate three types of adversarial examples, respectively. The experiments show that our defence method can significantly improve the adversarial robustness of deep neural networks which achieves the state-of-the-art performance even though we do not adopt adversarial training. © 2020, CC BY.

关键词： Deep neural networks

Feature extraction for hyperspectral imagery: The evolution from shallow to deep

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Rasti, Behnood Hong, Danfeng Hang, Renlong Ghamisi, Pedram Kang, Xudong Chanussot, Jocelyn Benediktsson, Jon Atli Machine Learning Group Exploration Division Helmholtz Institute Freiberg for Resource Technology Helmholtz-Zentrum Dresden-Rossendorf Freiberg09599 Germany Univ. Grenoble Alpes CNRS Grenoble INP GIPSAlab Grenoble38000 France Jiangsu Key Laboratory of Big Data Analysis Technology School of Automation Nanjing University of Information Science and Technology Nanjing210044 China Machine Learning Group Exploration Division Helmholtz Institute Freiberg for Resource Technology Helmholtz-Zentrum Dresden-Rossendorf Freiberg09599 Germany College of Electrical and Information Engineering Hunan University Changsha410082 China Key Laboratory of Visual Perception and Artificial Intelligence of Hunan Province Changsha410082 China Univ. Grenoble Alpes Inria CNRS Grenoble INP LJK GrenobleF-38000 France Faculty of Electrical and Computer Engineering University of Iceland Reykjavik101 Iceland Faculty of Electrical and Computer Engineering University of Iceland Reykjavik107 Iceland

The final version of the paper can be found in IEEE Geoscience and Remote Sensing Magazine. Hyperspectral images provide detailed spectral information through hundreds of (narrow) spectral channels (also known as dimensionality or bands) with continuous spectral information that can accurately classify diverse materials of interest. The increased dimensionality of such data makes it possible to significantly improve data information content but provides a challenge to the conventional techniques (the so-called curse of dimensionality) for accurate analysis of hyperspectral images. Feature extraction, as a vibrant field of research in the hyperspectral community, evolved through decades of research to address this issue and extract informative features suitable for data representation and classification. The advances in feature extraction have been inspired by two fields of research, including the popularization of image and signal processing as well as machine (deep) learning, leading to two types of feature extraction approaches named shallow and deep techniques. This article outlines the advances in feature extraction approaches for hyperspectral imagery by providing a technical overview of the state-of-the-art techniques, providing useful entry points for researchers at different levels, including students, researchers, and senior researchers, willing to explore novel investigations on this challenging topic. In more detail, this paper provides a bird's eye view over shallow (both supervised and unsupervised) and deep feature extraction approaches specifically dedicated to the topic of hyperspectral feature extraction and its application on hyperspectral image classification. Additionally, this paper compares 15 advanced techniques with an emphasis on their methodological foundations in terms of classification accuracies. Furthermore, to push this vibrant field of research forward an impressive amount of codes and libraries is shared at: https://***/Behnoo

关键词： Feature extraction

Gradient descent finds global minima of deep neural networks

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Du, Simon S. Lee, Jason D. Li, Haochuan Wang, Liwei Zhai, Xiyu Machine Learning Department Carnegie Mellon University Data Science and Operations Department University of Southern California School of Physics Peking University Center for Data Science Peking University Beijing Institute of Big Data Research Key Laboratory of Machine Perception Moe School of Eecs Peking University Department of Eecs Massachusetts Institute of Technology

Gradient descent finds a global minimum in training deep neural networks despite the objective function being non-convex. The current paper proves gradient descent achieves zero training loss in polynomial time for a deep over-parameterized neural network with residual connections (ResNet). Our analysis relies on the particular structure of the Gram matrix induced by the neural network architecture. This structure allows us to show the Gram matrix is stable throughout the training process and this stability implies the global optimality of the gradient descent algorithm. We further extend our analysis to deep residual convolutional neural networks and obtain a similar convergence result. Copyright © 2018, The Authors. All rights reserved.

关键词： Gradient methods

Strategic priorities for transformative progress in advancing biology with proteomics and artificial intelligence

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Sun, Yingying Jun, A. Liu, Zhiwei Sun, Rui Qian, Liujia Payne, Samuel H. Bittremieux, Wout Ralser, Markus Li, Chen Chen, Yi Dong, Zhen Perez-Riverol, Yasset Khan, Asif Sander, Chris Aebersold, Ruedi Vizcaíno, Juan Antonio Krieger, Jonathan R. Yao, Jianhua Wen, Han Zhang, Linfeng Zhu, Yunping Xuan, Yue Sun, Benjamin Boyang Qiao, Liang Hermjakob, Henning Tang, Haixu Gao, Huanhuan Deng, Yamin Zhong, Qing Chang, Cheng Bandeira, Nuno Li, Ming Weinan, E. Sun, Siqi Yang, Yuedong Omenn, Gilbert S. Zhang, Yue Xu, Ping Fu, Yan Liu, Xiaowen Overall, Christopher M. Wang, Yu Deutsch, Eric W. Chen, Luonan Cox, Jürgen Demichev, Vadim He, Fuchu Huang, Jiaxing Jin, Huilin Liu, Chao Li, Nan Luan, Zhongzhi Song, Jiangning Yu, Kaicheng Wan, Wanggen Wang, Tai Zhang, Kang Zhang, Le Bell, Peter A. Mann, Matthias Zhang, Bing Guo, Tiannan Affiliated Hangzhou First People’s Hospital State Key Laboratory of Medical Proteomics School of Medicine Westlake University Zhejiang Province Hangzhou China Westlake Center for Intelligent Proteomics Westlake Laboratory of Life Sciences and Biomedicine Zhejiang Province Hangzhou China Biology Department Brigham Young University ProvoUT84602 United States Department of Computer Science University of Antwerp Antwerp2020 Belgium Department of Biochemistry CharitéUniversitätsmedizin Berlin Berlin Germany Biomedicine Discovery Institute Department of Biochemistry and Molecular Biology Monash University MelbourneVICVIC 3800 Australia Wellcome Genome Campus Hinxton CambridgeCB10 1SD United Kingdom Harvard Medical School Ludwig Center at Harvard United States Harvard Medical School Broad Institute Ludwig Center at Harvard Dana-Farber Cancer Institute United States Department of Biology Institute of Molecular Systems Biology ETH Zürich Zürich Switzerland Bruker Ltd. MiltonONL9T 6P4 Canada AI for Life Sciences Lab Tencent Shenzhen518057 China State Key Laboratory of Medical Proteomics AI for Science Institute Beijing100080 China Beijing Institute of Lifeomics Beijing102206 China Thermo Fisher Scientific GmbH Hanna-Kunath Str. 11 Bremen28199 Germany Informatics and Predictive Sciences Research Bristol Myers Squibb United States Department of Chemistry Fudan University Songhu Road 2005 Shanghai200438 China Department of Computer Science Luddy School of Informatics Computing and Engineering Indiana University IN47408 United States ProCan® Children’s Medical Research Institute Faculty of Medicine and Health The University of Sydney WestmeadNSW Australia La Jolla CA United States Central China Institute of Artificial Intelligence University of Waterloo Canada AI for Science Institute Center for Machine Learning Research School of Mathematical Sciences Peking University China Research Institute of Intelligent Complex Systems Fudan U

Artificial intelligence (AI) is transforming scientific research, including proteomics. Advances in mass spectrometry (MS)-based proteomics data quality, diversity, and scale, combined with groundbreaking AI techniques, are unlocking new challenges and opportunities in biological discovery. Here, we highlight key areas where AI is driving innovation, from data analysis to new biological insights. These include developing an AI-friendly ecosystem for proteomics data generation, sharing, and analysis;improving peptide and protein identification and quantification;characterizing protein-protein interactions and protein complexes;advancing spatial and perturbation proteomics;integrating multi-omics data;and ultimately enabling AI-empowered virtual cells. © 2025, CC BY.

关键词： Biotic

Biomedical image analysis competitions: The state of current participation practice

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Eisenmann, Matthias Reinke, Annika Weru, Vivienn Tizabi, Minu Dietlinde Isensee, Fabian Adler, Tim J. Godau, Patrick Cheplygina, Veronika Kozubek, Michal Maier-Hein, Klaus Jäger, Paul F. Kopp-Schneider, Annette Maier-Hein, Lena Ali, Sharib Gupta, Anubha Kybic, Jan Noble, Alison de Solórzano, Carlos Ortiz Pachade, Samiksha Petitjean, Caroline Sage, Daniel Wei, Donglai Wilden, Elizabeth Alapatt, Deepak Andrearczyk, Vincent Baid, Ujjwal Bakas, Spyridon Balu, Niranjan Bano, Sophia Bawa, Vivek Singh Bernal, Jorge Bodenstedt, Sebastian Casella, Alessandro Choi, Jinwook Commowick, Olivier Daum, Marie Depeursinge, Adrien Dorent, Reuben Egger, Jan Eichhorn, Hannah Engelhardt, Sandy Ganz, Melanie Girard, Gabriel Hansen, Lasse Heinrich, Mattias Heller, Nicholas Hering, Alessa Huaulmé, Arnaud Kim, Hyunjeong Li, Hongwei Bran Landman, Bennett Li, Jianning Ma, Jun Martel, Anne Martín-Isla, Carlos Menze, Bjoern Nwoye, Chinedu Innocent Oreiller, Valentin Padoy, Nicolas Pati, Sarthak Payette, Kelly Sudre, Carole van Wijnen, Kimberlin Vardazaryan, Armine Vercauteren, Tom Wagner, Martin Wang, Chuanbo Yap, Moi Hoon Yu, Zeyun Yuan, Chun Zenk, Maximilian Zia, Aneeq Zimmerer, David Bao, Rina Choi, Chanyeol Cohen, Andrew Dzyubachyk, Oleh Galdran, Adrian Gan, Tianyuan Guo, Tianqi Gupta, Pradyumna Haithami, Mahmood Ho, Edward Jang, Ikbeom Li, Zhili Luo, Zhengbo Lux, Filip Makrogiannis, Sokratis Müller, Dominik Oh, Young-Tack Pang, Subeen Pape, Constantin Polat, Gorkem Reed, Charlotte Rosalie Ryu, Kanghyun Scherr, Tim Thambawita, Vajira Wang, Haoyu Wang, Xinliang Xu, Kele Yeh, Hung Yeo, Doyeob Yuan, Yixuan Zeng, Yan Zhao, Xin Abbing, Julian Adam, Jannes Adluru, Nagesh Agethen, Niklas Ahmed, Salman Al Khalil, Yasmina Alenyà, Mireia Alhoniemi, Esa An, Chengyang Arega, Tewodros Weldebirhan Avisdris, Netanell Aydogan, Dogu Baran Bai, Yingbin Calisto, Maria Baldeon Basaran, Berke Doga Beetz, Marcel Bian, Hao Blansit, Kevin Bloch, Louise Bohnsack, Robert Bosticardo, Sara Breen, Jack Brudfors, Mikael Brüngel, Raphael Cabezas, Mariano Cacciola, Alb Heidelberg Division of Intelligent Medical Systems Germany Heidelberg HI Helmholtz Imaging Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Biostatistics Germany Heidelberg Division of Medical Image Computing Germany Heidelberg HI Applied Vision Lab Germany IT University of Copenhagen Copenhagen Denmark Centre for Biomedical Image Analysis Masaryk University Brno Czech Republic Heidelberg Interactive Machine Learning Group Germany Faculty of Mathematics and Computer Science and Medical Faculty Heidelberg University Heidelberg Germany NCT Heidelberg DKFZ University Hospital Heidelberg Germany School of Computing University of Leeds Leeds United Kingdom SBILab Department of ECE IIIT-Delhi India Faculty of Electrical Engineering Czech Technical University Prague Czech Republic Institute of Biomedical Engineering University of Oxford United Kingdom Center for Applied Medical Research Pamplona Spain Shri Guru Gobind Singhji Institute of Engineering and Technology Maharashtra Nanded India Université de Rouen Normandie France Lausanne Switzerland School of Engineering and Applied Science Harvard University United States ICube University of Strasbourg CNRS France Institute of Informatics School of Management HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland Techno-Pôle 3 Sierre3960 Switzerland Department of Nuclear Medicine and Molecular Imaging Lausanne University Hospital Rue du Bugnon 46 LausanneCH-1011 Switzerland University of Pennsylvania PhiladelphiaPA United States Department of Radiology University of Washington United States Wellcome EPSRC Centre for Interventional and Surgical Sciences University College London London United Kingdom Visual Artificial Intelligence Lab Oxford Brookes University Oxford United Kingdom Universitat Autònoma de Barcelona & Computer Vision Center Spain Dresden Fetscherstraße 74 PF 64 Dresden01307 Germany

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps. © 2022, CC BY.

关键词： Benchmarking