检索结果-内蒙古大学图书馆

Experience report:investigating bug fixes in machine learning frameworks/libraries

Frontiers of computer Science 2021年第6期15卷 43-58页

作者： Xiaobing SUN Tianchi ZHOU Rongcun WANG Yucong DUAN Lili BO Jianming CHANG School of Information Engineering Yangzhou UniversityYangzhou 225100China State Key Laboratory for Novel Software Technology Nanjing UniversityNanjing 210023China Jiangsu Engineering Research Center of Knowledge Management and Intelligent Service Yangzhou University Yangzhou 225127China School of Computer Science and Technology China University of Mining and TechnologyXuzhou 221116China School of Computer Science and Cyberspace Security Hainan UniversityHaikou 570228China

Machine learning(ML)techniques and algorithms have been successfully and widely used in various areas including software engineering *** other software projects,bugs are also common in ML projects and *** order to more deeply understand the features related to bug fixing in ML projects,we conduct an empirical study with 939 bugs from five ML projects by manually examining the bug categories,fixing patterns,fixing scale,fixing duration,and types of *** results show that(1)there are commonly seven types of bugs in ML programs;(2)twelve fixing patterns are typically used to fix the bugs in ML programs;(3)68.80%of the patches belong to micro-scale-fix and small-scale-fix;(4)66.77%of the bugs in ML programs can be fixed within one month;(5)45.90%of the bug fixes belong to corrective activity from the perspective of software ***,we perform a questionnaire survey and send them to developers or users of ML projects to validate the results in our empirical *** results of our empirical study are basically consistent with the feedback from *** findings from the empirical study provide useful guidance and insights for developers and users to effectively detect and fix bugs in MLprojects.

关键词： bug fixing machine learning project empirical study questionnaire survey

来源：评论

学校读者我要写书评

暂无评论

A theory of transfer-based black-box attacks: explanation and implications 23

A theory of transfer-based black-box attacks: explanation an...

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Yanbo Chen Weiwei Liu School of Computer Science Wuhan University and National Engineering Research Center for Multimedia Software Wuhan University and Institute of Artificial Intelligence Wuhan University and Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University

Transfer-based attacks [1] are a practical method of black-box adversarial attacks in which the attacker aims to craft adversarial examples from a source model that is transferable to the target model. Many empirical works [2-6] have tried to explain the transferability of adversarial examples from different angles. However, these works only provide ad hoc explanations without quantitative analyses. The theory behind transfer-based attacks remains a *** paper studies transfer-based attacks under a unified theoretical framework. We propose an explanatory model, called the manifold attack model, that formalizes popular beliefs and explains the existing empirical results. Our model explains why adversarial examples are transferable even when the source model is inaccurate as observed in Papernot et al. [7]. Moreover, our model implies that the existence of transferable adversarial examples depends on the "curvature" of the data manifold, which further explains why the success rates of transfer-based attacks are hard to improve. We also discuss our model's expressive power and applicability.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Adversarial self-training improves robustness and generalization for gradual domain adaptation 23

Adversarial self-training improves robustness and generaliza...

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Lianghe Shi Weiwei Liu School of Computer Science Wuhan University and National Engineering Research Center for Multimedia Software Wuhan University and Institute of Artificial Intelligence Wuhan University and Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University

Gradual Domain Adaptation (GDA), in which the learner is provided with additional intermediate domains, has been theoretically and empirically studied in many contexts. Despite its vital role in security-critical scenarios, the adversarial robustness of the GDA model remains unexplored. In this paper, we adopt the effective gradual self-training method and replace vanilla self-training with adversarial self-training (AST). AST first predicts labels on the unlabeled data and then adversarially trains the model on the pseudo-labeled distribution. Intriguingly, we find that gradual AST improves not only adversarial accuracy but also clean accuracy on the target domain. We reveal that this is because adversarial training (AT) performs better than standard training when the pseudo-labels contain a portion of incorrect labels. Accordingly, we first present the generalization error bounds for gradual AST in a multiclass classification setting. We then use the optimal value of the Subset Sum Problem to bridge the standard error on a real distribution and the adversarial error on a pseudo-labeled distribution. The result indicates that AT may obtain a tighter bound than standard training on data with incorrect pseudo-labels. We further present an example of a conditional Gaussian distribution to provide more insights into why gradual AST can improve the clean accuracy for GDA.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Characterization of overfitting in robust multiclass classification 23

Characterization of overfitting in robust multiclass classif...

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Jingyuan Xu Weiwei Liu School of Computer Science Wuhan University and National Engineering Research Center for Multimedia Software Wuhan University and Institute of Artificial Intelligence Wuhan University and Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University

This paper considers the following question: Given the number of classes m, the number of robust accuracy queries k, and the number of test examples in the dataset n, how much can adaptive algorithms robustly overfit the test dataset? We solve this problem by equivalently giving near-matching upper and lower bounds of the robust overfitting bias in multiclass classification problems.

关键词：

来源：评论

学校读者我要写书评

暂无评论

On the adversarial robustness of out-of-distribution generalization models 23

On the adversarial robustness of out-of-distribution general...

引用

Proceedings of the 37th International Conference on Neural Information Processing Systems

作者： Xin Zou Weiwei Liu School of Computer Science Wuhan University and National Engineering Research Center for Multimedia Software Wuhan University and Institute of Artificial Intelligence Wuhan University and Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University

Out-of-distribution (OOD) generalization has attracted increasing research attention in recent years, due to its promising experimental results in real-world applications. Interestingly, we find that existing OOD generalization methods are vulnerable to adversarial attacks. This motivates us to study OOD adversarial robustness. We first present theoretical analyses of OOD adversarial robustness in two different complementary settings. Motivated by the theoretical results, we design two algorithms to improve the OOD adversarial robustness. Finally, we conduct experiments to validate the effectiveness of our proposed algorithms. Our code is available at https://***/ZouXinn/OOD-Adv.

关键词：

来源：评论

学校读者我要写书评

暂无评论

DPA-2:a large atomic model as a multitask learner

引用

npj Computational Materials 2024年第1期10卷 185-199页

作者： Duo Zhang Xinzijian Liu Xiangyu Zhang Chengqian Zhang Chun Cai Hangrui Bi Yiming Du Xuejian Qin Anyang Peng Jiameng Huang Bowen Li Yifan Shan Jinzhe Zeng Yuzhi Zhang Siyuan Liu Yifan Li Junhan Chang Xinyan Wang Shuo Zhou Jianchuan Liu Xiaoshan Luo Zhenyu Wang Wanrun Jiang Jing Wu Yudi Yang Jiyuan Yang Manyi Yang Fu-Qiang Gong Linshuang Zhang Mengchao Shi Fu-Zhi Dai Darrin M.York Shi Liu Tong Zhu Zhicheng Zhong Jian Lv Jun Cheng Weile Jia Mohan Chen Guolin Ke Weinan E Linfeng Zhang Han Wang AI for Science Institute BeijingP.R.China DP Technology BeijingP.R.China Academy for Advanced Interdisciplinary Studies Peking UniversityBeijingP.R.China State Key Lab of Processors Institute of Computing TechnologyChinese Academy of SciencesBeijingP.R.China University of Chinese Academy of Sciences BeijingP.R.China HEDPS CAPTCollege of EngineeringPeking UniversityBeijingP.R.China Ningbo Institute of Materials Technology and Engineering Chinese Academy of SciencesNingboP.R.China CAS Key Laboratory of Magnetic Materials and Devices and Zhejiang Province Key Laboratory of Magnetic Materials and Application Technology Chinese Academy of SciencesNingboP.R.China School of Electronics Engineering and Computer Science Peking UniversityBeijingP.R.China Shanghai Engineering Research Center of Molecular Therapeutics&New Drug Development School of Chemistry and Molecular EngineeringEast China Normal UniversityShanghaiP.R.China Laboratory for Biomolecular Simulation Research Institute for Quantitative Biomedicine and Department of Chemistry and Chemical BiologyRutgers UniversityPiscatawayNJUSA Department of Chemistry Princeton UniversityPrincetonNJUSA College of Chemistry and Molecular Engineering Peking UniversityBeijingP.R.China Yuanpei College Peking UniversityBeijingP.R.China School of Electrical Engineering and Electronic Information Xihua UniversityChengduP.R.China State Key Laboratory of Superhard Materials College of PhysicsJilin UniversityChangchunP.R.China Key Laboratory of Material Simulation Methods&Software of Ministry of Education College of PhysicsJilin UniversityChangchunP.R.China International Center of Future Science Jilin UniversityChangchunP.R.China Key Laboratory for Quantum Materialsof Zhejiang Province Department of PhysicsSchool of ScienceWestlake UniversityHangzhouP.R.China Atomistic Simulations Italian Institute of TechnologyGenovaItaly State Key Laboratory of Physical Chemistry of Solid Surface iChEMCollege of Chemistry and Chemical EngineeringXiame

The rapid advancements in artificial intelligence(AI)are catalyzing transformative changes in atomic modeling,simulation,and ***-driven potential energy models havedemonstrated the capability to conduct large-scale,long-duration simulations with the accuracy of ab initio electronic structure ***,the model generation process remains a bottleneck for large-scale *** propose a shift towards a model-centric ecosystem,wherein a large atomic model(LAM),pretrained across multiple disciplines,can be efficiently fine-tuned and distilled for various downstream tasks,thereby establishing a new framework for molecular *** this study,we introduce the DPA-2 architecture as a prototype for ***-trained on a diverse array of chemical and materials systemsusing a multi-task approach,DPA-2demonstrates superior generalization capabilities across multiple downstream tasks compared to the traditional single-task pre-training and fine-tuning *** approach sets the stage for the development and broad application of LAMs in molecular and materials simulation research.

关键词： DPA establishing thereby

来源：评论

学校读者我要写书评

暂无评论

You Only Align Once: Bidirectional Interaction for Spatial-Temporal Video Super-Resolution

arXiv

引用

arXiv 2022年

作者： Hu, Mengshun Jiang, Kui Nie, Zhixiang Wang, Zheng National Engineering Research Center for Multimedia Software Hubei Key Laboratory of Multimedia and Network Communication Engineering School of Computer Science Wuhan University China

Spatial-Temporal Video Super-Resolution (ST-VSR) technology generates high-quality videos with higher resolution and higher frame rates. Existing advanced methods accomplish ST-VSR tasks through the association of Spatial and Temporal video super-resolution (S-VSR and T-VSR). These methods require two alignments and fusions in S-VSR and T-VSR, which is obviously redundant and fails to sufficiently explore the information flow of consecutive spatial LR frames. Although bidirectional learning (future-to-past and past-to-future) was introduced to cover all input frames, the direct fusion of final predictions fails to sufficiently exploit intrinsic correlations of bidirectional motion learning and spatial information from all frames. We propose an effective yet efficient recurrent network with bidirectional interaction for ST-VSR, where only one alignment and fusion is needed. Specifically, it first performs backward inference from future to past, and then follows forward inference to super-resolve intermediate frames. The backward and forward inferences are assigned to learn structures and details to simplify the learning task with joint optimizations. Furthermore, a Hybrid Fusion Module (HFM) is designed to aggregate and distill information to refine spatial information and reconstruct high-quality video frames. Extensive experiments on two public datasets demonstrate that our method outperforms state-of-the-art methods in efficiency, and reduces calculation cost by about 22%. Copyright © 2022, The Authors. All rights reserved.

关键词： Optical resolving power

来源：评论

学校读者我要写书评

暂无评论

On the Effectiveness of Distillation in Mitigating Backdoors in Pre-trained Encoder

arXiv

引用

arXiv 2024年

作者： Han, Tingxu Huang, Shenghan Ding, Ziqi Sun, Weisong Feng, Yebo Fang, Chunrong Li, Jun Qian, Hanwei Wu, Cong Zhang, Quanjun Liu, Yang Chen, Zhenyu The State Key Laboratory for Novel Software Technology Nanjing University Jiangsu210093 China The School of Computer Science University of New South Wales NSW2052 Australia The School of Computer Science and Engineering Nanyang Technological University Nanyang639798 Singapore The Department of Computer Science The Director of the Network & Security Research Laboratory The University of Oregon United States

With the development of deep learning, self-supervised learning (SSL) has become particularly popular. SSL pre-trains an encoder (e.g., an image encoder) to learn generic features from a large amount of unlabeled data, releases it on a third-party platform, and allows any downstream task (e.g., an image classification task) to further fine-tune the encoder with task-specific data to derive the model for the task. However, despite the tremendous performance improvements it brings, SSL faces serious security risks. An adversary can poison pre-training datasets used to pre-train an encoder or publish a poisoned encoder directly to third-party platforms, which will also poison the model for any downstream task that uses these encoders. In this paper, we study a defense against poisoned encoders in SSL called distillation, which is a defense used in supervised learning originally. Distillation aims to distill knowledge from a given model (a.k.a the teacher net) and transfer it to another (a.k.a the student net). Now, we use it to distill benign knowledge from poisoned pre-trained encoders and transfer it to a new encoder, resulting in a clean pre-trained encoder. In particular, we conduct an empirical study on the effectiveness and performance of distillation against poisoned encoders. Using two state-of-the-art backdoor attacks against pre-trained image encoders and four commonly used image classification datasets, our experimental results show that distillation can reduce attack success rate from 80.87% to 27.51% while suffering a 6.35% loss in accuracy. Moreover, we investigate the impact of three core components of distillation on performance: Teacher net, student net, and distillation loss. By comparing 4 different teacher nets, 3 student nets, and 6 distillation losses, we find that fine-tuned teacher nets, warm-up-training-based student nets, and attention-based distillation loss perform best, respectively. Copyright © 2024, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Fast target-aware learning for few-shot video object segmentation

引用

Science China(Information Sciences) 2022年第8期65卷 71-86页

作者： Yadang CHEN Chuanyan HAO Zhi-Xin YANG Enhua WU Engineering Research Center of Digital Forensics Ministry of EducationSchool of Computer and SoftwareNanjing University of Information Science and Technology School of Education Science and Technology Nanjing University of Posts and Telecommunications State Key Laboratory of Internet of Things for Smart City Department of Electromechanical EngineeringUniversity of Macau State Key Laboratory of Computer Science Institute of SoftwareUniversity of Chinese Academy of Sciences Faculty of Science and Technology University of Macau

Few-shot video object segmentation(FSVOS) aims to segment a specific object throughout a video sequence when only the first-frame annotation is given. In this study, we develop a fast target-aware learning approach for FSVOS, where the proposed approach adapts to new video sequences from its firstframe annotation through a lightweight procedure. The proposed network comprises two models. First, the meta knowledge model learns the general semantic features for the input video image and up-samples the coarse predicted mask to the original image size. Second, the target model adapts quickly from the limited support set. Concretely, during the online inference for testing the video, we first employ fast optimization techniques to train a powerful target model by minimizing the segmentation error in the first frame and then use it to predict the subsequent frames. During the offline training, we use a bilevel-optimization strategy to mimic the full testing procedure to train the meta knowledge model across multiple video *** proposed method is trained only on an individual public video object segmentation(VOS) benchmark without additional training sets and compared favorably with state-of-the-art methods on DAVIS-2017, with a J &F overall score of 71.6%, and on YouT ubeVOS-2018, with a J &F overall score of 75.4%. Meanwhile,a high inference speed of approximately 0.13 s per frame is maintained.

关键词： video object segmentation few-shot target-aware meta knowledge bilevel-optimization

来源：评论

学校读者我要写书评

暂无评论

Climate Downscaling Using Neural Operator: Spatiotemporal Multimodal Fusion Operator with state-Query Coupled Kernel

Climate Downscaling Using Neural Operator: Spatiotemporal Mu...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Haodi Zhang Yichi Wang Yifan Jian Jiahui Jiang Zhaohai Bai Lin Ma College of Computer Science and Software Engineering Shenzhen University Center for Agricultural Resources Research Institute of Genetic and Developmental Biology Chinese Academy of Sciences State Key Laboratory of Pollution Control and Resource Reuse School of the Environment Nanjing University

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Climate downscaling is crucial for detailed small- scale analysis and for acquiring climate data in regions without weather stations. Operator learning has proven potential for this task. However, several challenges remain in operator learning, such as multimodal fusion, spatiotemporal fusion and input state and query adaptation. To address these challenges, we propose a Spatiotemporal Multimodal Fusion Operator with a state- Query Coupled Kernel (SMCK). This framework includes a latent space fusion encoder that encodes climate variables using position-wise multihead attention for multimodal fusion and integrates historical information to generate robust and precise representation. Additionally, we introduce a state-query coupled kernel that combines radial basis functions and discrete fourier encoding to enhance query location representation, while also adapting to the state to obtain the coupled kernel. Extensive experiments demonstrate that our method achieves state-of-the-art performance and provides strong support for climate downscaling and the planning of climate-related strategies.

关键词： Couplings Signal processing Encoding Robustness Spatiotemporal phenomena Planning Kernel Speech processing Forecasting Meteorology

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：