检索结果-内蒙古大学图书馆

FewSOME: One-Class Few Shot Anomaly Detection with Siamese Networks

学校读者我要写书评

暂无评论

FewSOME: One-Class Few Shot Anomaly Detection with Siamese N...

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

作者： Niamh Belton Misgina Tsighe Hagos Aonghus Lawlor Kathleen M. Curran Science Foundation Ireland Centre for Research Training in Machine Learning School of Medicine University College Dublin School of Computer Science University College Dublin Insight Centre for Data Analytics University College Dublin Dublin Ireland

Recent Anomaly Detection techniques have progressed the field considerably but at the cost of increasingly complex training pipelines. Such techniques require large amounts of training data, resulting in computationally expensive algorithms that are unsuitable for settings where only a small amount of normal samples are available for training. We propose ‘Few Shot anOMaly dEtection’ (FewSOME), a deep One-Class Anomaly Detection algorithm with the ability to accurately detect anomalies having trained on ‘few’ examples of the normal class and no examples of the anomalous class. We describe FewSOME to be of low complexity given its low data requirement and short training time. FewSOME is aided by pretrained weights with an architecture based on Siamese Networks. By means of an ablation study, we demonstrate how our proposed loss, ‘Stop Loss’, improves the robustness of FewSOME. Our experiments demonstrate that FewSOME performs at stateof-the-art level on benchmark datasets MNIST, CIFAR-10, F-MNIST and MVTec AD while training on only 30 normal samples, a minute fraction of the data that existing methods are trained on. Moreover, our experiments show FewSOME to be robust to contaminated datasets. We also report F1 score and balanced accuracy in addition to AUC as a benchmark for future techniques to be compared against. Code available; https://***/niamhbelton/FewSOME.

关键词：

data-driven Energy Consumption Modelling for Electric Micromobility using an Open dataset

学校读者我要写书评

暂无评论

Data-driven Energy Consumption Modelling for Electric Microm...

IEEE Transportation Electrification Conference and Expo (ITEC)

作者： Yue Ding Sen Yan Maqsood Hussain Shah Hongyuan Fang Ji Li Mingming Liu SFI Centre for Research Training in Machine Learning (ML-Labs) Dublin City University SFI Insight Centre for Data Analytics and the School of Electronic Engineering Dublin City University Dublin Ireland Department of Mechanical Engineering University of Birmingham

ISBN: (数字)9798350317664

ISBN: (纸本)9798350317671

The escalating challenges of traffic congestion and environmental degradation underscore the critical importance of embracing E-Mobility solutions in urban spaces. In particular, micro E-Mobility tools such as E-scooters and E-bikes, play a pivotal role in this transition, offering sustainable alternatives for urban commuters. However, the energy consumption patterns for these tools are a critical aspect that impacts their effectiveness in real-world scenarios and is essential for trip planning and boosting user confidence in using these. To this effect, recent studies have utilised physical models customised for specific mobility tools and conditions, but these models struggle with generalization and effectiveness in real-world scenarios due to a notable absence of open datasets for thorough model evaluation and verification. To fill this gap, our work presents an open dataset, collected in Dublin, Ireland, specifically designed for energy modelling research related to E-Scooters and E-Bikes. Furthermore, we provide a comprehensive analysis of energy consumption modelling based on the dataset using a set of representative machine learning algorithms and compare their performance against the contemporary mathematical models as a baseline. Our results demonstrate a notable advantage for data-driven models in comparison to the corresponding mathematical models for estimating energy consumption. Specifically, data-driven models outperform physical models in accuracy by up to 83.83% for E-Bikes and 82.16% for E-Scooters based on an in-depth analysis of the dataset under certain assumptions.

关键词： Energy consumption Analytical models machine learning algorithms Transportation Environmental degradation Electrification Boosting

Rethinking Knee Osteoarthritis Severity Grading: A Few Shot Self-Supervised Contrastive learning Approach

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Belton, Niamh Hagos, Misgina Tsighe Lawlor, Aonghus Curran, Kathleen M. Science Foundation Ireland Centre for Research Training in Machine Learning School of Medicine University College Dubline Ireland School of Computer Science University College Dublin Ireland Insight Centre for Data Analytics University College Dublin Dublin Ireland

Knee Osteoarthritis (OA) is a debilitating disease affecting over 250 million people worldwide. Currently, radiologists grade the severity of OA on an ordinal scale from zero to four using the Kellgren-Lawrence (KL) system. Recent studies have raised concern in relation to the subjectivity of the KL grading system, highlighting the requirement for an automated system, while also indicating that five ordinal classes may not be the most appropriate approach for assessing OA severity. This work presents preliminary results of an automated system with a continuous grading scale. This system, namely SS-FewSOME, uses self-supervised pre-training to learn robust representations of the features of healthy knee X-rays. It then assesses the OA severity by the X-rays’ distance to the normal representation space. SS-FewSOME initially trains on only ‘few’ examples of healthy knee X-rays, thus reducing the barriers to clinical implementation by eliminating the need for large training sets and costly expert annotations that existing automated systems require. The work reports promising initial results, obtaining a positive Spearman Rank Correlation Coefficient of 0.43, having had access to only 30 ground truth labels at training time. © 2024, CC BY.

关键词： Grading

Design and Implementation of a data Governance Framework and Platform: A Case Study of a National research Organization of Thailand

学校读者我要写书评

暂无评论

Design and Implementation of a Data Governance Framework and...

International Joint Conference on Computer Science and Software Engineering (JCSSE)

作者： Sapa Chanyachatchawan Krich Nasingkun Patipat Tumsangthong Porntiwa Chata Marut Buranarach Monsak Socharoentum Leveraging Technology Solutions Section National Electronics and Computer Technology Center Bangkok Thailand Strategic Analytics Networks with Machine Learning and AI Research National Electronics and Computer Technology Center Bangkok Thailand Data Science and Analytics Research Group National Electronics and Computer Technology Center Bangkok Thailand Digital Government Development Agency Bangkok Thailand

In the current era of extensive data usage across industries, data collection, preservation, utilization, and organization has become more challenging and nuanced because it is necessary to consider critical concerns such as data security, privacy, and legal issues, apart from efficiency issues. As a result, Thai government initiated the idea and effort to implement data governance throughout the government agency. This paper showcases the implementation of data governance in a governmental research organization with highly diverse structured and unstructured data. The implementation follows international standards and the guidelines of the Digital Government Development Agency (DGA). The executives set up the working body, including the data Governance Council and data Stewards, responsible for setting up and deploying policies and regulations. Creating awareness and the necessary infrastructure are the main focuses in the first-year phase. The metadata was designed to extend DGA's version and match the organization's unique requirements. A data catalog platform was developed accordingly. We organized activities to boost employee awareness and participation, including advertising and data catalog platform training. By the end of the first year of implementation, every organization unit had registered at least one data record into the data catalog.

关键词：

FewSOME: One-Class Few Shot Anomaly Detection with Siamese Networks

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Belton, Niamh Hagos, Misgina Tsighe Lawlor, Aonghus Curran, Kathleen M. Science Foundation Ireland Centre for Research Training in Machine Learning Ireland School of Medicine University College Dublin Ireland School of Computer Science University College Dublin Ireland Insight Centre for Data Analytics University College Dublin Dublin Ireland

Recent Anomaly Detection techniques have progressed the field considerably but at the cost of increasingly complex training pipelines. Such techniques require large amounts of training data, resulting in computationally expensive algorithms that are unsuitable for settings where only a small amount of normal samples are available for training. We propose ‘Few Shot anOMaly dEtection’ (FewSOME), a deep One-Class Anomaly Detection algorithm with the ability to accurately detect anomalies having trained on ‘few’ examples of the normal class and no examples of the anomalous class. We describe FewSOME to be of low complexity given its low data requirement and short training time. FewSOME is aided by pretrained weights with an architecture based on Siamese Networks. By means of an ablation study, we demonstrate how our proposed loss, ‘Stop Loss’, improves the robustness of FewSOME. Our experiments demonstrate that FewSOME performs at state-of-the-art level on benchmark datasets MNIST, CIFAR-10, F-MNIST and MVTec AD while training on only 30 normal samples, a minute fraction of the data that existing methods are trained on. Moreover, our experiments show FewSOME to be robust to contaminated datasets. We also report F1 score and balanced accuracy in addition to AUC as a benchmark for future techniques to be compared against. Code available;https://***/niamhbelton/FewSOME. © 2023, CC BY.

关键词： Anomaly detection

VulnerVAN: A Vulnerable Network Generation Tool

学校读者我要写书评

暂无评论

VulnerVAN: A Vulnerable Network Generation Tool

MILCOM, Military Communications Conference

作者： Sridhar Venkatesan Jason A. Youzwak Shridatt Sugrim Cho-Yu J. Chiang Alexander Poylisher Matthew Witkowski Gary Walther Michelle Wolberg Ritu Chadha E. Allison Newcomb Blaine Hoffman Norbou Buchler Machine Learning and Data Analytics Research Perspecta Labs Inc. Basking Ridge NJ USA Computational and Information Science Directorate U.S. CCDC Army Research Laboratory Aberdeen MD USA Human Research and Engineering Directorate U.S. CCDC Army Research Laboratory

ISBN: (数字)9781728142807

ISBN: (纸本)9781728142814

Cyber training, security testing, and research and development activities are vital to improve the security posture of a network. Currently, many institutions use cyber security testbeds to conduct these activities in an isolated virtual environment. One of the important requirements for such an environment is to provide organizers (or experimenters) with a library of vulnerable network scenarios and capabilities to mount attacks against them. However, the task of preparing a vulnerable network scenario in current testbed environments is costly in time and labor, requires significant support from the testbed staff. To this end, we present a toolset called VulnerVAN that creates a vulnerable network scenario to realize an attack sequence. In this paper, we discuss the design of VulnerVAn - our proof-of-concept implementation on CyberVAN - and present a new high-level attack specification language that enables users to chain attack steps into an attack sequence. For a given attack sequence and network scenario, VulnerVAN identifies all possible attack paths through the network that can realize the attack sequence, and provides instructions to configure machines on an attack path selected by the user. VulnerVAn also provides an attack blueprint that can guide a Red team or an automated attacker to execute the attack sequence. To demonstrate VulnerVAN's capability, we consider the use-case of a typical data exfiltration attack sequence conducted by APTs and study the performance of VulnerVAn in mapping the attack sequence to different networks.

关键词： data security Training Specification languages Virtual environments

NC-ALG: Graph-Based Active learning Under Noisy Crowd

学校读者我要写书评

暂无评论

NC-ALG: Graph-Based Active Learning Under Noisy Crowd

International Conference on data Engineering

作者： Wentao Zhang Yexin Wang Zhenbang You Yang Li Gang Cao Zhi Yang Bin Cui Center for Machine Learning Research Peking University Institute of Advanced Algorithms Research Shanghai National Engineering Labratory for Big Data Analytics and Applications Key Lab of High Confidence Software Technologies Peking University Department of Data Platform TEG Tencent Inc. Beijing Academy of Artificial Intelligence Institute of Computational Social Science Peking University Qingdao

ISBN: (数字)9798350317152

ISBN: (纸本)9798350317169

Graph Neural Networks (GNNs) have achieved great success in various data mining tasks but they heavily rely on a large number of annotated nodes, requiring considerable human efforts. Despite the effectiveness of existing GNN-based Active learning (AL) methods, they assume that the annotated labels are always correct, which is contradictory to the error-prone labeling process in a practical crowdsourcing environment. Besides, due to this impractical assumption, existing works only focus on optimizing the node selection in AL but neglect optimizing the labeling process. Therefore, we present NC-ALG, the first GNN-based AL framework that optimizes both the node selection and node labeling process under a noisy crowd. For node selection, NC-ALG introduces a new measurement to model influence reliability and an effective influence maximization objective to select nodes. For node labeling, NC-ALG significantly reduces the labeling cost by considering the model-predicted labels and the labels of mirror nodes. To the best of our knowledge, this is the first attempt to consider GNN-based AL under the practical noisy crowd. Empirical studies on public datasets demonstrate that NC-ALG significantly outperforms existing methods in terms labeling efficiency. Notably, it only takes NC-ALG one-third of the labeling budget that the competitive baseline GRAIN needs to achieve an accuracy of 70.7 % on PubMed.

关键词： Crowdsourcing Costs Noise Predictive models Graph neural networks Labeling Noise measurement

Analyzing the Structure of Attention in a Transformer Language Model

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Vig, Jesse Belinkov, Yonatan Palo Alto Research Center Machine Learning and Data Science Group Interaction and Analytics Lab Palo AltoCA United States Harvard John A. Paulson School of Engineering and Applied Sciences MIT Computer Science and Artificial Intelligence Laboratory CambridgeMA United States

The Transformer is a fully attention-based alternative to recurrent networks that has achieved state-of-the-art results across a range of NLP tasks. In this paper, we analyze the structure of attention in a Transformer language model, the GPT-2 small pretrained model. We visualize attention for individual instances and analyze the interaction between attention and syntax over a large corpus. We find that attention targets different parts of speech at different layer depths within the model, and that attention aligns with dependency relations most strongly in the middle layers. We also find that the deepest layers of the model capture the most distant relationships. Finally, we extract exemplar sentences that reveal highly specific patterns targeted by particular attention heads. Copyright © 2019, The Authors. All rights reserved.

关键词： Recurrent neural networks

SVC-onGoing: Signature Verification Competition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Tolosana, Ruben Vera-Rodriguez, Ruben Gonzalez-Garcia, Carlos Fierrez, Julian Morales, Aythami Ortega-Garcia, Javier Ruiz-Garcia, Juan Carlos Romero-Tapiador, Sergio Rengifo, Santiago Caruana, Miguel Jiang, Jiajia Lai, Songxuan Jin, Lianwen Zhu, Yecheng Galbally, Javier Diaz, Moises Ferrer, Miguel Angel Gomez-Barrero, Marta Hodashinsky, Ilya Sarin, Konstantin Slezkin, Artem Bardamova, Marina Svetlakov, Mikhail Saleem, Mohammad Szücs, Cintia Lia Kovari, Bence Pulsmeyer, Falk Wehbi, Mohamad Zanca, Dario Ahmad, Sumaiya Mishra, Sarthak Jabin, Suraiya Biometrics and Data Pattern Analytics Lab UAM Spain South China University of Technology China European Commission - Joint Research Centre Italy Universidad de las Palmas de Gran Canaria Spain Hochschule Ansbach Germany Tomsk State University of Control Systems and Radioelectronics Russia Budapest University of Technology and Economics Hungary Machine Learning and Data Analytics Lab FAU Germany Jamia Millia Islamia India

This article presents SVC-onGoing, an on-going competition for on-line signature verification where researchers can easily benchmark their systems against the state of the art in an open common platform using large-scale public databases, such as DeepSignDB and SVC2021_EvalDB, and standard experimental protocols. SVC-onGoing is based on the ICDAR 2021 Competition on On-Line Signature Verification (SVC 2021), which has been extended to allow participants anytime. The goal of SVC-onGoing is to evaluate the limits of on-line signature verification systems on popular scenarios (office/mobile) and writing inputs (stylus/finger) through large-scale public databases. Three different tasks are considered in the competition, simulating realistic scenarios as both random and skilled forgeries are simultaneously considered on each task. The results obtained in SVC-onGoing prove the high potential of deep learning methods in comparison with traditional methods. In particular, the best signature verification system has obtained Equal Error Rate (EER) values of 3.33% (Task 1), 7.41% (Task 2), and 6.04% (Task 3). Future studies in the field should be oriented to improve the performance of signature verification systems on the challenging mobile scenarios of SVC-onGoing in which several mobile devices and the finger are used during the signature acquisition. © 2021, CC BY-NC-ND.

关键词： Deep learning