检索结果-内蒙古大学图书馆

Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Murali, Nihal Puli, Aahlad Yu, Ke Ranganath, Rajesh Batmanghelich, Kayhan Intelligent Systems Program University of Pittsburgh United States Department of Computer Science New York University United States Department of Electrical and Computer Engineering Boston University United States

Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model generalization and poses problems when deploying them in safety-critical applications. This paper aims to better understand the effects of spurious features through the lens of the learning dynamics of the internal neurons during the training process. We make the following observations: (1) While previous works highlight the harmful effects of spurious features on the generalization ability of DNNs, we emphasize that not all spurious features are harmful. Spurious features can be "benign" or "harmful" depending on whether they are "harder" or "easier" to learn than the core features for a given model. This definition is model and dataset dependent. (2) We build upon this premise and use instance difficulty methods (like Prediction Depth (Baldock et al., 2021)) to quantify "easiness" for a given model and to identify this behavior during the training phase. (3) We empirically show that the harmful spurious features can be detected by observing the learning dynamics of the DNN’s early layers. In other words, easy features learned by the initial layers of a DNN early during the training can (potentially) hurt model generalization. We verify our claims on medical and vision datasets, both simulated and real, and justify the empirical success of our hypothesis by showing the theoretical connections between Prediction Depth and information-theoretic concepts like V-usable information (Ethayarajh et al., 2021). Lastly, our experiments show that monitoring only accuracy during training (as is common in machine learning pipelines) is insufficient to detect spurious features. We, therefore, highlight the need for monitoring early training dynamics using suitable instance difficulty metrics. © 2023, CC BY.

关键词： Deep neural networks

Model for Anomaly Detection in Reducing Water Losses in the Distribution Network of Peru using Machine Learning Algorithms

学校读者我要写书评

暂无评论

Model for Anomaly Detection in Reducing Water Losses in the ...

Software Engineering and computer science (CSECS), International Conference on

作者： Mayra Rivera Pricila Lucero José Luis Castillo-Sequera Lenis Wong Information Systems Engineering Program Universidad Peruana de Ciencias Aplicadas Lima Peru Department of Computer Science Group: Health Computing and Intelligent System Universidad de Alcalá Alcalá de Henares Spain

ISBN: (数字)9798331522216

ISBN: (纸本)9798331522223

Water leakage in distribution networks is a significant challenge, especially in regions with limited infrastructure like Huancayo, Peru, where losses account for 32.82% of the distributed volume. This study introduces a machine learning-based approach to detect leaks using four algorithms: Autoencoder LSTM, Isolation Forest, One-Class SVM, and K-Nearest Neighbors (KNN). The methodology involved preprocessing historical consumption data (2018–2024) into 12-month temporal sequences per client and evaluating the models based on F1 Score, Precision, and Mean Absolute Error (MAE). Among the algorithms, the Autoencoder LSTM demonstrated superior performance with the highest precision (0.89) and the lowest MAE (0.00402). Its robustness in high-variability contexts enables early and reliable leak detection, providing a cost-effective solution for optimizing water management in resource-constrained environments.

关键词： Support vector machines Machine learning algorithms Autoencoders Distribution networks Forestry Nearest neighbor methods Robustness Leak detection Long short term memory Water resources

An Approach to Formation Control of UAVs Based on Applying Adapted Kohonen Neural Network

学校读者我要写书评

暂无评论

An Approach to Formation Control of UAVs Based on Applying A...

Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT)

作者： Mikhail Khachumov Intelligent Control Laboratory Ailamazyan Program Systems Institute of RAS Pereslavl-Zalessky Russia Federal Research Center” Computer Science and Control” of RAS Moscow Russia

The paper gives a statement and considers the solution of an urgent scientific problem of formation control for a group of unmanned aerial vehicles (UAVs) operating in an unstable environment. To construct the reference trajectories and allocate UAVs to positions of a given structure, an original approach is proposed based on the adapted Kohonen neural network with a set of metrics, including Euclidean, Mahalanobis and Euclidean-Mahalanobis distances. To implement the movement of a UAV group in a complex environment, we apply the principles of intelligent-geometric control, which allows to combine flexible intelligent and precise geometric control methods within one concept. When moving along a given route, UAVs use a set of allowable control strategies. The developed modeling scheme is designed to take into account wind loads and possibly dangerous rapprochement of vehicles. To reflect the dynamics of UAVs, a special module is used that contains transfer functions integrated into a single stabilization system with an autopilot. The proposed approach has shown promise when simulating a series of formation control problems.

关键词：

LEATHER: A Framework for Learning to Generate Human-like Text in Dialogue

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Sicilia, Anthony Alikhani, Malihe Intelligent Systems Program United States Computer Science Department University of Pittsburgh PittsburghPA United States

Algorithms for text-generation in dialogue can be misguided. For example, in task-oriented settings, reinforcement learning that optimizes only task-success can lead to abysmal lexical diversity. We hypothesize this is due to poor theoretical understanding of the objectives in text-generation and their relation to the learning process (i.e., model training). To this end, we propose a new theoretical framework for learning to generate text in dialogue. Compared to existing theories of learning, our framework allows for analysis of the multifaceted goals inherent to text-generation. We use our framework to develop theoretical guarantees for learners that adapt to unseen data. As an example, we apply our theory to study data-shift within a cooperative learning algorithm proposed for the GuessWhat?! visual dialogue game. From this insight, we propose a new algorithm, and empirically, we demonstrate our proposal improves both task-success and human-likeness of the generated text. Finally, we show statistics from our theory are empirically predictive of multiple qualities of the generated dialogue, suggesting our theory is useful for model-selection when human evaluations are not available. © 2022, CC BY.

关键词： Learning algorithms

Modeling Non-Cooperative Dialogue: Theoretical and Empirical Insights

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Sicilia, Anthony Maidment, Tristan Healy, Pat Alikhani, Malihe Intelligent Systems Program University of Pittsburgh Pittsburgh United States Department of Informatics and Networked Systems University of Pittsburgh Pittsburgh United States Department of Computer Science and Intelligent Systems Program University of Pittsburgh Pittsburgh United States

Investigating cooperativity of interlocutors is central in studying pragmatics of dialogue. Models of conversation that only assume cooperative agents fail to explain the dynamics of strategic conversations. Thus, we investigate the ability of agents to identify non-cooperative interlocutors while completing a concurrent visual-dialogue task. Within this novel setting, we study the optimality of communication strategies for achieving this multi-task objective. We use the tools of learning theory to develop a theoretical model for identifying non-cooperative interlocutors and apply this theory to analyze different communication strategies. We also introduce a corpus of non-cooperative conversations about images in the GuessWhat?! dataset proposed by De Vries et al. (2017). We use reinforcement learning to implement multiple communication strategies in this context and find empirical results validate our theory. © 2022, CC BY.

关键词： Reinforcement learning

The Model of Managing a Group of UAVs by a Single Operator for Tasks Requiring Increased Attention

学校读者我要写书评

暂无评论

The Model of Managing a Group of UAVs by a Single Operator f...

International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM)

作者： Mikhail Khachumov Vyacheslav Khachumov Intelligent Control Laboratory Ailamazyan Program Systems Institute of RAS Pereslavl-Zalessky Russia RUDN University Federal Research Center "Computer Science and Control" of RAS Moscow Russia

The problem of optimizing the load on an operator of unmanned aerial vehicles (UAVs), which performs real-time tasks of researching and monitoring territories in an unstable environment is considered. Working load depends on the intensity of the information exchange between onboard and ground control stations and is determined by the agreed limit that leads to a limitation in the number of managed vehicles. As a mathematical model of the multi-functional control system, we use a closed-loop queuing system, which allows to establish coordination among its major elements (onboard computing complex, ground control station and operator) and reduce the loss of service requests. The latter is one of the main requirements to functioning of the system during emergencies. Of considerable interest are optimization statements for the problems of distribution of functions between elements and choosing the load modes. We gave formulations of some optimization problems in a general form and made appropriate conclusions. It is assumed that as an applied task, the problem of monitoring fire sites in forest areas can be considered, which requires increased attention from the operator to process information coming to the ground control station.

关键词：

Using LLMs to Discover Legal Factors

学校读者我要写书评

暂无评论

arXiv 2024年

Factors are a foundational component of legal analysis and computational models of legal reasoning. These factor-based representations enable lawyers, judges, and AI and Law researchers to reason about legal cases. In this paper, we introduce a methodology that leverages large language models (LLMs) to discover lists of factors that effectively represent a legal domain. Our method takes as input raw court opinions and produces a set of factors and associated definitions. We demonstrate that a semi-automated approach, incorporating minimal human involvement, produces factor representations that can predict case outcomes with moderate success, if not yet as well as expert-defined factors can. © 2024, CC BY.

关键词： Case based reasoning

A Two-stage Reconfiguration in Network Function Virtualization: Toward Service Function Chain Optimization

学校读者我要写书评

暂无评论

IEEE Transactions on Network and Service Management 2025年

作者： Assis, Karcius D. R. Almeida, Raul C. Baghban, Hojjat Santos, Alex F. Boutaba, Raouf Electrical and Computer Engineering Department Salvador Brazil University of Waterloo David R. Cheriton School of Computer Science Canada Department of Electronics and Systems Recife Brazil Chang Gung University Department of Artificial Intelligence Taiwan Chang Gung University College of Intelligent Computing Taiwan Center of Science and Technology in Energy and Sustainability Brazil Postgraduate Program in Computer Science Bahia Brazil

Network Function Virtualization (NFV), as a promising paradigm, speeds up the service deployment by separating network functions from proprietary devices and deploying them on common servers in the form of software. Any service in NFV-enabled networks is achieved as a Service Function Chain (SFC) which consists of a series of ordered Virtual Network Functions (VNFs). However, migration of VNFs for more flexible services within a dynamic NFV-enabled network is a key challenge to be addressed. Current VNF migration studies mainly focus on single VNF migration decisions without considering the sharing and concurrent migration of VNF instances. In this paper, we assume that each deployed VNF is used by multiple SFCs and deal with the optimal placement for the contemporaneous migration of VNFs based on the actual network situation. We formalize the VNF migration and SFC reconfiguration problem as a mathematical model, which aims to minimize the VNF migration between nodes or the total number of core changes per node. The approach is a two-stage MILP based on optimal order to solve the reconfiguration. Extensive evaluation shows that the proposed approach can reduce the change in terms of location or number of cores per node in a 6-node and 14-node networks while ensuring network latency compared with the model without reconfiguration. © 2004-2012 IEEE.

关键词： Network function virtualization

An Approach to Detect Abnormal Submissions for CodeWorkout Dataset

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Hicks, Alex Shi, Yang Arun-Balajiee Yan, Wei Marwan, Samiha Dept of Computer Science Virginia Tech BlacksburgVA United States Dept of Computer Science Utah State University LoganUT United States Lekshmi-Narayanan Intelligent Systems Program University of Pittsburgh PittsburghPA United States School of Informatics Computing and Cyber Systems North Arizona University FlagstaffAZ United States Dept. of Computer Science University of Virginia CharlottesvilleVA United States

Students’ interactions while solving problems in learning environments (i.e. log data) are often used to support students’ learning. For example, researchers use log data to develop systems that can provide students with personalized problem recommendations based on their knowledge level. However, anomalies in the students’ log data, such as cheating to solve programming problems, could introduce a hidden bias in the log data. As a result, these systems may provide inaccurate problem recommendations, and therefore, defeat their purpose. Classical cheating detection methods, such as MOSS, can be used to detect code plagiarism. However, these methods cannot detect other abnormal events such as a student gaming a system with multiple attempts of similar solutions to a particular programming problem. This paper presents a preliminary study to analyze log data with anomalies. The goal of our work is to overcome the abnormal instances when modeling personalizable recommendations in programming learning environments. © 2024, CC BY-NC-SA.

关键词： Students