Navigating Towards Fairness with Data Selection

作     者：Zhang, Yixuan Li, Zhidong Wang, Yang Chen, Fang Fan, Xuhui Zhou, Feng 

作者机构：School of Statistics and Data Science Southeast University China Data Science Institute University of Technology Sydney Australia School of Computing Macquarie University Australia Center for Applied Statistics School of Statistics Renmin University of China China Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing China 

出 版 物：《arXiv》 (arXiv)

年 卷 期：2024年

核心收录：

主　　题：Adversarial machine learning 

摘      要：Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias typically involve modifying models and intervening in the training process, but these lack flexibility for large-scale datasets. To address this limitation, we introduce a data selection method designed to efficiently and flexibly mitigate label bias, tailored to more practical needs. Our approach utilizes a zero-shot predictor as a proxy model that simulates training on a clean holdout set. This strategy, supported by peer predictions, ensures the fairness of the proxy model and eliminates the need for an additional holdout set, which is a common requirement in previous methods. Without altering the classifier’s architecture, our modality-agnostic method effectively selects appropriate training data and has proven efficient and effective in handling label bias and improving fairness across diverse datasets in experimental evaluations. Copyright © 2024, The Authors. All rights reserved.