What Happens to a Dataset Transformed by a Projection-based Concept Removal Method?

作     者：Johansson, Richard 

作者机构：Department of Computer Science and Engineering University of Gothenburg Chalmers University of Technology Sweden 

出 版 物：《arXiv》 (arXiv)

年 卷 期：2024年

核心收录：

主　　题：Cluster analysis 

摘      要：We investigate the behavior of methods that use linear projections to remove information about a concept from a language representation, and we consider the question of what happens to a dataset transformed by such a method. A theoretical analysis and experiments on real-world and synthetic data show that these methods inject strong statistical dependencies into the transformed datasets. After applying such a method, the representation space is highly structured: in the transformed space, an instance tends to be located near instances of the opposite label. As a consequence, the original labeling can in some cases be reconstructed by applying an anti-clustering method. © 2024, CC BY-SA.