PrivacyExplainabilityAccountabilitycs.CV
DUCK: Distance-based Unlearning via Centroid Kinematics
Marco Cotogni, Jacopo Bonato, Luigi Sabetta, Francesco Pelosin, Alessandro Nicolosi
December 4, 2023
arXiv.org
26 citations
2 influential
Key Takeaways
-
Machine unlearning is now a practical privacy tool: The paper addresses a real need in AI—the ability to remove specific data's influence from trained models. This is particularly relevant for compliance with privacy regulations like the right to be forgotten, where companies may need to delete a person's data from their AI systems.
-
DUCK achieves state-of-the-art performance on benchmark tests: The new algorithm outperforms existing unlearning methods across multiple datasets in two scenarios (class removal and homogeneous sampling removal), suggesting it's more effective at actually forgetting target data while maintaining overall model performance.
-
A new metric (AUS) balances forgetting with utility: The paper introduces the Adaptive Unlearning Score, which measures not just whether the model successfully forgets data, but also how much the model's overall performance degrades in the process. This dual focus reflects a key tension in responsible AI—privacy shouldn't come at the cost of making systems unusable.
-
The mechanism uses geometric organization of learned features: DUCK works by identifying and removing data based on distance metrics in the model's internal "embedding space" (how the model organizes learned concepts). This geometric approach provides interpretability, allowing researchers to understand how the unlearning actually works rather than treating it as a black box.
-
Explainable AI techniques were used to validate the approach: The authors employed interpretability methods to verify that DUCK genuinely removes the influence of target data rather than just hiding it, addressing concerns about whether unlearning is truly effective or merely superficial.