SecurityExplainabilityAccountabilitycs.IR
The Dark Side of Explanations: Poisoning Recommender Systems with Counterfactual Examples
Ziheng Chen, Fabrizio Silvestri, Jia Wang, Yongfeng Zhang, Gabriele Tolomei
April 30, 2023
Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
38 citations
1 influential
Key Takeaways
-
Explainability can create new security vulnerabilities: The paper demonstrates that counterfactual explanations—which are designed to help users understand why they receive recommendations—can paradoxically be weaponized by attackers to manipulate recommender systems, revealing an unintended trade-off between transparency and security.
-
Attackers can reverse-engineer systems through explanations: Malicious actors can use the logical patterns revealed in counterfactual explanations to train their own model of how the recommender system works, then exploit this knowledge to inject fake user profiles and interaction records that fool the system into making unwanted recommendations.
-
Current explainability methods may need security hardening: The research shows that popular counterfactual explanation techniques, while beneficial for legitimate users and designers, lack built-in defenses against adversarial misuse, suggesting that responsible AI development must consider security implications alongside transparency goals.
-
Poisoning attacks can be highly effective: The H-CARS attack strategy achieved "significant and successful attack performance" across multiple datasets, indicating this is not a theoretical concern but a practical threat that platforms using explainable recommender systems should actively address.
-
Responsible AI requires balancing competing values: This work illustrates a fundamental tension in responsible AI: providing explanations increases user trust and system accountability, but without proper safeguards, those same explanations can enable attacks—requiring developers to thoughtfully design security measures alongside transparency features.