PrivacyExplainabilityTrustworthinesscs.CR
Privacy-Preserving Explainable AIoT Application via SHAP Entropy Regularization
Dilli Prasad Sharma, Xiaowei Sun, Liang Xue, Xiaodong Lin, Pulei Xiong
November 12, 2025
2025 IEEE Annual Congress on Artificial Intelligence of Things (AIoT)
3 citations
Key Takeaways
-
Explainability can create new privacy risks: The paper demonstrates that popular AI explanation methods like SHAP and LIME, which are designed to make AI systems more transparent and trustworthy, can inadvertently expose sensitive user information such as behavioral patterns and personal attributes in smart home applications.
-
A technical solution exists to balance transparency and privacy: The researchers propose using "entropy regularization" during model training to make SHAP explanations less revealing about individual features, effectively spreading out the importance scores so that no single explanation leaks too much sensitive information.
-
Privacy attacks on explanations are a real threat: The study developed specific attacks that show how bad actors could strategically use model explanations to infer private user data, highlighting that the risk of explanation-based privacy breaches is not theoretical but actionable.
-
Smart homes are a critical application area: The focus on AIoT (Artificial Intelligence of Things) in smart home environments underscores that privacy-preserving AI is particularly urgent for intimate settings where systems monitor energy use, occupancy patterns, and daily routines that users consider highly personal.
-
Responsible AI requires solving multiple problems simultaneously: This work illustrates that truly responsible AI deployment in regulated domains requires not just making models explainable or private, but finding technical approaches that achieve both transparency and privacy protection at the same time.