SecurityExplainabilitySafetycs.LG
Explainable Data Poison Attacks on Human Emotion Evaluation Systems based on EEG Signals
Zhibo Zhang, Sani Umar, Ahmed Y. Al Hammadi, Sangyoung Yoon, Ernesto Damiani, Claudio Agostino Ardagna, Nicola Bena, Chan Yeob Yeun
January 17, 2023
IEEE Access
21 citations
Key Takeaways
-
EEG-based emotion detection systems are vulnerable to data poisoning attacks: Researchers demonstrated that attackers can manipulate training data by flipping emotion labels, successfully degrading the performance of machine learning models used to evaluate human emotional states from brain signals—a concerning finding given these systems' potential use in security screening.
-
These attacks work across different AI models: The study found that data poisoning attacks succeed regardless of which machine learning model is used, though different models show varying levels of vulnerability, suggesting no single technical approach provides complete protection.
-
Explainability tools can reveal how attacks work: By applying interpretability methods like SHAP values and LIME, researchers were able to explain which specific EEG signal features attackers manipulated, making the attacks more transparent and potentially helping defenders identify suspicious patterns.
-
Insider threats in emotion detection systems require attention: The paper highlights that EEG-based emotion evaluation systems designed to detect internal security threats themselves face risks from malicious actors who could poison training data, creating a potential blind spot in security infrastructure.
-
Transparency supports defensive measures: Making attack mechanisms publicly understandable through explainable AI methods and releasing code openly enables the research community to develop better safeguards for emotion detection systems before they're widely deployed in security-critical applications.
Abstract
The major aim of this paper is to explain the data poisoning attacks using label-flipping during the training stage of the electroencephalogram (EEG) signal-based human emotion evaluation systems deploying Machine Learning models from the attackers' perspective. Human emotion evaluation using EEG signals has consistently attracted a lot of research attention. The identification of human emotional states based on EEG signals is effective to detect potential internal threats caused by insider individuals. Nevertheless, EEG signal-based human emotion evaluation systems have shown several vulnerabilities to data poison attacks. The findings of the experiments demonstrate that the suggested data poison assaults are model-independently successful, although various models exhibit varying levels of resilience to the attacks. In addition, the data poison attacks on the EEG signal-based human emotion evaluation systems are explained with several Explainable Artificial Intelligence (XAI) methods, including Shapley Additive Explanation (SHAP) values, Local Interpretable Model-agnostic Explanations (LIME), and Generated Decision Trees. And the codes of this paper are publicly available on GitHub.
Paper Info
arXiv ID2301.06923
PublishedJanuary 17, 2023
Citations
21
Relevance72%
VenueIEEE Access
TypeJournalArticle
Categorycs.LG
Responsible AI Topics
SecurityExplainabilitySafety
Links
Citation data from Semantic Scholar