ExplainabilityTransparencySecuritycs.LG
Impact of Feature Encoding on Malware Classification Explainability
Elyes Manai, Mohamed Mejri, Jaouhar Fattahi
July 10, 2023
European Conference on Artificial Intelligence
5 citations
Key Takeaways
-
Feature encoding choices directly affect how well humans can understand AI security decisions: One Hot Encoding (OHE) provided more detailed explanations of why the malware classifier made specific predictions compared to Label Encoding (LE), even though LE performed slightly better at classification accuracy.
-
Better explainability can outweigh small performance trade-offs in security applications: The researchers found that OHE's superior explanations compensated for its marginal performance loss, suggesting that in malware detection—where understanding why a threat was flagged matters for security teams—explainability may be more valuable than marginal accuracy gains.
-
Explainability improvements can also reduce analyst workload: Using OHE resulted in smaller explanation files and shorter analysis times for human experts reviewing the AI's decisions, making the security review process more efficient alongside being more transparent.
-
Technical implementation details have real consequences for responsible AI: This research demonstrates that seemingly low-level decisions about how to prepare data for AI systems significantly impact whether security professionals can trust, verify, and act on the AI's recommendations—a critical requirement for responsible deployment in high-stakes domains.
Abstract
This paper investigates the impact of feature encoding techniques on the explainability of XAI (Explainable Artificial Intelligence) algorithms. Using a malware classification dataset, we trained an XGBoost model and compared the performance of two feature encoding methods: Label Encoding (LE) and One Hot Encoding (OHE). Our findings reveal a marginal performance loss when using OHE instead of LE. However, the more detailed explanations provided by OHE compensated for this loss. We observed that OHE enables deeper exploration of details in both global and local contexts, facilitating more comprehensive answers. Additionally, we observed that using OHE resulted in smaller explanation files and reduced analysis time for human analysts. These findings emphasize the significance of considering feature encoding techniques in XAI research and suggest potential for further exploration by incorporating additional encoding methods and innovative visualization approaches.
This paper is accpeted in the 15th Edition of INTERNATIONAL CONFERENCE on Electronics, Computers and Artificial Intelligence, BUCHAREST, ROMANIA (ECAI 2023)
Paper Info
arXiv ID2307.05614
PublishedJuly 10, 2023
Citations
5
Relevance72%
VenueEuropean Conference on Artificial Intelligence
TypeJournalArticle, Conference
Categorycs.LG
Responsible AI Topics
ExplainabilityTransparencySecurity
Links
Citation data from Semantic Scholar