ExplainabilityTransparencyAccountabilitycs.LG
Feature Importance Ranking for Deep Learning
Maksymilian Wojtas, Ke Chen
October 18, 2020
Neural Information Processing Systems
159 citations
9 influential
Key Takeaways
-
Feature importance ranking helps explain AI decisions: The paper addresses a key challenge in explainable AI by developing methods to identify which input features (data elements) are most important for deep learning models' predictions, making these "black box" systems more transparent to users and stakeholders.
-
The dual-net approach solves a complex optimization problem: Rather than using traditional methods, the researchers created two interconnected neural networks—one that makes predictions and another that identifies the best subset of features to use—working together to find optimal feature combinations, which the paper demonstrates outperforms existing feature selection methods.
-
Practical deployment is straightforward: Once trained, the system can be easily deployed to automatically identify which features matter most for predictions on new data, potentially reducing data collection costs and computational requirements by focusing only on the most important information.
-
Performance improvements are empirically validated: The authors tested their approach on synthetic, benchmark, and real-world datasets and report that it outperforms "several state-of-the-art" competing methods, suggesting practical advantages for organizations implementing explainable AI systems.
-
Open-source availability supports reproducibility: By making their source code publicly available on GitHub, the researchers enable other organizations and researchers to verify their findings and build upon this work, supporting responsible AI development through transparency and reproducibility.