ExplainabilityTransparencyTrustworthinesscs.LG
Metric Tools for Sensitivity Analysis with Applications to Neural Networks
Jaime Pizarroso, David Alfaya, José Portela, Antonio Muñoz
May 3, 2023
Applied Soft Computing
7 citations
Key Takeaways
-
Existing sensitivity analysis methods lack theoretical justification: The paper identifies that current XAI techniques using partial derivatives to measure input variable importance don't have solid mathematical foundations for how they aggregate information—a gap this research addresses through a new metric-based framework.
-
New "α-curves" method provides deeper insights than current tools: The proposed α-curves family of metrics offers more detailed information about which input variables matter most to neural networks compared to existing XAI methods, potentially helping practitioners better understand model decision-making.
-
Input variable importance is critical for model trustworthiness: The research emphasizes that understanding which input features a model relies on is essential for building transparent and trustworthy AI systems, especially when these models influence important decisions affecting people's lives.
-
Theoretical rigor improves practical AI transparency: By establishing a mathematical foundation for sensitivity analysis metrics, this work demonstrates that rigorous theoretical frameworks can strengthen explainability tools—making it easier for non-technical stakeholders to trust and validate AI system decisions.
-
Validation against real-world data confirms practical value: The researchers tested their α-curves approach on both synthetic and real datasets, comparing results to established methods and ground truth, suggesting the framework has practical applicability beyond theoretical interest.