ExplainabilityAccountabilityTransparencystat.ML
Explicating feature contribution using Random Forest proximity distances
Leanne S. Whitmore, Anthe George, Corey M. Hudson
July 17, 2018
arXiv.org
8 citations
Key Takeaways
-
Random Forests can be made more transparent: The paper demonstrates a method to explain how Random Forest models make decisions by tracking how individual features move data points through the decision space, addressing the "black box" nature of these widely-used machine learning models.
-
Feature contributions can be independently measured: By observing how changes in input features affect the model's decisions, researchers can determine which features are actually driving specific predictions, rather than just knowing that a prediction was made.
-
This enables meaningful model auditing: The technique allows organizations to systematically review and audit classifier decisions after deployment, which is essential for identifying potential biases or errors in high-stakes applications like hiring, lending, or criminal justice.
-
Post-hoc error analysis becomes possible: When the model makes mistakes, this method allows practitioners to understand why—whether a particular feature was weighted incorrectly or whether the error reveals a gap in the training data—supporting continuous improvement of AI systems.
-
Explainability supports responsible deployment: By making Random Forest decisions explicable rather than opaque, this work contributes to the practical ability to hold AI systems accountable and to build appropriate human oversight into automated decision-making processes.
Abstract
In Random Forests, proximity distances are a metric representation of data into decision space. By observing how changes in input map to the movement of instances in this space we are able to determine the independent contribution of each feature to the decision-making process. For binary feature vectors, this process is fully specified. As these changes in input move particular instances nearer to the in-group or out-group, the independent contribution of each feature can be uncovered. Using this technique, we are able to calculate the contribution of each feature in determining how black-box decisions were made. This allows explication of the decision-making process, audit of the classifier, and post-hoc analysis of errors in classification.
Presented at IJCAI/ECAI 2018 Workshop on Explainable Artificial Intelligence (XAI)
Paper Info
arXiv ID1807.06572
PublishedJuly 17, 2018
Citations
8
Relevance82%
VenuearXiv.org
TypeJournalArticle
Categorystat.ML
Responsible AI Topics
ExplainabilityAccountabilityTransparency
Links
Citation data from Semantic Scholar