ExplainabilityFairnessAccountabilitycs.LG
Generating User-friendly Explanations for Loan Denials using GANs
Ramya Srinivasan, Ajay Chander, Pouya Pezeshkpour
June 24, 2019
arXiv.org
16 citations
Key Takeaways
-
Explanations need to serve real people, not just engineers. The paper identifies a critical gap in current explainable AI systems, which "mostly serve AI engineers and offer little to no value to business decision makers, customers, and other stakeholders"—highlighting that technical explanations alone don't meet the needs of those actually affected by AI decisions.
-
Loan denial explanations can be tailored to different purposes. The research demonstrates that the same AI decision can be explained in multiple ways depending on the audience's needs—some explanations can educate applicants about why they were denied, while others can guide them toward actionable steps to improve their chances of future approval.
-
Regulatory and competitive pressures are driving better AI transparency in finance. The paper notes there is "increasing competitive desire and regulatory incentive to deploy AI mindfully within financial services," suggesting that both legal requirements and market competition are pushing financial institutions toward more responsible AI practices.
-
Creating representative datasets for explanations is foundational work. The authors built "the first-of-its-kind dataset that is representative of loan-applicant friendly explanations," indicating that developing realistic training data for generating human-centered explanations is an essential first step that was previously missing from the field.
-
Financial AI decisions warrant special attention to explainability. Because "financial decisions impact our lives," the paper emphasizes that loan approval systems deserve particular focus on fairness, soundness, and transparency compared to lower-stakes applications.
Abstract
Financial decisions impact our lives, and thus everyone from the regulator to the consumer is interested in fair, sound, and explainable decisions. There is increasing competitive desire and regulatory incentive to deploy AI mindfully within financial services. An important mechanism towards that end is to explain AI decisions to various stakeholders. State-of-the-art explainable AI systems mostly serve AI engineers and offer little to no value to business decision makers, customers, and other stakeholders. Towards addressing this gap, in this work we consider the scenario of explaining loan denials. We build the first-of-its-kind dataset that is representative of loan-applicant friendly explanations. We design a novel Generative Adversarial Network (GAN) that can accommodate smaller datasets, to generate user-friendly textual explanations. We demonstrate how our system can also generate explanations serving different purposes: those that help educate the loan applicants, or help them take appropriate action towards a future approval.
Presented at the NeurIPS 2018 Workshop on Challenges and Opportunities for AI in Financial Services: the Impact of Fairness, Explainability, Accuracy, and Privacy, Montreal, Canada
Paper Info
arXiv ID1906.10244
PublishedJune 24, 2019
Citations
16
Relevance88%
VenuearXiv.org
TypeJournalArticle
Categorycs.LG
Responsible AI Topics
ExplainabilityFairnessAccountability
Links
Citation data from Semantic Scholar