ExplainabilityTransparencyAccountabilitycs.CL
Discrete Subgraph Sampling for Interpretable Graph based Visual Question Answering
Pascal Tilli, Ngoc Thang Vu
December 11, 2024
arXiv.org
1 citations
Key Takeaways
-
Built-in explanations are better than add-ons: The paper demonstrates that generating explanations during the prediction process (interpretable approaches) is more effective than explaining predictions after the fact, suggesting that AI systems designed with transparency built in from the start may be more trustworthy than those where explanations are added later.
-
You can have accuracy AND interpretability: The research shows that using discrete subset sampling methods allows visual question answering systems to maintain strong answer accuracy while simultaneously providing clear, interpretable explanations—challenging the common assumption that transparency requires sacrificing performance.
-
Human judgment validates technical metrics: The study found that computational metrics measuring how well answer and question tokens co-occur in explanations "strongly correlate with human preferences," meaning automated measures can reliably predict whether humans find AI explanations actually useful and understandable.
-
Subgraph explanations help users understand AI reasoning: By generating visual subgraphs that highlight which parts of an image the AI focused on when answering questions, the system provides concrete evidence of the model's reasoning process, making it easier for non-experts to verify whether the AI is making decisions for the right reasons.
-
Reproducibility supports responsible AI development: The authors' commitment to publicly releasing source code enables other researchers to verify findings and build upon this work, which is essential for developing trustworthy AI systems that can be independently audited and improved.