ExplainabilityAccountabilityTransparencycs.DB
Expected Shapley-Like Scores of Boolean Functions: Complexity and Applications to Probabilistic Databases
Pratik Karmakar, Mikaël Monet, Pierre Senellart, Stéphane Bressan
January 12, 2024
Proc. ACM Manag. Data
19 citations
Key Takeaways
-
Shapley values offer a rigorous framework for explaining AI decisions: The paper demonstrates that Shapley values—a game theory concept—can be adapted to explain how individual data facts contribute to database query results, providing a mathematically principled approach to AI explainability beyond simpler attribution methods.
-
Computing explanations is computationally challenging but solvable in specific cases: The research shows that calculating expected Shapley values is generally difficult, but becomes tractable when data relationships are represented as "decomposable circuits," enabling practical implementation in real database systems like ProvSQL.
-
Probabilistic reasoning requires new explanation approaches: By extending Shapley values to probabilistic databases (where data has uncertainty), this work addresses a real-world challenge: explaining AI decisions when the underlying data itself is uncertain or incomplete, which is common in healthcare, finance, and scientific applications.
-
Theoretical advances enable practical tools: The paper bridges abstract computer science theory with implementation, demonstrating through ProvSQL experiments that the proposed algorithm works efficiently on standard benchmarks, suggesting these explanation methods could be deployed in actual database systems used by organizations.
-
Standardized metrics improve AI accountability: By adapting established game-theoretic measures (Shapley and Banzhaf values) rather than inventing new ones, the work promotes consistency in how organizations measure and communicate the importance of data in automated decision-making systems.
Abstract
Shapley values, originating in game theory and increasingly prominent in explainable AI, have been proposed to assess the contribution of facts in query answering over databases, along with other similar power indices such as Banzhaf values. In this work we adapt these Shapley-like scores to probabilistic settings, the objective being to compute their expected value. We show that the computations of expected Shapley values and of the expected values of Boolean functions are interreducible in polynomial time, thus obtaining the same tractability landscape. We investigate the specific tractable case where Boolean functions are represented as deterministic decomposable circuits, designing a polynomial-time algorithm for this setting. We present applications to probabilistic databases through database provenance, and an effective implementation of this algorithm within the ProvSQL system, which experimentally validates its feasibility over a standard benchmark.
27 pages, including 20 pages of maintext. This is the authors' version of the corresponding PODS'2024 article
Paper Info
arXiv ID2401.06493
PublishedJanuary 12, 2024
RevisedApril 16, 2024
Citations
19
Relevance72%
VenueProc. ACM Manag. Data
TypeJournalArticle
Categorycs.DB
Responsible AI Topics
ExplainabilityAccountabilityTransparency
Links
Citation data from Semantic Scholar