ExplainabilityTransparencyTrustworthinesscs.AI
Explainable Distributed Constraint Optimization Problems
Ben Rachmut, Stylianos Loukas Vasileiou, Nimrod Meir Weinstein, Roie Zivan, William Yeoh
February 19, 2025
arXiv.org
1 citations
Key Takeaways
-
Multi-agent AI systems need explanations, not just solutions: The paper challenges the assumption that solutions from distributed multi-agent systems are automatically understandable. This mirrors real-world concerns in responsible AI—a technically correct decision means little if users cannot understand or trust why it was made.
-
Contrastive explanations help users understand AI decisions: The X-DCOP model uses "contrastive queries" (explaining why one solution was chosen over alternatives) rather than just describing what the solution is. The human user study confirmed that this approach resonates with people, as users preferred shorter, more focused explanations.
-
Shorter explanations are more practical: The research found that users prefer concise explanations over lengthy ones, and the proposed algorithms can generate explanations of varying lengths. This is important for real-world deployment—overly complex explanations may reduce rather than increase user trust and adoption.
-
Explainability can be built into distributed systems without sacrificing performance: The paper demonstrates that adding explainability to multi-agent optimization problems is computationally feasible, with different algorithmic variants allowing practitioners to choose between explanation quality and processing speed—a practical consideration for responsible AI implementation.
-
Explainability is essential for real-world adoption: The authors argue that making DCOP solutions explainable "reduces the barrier for users to understand" and facilitates adoption in real applications, suggesting that without explanation capabilities, even optimal technical solutions may fail in practice.