ExplainabilityAccountabilitySafetycs.AI
Towards Responsible and Explainable AI Agents with Consensus-Driven Reasoning
Eranga Bandara, Tharaka Hewa, Ross Gore, Sachin Shetty, Ravi Mukkamala, Peter Foytik, Abdul Rahman, Safdar H. Bouk, Xueping Liang, Amin Hass, Sachini Rajapakse, Ng Wee Keong, Kasun De Zoysa, Aruna Withanage, Nilaan Loganathan
December 25, 2025
arXiv.org
13 citations
Key Takeaways
-
Multiple AI models working together improve reliability: The paper proposes using a "consortium" of different AI models that independently analyze the same task, then compares their outputs. This approach exposes disagreements and uncertainty between models, helping catch errors that a single AI system might miss—similar to how getting multiple expert opinions reduces the chance of a single person's mistake.
-
Transparency through showing your work: The architecture preserves intermediate outputs and reasoning steps so that decisions can be traced back to their sources. Rather than an AI simply providing an answer, this approach documents how it arrived at that answer, making it possible to audit and understand the decision-making process.
-
A dedicated "reasoning agent" enforces safety guardrails: The system includes a specialized component that reviews all candidate outputs from different models specifically to enforce safety policies, reduce hallucinations (false information), and mitigate bias before a final decision is made—functioning as a quality control checkpoint.
-
Addresses the accountability gap in autonomous systems: The paper identifies that current AI agents prioritize functionality over explainability and accountability. This work tackles that gap by building governance directly into the system's architecture rather than treating responsibility as an afterthought.
-
Designed for real-world deployment: The proposed architecture is framed as "production-grade," suggesting it's intended to handle actual business workflows where AI decisions have downstream consequences—not just laboratory demonstrations.
Abstract
Agentic AI represents a major shift in how autonomous systems reason, plan, and execute multi-step tasks through the coordination of Large Language Models (LLMs), Vision Language Models (VLMs), tools, and external services. While these systems enable powerful new capabilities, increasing autonomy introduces critical challenges related to explainability, accountability, robustness, and governance, especially when agent outputs influence downstream actions or decisions. Existing agentic AI implementations often emphasize functionality and scalability, yet provide limited mechanisms for understanding decision rationale or enforcing responsibility across agent interactions. This paper presents a Responsible(RAI) and Explainable(XAI) AI Agent Architecture for production-grade agentic workflows based on multi-model consensus and reasoning-layer governance. In the proposed design, a consortium of heterogeneous LLM and VLM agents independently generates candidate outputs from a shared input context, explicitly exposing uncertainty, disagreement, and alternative interpretations. A dedicated reasoning agent then performs structured consolidation across these outputs, enforcing safety and policy constraints, mitigating hallucinations and bias, and producing auditable, evidence-backed decisions. Explainability is achieved through explicit cross-model comparison and preserved intermediate outputs, while responsibility is enforced through centralized reasoning-layer control and agent-level constraints. We evaluate the architecture across multiple real-world agentic AI workflows, demonstrating that consensus-driven reasoning improves robustness, transparency, and operational trust across diverse application domains. This work provides practical guidance for designing agentic AI systems that are autonomous and scalable, yet responsible and explainable by construction.
Paper Info
arXiv ID2512.21699
PublishedDecember 25, 2025
Citations
13
Relevance92%
VenuearXiv.org
TypeJournalArticle
Categorycs.AI
Responsible AI Topics
ExplainabilityAccountabilitySafety
Links
Citation data from Semantic Scholar