ExplainabilityTransparencyAccountabilitycs.AI
Increasing AI Explainability by LLM Driven Standard Processes
Marc Jansen, Marcel Pehlke
November 10, 2025
arXiv.org
1 citations
Key Takeaways
-
Structured processes make AI reasoning more transparent: Rather than trying to explain AI decisions after the fact, this approach embeds LLMs within established decision-making frameworks (like risk management and sensitivity analysis), creating a clear "audit trail" that shows how the AI arrived at its conclusion.
-
Separation of AI reasoning from decision logic improves accountability: The paper's layered architecture keeps the LLM's internal reasoning separate from the formal decision process, allowing organizations to verify that AI recommendations follow proper procedures and can be traced back to specific inputs and criteria.
-
Human-level decision logic can be reproduced reliably: Empirical testing demonstrated the system could match human-level reasoning in complex domains like governance and strategic planning, suggesting this approach could make AI systems trustworthy enough for high-stakes decisions where explainability is critical.
-
Standard processes replace black-box interpretation methods: Traditional explainability techniques focus on explaining individual features after decisions are made, but this framework prevents the "black box" problem from occurring in the first place by requiring AI to work within transparent, standardized decision models.
-
Potential for verifiable AI in governance and risk management: The approach showed promise in decentralized governance and risk assessment contexts, suggesting it could help organizations deploy AI systems where decisions need to be auditable and defensible to stakeholders or regulators.