ExplainabilitySafetyTrustworthinesscs.AI
PASS: Probabilistic Agentic Supernet Sampling for Interpretable and Adaptive Chest X-Ray Reasoning
Yushi Feng, Junye Du, Yingying Hong, Qifan Wang, Lequan Yu
August 14, 2025
AAAI Conference on Artificial Intelligence
4 citations
Key Takeaways
-
Interpretability through probability annotations: PASS makes AI reasoning transparent by assigning probabilities to each decision step in chest X-ray analysis, enabling doctors to audit and understand why the system reached specific conclusions—addressing a critical safety concern in medical AI where "black-box" decisions undermine clinical trust.
-
Adaptive tool selection improves efficiency: Rather than following rigid workflows, PASS dynamically chooses the most appropriate analysis tool at each step and can exit early when confident, reducing computational costs while maintaining diagnostic accuracy—important for making AI systems practical in resource-constrained healthcare settings.
-
Better integration of multiple data types: The framework specifically addresses how medical AI systems struggle to combine different types of information (images, text, measurements). PASS improves multimodal integration, which the authors identify as "inherently critical for healthcare tasks" where doctors rely on diverse data sources.
-
New safety-focused evaluation benchmark: The authors created CAB-E, a comprehensive benchmark specifically designed to test AI systems on complex, multi-step chest X-ray reasoning tasks with safety considerations, providing the medical AI community with better tools to evaluate whether systems are trustworthy before clinical deployment.
-
Balancing performance with computational cost: The three-stage training approach (expert knowledge, contrastive ranking, and cost-aware reinforcement learning) explicitly optimizes for a "Pareto frontier" between diagnostic accuracy and computational efficiency, acknowledging that responsible AI deployment requires practical trade-offs, not just maximum performance.