ExplainabilityTransparencyTrustworthinesscs.LG
Lessons from Usable ML Deployments and Application to Wind Turbine Monitoring
Alexandra Zytek, Wei-En Wang, Sofia Koukoura, Kalyan Veeramachaneni
December 5, 2023
arXiv.org
Key Takeaways
-
Bridge roles are essential for responsible AI deployment: Organizations need dedicated "bridge" professionals who can translate between ML developers and domain experts. In the wind turbine case, these intermediaries help ensure that ML systems actually address real operational needs rather than simply providing technically accurate predictions.
-
Usable ML goes beyond explainability: The paper distinguishes "usable ML" from merely "explainable ML," emphasizing that real-world impact requires not just explanations but also supporting information and interfaces that domain experts can actually act on. For wind turbine engineers deciding whether to investigate potential brake failures, this means the system must provide actionable guidance, not just model outputs.
-
Configurable interfaces enable better human-AI collaboration: Systems that allow iterative refinement of ML interfaces during ongoing collaboration with domain experts are critical. This flexibility helps ensure the AI tool evolves to match how professionals actually work, rather than forcing professionals to adapt to rigid AI systems.
-
Continuous evaluation in real deployments is necessary: The paper emphasizes that impact cannot be assessed in labs alone—organizations must implement ongoing evaluation methods to measure whether usable ML actually improves decision-making and outcomes in practice. For wind turbine monitoring, this means tracking whether the system genuinely reduces unnecessary site visits or prevents equipment failures.
-
Responsible AI requires domain-specific design: Effective AI deployment in specialized fields like renewable energy demands deep understanding of the actual decision-making context, constraints, and expertise of practitioners, not one-size-fits-all AI solutions.