ExplainabilityTransparencyAccountabilitycs.CV
Interactive Visual Feature Search
Devon Ulrich, Ruth Fong
November 28, 2022
XAI4CV
Key Takeaways
-
Interactive tools make AI models more interpretable than static explanations: The paper demonstrates that interactive visualizations allow users to more easily understand how computer vision models work compared to traditional static diagrams, suggesting that the way we present AI behavior matters significantly for human understanding.
-
Reusable visualization tools can democratize AI explainability: Visual Feature Search is designed to work with any CNN (convolutional neural network) and integrate into researchers' existing workflows, addressing a key barrier to responsible AI—the ability to audit and understand models across different applications without building new tools from scratch.
-
Feature visualization has practical applications across domains: The researchers tested their tool on diverse applications including medical imaging and wildlife classification, showing that understanding what features a model learns is relevant whether AI systems are used in healthcare, conservation, or other high-stakes fields.
-
Searching for similar features reveals model decision-making: By allowing users to highlight image regions and find similar examples in a dataset based on what the model "sees," the tool provides concrete insight into which visual patterns influence model predictions—critical information for identifying potential biases or errors.