ExplainabilityAccountabilityTransparencycs.IR
Explainable Text Classification in Legal Document Review A Case Study of Explainable Predictive Coding
Rishi Chhatwal, Peter Gronvall, Nathaniel Huber-Fliflet, Robert Keeling, Jianping Zhang, Haozhen Zhao
April 3, 2019
2018 IEEE International Conference on Big Data (Big Data)
36 citations
4 influential
Key Takeaways
-
Explainability enables attorney oversight: The paper demonstrates that when machine learning systems can highlight which specific text snippets led to a "responsive" classification, lawyers can quickly verify whether the AI's decision was correct, rather than having to trust a black-box prediction.
-
Explainable AI improves efficiency and quality simultaneously: By showing attorneys exactly why documents were flagged, explainable predictive coding can "drastically enhance the overall quality and speed of the document review process by reducing the time it takes to review documents"—addressing both accuracy and resource constraints in legal discovery.
-
Current legal AI tools lack transparency: The paper notes that attorneys have been using machine learning for document review "most recently," but highlights a gap: most existing systems don't explain their decisions, making it difficult for legal professionals to audit whether the technology is working correctly.
-
Responsible AI requires human-understandable decisions: The research emphasizes that in explainable AI systems, "actions or decisions are human understandable"—a critical principle for high-stakes applications like legal review where decisions can have significant consequences for litigation outcomes.
-
Snippet-level explanations are practical for legal work: Rather than explaining decisions at the document level, identifying responsive text snippets within documents gives attorneys a concrete, actionable way to evaluate AI recommendations without requiring technical expertise.