ExplainabilityTransparencyAccountabilitycs.IR
A Framework for Explainable Text Classification in Legal Document Review
Christian J. Mahoney, Jianping Zhang, Nathaniel Huber-Fliflet, Peter Gronvall, Haozhen Zhao
December 19, 2019
2019 IEEE International Conference on Big Data (Big Data)
40 citations
3 influential
Key Takeaways
-
Explainability builds trust in AI-assisted legal review: The paper demonstrates that when machine learning models can explain why they classify documents as responsive (rather than operating as a "black box"), lawyers gain greater confidence in the results, addressing a significant perception barrier to AI adoption in the legal profession.
-
Identifying specific text snippets improves decision-making: The framework's key innovation is locating the exact text passages that trigger a "responsive" classification, allowing attorneys to quickly verify whether the model's reasoning is sound rather than having to trust an opaque overall decision.
-
Explainable AI can reduce both costs and review time: By combining text classification with interpretability features, the framework promises to "drastically enhance overall quality and speed of the review process," potentially reducing the millions of dollars companies spend on document review in legal matters while maintaining accuracy.
-
Responsible AI requires human oversight mechanisms: The paper emphasizes that effective legal AI deployment requires lawyers to be able to evaluate and understand model decisions, highlighting that automation in high-stakes domains like law should preserve human agency and comprehension rather than replacing human judgment entirely.