Alleged Gaggle Surveillance Alert Reportedly Leads to Arrest and Detention of 13-Year-Old Student in Fairview, Tennessee
Description
Sometime in August 2023, a 13-year-old student at Fairview Middle School in Tennessee was reportedly arrested, strip-searched, and detained overnight after Gaggle's purported AI-powered surveillance system flagged a private online message as a threat. The student's comment, reportedly a joke in context, was sent to law enforcement under a state zero-tolerance law. The incident reportedly resulted in house arrest, alternative school placement, and a lawsuit alleging wrongful arrest.
Actors
Alleged Deployers
- williamson-county-schools
- fairview-middle-school-tennessee
Alleged Developers
- gaggle
Harmed Parties
- unnamed-13-year-old-student-from-fairview-tennessee
- students
- privacy
- minors
- educational-communities
- biometric-data-subjects
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
Topics
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
Representation Engineering: A Top-Down Approach to AI Transparency
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.