Microsoft-Powered New York City Chatbot Advises Illegal Practices
Description
New York City's chatbot, launched under Mayor Eric Adams's plan to assist businesses, has been reportedly providing dangerously inaccurate legal advice. The Microsoft-powered bot allegedly informed users that landlords can refuse Section 8 vouchers and that businesses can operate cash-free, among other falsehoods. The city acknowledges the chatbot is a pilot program and commits to improvements while the errors are addressed.
Actors
Alleged Deployers
- new-york-city-government
- eric-adams-administration
Alleged Developers
- microsoft
- new-york-city-office-of-technology-and-innovation
Harmed Parties
- new-york-city-small-business-owners
- new-york-city-landlords-and-tenants
- new-york-city-employers-and-employees
- eric-adams-administration
Classification
Risk Domain
MisinformationRisk Subdomain
3.1. False or misleading information
MIT Risk Profile
Source
Related Incidents (Misinformation)
View all →Research Papers on This Topic
Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
Why Language Models Hallucinate
CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Degenerate Feedback Loops in Recommender Systems