Erroneous Declined Transaction Notification by PayPal AI Assistant
Description
On July 13th, 2024, a user reported an incident involving PayPal's generative AI chatbot. The chatbot allegedly incorrectly informed the user of a declined transaction that never occurred, causing confusion and prompting a call to customer service for clarification. This false alert suggests a flaw in the AI system's reliability. The incident created unnecessary labor for both the user and PayPal's human support, demonstrating the potential harm of deploying generative AI without thorough testing and error handling mechanisms.
Actors
Alleged Deployers
- paypal
Alleged Developers
- paypal
Harmed Parties
- kiri-wagstaff
- paypal-customer-service-representatives
- paypal-customers
Classification
Risk Domain
MisinformationRisk Subdomain
3.1. False or misleading information
MIT Risk Profile
Source
Related Incidents (Misinformation)
View all →Research Papers on This Topic
Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
Why Language Models Hallucinate
CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Degenerate Feedback Loops in Recommender Systems