Bing Chat Solved CAPTCHAs with Image Analysis Feature Despite Safeguards
Description
Microsoft was reported by a Twitter user for deploying image analysis feature capable of solving CAPTCHAs for its GPT-based chatbot despite it being safeguarded against solving them for users.
Actors
Alleged Deployers
- microsoft
Alleged Developers
- openai
- microsoft
Harmed Parties
- microsoft
Classification
Risk Domain
Privacy & SecurityRisk Subdomain
2.2. AI system security vulnerabilities and attacks
MIT Risk Profile
Topics
Source
Related Incidents (Privacy & Security)
View all →Research Papers on This Topic
View all →StarCoder: may the source be with you!
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
LineVD: Statement-level Vulnerability Detection using Graph Neural Networks
TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.
Open Source
View all →flair
flairNLP/flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
⭐ 14,353
PySyft
OpenMined/PySyft
Perform data science on data that remains in someone else's server
⭐ 10,041
FATE
FederatedAI/FATE
An Industrial Grade Federated Learning Framework
⭐ 6,100
adversarial-robustness-toolbox