Chatbot in Workplace Training at Bunbury Prison Reveals Real Names in Sexual Harassment Case
Description
During workplace training at Bunbury Prison in Western Australia, a trainer used Microsoft's Copilot AI chatbot to generate case study scenarios. The chatbot produced a scenario that included the real name of a former employee involved in a sexual harassment case, revealing sensitive information.
Actors
Alleged Deployers
- western-australia-department-of-justice
- charlotte-ingham
Alleged Developers
- microsoft
- large-language-model-developers
- chatbot-developers
Harmed Parties
- western-australia-department-of-justice-senior-staff-members
- western-australia-department-of-justice
- bronwyn-hendry
- privacy
Classification
Risk Domain
Privacy & SecurityRisk Subdomain
2.1. Compromise of privacy by obtaining, leaking or correctly inferring sensitive information
MIT Risk Profile
Topics
Source
Related Incidents (Privacy & Security)
View all →Research Papers on This Topic
View all →StarCoder: may the source be with you!
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
LineVD: Statement-level Vulnerability Detection using Graph Neural Networks
TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.
Open Source
View all →flair
flairNLP/flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
⭐ 14,353
PySyft
OpenMined/PySyft
Perform data science on data that remains in someone else's server
⭐ 10,041
FATE
FederatedAI/FATE
An Industrial Grade Federated Learning Framework
⭐ 6,100
adversarial-robustness-toolbox