Hidden Prompt Injection in Brazilian Labor-Court Petition Reportedly Tried to Manipulate Galileu
Description
Galileu, an AI tool used by Brazil's labor courts, reportedly detected hidden instructions embedded in an initial petition before the 3rd Labor Court of Parauapebas. The text allegedly told the AI to contest the petition superficially and not challenge documents. Galileu reportedly alerted the judge and blocked the hidden content from processing; the judge then reviewed the material before imposing any procedural consequences.
Actors
Alleged Deployers
- conselho-superior-da-justica-do-trabalho
- tribunal-regional-do-trabalho-da-8a-regiao
- 3a-vara-do-trabalho-de-parauapebas
- judicial-system-of-brazil
- brazilian-labor-courts
Alleged Developers
- tribunal-regional-do-trabalho-da-4a-regiao
- conselho-superior-da-justica-do-trabalho
Harmed Parties
- epistemic-integrity
- judicial-integrity
- judicial-system-of-brazil
- brazilian-labor-courts
- defendants-in-brazilian-labor-cases
Classification
Risk Domain
Privacy & SecurityRisk Subdomain
2.2. AI system security vulnerabilities and attacks
MIT Risk Profile
Topics
Source
Related Incidents (Privacy & Security)
View all →Research Papers on This Topic
View all →StarCoder: may the source be with you!
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
LineVD: Statement-level Vulnerability Detection using Graph Neural Networks
TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.
Open Source
View all →flair
flairNLP/flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
⭐ 14,353
PySyft
OpenMined/PySyft
Perform data science on data that remains in someone else's server
⭐ 10,041
FATE
FederatedAI/FATE
An Industrial Grade Federated Learning Framework
⭐ 6,100
adversarial-robustness-toolbox