Response to Office of the Privacy Commissioner of Canada Consultation Proposals pertaining to amendments to PIPEDA relative to Artificial Intelligence

AI systems should augment human judgment rather than replace trust: The paper emphasizes that AI should enhance human capacity for meaningful connections and decision-making, not substitute for the human trust relationships that underpin society. This distinction is critical for maintaining accountability in high-stakes decisions.

Code, not law, governs machine behavior: The document highlights a fundamental challenge in AI regulation—while humans are bound by legal frameworks and the rule of law, AI systems operate according to their programming. This gap requires new regulatory approaches to ensure AI systems comply with legal and ethical standards, particularly when deployed for important decisions.

Privacy legislation needs AI-specific amendments: The paper responds to 12 specific proposals from Canada's Office of the Privacy Commissioner for updating PIPEDA to address AI-related risks, indicating that existing privacy laws are insufficient for protecting individuals in an AI-driven landscape and require targeted legislative updates.

Public participation in AI governance is essential: By incorporating feedback from Montreal residents in their workshops (included as Schedule 1), the Montreal AI Ethics Institute demonstrates that responsible AI policy should include diverse public voices, not just technical experts, to ensure regulations reflect community values and concerns.

Socio-technical systems require holistic oversight: The paper suggests that regulating AI cannot focus solely on the technology itself; instead, regulators must consider how AI systems interact with human institutions, decision-making processes, and social structures to effectively protect individuals and maintain fairness.