AI2030 Responsible AI Tools Marketplace

Key Takeaways

"Trustworthy AI" is not the same as "Responsible" or "Ethical AI": The paper argues these terms should not be used interchangeably, as conflating them creates confusion in both regulatory and engineering contexts. The authors recommend abandoning substitute terminology to achieve clarity in how organizations approach AI governance.
A universal TAI framework is impossible; focus on specific attributes instead: Rather than developing one-size-fits-all standards, the paper advocates for approaches that address key properties individually—including fairness, bias, risk, security, explainability, and reliability—recognizing that trustworthiness is inherently subjective and complex.
Risk assessment is the cornerstone of AI regulation: The paper identifies risk as a central factor across regulatory frameworks, citing the EU-AI Act as an example where organizations must evaluate their AI products' risk levels to comply with regulations or face significant penalties, making risk-based governance essential.
Geopolitical differences create compliance challenges for global companies: Regulations differ substantially across the EU, China, and the USA based on geographical and geopolitical factors, creating additional complexity for multinational organizations attempting to deploy trustworthy AI systems across borders.
Effective TAI requires cross-functional collaboration, not a "brute force" approach: The paper emphasizes that implementing trustworthy AI through siloed efforts undermines efficiency and agility, proposing instead the Set-Formalize-Measure-Act (SFMA) framework to coordinate multiple teams in a structured, pragmatic process.

Abstract

This paper reviews Trustworthy Artificial Intelligence (TAI) and its various definitions. Considering the principles respected in any society, TAI is often characterized by a few attributes, some of which have led to confusion in regulatory or engineering contexts. We argue against using terms such as Responsible or Ethical AI as substitutes for TAI. And to help clarify any confusion, we suggest leaving them behind. Given the subjectivity and complexity inherent in TAI, developing a universal framework is deemed infeasible. Instead, we advocate for approaches centered on addressing key attributes and properties such as fairness, bias, risk, security, explainability, and reliability. We examine the ongoing regulatory landscape, with a focus on initiatives in the EU, China, and the USA. We recognize that differences in AI regulations based on geopolitical and geographical reasons pose an additional challenge for multinational companies. We identify risk as a core factor in AI regulation and TAI. For example, as outlined in the EU-AI Act, organizations must gauge the risk level of their AI products to act accordingly (or risk hefty fines). We compare modalities of TAI implementation and how multiple cross-functional teams are engaged in the overall process. Thus, a brute force approach for enacting TAI renders its efficiency and agility, moot. To address this, we introduce our framework Set-Formalize-Measure-Act (SFMA). Our solution highlights the importance of transforming TAI-aware metrics, drivers of TAI, stakeholders, and business/legal requirements into actual benchmarks or tests. Finally, over-regulation driven by panic of powerful AI models can, in fact, harm TAI too. Based on GitHub user-activity data, in 2023, AI open-source projects rose to top projects by contributor account. Enabling innovation in TAI hinges on the independent contributions of the open-source community.

Updates: Added disclaimer about USA's recent U-turn on Trustworthy AI Executive Order. Improved Fairness and Group size in section 6.5. Fixed typos. Added a few new references. Updated title

Key Takeaways

"Trustworthy AI" is not the same as "Responsible" or "Ethical AI": The paper argues these terms should not be used interchangeably, as conflating them creates confusion in both regulatory and engineering contexts. The authors recommend abandoning substitute terminology to achieve clarity in how organizations approach AI governance.
A universal TAI framework is impossible; focus on specific attributes instead: Rather than developing one-size-fits-all standards, the paper advocates for approaches that address key properties individually—including fairness, bias, risk, security, explainability, and reliability—recognizing that trustworthiness is inherently subjective and complex.
Risk assessment is the cornerstone of AI regulation: The paper identifies risk as a central factor across regulatory frameworks, citing the EU-AI Act as an example where organizations must evaluate their AI products' risk levels to comply with regulations or face significant penalties, making risk-based governance essential.
Geopolitical differences create compliance challenges for global companies: Regulations differ substantially across the EU, China, and the USA based on geographical and geopolitical factors, creating additional complexity for multinational organizations attempting to deploy trustworthy AI systems across borders.
Effective TAI requires cross-functional collaboration, not a "brute force" approach: The paper emphasizes that implementing trustworthy AI through siloed efforts undermines efficiency and agility, proposing instead the Set-Formalize-Measure-Act (SFMA) framework to coordinate multiple teams in a structured, pragmatic process.

Abstract

Updates: Added disclaimer about USA's recent U-turn on Trustworthy AI Executive Order. Improved Fairness and Group size in section 6.5. Fixed typos. Added a few new references. Updated title

The Journey to Trustworthy AI: Pursuit of Pragmatic Frameworks

Key Takeaways

Abstract

Paper Info

Responsible AI Topics

Links

The Journey to Trustworthy AI: Pursuit of Pragmatic Frameworks

Key Takeaways

Abstract

Paper Info

Responsible AI Topics

Links