TrustworthinessSafetyAccountabilitycs.SE
Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars
Markus Borg
November 28, 2021
International Conference on Lean and Agile Software Development
13 citations
Key Takeaways
-
Notebook interfaces have inherent weaknesses that need addressing: The paper identifies that while Jupyter notebooks and similar tools are popular for machine learning development due to their experimental nature, they have built-in limitations. The authors propose solutions to help data scientists transition more easily from notebooks to integrated development environments (IDEs) for more robust development practices.
-
MLOps requires structural reinforcement for trustworthy AI: Drawing on engineering metaphors of "buttresses and rebars" (structural reinforcement elements), the paper argues that machine learning operations need strengthened engineering practices. This reinforcement is necessary because ML-based solutions are inherently dynamic and require continuous quality assurance throughout their lifecycle.
-
Agility and quality assurance must work together: The paper emphasizes that while agility is essential for machine learning development due to its experimental nature, it cannot come at the expense of quality. The authors propose that reinforced continuous engineering practices can maintain both the flexibility data scientists need and the trustworthiness that responsible AI systems require.
-
Current ML development practices need systematic improvement: The paper identifies that the engineering community faces significant challenges in developing machine learning solutions responsibly, suggesting that contemporary practices around notebooks and MLOps—while useful—require deliberate structural improvements to ensure AI systems are trustworthy and reliable.