Reference. Modularizing Reasoning about AI Capabilities via Abstract Dijkstra Monads [omar2024bastion]
- 2024
- Cyrus Omar, Patrick Ferris, Anil Madhavapeddy
- https://icfp24.sigplan.org/home/hope-2024
Abstract
- 2024
- Cyrus Omar, Patrick Ferris, Anil Madhavapeddy
The proposed talk will outline the vision for a recently originated research project aiming to build a formally verified prototype of a foundational "operating system" for safeguarded AI, called Bastion, that grounds these activities within programming language theory, namely by combining dependent type theory (as a practical general-purpose theory of computational structures and proofs), Dijkstra monads (as a flexible formalism for reasoning about an AI agent's computational effects), and abstract types (for modularizing reasoningto individual components that can be separately developed by various stakeholders, including AI safety researchers, formal methods experts, organizations of various scales, and governments seeking to develop actionable, specific policy).