Steve Omohundro: Regulating AGI: From Liability to Provable Contracts

2025-11-18

AGI will render today's liability-based AI regulation obsolete through its ability to circumvent cybersecurity, hide its origins, and act strategically—but it will also enable a new regulatory paradigm based on mathematically provable contracts.

This piece on the Windfall Trust Substack explores how theorem-proving capabilities can be harnessed to create trustworthy constraints on AI behavior, offering a path to guaranteed safe AI through technological rather than purely legal mechanisms.

Steve Omohundro is the Founder and CEO of Beneficial AI Research, which is working to ensure that artificial intelligence is safe and beneficial for humanity. Steve is a co-founding editor of SuperIntelligence.