Don’t believe OpenAI’s “nonprofit” spin (emergency pod with Tyler Whitmer)

Don’t believe OpenAI’s “nonprofit” spin (emergency pod with Tyler Whitmer)

OpenAI’s recent announcement that its nonprofit would “retain control” of its for-profit business sounds reassuring. But this seemingly major concession, celebrated by so many, is in itself largely meaningless.

Litigator Tyler Whitmer is a coauthor of a newly published letter that describes this attempted sleight of hand and directs regulators on how to stop it.

As Tyler explains, the plan both before and after this announcement has been to convert OpenAI into a Delaware public benefit corporation (PBC) — and this alone will dramatically weaken the nonprofit’s ability to direct the business in pursuit of its charitable purpose: ensuring AGI is safe and “benefits all of humanity.”

Right now, the nonprofit directly controls the business. But were OpenAI to become a PBC, the nonprofit, rather than having its “hand on the lever,” would merely contribute to the decision of who does.

Why does this matter? Today, if OpenAI’s commercial arm were about to release an unhinged AI model that might make money but be bad for humanity, the nonprofit could directly intervene to stop it. In the proposed new structure, it likely couldn’t do much at all.

But it’s even worse than that: even if the nonprofit could select the PBC’s directors, those directors would have fundamentally different legal obligations from those of the nonprofit. A PBC director must balance public benefit with the interests of profit-driven shareholders — by default, they cannot legally prioritise public interest over profits, even if they and the controlling shareholder that appointed them want to do so.

As Tyler points out, there isn’t a single reported case of a shareholder successfully suing to enforce a PBC’s public benefit mission in the 10+ years since the Delaware PBC statute was enacted.

This extra step from the nonprofit to the PBC would also mean that the attorneys general of California and Delaware — who today are empowered to ensure the nonprofit pursues its mission — would find themselves powerless to act. These are probably not side effects but rather a Trojan horse for-profit investors are trying to slip past regulators.

Fortunately this can all be addressed — but it requires either the nonprofit board or the attorneys general of California and Delaware to promptly put their foot down and insist on watertight legal agreements that preserve OpenAI’s current governance safeguards and enforcement mechanisms.

As Tyler explains, the same arrangements that currently bind the OpenAI business have to be written into a new PBC’s certificate of incorporation — something that won’t happen by default and that powerful investors have every incentive to resist.

Full transcript and links to learn more: https://80k.info/tw

Chapters:
• Cold open (00:00:00)
• Who’s Tyler Whitmer? (00:01:34)
• The new plan may be no improvement (00:02:04)
• The public hasn't even been allowed to know what they are owed (00:06:56)
• Issues beyond control (00:11:06)
• The new directors wouldn’t have to pursue the current purpose (00:12:08)
• The nonprofit might not even retain voting control (00:17:01)
• The attorneys general could lose their enforcement oversight (00:22:15)
• By default things go badly (00:29:13)
• How to keep the mission in the restructure (00:32:29)
• What will become of OpenAI’s Charter? (00:37:16)
• Ways to make things better, and not just avoid them getting worse (00:42:20)
• How the AGs can avoid being disempowered (00:48:16)
• Retaining the power to fire the CEO (00:54:36)
• Will the current board get a financial stake in OpenAI? (00:57:23)
• Could the AGs insist the current nonprofit agreement be made public? (00:58:59)
• How OpenAI is valued should be transparent and scrutinised (01:00:46)
• Investors aren't bad people, but they can't be trusted either (01:05:54)

This episode was originally recorded on May 13, 2025.

Video editing: Simon Monsour and Luke Monsour
Audio engineering: Ben Cordell, Milo McGuire, Simon Monsour, and Dominic Armstrong
Music: Ben Cordell
Transcriptions and web: Katy Moore

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(364)

Luke Muehlhauser on the most important AI safety work nobody is doing

Luke Muehlhauser on the most important AI safety work nobody is doing

The US government spends 25 times more on military marching bands than on its AI safety institute. And that’s just one of the many institutions we’re missing as AI becomes more powerful and dangerous....

29 Okt 2h 36min

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Two-thirds of Americans think AI is moving too fast. So do the people building it. So why the hell isn’t anyone slowing down?We can’t tell when models are too dangerous. We mostly don’t know how they ...

27 Okt 21min

Tom Milton on how we could verify a US–China deal on AI

Tom Milton on how we could verify a US–China deal on AI

If the US and China agreed to pause frontier AI training, how would either side confirm the other was complying? Today, Tom Milton argues, the most likely answer would be to shut down data centres ent...

23 Okt 1h 48min

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

I have a plea for all staff at AI companies: reassess if your current role is still your best opportunity for impact. And if it’s not — move.Frontier lab staff listening to this show will mostly alrea...

21 Okt 14min

Introducing our new YouTube channel: Zershaaneh Talks AI

Introducing our new YouTube channel: Zershaaneh Talks AI

Our host Zershaaneh Qureshi has just launched a new YouTube channel: Zershaaneh Talks AI — featuring conversations about who should control AI, how to control AI, and who gets the benefits.The first e...

20 Okt 1min

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

The AI safety field has grown by about 30x in the last eight years. Yet it is still in need of more people. Many want to help, but don’t know where to start. As an advisor at 80,000 Hours, Matt Beard ...

15 Okt 18min

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

This is an (unpaid) cross-post of a video from the podcast 'AI Explained', which Rob Wiblin thought you might be interested in.You can find the original on YouTube here. If you like it and want more s...

9 Okt 40min

In 2023 Ajeya Cotra already knew what was coming (classic episode)

In 2023 Ajeya Cotra already knew what was coming (classic episode)

We're rereleasing some of older episodes that seem more relevant than ever with new rogue AI incidents now seemingly announced every day. Ajeya was one of three independent investigators into the Hugg...

8 Okt 2h 46min

Populært innen Fakta

fastlegen
dine-penger-pengeradet
fryktlos
relasjonspodden-med-dora-thorhallsdottir-kjersti-idem
rss-strid
foreldreradet
treningspodden
jakt-og-fiskepodden
rss-kunsten-a-leve
rss-bisarr-historie
rss-ekteskapet
sinnsyn
rss-orjasater
hverdagspsyken
gravid-uke-for-uke
rss-sarbar-med-lotte-erik
mikkels-paskenotter
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
rss-kull
branncast