Anjney Midha's Plan to Radically Lower the Price of Compute

Anjney Midha wrote the first check to Anthropic. He teaches a viral course at Stanford on how AI works. And he was, until recently, a partner at a16z. In other words, he is AI-industry royalty. Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute. To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility. But right now, compute is too fragmented. It's too heterogeneous. And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused. In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky. On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization. He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.

Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots

Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots

See omnystudio.com/listener for privacy information.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(1253)

How a Sardine Gets From the Ocean to a Can

Just a decade ago, tinned fish was hardly a premium product. Most Americans likely associated cans of tuna with thrift. But that has changed a lot in recent years. The category took off during Covid a...

7 Aug 57min

Brad Setser on the US's Unusual Japanese Yen Intervention

Last week, the US joined forces with Japan to try to stop the yen’s slide. It’s the first time the two sides have intervened in the Japanese currency in 15 years, and in many ways it was an unpreceden...

6 Aug 42min

The Tungsten Market Is Warning of an Upcoming War

Bloomberg Opinion columnist David Fickling tells us you can think of tungsten mining as “a century old prediction market for war.” As he writes in a recent piece, tungsten is “a super-element that can...

3 Aug 44min

Why Private Credit Got Entangled With Insurance

Insurers have quietly become a major driver of the private credit boom, with numerous private equity shops striking deals with insurance companies or buying them outright. But the entanglement with pr...

31 Jul 51min

How the Iranian Economy Actually Works

After the Iranian Revolution of 1979, the country's new leaders — religious and political — promised to redistribute the country's wealth and made moves to make Iran independent from western influence...

30 Jul 57min

Branko Milanovic on What Comes After Globalization

It's pretty obvious by now that globalization has fallen out of favor. And while many pundits have deemed economic globalism dead, we are still figuring out what to call this new era. Branko Milanovic...

27 Jul 1h 1min

How Financial Advisors Can Grow During the Great Wealth Transfer (Sponsored Content)

Over the next two decades, more than $100 trillion will change hands in the greatest wealth transfer in history. This is a massive opportunity for financial advisors, both new and established. This co...

26 Jul 17min

How Franchise Restaurants Opened the Door to the Gig Economy

When the fast food industry began booming in the 1950s, it did so via a new business model known as the franchise. This model allowed independent operators to license trademarks from a business like M...

24 Jul 44min