Anjney Midha's Plan to Radically Lower the Price of Compute

Anjney Midha wrote the first check to Anthropic. He teaches a viral course at Stanford on how AI works. And he was, until recently, a partner at a16z. In other words, he is AI-industry royalty. Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute. To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility. But right now, compute is too fragmented. It's too heterogeneous. And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused. In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky. On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization. He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.

Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots

Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots

See omnystudio.com/listener for privacy information.

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(1227)

Jeremy Grantham on How to Tell If a Bubble Is About to Burst

Jeremy Grantham, co-founder and long-term strategist of GMO, has a long history of calling bubbles. As he recounts in his new memoir, The Making of a Permabear: The Perils of Long-Term Investing in a ...

18 Juni 59min

The Iran War’s Lasting Scars Across Asia

An interim deal to reopen the Strait of Hormuz offers relief, but Asia’s economic woes are far from over. Beyond the chokepoint, the conflict has forced long-lasting shifts in Asia’s food and energy f...

16 Juni 20min

Carmen Li's Plan to Build a Futures Market for Compute

When we spoke to DRW's Don Wilson last year, he talked about building out a GPU market that might be bigger than oil. Now, a year later, he is working with Carmen Li to do just that. Li is the CEO of ...

15 Juni 32min

How a Vibecoded Newsletter Is Making the Hay Market More Transparent

The hay market is not a transparent market: It is very fractured by types of hay, whether it is alfalfa or clover hay. There are a few opaque, illiquid markets like this — scrap metal for instance — t...

12 Juni 40min

Why Tomatoes Are the Most Expensive They've Been in Four Decades

In April, the price of tomatoes was around $2.69 per pound — the highest seen in some four decades. And tomatoes aren't the only food getting more expensive. From cauliflower to lettuce, fresh produce...

11 Juni 54min

How CoreWeave Sees the Market for Compute Right Now

When we last spoke to Brannin McBee, the co-founder and chief development officer of cloud company CoreWeave, his business was not yet public and sourcing GPUs was a key constraint on growth. But thre...

8 Juni 50min

Why Susquehanna Is Building a Prediction Markets Business

Prediction markets that enable you to bet on pretty much everything are everywhere nowadays. But there's still a big question over whether they can expand to include larger institutional investors lik...

6 Juni 31min