Anjney Midha's Plan to Radically Lower the Price of Compute

Anjney Midha wrote the first check to Anthropic. He teaches a viral course at Stanford on how AI works. And he was, until recently, a partner at a16z. In other words, he is AI-industry royalty. Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute. To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility. But right now, compute is too fragmented. It's too heterogeneous. And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused. In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky. On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization. He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.

Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots

Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots

See omnystudio.com/listener for privacy information.

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(1274)

There's a Mind-Boggling Number of Rich People in America

In 2014, the economists Owen Zidar and Eric Zwick were asked by the Treasury to conduct a study on the tax burden of private business owners. It was tricky to figure out how much these sorts of busine...

18 Sep 59min

What Francis Fukuyama Is Seeing at 'The End of History'

Francis Fukuyama's essay “The End of History?” was published in the summer of 1989, a few months before the fall of the Berlin Wall. The essay's argument — that liberal democracy would not only defeat...

17 Sep 54min

OpenAI President Greg Brockman on Doing Business in the Wake of Hugging Face

According to OpenAI President Greg Brockman, the models that escaped their sandbox and hacked into Hugging Face's servers had yet to go through alignment training. That they were able to break free of...

14 Sep 1h 2min

Robert Friedland on the World's Monumental Shortage of Copper

Copper demand is booming, with the metal surging another 15% this year. Copper demand has always been tightly linked to economic activity, but now it's in overdrive, thanks to data centers, electric c...

12 Sep 1h 9min

Why Bridgewater's CIO Says AI's Human Extinction Risk Is Real

Greg Jensen was one of the earliest backers of both OpenAI and Anthropic, and at Bridgewater Associates, where he is the managing chief investment officer, he leads the hedge fund’s AI strategy. As an...

11 Sep 1h 5min

The Rise of Organized Retail Crime at Big Box Stores

If you walk into a local pharmacy in New York City, more likely than not, lots of the merchandise is locked behind closed doors as a measure to mitigate shoplifting. So how big is the “retail shrink” ...

10 Sep 52min

Why Money Launderers Love $100 Bills

Hardly anyone nowadays seems to carry much cash, never mind carrying around a bunch of $100 bills. So why does the amount of physical cash in circulation — especially big denominations like the $100 b...

7 Sep 54min

Why Laser Beams Are the Hottest New Tech in Defense

Our guest today is Colonel Sanders. More precisely, we speak with Wayne Sanders, a retired US army colonel who is currently senior defense research analyst for Bloomberg Intelligence. During his milit...

4 Sep 53min