Anjney Midha's Plan to Radically Lower the Price of Compute

Anjney Midha wrote the first check to Anthropic. He teaches a viral course at Stanford on how AI works. And he was, until recently, a partner at a16z. In other words, he is AI-industry royalty. Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute. To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility. But right now, compute is too fragmented. It's too heterogeneous. And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused. In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky. On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization. He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.

Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots

Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots

See omnystudio.com/listener for privacy information.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(1274)

There's a Mind-Boggling Number of Rich People in America

In 2014, the economists Owen Zidar and Eric Zwick were asked by the Treasury to conduct a study on the tax burden of private business owners. It was tricky to figure out how much these sorts of busine...

18 Syys 59min

What Francis Fukuyama Is Seeing at 'The End of History'

Francis Fukuyama's essay “The End of History?” was published in the summer of 1989, a few months before the fall of the Berlin Wall. The essay's argument — that liberal democracy would not only defeat...

17 Syys 54min

OpenAI President Greg Brockman on Doing Business in the Wake of Hugging Face

According to OpenAI President Greg Brockman, the models that escaped their sandbox and hacked into Hugging Face's servers had yet to go through alignment training. That they were able to break free of...

14 Syys 1h 2min

Robert Friedland on the World's Monumental Shortage of Copper

Copper demand is booming, with the metal surging another 15% this year. Copper demand has always been tightly linked to economic activity, but now it's in overdrive, thanks to data centers, electric c...

12 Syys 1h 9min

Why Bridgewater's CIO Says AI's Human Extinction Risk Is Real

Greg Jensen was one of the earliest backers of both OpenAI and Anthropic, and at Bridgewater Associates, where he is the managing chief investment officer, he leads the hedge fund’s AI strategy. As an...

11 Syys 1h 5min

The Rise of Organized Retail Crime at Big Box Stores

If you walk into a local pharmacy in New York City, more likely than not, lots of the merchandise is locked behind closed doors as a measure to mitigate shoplifting. So how big is the “retail shrink” ...

10 Syys 52min

Why Money Launderers Love $100 Bills

Hardly anyone nowadays seems to carry much cash, never mind carrying around a bunch of $100 bills. So why does the amount of physical cash in circulation — especially big denominations like the $100 b...

7 Syys 54min

Why Laser Beams Are the Hottest New Tech in Defense

Our guest today is Colonel Sanders. More precisely, we speak with Wayne Sanders, a retired US army colonel who is currently senior defense research analyst for Bloomberg Intelligence. During his milit...

4 Syys 53min