The True Cost of Compute
The a16z Show7 Aug 2023

The True Cost of Compute

With software becoming more important than ever, hardware is following suit.

As the world generates more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.

But how much does this all really cost? In this final segment of our AI hardware series, we tackle that question head on.

Be sure to check part 1 and 2, where we explore the emerging architectures and the momentous competition for AI hardware.

Topics Covered:

00:00 – The cost of compute

02:20 – Is this sustainable?

03:23 – The cost to train a model

05:39 – Computation requirements

09:05 – The relationship between compute, capital, and technology

11:15 – GPT4 commenting on the technology with help from ElevenLabs

Resources:

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

a16z Podcast: The Asshole Survival Guide

a16z Podcast: The Asshole Survival Guide

with Michael Dearing (@mcgd), Bob Sutton (@work_matters), and Hanne Tidnam (@omnivorousread) Bob Sutton's book The No Asshole Rule was all about how to foster company cultures that don't tolerate assh...

13 Sep 201734min

a16z Podcast: Adjusting to Trade... and Innovation

a16z Podcast: Adjusting to Trade... and Innovation

with Russ Roberts, Noah Smith, and Sonal Chokshi Beyond the overly simplistic framing of trade as “good” or “bad” — by politicians, by Econ 101 — why is the topic of trade (or rather, economies and pe...

10 Sep 201738min

a16z Podcast: The Macro and Micro of Parenting

a16z Podcast: The Macro and Micro of Parenting

We tend to talk about tech and parenting through devices and artifacts -- screen time, to code or not to code -- but actually, there's a bigger, macro picture at play there: game theory, economic ince...

5 Sep 201729min

a16z Podcast: Competing Against Luck

a16z Podcast: Competing Against Luck

with Clayton Christensen, Marc Andreessen, and Steven Levy In business, mistakes of omission may be just as bad as (if not worse than) mistakes of commission -- simply because of the loss in potential...

2 Sep 201737min

a16z Podcast: Engineering Intent

a16z Podcast: Engineering Intent

"Young hungry and scrappy" is how Hamilton described his country, and it's how many -- including the guests on this episode -- describe startups... or more precisely, the mindset that engineers in sta...

30 Aug 201728min

a16z Podcast: A Society Under Construction - Modernizing Infrastructure

a16z Podcast: A Society Under Construction - Modernizing Infrastructure

What is "infrastructure" actually? In the 19th and 20th century, that usually meant the transportation systems supporting roadways, airports, trains... but we don't even really know yet what it might ...

25 Aug 201722min

a16z Podcast: Cash, Growth, and CEO ❤️  CFO

a16z Podcast: Cash, Growth, and CEO ❤️ CFO

with Ben Horowitz, Scott Kupor, and Caroline Moon “The only unforgivable sin in business is to run out of cash” [so said Harold Geneen], yet startup CEOs “always act on leading indicators of good news...

25 Aug 201719min

a16z Podcast: The Taxonomy of Collective Knowledge

a16z Podcast: The Taxonomy of Collective Knowledge

What do disease diagnostics, language learning, and image recognition have in common? All depend on the organization of collective intelligence: data ontologies. In this episode of the a16z Podcast, g...

15 Aug 201726min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
rss-penger-polser-og-politikk
e24-podden
rss-borsmorgen-okonominyhetene
pengepodden-2
finansredaksjonen
utbytte
livet-pa-veien-med-jan-erik-larssen
rss-sunn-okonomi
pengesnakk
tid-er-penger-en-podcast-med-peter-warren
morgenkaffen-med-finansavisen
okonomiamatorene
stormkast-med-valebrokk-stordalen
lederpodden
liberal-halvtime
rss-markedspuls-2
lederskap-nhhs-podkast-om-ledelse