The True Cost of Compute
The a16z Show7 Aug 2023

The True Cost of Compute

With software becoming more important than ever, hardware is following suit.

As the world generates more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.

But how much does this all really cost? In this final segment of our AI hardware series, we tackle that question head on.

Be sure to check part 1 and 2, where we explore the emerging architectures and the momentous competition for AI hardware.

Topics Covered:

00:00 – The cost of compute

02:20 – Is this sustainable?

03:23 – The cost to train a model

05:39 – Computation requirements

09:05 – The relationship between compute, capital, and technology

11:15 – GPT4 commenting on the technology with help from ElevenLabs

Resources:

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

The State of American AI Policy: From ‘Pause AI’ to ‘Build’

The State of American AI Policy: From ‘Pause AI’ to ‘Build’

a16z General Partners Martin Casado and Anjney Midha join Erik Torenberg to unpack one of the most dramatic shifts in tech policy in recent memory: the move from “pause AI” to “win the AI race.”They t...

15 Aug 202542min

H20s to China + 15% with Chris Miller and Lennart Heim

H20s to China + 15% with Chris Miller and Lennart Heim

We’re sharing an episode from ChinaTalk that dives into one of the biggest recent reversals in U.S. tech policy.The U.S. banned Nvidia’s H20 AI chips to China in April. Now, just months later, they’re...

14 Aug 20251h 6min

Grok, Genie 3, GPT-5 & the Rise of Vibe Coding

Grok, Genie 3, GPT-5 & the Rise of Vibe Coding

a16z partners Olivia and Justine Moore unpack the latest in consumer AI including: - Grok’s “Imagine” and its instant, social-first creative tools- Google’s Genie 3 and the future of 3D worlds- GPT-5:...

13 Aug 202527min

Alex Danco on Speechwriting, Blogging, and Giving Founders Power

Alex Danco on Speechwriting, Blogging, and Giving Founders Power

Fresh off the announcement of his move from Shopify to a16z, Alex Danco joins TBPN to talk about the “trade deal” that brought him here and his mission to make the firm’s written content truly world c...

13 Aug 202515min

Steven Sinofsky & Balaji Srinivasan on the Future of AI, Tech, & the Global World Order

Steven Sinofsky & Balaji Srinivasan on the Future of AI, Tech, & the Global World Order

There’s been a wave of M&A deals lately - Meta and Scale, Windsurf and Google - and a lot of it points to something bigger: how regulation, capital, and innovation are colliding in 2025.In this episod...

11 Aug 20251h 17min

Marc Andreessen: Why Perfect Products Become Obsolete

Marc Andreessen: Why Perfect Products Become Obsolete

In this episode, Marc Andreessen joins TBPN for an unfiltered conversation spanning everything from ads in LLMs to why Apple’s AI strategy may be risky for anyone not named Apple.Marc breaks down the ...

8 Aug 202537min

GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim

GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim

ChatGPT-5 just launched, marking a major milestone for OpenAI and the entire AI ecosystem.Fresh off the live stream, Erik Torenberg was joined in the studio by  three people who played key roles in ma...

8 Aug 202543min

How to Build a Successful Company in an Era of Disruption

How to Build a Successful Company in an Era of Disruption

What happens when a startup becomes a giant—and then has to reinvent itself all over again?In this episode, Martin Casado sits down with Raghu Raghuram (former CEO of VMware) and Jeetu Patel (Presiden...

6 Aug 202542min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
rss-penger-polser-og-politikk
e24-podden
rss-borsmorgen-okonominyhetene
livet-pa-veien-med-jan-erik-larssen
pengepodden-2
tid-er-penger-en-podcast-med-peter-warren
pengesnakk
utbytte
rss-sunn-okonomi
finansredaksjonen
morgenkaffen-med-finansavisen
lederpodden
rss-markedspuls-2
lederskap-nhhs-podkast-om-ledelse
stormkast-med-valebrokk-stordalen
liberal-halvtime
arcticpodden