The True Cost of Compute
The a16z Show7 Aug 2023

The True Cost of Compute

With software becoming more important than ever, hardware is following suit.

As the world generates more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.

But how much does this all really cost? In this final segment of our AI hardware series, we tackle that question head on.

Be sure to check part 1 and 2, where we explore the emerging architectures and the momentous competition for AI hardware.

Topics Covered:

00:00 – The cost of compute

02:20 – Is this sustainable?

03:23 – The cost to train a model

05:39 – Computation requirements

09:05 – The relationship between compute, capital, and technology

11:15 – GPT4 commenting on the technology with help from ElevenLabs

Resources:

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

a16z Podcast: Of Presidents, Policies, and Tech

a16z Podcast: Of Presidents, Policies, and Tech

How to think about tech policy and top-of-mind issues for the tech industry, given a new president? From what agencies matter for different tech domains -- e.g., autonomous cars, drones, fintech, heal...

21 Jan 201740min

a16z Podcast: Culture and/of Design

a16z Podcast: Culture and/of Design

"Mobile-first" (and now too AI-first) has been a mantra of sorts in design, but what does that mean at a company, product management, and competitive level? Especially when someone in company X will a...

18 Jan 201729min

a16z Podcast: Real Estate -- Ownership, Asset, Economy

a16z Podcast: Real Estate -- Ownership, Asset, Economy

The largest asset class in the United States is owner-occupied real estate, yet options for homeowners accessing this are very binary right now: either own 100% of your home (with a mortgage), or own ...

13 Jan 201729min

a16z Podcast: Machine Intelligence, from University to Industry

a16z Podcast: Machine Intelligence, from University to Industry

From the significance of Google DeepMind's AlphaGo wins to recent advances in "expert-level artificial intelligence" in playing an imperfect/ asymmetric information game like poker, toys and games hav...

11 Jan 201727min

a16z Podcast: New Year, New Horizons -- Pluto!

a16z Podcast: New Year, New Horizons -- Pluto!

What (on earth) does it take to get a signal to Pluto? Stanford senior scientist and astronomer Ivan Linscott, part of the team that ran the radio science experiment on the New Horizons probe, shares ...

1 Jan 201749min

a16z Podcast: The Movement of Money

a16z Podcast: The Movement of Money

As companies expand out from the internet into the rest of the economy — the proverbial bits to atoms — “the business models are becoming more complicated, more interesting, more payment based”, obser...

31 Des 201627min

a16z Podcast: The Realities of Aging / When Healthcare Is Local

a16z Podcast: The Realities of Aging / When Healthcare Is Local

As people live longer, aging is more top of mind than ever. This is especially true for the "sandwich generation" wedged between caring for aging parents as well as young children at the same time. Th...

27 Des 201631min

a16z Podcast: Mobility and the Global Refugee Crisis

a16z Podcast: Mobility and the Global Refugee Crisis

"We throw around words like 'crisis' very easily, but this is a global crisis, and it is of historic proportions," says current U.S. Deputy Secretary of State Tony Blinken about the refugee crisis (fo...

16 Des 201634min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
e24-podden
finansredaksjonen
pengepodden-2
pengesnakk
rss-sunn-okonomi
morgenkaffen-med-finansavisen
stormkast-med-valebrokk-stordalen
tid-er-penger-en-podcast-med-peter-warren
rss-markedspuls-2
livet-pa-veien-med-jan-erik-larssen
rss-investering-gjort-enkelt
utbytte
liberal-halvtime
okonomiamatorene
lederskap-nhhs-podkast-om-ledelse