The True Cost of Compute
The a16z Show7 Aug 2023

The True Cost of Compute

With software becoming more important than ever, hardware is following suit.

As the world generates more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.

But how much does this all really cost? In this final segment of our AI hardware series, we tackle that question head on.

Be sure to check part 1 and 2, where we explore the emerging architectures and the momentous competition for AI hardware.

Topics Covered:

00:00 – The cost of compute

02:20 – Is this sustainable?

03:23 – The cost to train a model

05:39 – Computation requirements

09:05 – The relationship between compute, capital, and technology

11:15 – GPT4 commenting on the technology with help from ElevenLabs

Resources:

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

a16z Podcast: Exploding the Map

a16z Podcast: Exploding the Map

with Wei Luo, David Rumsey (@davidrumseymaps), and Hanne Tidnam (@omnivorousread) In this episode, Wei Luo, founding COO of DeepMap -- who build HD maps for autonomous vehicles -- and David Rumsey, fo...

16 Sep 201738min

a16z Podcast: Getting Applications Into People's Hands

a16z Podcast: Getting Applications Into People's Hands

with Juan Benet and Chris Dixon The story of how innovation happens is a long one — from government funding early basic research, to the heyday of corporate R&D like Bell Labs, to startups as experime...

15 Sep 201721min

a16z Podcast: The Asshole Survival Guide

a16z Podcast: The Asshole Survival Guide

with Michael Dearing (@mcgd), Bob Sutton (@work_matters), and Hanne Tidnam (@omnivorousread) Bob Sutton's book The No Asshole Rule was all about how to foster company cultures that don't tolerate assh...

13 Sep 201734min

a16z Podcast: Adjusting to Trade... and Innovation

a16z Podcast: Adjusting to Trade... and Innovation

with Russ Roberts, Noah Smith, and Sonal Chokshi Beyond the overly simplistic framing of trade as “good” or “bad” — by politicians, by Econ 101 — why is the topic of trade (or rather, economies and pe...

10 Sep 201738min

a16z Podcast: The Macro and Micro of Parenting

a16z Podcast: The Macro and Micro of Parenting

We tend to talk about tech and parenting through devices and artifacts -- screen time, to code or not to code -- but actually, there's a bigger, macro picture at play there: game theory, economic ince...

5 Sep 201729min

a16z Podcast: Competing Against Luck

a16z Podcast: Competing Against Luck

with Clayton Christensen, Marc Andreessen, and Steven Levy In business, mistakes of omission may be just as bad as (if not worse than) mistakes of commission -- simply because of the loss in potential...

2 Sep 201737min

a16z Podcast: Engineering Intent

a16z Podcast: Engineering Intent

"Young hungry and scrappy" is how Hamilton described his country, and it's how many -- including the guests on this episode -- describe startups... or more precisely, the mindset that engineers in sta...

30 Aug 201728min

a16z Podcast: A Society Under Construction - Modernizing Infrastructure

a16z Podcast: A Society Under Construction - Modernizing Infrastructure

What is "infrastructure" actually? In the 19th and 20th century, that usually meant the transportation systems supporting roadways, airports, trains... but we don't even really know yet what it might ...

25 Aug 201722min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
pengesnakk
pengepodden-2
utbytte
finansredaksjonen
livet-pa-veien-med-jan-erik-larssen
tid-er-penger-en-podcast-med-peter-warren
rss-sunn-okonomi
morgenkaffen-med-finansavisen
lederpodden
okonomiamatorene
rss-markedspuls-2
rss-andelige-tanker-med-camillo
rss-fa-makro
rss-investering-gjort-enkelt