The True Cost of Compute
The a16z Show7 Aug 2023

The True Cost of Compute

With software becoming more important than ever, hardware is following suit.

As the world generates more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.

But how much does this all really cost? In this final segment of our AI hardware series, we tackle that question head on.

Be sure to check part 1 and 2, where we explore the emerging architectures and the momentous competition for AI hardware.

Topics Covered:

00:00 – The cost of compute

02:20 – Is this sustainable?

03:23 – The cost to train a model

05:39 – Computation requirements

09:05 – The relationship between compute, capital, and technology

11:15 – GPT4 commenting on the technology with help from ElevenLabs

Resources:

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Avsnitt(1000)

a16z Podcast: Coding as Literacy

a16z Podcast: Coding as Literacy

Tracy Chou from Pinterest, and Chris Granger and Jamie Brandon from Eve, discuss whether coding is a literacy (or as Granger puts it, a "superpower" ). But as software infuses every industry and much ...

19 Jan 201524min

a16z Podcast: The Technology is Ready, So Where is the Internet of Things?

a16z Podcast: The Technology is Ready, So Where is the Internet of Things?

Does your burglar alarm need to speak to your thermostat? What about your lighting system? And if all those things need to interoperate, how does that happen -- and what does that look like on the she...

9 Jan 201518min

a16z Podcast: Dumb Storage Gets Smart

a16z Podcast: Dumb Storage Gets Smart

Storage as a set of technologies in the datacenter has a conservative reputation when it comes to innovation. Reliability, capacity, speed, and cost -- those have long been the only levers to pull in ...

19 Dec 201421min

a16z Podcast: Why the Datacenter Needs an Operating System

a16z Podcast: Why the Datacenter Needs an Operating System

What does an operating system for today's datacenter look like? Why do we even need one, and how does it function? Mesosphere's Benjamin Hindman, the co-creator of Apache Mesos, joins Steven Sinofsky ...

18 Dec 201431min

a16z Podcast: Enough with the Old Stuff -- Time for New Questions in Mobile

a16z Podcast: Enough with the Old Stuff -- Time for New Questions in Mobile

It's been a long and (at times) interesting battle pitching iOS vs. Android. It's time to let it go, says a16z's Benedict Evans. It's time to move on to a new set of questions -- and ideas -- in mobil...

17 Dec 201436min

a16z Podcast: Gateway Gadgets to the Internet of Things

a16z Podcast: Gateway Gadgets to the Internet of Things

The Internet of Things puts intelligence into all kinds of things -- especially in the home, from appliances to light bulbs and door locks. But we still have a ways to go. “We need to be very patient ...

13 Dec 201415min

a16z Podcast: Technology and the Opening of Myanmar

a16z Podcast: Technology and the Opening of Myanmar

After years of being shut off to the world -- Myanmar is opening itself up. Not just across physical borders, but also the digital. What happens when the vast majority of a population suddenly has acc...

8 Dec 201433min

a16z Podcast: If Coding is the New Literacy, How Can More People Code?

a16z Podcast: If Coding is the New Literacy, How Can More People Code?

Technology can be an equalizer, especially as new tools democratize the expertise that was previously held only by a limited few. But is coding really the new literacy -- the fourth “r” -- after read...

8 Dec 201435min

Populärt inom Business & ekonomi

badfluence
framgangspodden
varvet
rss-jossan-nina
rss-svart-marknad
rss-borsens-finest
avanzapodden
uppgang-och-fall
rss-dagen-med-di
fill-or-kill
lastbilspodden
rss-inga-dumma-fragor-om-pengar
rss-den-nya-ekonomin
bathina-en-podcast
dynastin
rss-kort-lang-analyspodden-fran-di
svd-tech-brief
bilar-med-sladd
24fragor
market-makers