The True Cost of Compute
The a16z Show7 Aug 2023

The True Cost of Compute

With software becoming more important than ever, hardware is following suit.

As the world generates more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.

But how much does this all really cost? In this final segment of our AI hardware series, we tackle that question head on.

Be sure to check part 1 and 2, where we explore the emerging architectures and the momentous competition for AI hardware.

Topics Covered:

00:00 – The cost of compute

02:20 – Is this sustainable?

03:23 – The cost to train a model

05:39 – Computation requirements

09:05 – The relationship between compute, capital, and technology

11:15 – GPT4 commenting on the technology with help from ElevenLabs

Resources:

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

DeepSeek: America’s Sputnik Moment for AI?

DeepSeek: America’s Sputnik Moment for AI?

Two words have caught the Internet by storm. DeepSeek. The Chinese reasoning model r1 is rivaling others at the frontier with an open-source MIT license, methods that some claim may be 45x more effici...

6 Feb 202543min

Ben Horowitz Sharing History with Dr. Clarence Jones, MLK's Speechwriter

Ben Horowitz Sharing History with Dr. Clarence Jones, MLK's Speechwriter

This week, a16z cofounder Ben Horowitz had a rare and invaluable conversation with Dr. Clarence B. Jones, a pivotal figure in American history. Dr. Jones, who served as speechwriter, attorney, and adv...

1 Feb 202555min

How AI Is Changing Warfare with Brian Schimpf, CEO of Anduril

How AI Is Changing Warfare with Brian Schimpf, CEO of Anduril

How is AI reshaping modern warfare? Speaking with a16z Growth General Partner David George, Anduril cofounder and CEO Brian Schimpf discusses how AI helps humans make better strategic decisions by sor...

28 Jan 202535min

RIP to RPA: How AI Makes Operations Work

RIP to RPA: How AI Makes Operations Work

Intelligent automation is transforming industries by tackling messy, unstructured workflows that traditional Robotic Process Automation (RPA) couldn’t handle. In this episode, a16z partner Kimberly Ta...

22 Jan 202517min

Marc Andreessen: Can Tech Finally Fix Healthcare?

Marc Andreessen: Can Tech Finally Fix Healthcare?

Healthcare is a $4 trillion industry, making up nearly a fifth of the U.S. economy—but despite having some of the best doctors and advanced technology, the system often delivers poor outcomes at skyro...

15 Jan 202532min

Building Substack: Reinventing Culture through Subscriptions

Building Substack: Reinventing Culture through Subscriptions

In this episode, Substack cofounder and CEO Chris Best joins a16z General Partner Andrew Chen to discuss the origins and evolution of Substack, a platform redefining media and empowering creators to c...

9 Jan 202536min

Crypto Trends for 2025: Stablecoins, App Stores, UX, and More

Crypto Trends for 2025: Stablecoins, App Stores, UX, and More

with @sambroner @meigga @darenmatsuoka @jneu_net @chrislyons and @rhhackett @smc90Welcome to our special end-of-year episodes -- which also look ahead to 2025 --  covering our annual Big Ideas lists, ...

3 Jan 202534min

Super Staffing Healthcare, Codifying Compliance, & Scaling Services

Super Staffing Healthcare, Codifying Compliance, & Scaling Services

As we prepare to step into 2025, the possibilities for applied AI are reshaping industries in profound ways. In this episode, a16z General Partners Julie Yoo and Angela Strange, and Partner Joe Schmid...

30 Des 202452min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
lydartikler-fra-aftenposten
e24-podden
rss-borsmorgen-okonominyhetene
rss-penger-polser-og-politikk
pengepodden-2
finansredaksjonen
utbytte
livet-pa-veien-med-jan-erik-larssen
rss-sunn-okonomi
morgenkaffen-med-finansavisen
okonomiamatorene
tid-er-penger-en-podcast-med-peter-warren
lederpodden
pengesnakk
liberal-halvtime
rss-investering-gjort-enkelt
rss-andelige-tanker-med-camillo
rss-markedspuls-2