Text to Video: The Next Leap in AI Generation
The a16z Show20 Des 2023

Text to Video: The Next Leap in AI Generation

General Partner Anjney Midha explores the cutting-edge world of text-to-video AI with AI researchers Andreas Blattmann and Robin Rombach.

Released in November, Stable Video Diffusion is their latest open-source generative video model, overcoming challenges in size and dynamic representation.

In this episode Robin and Andreas share why translating text to video is complex, the key role of datasets, current applications, and the future of video editing.

Topics Covered:

00:00 - Text to Video: The Next Leap in AI Generation

02:41 - The Stable Diffusion backstory

04:25 - Diffusion vs autoregressive models

06:09 - The benefits of single step sampling

09:15 - Why generative video?

11:19 - Understanding physics through AI video

12:20 - The challenge of creating generative video

15:36 - Data set selection and training

17:50 - Structural consistency and 3D objects

19:50 - Incorporating LoRAs

21:24 - How should creators think about these tools?

23:46 - Open challenges in video generation

25:42 - Infrastructure challenges and future research

Resources:

Find Robin on Twitter: https://twitter.com/robrombach

Find Andreas on Twitter: https://twitter.com/andi_blatt

Find Anjney on Twitter: https://twitter.com/anjneymidha

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

Emil Michael: Iran, Anthropic and the Future of AI at the Pentagon

Emil Michael: Iran, Anthropic and the Future of AI at the Pentagon

This conversation with Emil Michael, undersecretary of defense for research and engineering and acting director of the Defense Innovation Unit, was recorded at the a16z American Dynamism Summit in Was...

13 Mar 27min

Palantir CEO Alex Karp on the Zero-Sum AI Race

Palantir CEO Alex Karp on the Zero-Sum AI Race

This conversation with Alex Karp, cofounder and CEO of Palantir, was recorded at the a16z American Dynamism Summit in Washington, D.C. Karp discusses the role of technology in modern warfare, Silicon ...

12 Mar 32min

What It Takes to Clear a Million Crimes a Year with Flock Safety's CEO

What It Takes to Clear a Million Crimes a Year with Flock Safety's CEO

In this episode, previously aired on Cheeky Pint, Garrett Langley describes how a stolen gun in his Atlanta neighborhood led him to build Flock Safety, now deployed in more than 6,000 cities and invol...

11 Mar 1h 46min

The Top 100 Gen AI Consumer Apps

The Top 100 Gen AI Consumer Apps

Anish Acharya speaks with Olivia Moore about the latest edition of the a16z Top 100 AI Apps report. They cover why ChatGPT is still 30 times bigger than Claude on web, how the three major platforms ar...

10 Mar 40min

Andrew Huberman: Peptides, Sleep Tech, and the End of Obesity

Andrew Huberman: Peptides, Sleep Tech, and the End of Obesity

Daisy Wolf speaks with Dr. Andrew Huberman, professor of neurobiology and ophthalmology at Stanford University and host of the Huberman Lab podcast. They discuss how the pandemic sparked a consumer he...

9 Mar 51min

Atlassian CEO on the SaaS Apocalypse, AI Agents & What Comes Next

Atlassian CEO on the SaaS Apocalypse, AI Agents & What Comes Next

Alex Rampell and Erik Torenberg speak with Mike Cannon-Brookes, cofounder and CEO of Atlassian, about how to make sense of the SaaS selloff, why not all software companies face the same AI-driven risk...

6 Mar 55min

Ben Thompson: Anthropic, the Pentagon, and the Limits of Private Power

Ben Thompson: Anthropic, the Pentagon, and the Limits of Private Power

In this conversation, previously aired on TBPN, John Coogan and Jordi Hays speak with Ben Thompson, founder of Stratechery, about his essay "Anthropic and Alignment" and the broader collision between ...

5 Mar 36min

Deploying AI in Healthcare

Deploying AI in Healthcare

a16z general partner Julie Yoo talks with Nikhil Buduma, CEO and cofounder of Ambience Healthcare, to discuss how AI is transforming clinical workflows. They cover the early days of deep learning, why...

4 Mar 49min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
finansredaksjonen
pengesnakk
pengepodden-2
tid-er-penger-en-podcast-med-peter-warren
rss-sunn-okonomi
utbytte
morgenkaffen-med-finansavisen
livet-pa-veien-med-jan-erik-larssen
stormkast-med-valebrokk-stordalen
rss-markedspuls-2
lederpodden
liberal-halvtime
rss-politisk-preik
okonomiamatorene