Text to Video: The Next Leap in AI Generation
The a16z Show20 Des 2023

Text to Video: The Next Leap in AI Generation

General Partner Anjney Midha explores the cutting-edge world of text-to-video AI with AI researchers Andreas Blattmann and Robin Rombach.

Released in November, Stable Video Diffusion is their latest open-source generative video model, overcoming challenges in size and dynamic representation.

In this episode Robin and Andreas share why translating text to video is complex, the key role of datasets, current applications, and the future of video editing.

Topics Covered:

00:00 - Text to Video: The Next Leap in AI Generation

02:41 - The Stable Diffusion backstory

04:25 - Diffusion vs autoregressive models

06:09 - The benefits of single step sampling

09:15 - Why generative video?

11:19 - Understanding physics through AI video

12:20 - The challenge of creating generative video

15:36 - Data set selection and training

17:50 - Structural consistency and 3D objects

19:50 - Incorporating LoRAs

21:24 - How should creators think about these tools?

23:46 - Open challenges in video generation

25:42 - Infrastructure challenges and future research

Resources:

Find Robin on Twitter: https://twitter.com/robrombach

Find Andreas on Twitter: https://twitter.com/andi_blatt

Find Anjney on Twitter: https://twitter.com/anjneymidha

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(1000)

The Missing Infrastructure for AI Agents: Documents | Reducto’s Adit Abraham

The Missing Infrastructure for AI Agents: Documents | Reducto’s Adit Abraham

AI agents can reason over enormous amounts of information, but much of the world’s actual work is still trapped in PDFs, spreadsheets, scans, and other formats that models struggle to reliably underst...

21 Okt 38min

What Happens When Everyone Has a Health Expert in Their Pocket? | OpenAI’s Karan Singhal

What Happens When Everyone Has a Health Expert in Their Pocket? | OpenAI’s Karan Singhal

More than 300 million people use ChatGPT for health and wellness questions each week. OpenAI’s Karan Singhal thinks that’s only the beginning: the longer-term goal is AI that can help people navigate ...

20 Okt 55min

What Happens When Al Agents Can Spend Your Money?

What Happens When Al Agents Can Spend Your Money?

Why hasn't AI transformed everyday work as quickly as coding? Town CEO Jean-Denis Greze argues the bottleneck isn't intelligence, but making AI useful to people who don't have the time or technical sk...

19 Okt 1h 2min

Why Real-World AI Is Harder Than the Benchmark | EliseAI’s Mario Martone

Why Real-World AI Is Harder Than the Benchmark | EliseAI’s Mario Martone

What changes when an AI mistake doesn’t just hurt a benchmark score, but affects someone’s housing or healthcare? EliseAI Head of Applied Research Mario Martone argues that deploying AI in essential i...

18 Okt 24min

Why AI Could Finally Fix Healthcare Access | Zocdoc CEO Oliver Kharraz

Why AI Could Finally Fix Healthcare Access | Zocdoc CEO Oliver Kharraz

Why is booking a doctor's appointment still so difficult, and can AI finally change that? Zocdoc CEO Oliver Kharraz argues that the real problem isn't finding doctors, but connecting patients to accur...

17 Okt 34min

AI Can Write the Code. Can It Run the System? | Grepr CEO Jad Naous

AI Can Write the Code. Can It Run the System? | Grepr CEO Jad Naous

a16z General Partner Martin Casado sits down with Grepr CEO Jad Naous to ask what comes after AI learns to write code: can it also debug and operate the systems that code creates?Jad shares how AI has...

16 Okt 1h

When AI Agents Start Spending Your Money | Alex Rampell & Terry Angelos

When AI Agents Start Spending Your Money | Alex Rampell & Terry Angelos

a16z General Partner Alex Rampell sits down with VGS Executive Board Member, Terry Angelos, to unpack what happens to payments when AI agents go from recommending what to buy to actually making the pu...

15 Okt 51min

Can Open Models Keep Up With the AI Frontier? | Nathan Lambert

Can Open Models Keep Up With the AI Frontier? | Nathan Lambert

a16z Partner Lisha Li sits down with AI researcher and Trillium founder Nathan Lambert to ask how durable the gap really is between frontier AI labs and open models.Nathan argues that OpenAI and Anthr...

14 Okt 59min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
rss-skravla-gar
rss-pa-konto
livet-pa-veien-med-jan-erik-larssen
pengepodden-2
tid-er-penger-en-podcast-med-peter-warren
utbytte
pengesnakk
lederpodden
stormkast-med-valebrokk-stordalen
finansredaksjonen
morgenkaffen-med-finansavisen
rss-orjasater
rss-politisk-preik
rss-neste-generasjon-med-emilie-stordalen
liberal-halvtime