Text to Video: The Next Leap in AI Generation
The a16z Show20 Dec 2023

Text to Video: The Next Leap in AI Generation

General Partner Anjney Midha explores the cutting-edge world of text-to-video AI with AI researchers Andreas Blattmann and Robin Rombach.

Released in November, Stable Video Diffusion is their latest open-source generative video model, overcoming challenges in size and dynamic representation.

In this episode Robin and Andreas share why translating text to video is complex, the key role of datasets, current applications, and the future of video editing.

Topics Covered:

00:00 - Text to Video: The Next Leap in AI Generation

02:41 - The Stable Diffusion backstory

04:25 - Diffusion vs autoregressive models

06:09 - The benefits of single step sampling

09:15 - Why generative video?

11:19 - Understanding physics through AI video

12:20 - The challenge of creating generative video

15:36 - Data set selection and training

17:50 - Structural consistency and 3D objects

19:50 - Incorporating LoRAs

21:24 - How should creators think about these tools?

23:46 - Open challenges in video generation

25:42 - Infrastructure challenges and future research

Resources:

Find Robin on Twitter: https://twitter.com/robrombach

Find Andreas on Twitter: https://twitter.com/andi_blatt

Find Anjney on Twitter: https://twitter.com/anjneymidha

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Avsnitt(1000)

Why Speed, Not Size, Will Define the Next War

Why Speed, Not Size, Will Define the Next War

As global tensions rise, AI and autonomy are transforming how nations prepare for conflict. In this episode, Horacio Rozanski, CEO of Booz Allen Hamilton and Gary Steele, CEO of Shield AI join Erik To...

1 Nov 202539min

Beyond Chatbots: Marc Andreessen and Ben Horowitz on AI's Future

Beyond Chatbots: Marc Andreessen and Ben Horowitz on AI's Future

In this closing keynote from a16z’s Runtime conference, General Partner Erik Torenberg speaks with our firm’s cofounders, Marc Andreessen and Ben Horowitz on highlights from throughout the conference,...

31 Okt 202538min

"Is there an AI bubble?” Gavin Baker and David George

"Is there an AI bubble?” Gavin Baker and David George

In this conversation from a16z’s Runtime conference, Gavin Baker, Managing Partner and CIO of Atreides Management, joins David George, General Partner at a16z, to unpack the macro view of AI: the tril...

30 Okt 202531min

Building the Real-World Infrastructure for AI, with Google, Cisco & a16z

Building the Real-World Infrastructure for AI, with Google, Cisco & a16z

AI isn’t just changing software, it’s causing the biggest buildout of physical infrastructure in modern history.In this episode, Raghu Raghuram (a16z) speaks with Amin Vahdat, VP and GM of AI and Infr...

29 Okt 202532min

Google DeepMind Developers: How Nano Banana Was Made

Google DeepMind Developers: How Nano Banana Was Made

Google DeepMind’s new image model Nano Banana took the internet by storm.In this episode, we sit down with Principal Scientist Oliver Wang and Group Product Manager Nicole Brichtova to discuss how Nan...

28 Okt 202554min

Raghu Raghuram: AI, Robotics, and the Rebirth of Infrastructure

Raghu Raghuram: AI, Robotics, and the Rebirth of Infrastructure

From Netscape to VMware, Raghu Raghuram has been at the center of nearly every major inflection point in enterprise technology.In this episode, Raghu joins Ben Horowitz, Martin Casado and David George...

27 Okt 202530min

Marc Andreessen: How Movies Explain America

Marc Andreessen: How Movies Explain America

In this episode of Monitoring the Situation, Marc Andreessen, Katherine Boyle, and Erik Torenberg dive into the movies that best explain America, from Once Upon a Time in Hollywood to Tropic Thunder t...

24 Okt 20251h 15min

Marc Andreessen and Amjad Masad: English As the New Programming Language

Marc Andreessen and Amjad Masad: English As the New Programming Language

Amjad Masad, founder and CEO of Replit, joins a16z’s Marc Andreessen and Erik Torenberg to discuss the new world of AI agents, the future of programming, and how software itself is beginning to build ...

23 Okt 20251h 11min

Populärt inom Business & ekonomi

framgangspodden
varvet
rss-jossan-nina
rss-borsens-finest
rss-svart-marknad
badfluence
avanzapodden
uppgang-och-fall
svd-tech-brief
rss-kort-lang-analyspodden-fran-di
fill-or-kill
rss-dagen-med-di
lastbilspodden
tabberaset
bathina-en-podcast
24fragor
kapitalet-en-podd-om-ekonomi
rss-inga-dumma-fragor-om-pengar
rikatillsammans-om-privatekonomi-rikedom-i-livet
dynastin