Text to Video: The Next Leap in AI Generation
The a16z Show20 Joulu 2023

Text to Video: The Next Leap in AI Generation

General Partner Anjney Midha explores the cutting-edge world of text-to-video AI with AI researchers Andreas Blattmann and Robin Rombach.

Released in November, Stable Video Diffusion is their latest open-source generative video model, overcoming challenges in size and dynamic representation.

In this episode Robin and Andreas share why translating text to video is complex, the key role of datasets, current applications, and the future of video editing.

Topics Covered:

00:00 - Text to Video: The Next Leap in AI Generation

02:41 - The Stable Diffusion backstory

04:25 - Diffusion vs autoregressive models

06:09 - The benefits of single step sampling

09:15 - Why generative video?

11:19 - Understanding physics through AI video

12:20 - The challenge of creating generative video

15:36 - Data set selection and training

17:50 - Structural consistency and 3D objects

19:50 - Incorporating LoRAs

21:24 - How should creators think about these tools?

23:46 - Open challenges in video generation

25:42 - Infrastructure challenges and future research

Resources:

Find Robin on Twitter: https://twitter.com/robrombach

Find Andreas on Twitter: https://twitter.com/andi_blatt

Find Anjney on Twitter: https://twitter.com/anjneymidha

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(1000)

a16z Podcast: Crisis Communications

a16z Podcast: Crisis Communications

A crisis is an opportunity to change one's culture, to model scenarios and set up a crisis plan/process, to become a better company. But it's also a bit like therapy, from the act of asking probing qu...

13 Huhti 201733min

a16z Podcast: Monetizing Open Source (Or, All Enterprise Software)

a16z Podcast: Monetizing Open Source (Or, All Enterprise Software)

Here’s what we know about open source: Developers are the new buyers. Community matters. And there will never be another Red Hat (i.e., a successful “open core” business model … nor do we necessarily ...

11 Huhti 201729min

a16z Podcast: The Changing Culture of Open Source

a16z Podcast: The Changing Culture of Open Source

The culture of open source has changed across generations, from previous ones that had to fight for the brave new way -- to the current "GitHub generation" that not only accepts open source, but expec...

8 Huhti 201739min

a16z Podcast: Cryptocurrencies, App Coins, and Investing in Protocols

a16z Podcast: Cryptocurrencies, App Coins, and Investing in Protocols

Most of us have probably heard of bitcoin and ethereum -- but did you know there were 15 new cryptocurrencies launched this past month alone? How then do we know which protocols to invest in -- not ju...

3 Huhti 201732min

a16z Podcast: Eyes in the Sky

a16z Podcast: Eyes in the Sky

In this episode of the a16z Podcast recorded at our inaugural Summit, Jonathan Downey, CEO of Airware, Grant Jordan, CEO of Skysafe, and Kyle Russell, partner at a16z, discuss our future with “eyes in...

25 Maalis 201719min

a16z Podcast: From Hidden Figure to Sonic BOOM

a16z Podcast: From Hidden Figure to Sonic BOOM

An aerospace engineer who worked for NASA for over 40 years, Dr. Christine Darden is one of the mathematicians that the book and movie Hidden Figures was based on. Darden eventually would lead the son...

22 Maalis 201738min

a16z Podcast: The Storage Renaissance

a16z Podcast: The Storage Renaissance

As we enter a new era of distributed computing -- and of big data, in the form of machine and deep learning -- storage becomes (even more) important. It might not be sexy, but storage is what makes th...

21 Maalis 201722min

a16z Podcast: The Product Edge in Machine Learning Startups

a16z Podcast: The Product Edge in Machine Learning Startups

A lot of machine learning startups initially feel a bit of “impostor syndrome” around competing with big companies, because (the argument goes), those companies have all the data; surely we can’t beat...

17 Maalis 201721min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
rss-rahapodi
psykopodiaa-podcast
ostan-asuntoja-podcast
herrasmieshakkerit
rss-seuraava-potilas
rahapuhetta
rss-rahamania
rss-40-ajatusta-aanesta
rss-porssipuhetta
rss-merja-mahkan-rahat
rss-lahtijat
rss-20-30-40-podcast
rss-levosta-kasin-yrittajyys
rss-draivi
rss-ma
raksapodi
rss-laakispodi
rss-paasipodi