How EleutherAI Trains and Releases LLMs: Interview with Stella Biderman

How EleutherAI Trains and Releases LLMs: Interview with Stella Biderman

On this episode, we’re joined by Stella Biderman, Executive Director at EleutherAI and Lead Scientist - Mathematician at Booz Allen Hamilton.

EleutherAI is a grassroots collective that enables open-source AI research and focuses on the development and interpretability of large language models (LLMs).

We discuss:

- How EleutherAI got its start and where it's headed.

- The similarities and differences between various LLMs.

- How to decide which model to use for your desired outcome.

- The benefits and challenges of reinforcement learning from human feedback.

- Details around pre-training and fine-tuning LLMs.

- Which types of GPUs are best when training LLMs.

- What separates EleutherAI from other companies training LLMs.

- Details around mechanistic interpretability.

- Why understanding what and how LLMs memorize is important.

- The importance of giving researchers and the public access to LLMs.

Stella Biderman - https://www.linkedin.com/in/stellabiderman/

EleutherAI - https://www.linkedin.com/company/eleutherai/

Resources:

- https://www.eleuther.ai/

Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation.


#OCR #DeepLearning #AI #Modeling #ML

Jaksot(134)

From No-Code to AI-Powered Apps with Airtable’s Howie Liu

From No-Code to AI-Powered Apps with Airtable’s Howie Liu

In this episode of Gradient Dissent, Howie Lou, CEO of Airtable, joins host Lukas Biewald to dive into Airtable's transformation from a no-code app builder to a platform capable of supporting complex ...

12 Syys 20241h 12min

Launching the Fastest AI Inference Solution with Cerebras Systems CEO Andrew Feldman

Launching the Fastest AI Inference Solution with Cerebras Systems CEO Andrew Feldman

In this episode of Gradient Dissent, Andrew Feldman, CEO of Cerebras Systems, joins host Lukas Biewald to discuss the latest advancements in AI inference technology. They explore Cerebras Systems' gro...

27 Elo 202453min

Reinventing AI Agents with Imbue CEO Kanjun Qiu

Reinventing AI Agents with Imbue CEO Kanjun Qiu

In this episode of Gradient Dissent, Kanjun Qiu, CEO and Co-founder of Imbue, joins host Lukas Biewald to discuss how AI agents are transforming code generation and software development. Discover the ...

8 Elo 202448min

From startup to $1.2B with Lambda’s Stephen Balaban

From startup to $1.2B with Lambda’s Stephen Balaban

In this episode of Gradient Dissent, Stephen Balaban, CEO of Lambda Labs, joins host Lukas Biewald to discuss the journey of scaling Lambda Labs to an impressive $400M in revenue. They explore the piv...

25 Heinä 202449min

Harnessing AI for legal practice with CoCounsel’s Jake Heller

Harnessing AI for legal practice with CoCounsel’s Jake Heller

In this episode of Gradient Dissent, Jake Heller, Head of Product, CoCounsel, joins host Lukas Biewald to discuss how AI is innovating legal practices and reshaping educational approaches for aspiring...

11 Heinä 20241h 4min

Transforming Search with Perplexity AI’s CTO Denis Yarats

Transforming Search with Perplexity AI’s CTO Denis Yarats

In this episode of Gradient Dissent, Denis Yarats, CTO of Perplexity, joins host Lukas Biewald to discuss the innovative use of AI in creating high-quality, fast search engine answers.Discover how Per...

20 Kesä 202443min

AI in electronics: Quilter’s journey in PCB design

AI in electronics: Quilter’s journey in PCB design

In this episode of Gradient Dissent, Sergiy Nesterenko, CEO of Quilter, joins host Lukas Biewald to discuss the groundbreaking use of reinforcement learning in PCB design. Learn how Quilter automates ...

6 Kesä 202443min

The Future of AI in Coding with Codeium CEO Varun Mohan

The Future of AI in Coding with Codeium CEO Varun Mohan

In this episode of Gradient Dissent, Varun Mohan, Co-Founder & CEO of Codeium, joins host Lukas Biewald to discuss the transformative power of AI in coding. They explore how Codeium evolved from GPU v...

23 Touko 202454min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
rss-rahapodi
psykopodiaa-podcast
herrasmieshakkerit
ostan-asuntoja-podcast
rahapuhetta
rss-rahamania
rss-lahtijat
rss-seuraava-potilas
leadcast
rss-merja-mahkan-rahat
rss-40-ajatusta-aanesta
rss-porssipuhetta
rss-levosta-kasin-yrittajyys
rss-sisalto-kuntoon
rss-vaikuttavan-opettajan-vierella
rss-ma
rss-bisneksen-pehmea-puoli
rss-draivi