Sam Lehman: What the Reinforcement Learning Renaissance Means for Decentralized AI

Sam Lehman: What the Reinforcement Learning Renaissance Means for Decentralized AI

Join Tommy Shaughnessy from Delphi Ventures as he hosts Sam Lehman, Principal at Symbolic Capital and AI researcher, for a deep dive into the Reinforcement Learning (RL) renaissance and its implications for decentralized AI. Sam recently authored a widely discussed post, "The World's RL Gym", exploring the evolution of AI scaling and the exciting potential of decentralized networks for training next-generation models.

The World’s RL Gym: https://www.symbolic.capital/writing/the-worlds-rl-gym



🎯 Key Highlights


The three phases of AI scaling: Pre-training, Inference Time Compute, and the RL Renaissance.

How DeepMind's novel RL approach (using GRPO) created powerful reasoning models with minimal human data.

Understanding "reasoning traces" and how models learn to "think" longer and more effectively.

The potential downsides of human preference data potentially inhibiting model creativity, drawing parallels to AlphaGo.

Exploring the "World's RL Gym" concept: Decentralizing RL through open environments, diverse tasks, and verified data.

Why open, collaborative RL environments might outperform closed-source labs in generating diverse AI strategies.

The critical role of high-quality base models for successful RL fine-tuning.

Future AI architectures: Continuous learning and the potential of modular Mixture-of-Experts (MoE) models.

Current landscape: Open-source vs. proprietary AI, the challenge of model lock-in, and the role of crypto networks.

Debunking recent claims that "RL is dead" and understanding its true impact.



💡 Want to stay updated with the latest in crypto & AI? Hit subscribe and the notification bell! 🔔



🧠 Follow the Alpha


Tommy's Twitter: @Shaughnessy119

Sam's Twitter: @SPLehman

Symbolic Capital’s Twitter: @symbolicvc



🔗 Connect with Delphi


🌐 Portal: https://delphidigital.io/

🐦 Twitter: https://twitter.com/delphi_digital

💼 LinkedIn: https://www.linkedin.com/company/delphi-digital



🎧 Listen on


Spotify: https://open.spotify.com/show/62PR1RigLG2YN5Pelq6UY9?si=18ac7ccf36ab4753

Apple Podcasts: https://podcasts.apple.com/us/podcast/the-delphi-podcast/id1438148082

Youtube: https://www.youtube.com/channel/UC9Yy99ZlQIX9-PdG_xHj43Q



Timestamps


00:00 - Introduction: Sam Lehman, Symbolic Capital & "The World's RL Gym"

01:30 - History of AI Scaling: Pre-training Era

03:30 - Phase 2: Inference Time Compute Scaling

09:30 - Phase 3: The RL Renaissance & DeepMind Moment

14:30 - How DeepMind Trained R1 without Human Preferences

16:30 - AlphaGo Analogy: Human Data Inhibiting Creativity?

20:30 - Generalizability of RL Training: How Far Does It Go?

22:30 - The "Aha Moment": Models Learning to Think Longer

25:30 - Concept: Decentralized RL & The World's Gym

31:30 - Why Decentralize RL? Open Collaboration vs. Closed Labs

35:00 - Understanding Reasoning Traces

39:00 - Current Decentralized RL Projects (Prime Intellect, General Reasoning)

41:30 - Future Architectures: Continuous Improvement & Modular Models

46:30 - Open Source vs. Proprietary AI: Landscape & Challenges

50:30 - The Lock-In Problem with Foundational Models

52:30 - Is AGI Here? Experiences with GPT-4o

56:30 - Investment Focus in Decentralized AI

59:00 - Modular MoE Models & Jensen's HDEE Paper

1:03:00 - Debunking "RL is Dead" Claims

1:06:00 - Importance of Performant Base Models for RL



Disclaimer


This podcast is strictly informational and educational and is not investment advice or a solicitation to buy or sell any tokens or securities or to make any financial decisions. Do not trade or invest in any project, tokens, or securities based upon this podcast episode. The host and members at Delphi Ventures may personally own tokens or art that are mentioned on the podcast. Our current show features paid sponsorships which may be featured at the start, middle, and/or the end of the episode. These sponsorships are for informational purposes only and are not a solicitation to use any product, service or token.

Avsnitt(468)

Tezos’ Jacob Arluck: The Future of Governance

Tezos’ Jacob Arluck: The Future of Governance

Host Tom Shaughnessy of 51pct.io is joined by Jacob Arluck, a governance research at Tezos. This is a timely episode since governance is becoming more and more important given recent events with Bitcoin Cash, Ethereum and of course with Tezos itself over the long term. Jacob gives us a complete rundown on how the innovative governance structure at Tezos works and compares it to Ethereum and Bitcoin. The discussion includes the importance of governance at the base blockchain layer, how this effects everything built on top (applications) and the problems with a bad governance structure.  Sign up for 51pct.io using coupon code "Token" while this offer lasts. Relevant Posts: Tezos Deep Dive: The Only Viable Ethereum Competitor In The Smart Contract War Ethereum’s Serenity: A Potential ~10x Increase In Demand For Gas and Increasing Scarcity Could Both Drive ETH’s Price Higher ----more----   Follow Tom on Twitter @Shaughnessy119 Follow Jacob on Twitter: @JacobArluck Jacob's post on Tezos' Amendment Process Tezos' Website   ----more----  51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode. Tom has no investment stake in Tezos or XTZ tokens. ----more---- Sign Up For 51percent's Leading Crypto Research ----more----   Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io   ----more----

13 Dec 201859min

Alpine’s Rocco and Jacob: Creative Token Destruction and Evolution

Alpine’s Rocco and Jacob: Creative Token Destruction and Evolution

Host Tom Shaughnessy of 51pct.io is joined by Gregory Rocco and Jacob Blish, two token designers and engineers as ConsenSys' Alpine Spoke. The conversation covers everything from the use cases and design of utility tokens, to designing for governance and positive incentives and even token doomsday scenarios. Sign up for 51pct.io using coupon code "Token" for 20% of for the next 24 hours. Topics covered include How the two design tokens for crypto projects How to decide which projects actually need a token The use cases of tokens (payments, voting, work, and representative) tokens. Why we don't need so many utility tokens, we can just use Ethereum. Convincing enterprises why shared infrastructure through token usage is the future, and convincing them how to use work tokens. Why Brave doesn't need its BAT token 0x Project and MakerDAO token dynamics The idea of futility tokens, and how projects that issued tokens that don't need them will pivot. designing tokens that offer real foundational governance How to design token governance the right way Doomsday scenarios; how changes to the base protocol of blockchains can negatively impact all of the decentralized applications and smart contracts built on top of it. We also detail Rocco's posts; The Death of Decentralization (the buzzword). How to design for decentralization Debating whether a project having a centralized leader is a good thing or a bad thing How to handle token voting.   ----more----   Follow Tom on Twitter @Shaughnessy119 Follow Rocco on Twitter @Obstropolos  Follow Jacob on Twitter @chaingenius ConsenSys' Website    ----more----  Sign Up For 51percent's Leading Crypto Research 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode. Tom has no investment stake in ConsenSys or PegaSys. ----more---- Sign Up For 51percent's Leading Crypto Research ----more----   Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io   ----more----

6 Dec 20181h 12min

PegaSys: Daniel and Faisal On The Future of Enterprise Ethereum

PegaSys: Daniel and Faisal On The Future of Enterprise Ethereum

Host Tom Shaughnessy of 51pct.io is joined by the PegaSys team, a spoke of ConsenSys focused on building Ethereum tech for the public-chain community and leading enterprises. The 50 person team is one of ConsenSys' largest teams. Tom is joined by Daniel Heyman a co-founder of PegaSys and Program Director and Faisal Khan whose role is Strategy and Business development at PegaSys. The conversation spans The use case for enterprise/private blockchains What PegaSys does, and its goals. The release of Pantheon Core and why this client is catered towards enterprises. The future release of Enterprise Alpha and what this means for the space. The interaction between private blockchains and the main Ethereum chain The use cases for private blockchains. The pain points the PegaSys team has faced and how the team overcame them The future of Ethereum with Serenity.   ----more----   Follow Tom on Twitter @Shaughnessy119 Follow PegaSys on Twitter @PegaSysEng   Follow Daniel on Twitter @HeymanDaniel Follow Faisal on Twitter @fkhan11  PegaSys Website   ----more----  Sign Up For 51percent's Leading Crypto Research 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode. Tom has no investment stake in ConsenSys or PegaSys. ----more---- Sign Up For 51percent's Leading Crypto Research ----more----   Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io   ----more----

4 Dec 201855min

Kevin Werbach: The Blockchain and the New Architecture of Trust

Kevin Werbach: The Blockchain and the New Architecture of Trust

Host Tom Shaughnessy of 51percent is joined by Kevin Werbach to discuss his newly released book, "The Blockchain and the New Architecture of Trust".    About Kevin: Kevin Werbach is Professor of Legal Studies and Business Ethics at the Wharton School of the University of Pennsylvania. Founder of the technology consulting firm Supernova Group, he has advised the FCC and Department of Commerce on communication policy. ----more----   Follow Tom on Twitter @Shaughnessy119 Follow Kevin on Twitter @kwerb Purchase Kevin's Book: The Blockchain and the New Architecture of Trust ----more----  Sign Up For 51percent's Leading Crypto Research 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. Tom does not own tokens in EOS. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode.  ----more---- Sign Up For 51percent's Leading Crypto Research ----more----   Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io   ----more----

30 Nov 20181h

Zak, Nate and Daniel: Three Months of Heavy Analysis Unearthed Serious Issues With EOS

Zak, Nate and Daniel: Three Months of Heavy Analysis Unearthed Serious Issues With EOS

Today on the podcast, the Whiteblock Team joins host Tom Shaughnessy of 51percent to discuss their widely circulated technical research report titled; "EOS: An Architectural, Performance, and Economic Analysis Paper". Tom is joined by Zak Cole the CTO of Whiteblock, Nate Blakely a systems developer at Whiteblock and Daniel Choi a blockchain developer at Whiteblock. Why the actual throughput or tx/s of EOS falls short of what is marketed or promised. EOS can only handle a few dozen tx/s not 5,000 to 10,000 tx/s. The issues with having 21 block producers, and the formation of cartels. The results of the team's three-month analysis of EOS, which comprised thousands of hours. The issues with voting on EOS and why fixing the constitution cant fix the current problems. The problems with Bandwidth and Log Storage (Disk), Computation and Computational Backlog (CPU) and Storage (RAM) on EOS. Could Block One act against EOS or is the fact that we have to trust that they wont against EOS the real issue? ----more----   51percent's Reports on Tezos and MakerDAO Follow Tom on Twitter @Shaughnessy119 EOS: An Architectural, Performance, and Economic Analysis Paper Follow Zak on Twitter @0xzak   Follow Nate on Linkedin Follow Daniel on Linkedin Follow Whiteblock on Twitter @whiteblockio ----more----  Sign Up For 51percent's Leading Crypto Research 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. Tom does not own tokens in EOS. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode.----more---- Sign Up For 51percent's Leading Crypto Research ----more----  Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io ----more----

27 Nov 20181h 4min

Scott Andersen: A Former Prosecutors Take On The Legality of Crypto, ICO’s Returning Funds, and SEC Enforcement Actions

Scott Andersen: A Former Prosecutors Take On The Legality of Crypto, ICO’s Returning Funds, and SEC Enforcement Actions

On this episode host Tom Shaughnessy is joined by Scott Andersen, a principal at Finlawyer.com and a former prosecutor at FINRA. In this episode the two discuss everything legal ranging from ICOs to the future of the space   The legality of ICOs Etherdetla, Paragon and Airfox enforcement actions The legality of security tokens and exchanges Will all ICOs have to return investor money How the SEC is positioning in the space The BAKKT Delay ETF timing and impact Much, much more.   ----more----   51percent's Reports on Tezos and MakerDAO Follow Tom on Twitter @Shaughnessy119 Scott's Company Website Scott's 2016 Post       ----more----  Sign Up For 51percent's Leading Crypto Research Using Coupon Code "Thanksgiving" 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode.----more---- Sign Up For 51percent's Leading Crypto Research - Using Coupon Code "Thanksgiving" ----more----  Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io ----more----

21 Nov 20181h 8min

Eric Olszewski and José Macedo: Ethereum’s Fat Protocol Thesis and Why Crypto Hasn’t Bottomed

Eric Olszewski and José Macedo: Ethereum’s Fat Protocol Thesis and Why Crypto Hasn’t Bottomed

Eric Olszewskii and Jose Macedo join host Tom Shaughnessy to discuss Ethereum’s fat protocol thesis following Jose’s post on the topic. We also go into depth on everything Ethereum with Serenity, scalability, store of values, future use cases and why ETH prices haven’t yet bottomed. Our conversation also dives into Ethereum's competition, ranging from Bitcoin, NEO, EOS, Litecoin and Tezos.   ----more----   51percent's Reports on Tezos and MakerDAO Follow Tom on Twitter @Shaughnessy119 Follow Eric on Twitter @hrdwrknvrstps  Follow Jose on Twitter @ZeMariaMacedo  Jose's Post on Ethereum's Fat Protocol Thesis AmaZix Company Website     ----more----  Sign Up For 51percent's Leading Crypto Research 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent was not compensated by any party for this podcast episode.----more---- Sign Up For 51percent's Leading Crypto Research  ----more----  Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io ----more----

19 Nov 20181h 24min

John Quinn: How StorJ Is Battling Cloud Competitors (AWS/Azure) and Decentralized Peers (Filecoin, Sia, Maidsafe)

John Quinn: How StorJ Is Battling Cloud Competitors (AWS/Azure) and Decentralized Peers (Filecoin, Sia, Maidsafe)

John Quinn, the Co-founder and Chief Revenue Officer at StorJ joins host Tom Shaughnessy to discuss the decentralized storage provider.  ----more---- Decentralized (StorJ, Sia, Filecoin, Maidsafe) vs Centralized storage providers (AWS, Azure) How StorJ is more focused on competing with centralized cloud providers over its decentralized peers. What's new in the comprehensive StorJ Version 3.0 White Paper (90+ pages). How the StorJ platform works, metrics so far (100 petabytes stored globally). StorJ's token dynamics. Why decentralized storage is needed since mass data can not be stored on-chain. What the future holds for decentralized storage and StorJ StorJ's timeline (2Q18 full launch for V3) Why uptime for nodes on StorJ is more important than bandwidth speed or storage capacity.  ----more---- Follow StorJ on Twitter @storjproject  Follow John on Twitter @StorjQ StorJ V3 Whitepaper StorJ Blog on Security and Encryption Follow Tom on Twitter @Shaughnessy119   ----more----  Sign Up For 51percent's Leading Crypto Research 51percent's Institutional Crypto Podcasts are to the point discussions with crypto leaders for analysts, funds and institutions. Make sure to add your email on 51pct.io Disclosure: Tom Shaughnessy owns tokens in ETH, MKR, ZRX, HYDRO, CVC, POLY and GLA and has no stake in StorJ. This podcast is NOT investment advice and is only informational. Do not make investment decisions based upon this podcast. 51percent a----more---- Sign Up For 51percent's Leading Crypto Research  ----more----  Advertisers: To advertise on this podcast, email Tom@51pct.io Potential Guests: If you're interested in appearing on the podcast, email Tom@51pct.io ----more----

12 Nov 201858min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-racevecka
rss-elektrikerpodden
rss-uppgang-och-fall
natets-morka-sida
bli-saker-podden
skogsforum-podcast
rss-technokratin
developers-mer-an-bara-kod
har-vi-akt-till-mars-an
solcellskollens-podcast
rss-veckans-ai
mediepodden
bilar-med-sladd
rss-laddstationen-med-elbilen-i-sverige
hej-bruksbil
rss-fabriken-2
rss-bakom-boken