514: Running Local LLMs in VS Code

514: Running Local LLMs in VS Code

In this episode James and Frank dive into running AI coding models locally versus in the cloud—BYOK/Open Router, VS Code’s chat/agent harness, model runners (Olama, vLLM), and the practicality of 27B models on a 3090 using 4‑bit quantization. They share hands-on takeaways—how recent engineering (MT/MTPLX) boosts inference to usable token rates, when auto model selection makes sense, cost and hardware trade‑offs, and why local models can liberate your workflow while still needing smarter, unified tooling.

Follow Us

⭐⭐ Review Us ⭐⭐

Machine transcription available on http://mergeconflict.fm

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(524)

516: Evolving Agent Session Management

516: Evolving Agent Session Management

James and Frank unpack AI-driven development shifts—agent SDKs, session management, and the rise of agent-first UIs like Google’s anti-gravity and GitHub Copilot—showing how VS Code’s Agents window, w...

25 Touko 42min

515: Mini-LED, IPS, and the Great Monitor Rabbit Hole

515: Mini-LED, IPS, and the Great Monitor Rabbit Hole

James and Frank share thrift‑store monitor triumphs (and a retro Wii audio nightmare) before diving into a no‑nonsense guide to buying displays: what ports, VESA mounts, and speakers really matter. Th...

18 Touko 44min

513: Agents Over Chat: The Future of Developer Workflows

513: Agents Over Chat: The Future of Developer Workflows

James and Frank explore the future of developer workflows powered by AI agents, revealing how developers are shifting from coders to testers and product strategists. They dive into new research-planni...

4 Touko 57min

512: Does Matter Really Matter?

512: Does Matter Really Matter?

After a quick round of Apple dev updates, James and Frank dive into Matter — why Frank went from skeptic to devotee and why it’s poised to fix IoT chaos. They break down how Matter (an app-layer proto...

27 Huhti 37min

511: Terminals, Remote Sessions, No More Watches!

511: Terminals, Remote Sessions, No More Watches!

In episode 511 James and Frank dig into audio gear (why impedance matters and the pros/cons of hardware DSP and headphone high‑power modes), explore GitHub Copilot CLI's new Remote Sessions for mobile...

20 Huhti 49min

510: AI Agents: Claws, Copilot, GUI vs CLI Debate

510: AI Agents: Claws, Copilot, GUI vs CLI Debate

James and Frank dig into the messy world of AI agents—Claudes, Copilots, “claws”—and why now is the wrong time to over-box these tools. They debate GUI vs. CLI futures, explain when AI should be invis...

13 Huhti 47min

509: How AI Fleets Fixed 31 Issues in Two Days

509: How AI Fleets Fixed 31 Issues in Two Days

In this episode Frank and James riff on everything from accidental source‑map leaks (yes, even Apple slips up) to using Copilot and multi‑agent AI workflows to triage issues, write PRs and even plan t...

6 Huhti 42min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
politiikan-puskaradio
ootsa-kuullut-tasta-2
rss-ootsa-kuullut-tasta
rss-podme-livebox
tervo-halme
otetaan-yhdet
rss-vaalirankkurit-podcast
et-sa-noin-voi-sanoo-esittaa
viisupodi
rss-asiastudio
rss-kaikki-uusiksi
rss-hyvaa-huomenta-bryssel
rss-girls-finish-f1rst
rss-ulkopoditiikkaa
linda-maria
the-ulkopolitist
rss-sinivalkoinen-islam
rss-pinnalla