514: Running Local LLMs in VS Code

514: Running Local LLMs in VS Code

In this episode James and Frank dive into running AI coding models locally versus in the cloud—BYOK/Open Router, VS Code’s chat/agent harness, model runners (Olama, vLLM), and the practicality of 27B models on a 3090 using 4‑bit quantization. They share hands-on takeaways—how recent engineering (MT/MTPLX) boosts inference to usable token rates, when auto model selection makes sense, cost and hardware trade‑offs, and why local models can liberate your workflow while still needing smarter, unified tooling.

Follow Us

⭐⭐ Review Us ⭐⭐

Machine transcription available on http://mergeconflict.fm

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(524)

516: Evolving Agent Session Management

516: Evolving Agent Session Management

James and Frank unpack AI-driven development shifts—agent SDKs, session management, and the rise of agent-first UIs like Google’s anti-gravity and GitHub Copilot—showing how VS Code’s Agents window, w...

25 Maj 42min

515: Mini-LED, IPS, and the Great Monitor Rabbit Hole

515: Mini-LED, IPS, and the Great Monitor Rabbit Hole

James and Frank share thrift‑store monitor triumphs (and a retro Wii audio nightmare) before diving into a no‑nonsense guide to buying displays: what ports, VESA mounts, and speakers really matter. Th...

18 Maj 44min

513: Agents Over Chat: The Future of Developer Workflows

513: Agents Over Chat: The Future of Developer Workflows

James and Frank explore the future of developer workflows powered by AI agents, revealing how developers are shifting from coders to testers and product strategists. They dive into new research-planni...

4 Maj 57min

512: Does Matter Really Matter?

512: Does Matter Really Matter?

After a quick round of Apple dev updates, James and Frank dive into Matter — why Frank went from skeptic to devotee and why it’s poised to fix IoT chaos. They break down how Matter (an app-layer proto...

27 Apr 37min

511: Terminals, Remote Sessions, No More Watches!

511: Terminals, Remote Sessions, No More Watches!

In episode 511 James and Frank dig into audio gear (why impedance matters and the pros/cons of hardware DSP and headphone high‑power modes), explore GitHub Copilot CLI's new Remote Sessions for mobile...

20 Apr 49min

510: AI Agents: Claws, Copilot, GUI vs CLI Debate

510: AI Agents: Claws, Copilot, GUI vs CLI Debate

James and Frank dig into the messy world of AI agents—Claudes, Copilots, “claws”—and why now is the wrong time to over-box these tools. They debate GUI vs. CLI futures, explain when AI should be invis...

13 Apr 47min

509: How AI Fleets Fixed 31 Issues in Two Days

509: How AI Fleets Fixed 31 Issues in Two Days

In this episode Frank and James riff on everything from accidental source‑map leaks (yes, even Apple slips up) to using Copilot and multi‑agent AI workflows to triage issues, write PRs and even plan t...

6 Apr 42min

Populärt inom Politik & nyheter

aftonbladet-krim
svenska-fall
motiv
p3-krim
flashback-forever
aftonbladet-daily
politiken
rss-sanning-konsekvens
rss-aftonbladet-krim
rss-vad-fan-hande
grans
olyckan-inifran
rss-krimreportrarna
rss-flodet
rss-frandfors-horna
dagens-eko
rss-krimstad
spar
ett-rent-noje
krimmagasinet