Home Assistant AI Deep Dive: LLM Vision, Copilot, OpenClaw & More

Phil and Rohan go deep on practical AI for Home Assistant. We cover LLM Vision for doorbell and perimeter alerts, HACS add‑ons like AI Agent and AI Suggester, and using GitHub Copilot to generate YAML automations. Rohan shares his Ollama + LiteLLM routing setup and why private cloud models might beat pay‑per‑token APIs. Phil battles OpenClaw (aka MoltBot/Claude Bot) to control lights via MCP

Watch this episode on YouTube

Show notes for this episode are available at https://homeassistant.fm/HA225

Support the Podcast

Get early-access to episodes and an ad-free feed by supporting our Patreon.

https://homeassistant.fm/patreon

Share your story

We wouldn't be able to do this podcast without community members and home automation enthusiasts sharing their stories. To register your interest to come share your home automation journey, head over to homeassistant.fm and click share your story.

Chapters

00:00:00 - Intro

00:02:02 - Rohan’s AI stack today

00:09:00 - HA’s built-in AI + Copilot

00:18:00 - HACS: AI Agent & Suggester

00:26:24 - LLM Vision in practice

00:37:00 - OpenClaw, MCP, and gotchas

00:47:00 - Do we need agents? Use cases

00:51:00 - Costs, feedback, and outro

This episode was made possible thanks to our sponsors

Home Assistant Cloud by Nabu Casa

Easily connect to Google and Amazon voice assistants for a small monthly fee that also supports the Home Assistant project. Configuration is via the User Interface so no fiddling with router settings, dynamic DNS, or YAML.

Zooz

If you're looking to upgrade your smart home - you can’t go past Zooz! Zooz offers a range of affordable and innovative devices, including water leak sensors, water valve controllers, smart plugs and scene controllers.

For the best prices on all Zooz products, head over to https://thesmartesthouse.com

Products Discussed

Reolink AI Security Cameras: https://amzn.to/3OwwLH2

Hosts

Phil Hawthorne

Website

Smart Home Products

Twitter: @philhawthorne

Bluesky: @philhawthorne.com

Buy Phil a Coffee

Rohan Karamandi

Website

Smart Home Products

Twitter: @rohank9

Buy Rohan a Coffee

This episode contains Amazon affiliate links. If you click on one of them and make a purchase, we may earn a commission at no extra cost to you. As an Amazon Associate, we earn from qualifying purchases.

Privacy & Opt-Out: https://redcircle.com/privacy