From Cloud Dependency to Local Intelligence: The Future of Accessible AI
Intel on AI29 Okt 2025

From Cloud Dependency to Local Intelligence: The Future of Accessible AI

As AI models grow more powerful, the question of where they run is becoming just as important as what they do. In this episode, Brandon Weng, Co-Founder and CEO of Fluid Inference, unpacks what it takes to move AI from massive data centers to everyday devices—and why that shift matters.

Brandon shares the story behind Fluid Inference, a company focused on making it easier for developers to deploy large AI models like transformers on consumer hardware. From pivoting away from his previous project, Slipbox, to the technical and philosophical choices that shaped Fluid's direction, he walks us through the thinking behind local-first AI. We explore the tradeoffs between cloud-based and on-device inference—touching on privacy, cost, control, and performance—and the hardware breakthroughs that are making edge AI more viable, including integrated NPUs in devices like Intel's AI PCs.

#EdgeAI #OnDeviceInference #AIOptimization #PrivacyFirst #OpenSourceAI #LocalAI

Episoder(137)

Using AI to Build Explainable AI with Intel Optimizations and DarwinAI – Intel on AI – Episode 25

Using AI to Build Explainable AI with Intel Optimizations and DarwinAI – Intel on AI – Episode 25

In this Intel on AI podcast episode: Deep neural networks (DNNs), which are arguably the most powerful form of AI today, are difficult to build, run, and explain. Such challenges constitute significan...

21 Aug 201915min

Vispera Visual Intelligence for Retail with Intel OpenVINO Toolkit – Intel on AI – Episode 24

Vispera Visual Intelligence for Retail with Intel OpenVINO Toolkit – Intel on AI – Episode 24

In this Intel on AI podcast episode: Millions of dollars are lost by retailers worldwide each year as a result of out of stock products, overstocking, and shrinkage. Out of stock products also incur o...

7 Aug 201912min

Cloudera Data Science Workbench and ML Services Driving an AI First World – Intel on AI – Episode 23

Cloudera Data Science Workbench and ML Services Driving an AI First World – Intel on AI – Episode 23

In this Intel on AI podcast episode: Justin Norman, Director of Data Science Research and Services at Cloudera, joins the Intel on AI podcast to talk about the challenges that enterprises face when ex...

7 Aug 201911min

Real-time Insights with the Avaya Intelligent Conversational Platform – Intel on AI – Episode 22

Real-time Insights with the Avaya Intelligent Conversational Platform – Intel on AI – Episode 22

In this Intel on AI podcast episode: Every customer call is an opportunity to gain information about customer preferences and pain points. Yet capturing and structuring call data can be a very slow, t...

30 Jul 201912min

Unlocking the Power of Data with BigData Corp. and Intel Optimizations – Intel on AI – Episode 21

Unlocking the Power of Data with BigData Corp. and Intel Optimizations – Intel on AI – Episode 21

In this Intel on AI podcast episode: When doing big data analysis and developing AI models businesses start by capturing very accurate, well defined, and structured data to be able to train their mode...

17 Jul 201915min

Enabling Early Cancer Detection with Huiying Medical and Intel AI – Intel on AI – Episode 20

Enabling Early Cancer Detection with Huiying Medical and Intel AI – Intel on AI – Episode 20

In this Intel on AI podcast episode: There is growing need for digital health solutions to improve accessibility and affordability of medical resources to add value for care providers and improve heal...

17 Jul 201911min

Dell EMC Ready Solutions for AI Accelerating Insights with Intel Nauta – Intel on AI – Episode 19

Dell EMC Ready Solutions for AI Accelerating Insights with Intel Nauta – Intel on AI – Episode 19

In this Intel on AI podcast episode: Phil Hummel, Senior Principal Engineer at Dell EMC, joins the Intel on AI Podcast to talk about the new Dell EMC Ready Solution for AI with Intel featuring Nauta. ...

8 Jul 201913min

Avaamo Conversational AI Helping Computers Understand Humans – Intel on AI – Episode 18

Avaamo Conversational AI Helping Computers Understand Humans – Intel on AI – Episode 18

In this Intel on AI podcast episode: Enterprises want to deploy conversational virtual assistants but often the technology to do the necessary natural language processing (NLP), graphing for knowledge...

26 Jun 201918min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
popradet
lydartikler-fra-aftenposten
forklart
stopp-verden
rss-gukild-johaug
dine-penger-pengeradet
det-store-bildet
rss-ness
nokon-ma-ga
hanna-de-heldige
fotballpodden-2
aftenbla-bla
rss-penger-polser-og-politikk
rss-utenrikskomiteen-med-bogen-og-grasvik
rss-dannet-uten-piano
e24-podden
bt-dokumentar-2