#314 Nick Pandher: How Inference-First Infrastructure Is Powering the Next Wave of AI
Eye On A.I.17 Tammi

#314 Nick Pandher: How Inference-First Infrastructure Is Powering the Next Wave of AI

Inference is now the biggest challenge in enterprise AI.

In this episode of Eye on AI, Craig Smith speaks with Nick Pandher, VP of Product at Cirrascale, about why AI is shifting from model training to inference at scale. As AI moves into production, enterprises are prioritizing performance, latency, reliability, and cost efficiency over raw compute.

The conversation covers the rise of inference-first infrastructure, the limits of hyperscalers, the emergence of neoclouds, and how agentic AI is driving always-on inference workloads. Nick also explains how inference-optimized hardware and serverless AI platforms are shaping the future of enterprise AI deployment.

If you are deploying AI in production, this episode explains why inference is the real frontier.


Stay Updated:

Craig Smith on X: https://x.com/craigss

Eye on A.I. on X: https://x.com/EyeOn_AI



(00:00) Preview

(00:50) Introduction to Cirrascale and AI inference

(03:04) What makes Cirrascale a neocloud

(04:42) Why AI shifted from training to inference

(06:58) Private inference and enterprise security needs

(08:13) Hyperscalers vs neoclouds for AI workloads

(10:22) Performance metrics that matter in inference

(13:29) Hardware choices and inference accelerators

(20:04) Real enterprise AI use cases and automation

(23:59) Hybrid AI, regulated industries, and compliance

(26:43) Proof of value before AI pilots

(31:18) White-glove AI infrastructure vs self-serve cloud

(33:32) Qualcomm partnership and inference-first AI

(41:52) Edge-to-cloud inference and agentic workflows

(49:20) Why AI pilots fail and how enterprises succeed



Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(386)

Chat GPT's Creator Explains The Shocking Truth About How AI Understands the World | Ilya Sutskever

Chat GPT's Creator Explains The Shocking Truth About How AI Understands the World | Ilya Sutskever

Craig Smith sits down with Ilya Sutskever - Co-Founder and Chief Scientist at Safe Superintelligence Inc. & former chief scientist at OpenAI and one of the primary minds behind GPT-3, GPT-4, and the d...

9 Loka 41min

The Coordination Tax: Why AI Is Burning Out Your Best People | Dan O'Connell, Front

The Coordination Tax: Why AI Is Burning Out Your Best People | Dan O'Connell, Front

Everyone assumes AI in customer operations means fewer people and lower costs. The data from 700 customer operations leaders is more complicated, and more honest. Dan O'Connell, CEO of Front, joins Cr...

6 Loka 51min

Ukraine's Secret Weapon: The Points System Winning the Drone War | Andrii Hrytseniuk

Ukraine's Secret Weapon: The Points System Winning the Drone War | Andrii Hrytseniuk

Ukraine tracks every confirmed drone kill with video evidence, deduplicates the data to prevent double-counting, converts verified strikes into e-points, and delivers newly ordered weapons to frontlin...

2 Loka 33min

Why Current AI Cannot Be Conscious | Dr. Christof Koch

Why Current AI Cannot Be Conscious | Dr. Christof Koch

One in four patients currently being considered for life support withdrawal may actually be fully conscious, they just can't signal it. That single finding, from a landmark New England Journal of Medi...

30 Syys 1h 1min

The Technology for Fully Autonomous Attack Is Already Here | Alex Liannyi, NORDA Dynamics

The Technology for Fully Autonomous Attack Is Already Here | Alex Liannyi, NORDA Dynamics

The AI systems guiding Ukrainian combat drones aren't running on expensive Nvidia chips. They're running on a Raspberry Pi Zero - a $15 hobby computer - and that single detail tells you more about how...

24 Syys 19min

Inside Ukraine's Drone War: Maj. "Phoenix" of Lasar's Group

Inside Ukraine's Drone War: Maj. "Phoenix" of Lasar's Group

The first armed drone Ukraine ever fielded wasn't built in a factory or procured from a defense contractor. It was built in four months by a network engineer using a Starlink terminal and a large agri...

21 Syys 1h 5min

The Hidden Algorithm That Decides Which Software AI Will Recommend | Tim Sanders, G2

The Hidden Algorithm That Decides Which Software AI Will Recommend | Tim Sanders, G2

Most companies investing in AI visibility are optimizing for the wrong thing. Being cited by an AI response and being recommended by an AI response are completely different outcomes, with click-throug...

14 Syys 58min

The Reason 30 Years of Cybersecurity Has Failed - and What Actually Fixes It | Trent Telford, Qanapi

The Reason 30 Years of Cybersecurity Has Failed - and What Actually Fixes It | Trent Telford, Qanapi

Every major data breach in the last 30 years shares the same root cause: the data inside the wall was never protected, only the wall. And AI frontier models are now making that wall easier to breach t...

10 Syys 55min