#314 Nick Pandher: How Inference-First Infrastructure Is Powering the Next Wave of AI
Eye On A.I.17 Tammi

#314 Nick Pandher: How Inference-First Infrastructure Is Powering the Next Wave of AI

Inference is now the biggest challenge in enterprise AI.

In this episode of Eye on AI, Craig Smith speaks with Nick Pandher, VP of Product at Cirrascale, about why AI is shifting from model training to inference at scale. As AI moves into production, enterprises are prioritizing performance, latency, reliability, and cost efficiency over raw compute.

The conversation covers the rise of inference-first infrastructure, the limits of hyperscalers, the emergence of neoclouds, and how agentic AI is driving always-on inference workloads. Nick also explains how inference-optimized hardware and serverless AI platforms are shaping the future of enterprise AI deployment.

If you are deploying AI in production, this episode explains why inference is the real frontier.


Stay Updated:

Craig Smith on X: https://x.com/craigss

Eye on A.I. on X: https://x.com/EyeOn_AI



(00:00) Preview

(00:50) Introduction to Cirrascale and AI inference

(03:04) What makes Cirrascale a neocloud

(04:42) Why AI shifted from training to inference

(06:58) Private inference and enterprise security needs

(08:13) Hyperscalers vs neoclouds for AI workloads

(10:22) Performance metrics that matter in inference

(13:29) Hardware choices and inference accelerators

(20:04) Real enterprise AI use cases and automation

(23:59) Hybrid AI, regulated industries, and compliance

(26:43) Proof of value before AI pilots

(31:18) White-glove AI infrastructure vs self-serve cloud

(33:32) Qualcomm partnership and inference-first AI

(41:52) Edge-to-cloud inference and agentic workflows

(49:20) Why AI pilots fail and how enterprises succeed



Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(372)

Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix

Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix

The AI chip market looks monolithic from the outside - NVIDIA dominates, and everyone else is fighting for scraps. But d-Matrix's CEO Sid Sheth argues that the market is quietly splitting into two dis...

17 Elo 50min

American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI

American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI

The same tools that slowed the U.S. military down in Afghanistan (PowerPoint, Excel, email, and Word) are now slowing American businesses down in the AI race. Drew Cukor spent 30 years as a Marine int...

13 Elo 58min

In 5 Years, 90% of What You Use AI For Will Run on Your Smartphone | Paolo Ardoino, Tether

In 5 Years, 90% of What You Use AI For Will Run on Your Smartphone | Paolo Ardoino, Tether

Hundreds of billions of dollars are flowing into AI data centers right now, and Paolo Ardoino, CEO of Tether - the company behind the world's most widely used stablecoin with 573 million users - think...

10 Elo 58min

AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix

AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix

Most enterprise IT teams spend the majority of their time fighting the same fires repeatedly. BMC Helix is building the AI system that handles those fires automatically, detecting anomalies, tracing r...

3 Elo 59min

Real AI Transformation Costs HALF of Everyone's Salary for 2 Years | Chris Blackburn, Liatrio

Real AI Transformation Costs HALF of Everyone's Salary for 2 Years | Chris Blackburn, Liatrio

Most companies think they're transforming with AI. They're not, and the gap between what they believe and what's actually happening on the ground is costing them far more than they realize. In this e...

30 Heinä 1h 5min

"According to NASA's Definition of Life, I'm Not Alive" - Why Nobody Can Define Life | Dr. Kate Adamala

"According to NASA's Definition of Life, I'm Not Alive" - Why Nobody Can Define Life | Dr. Kate Adamala

Nobody has ever built a cell from scratch - assembled entirely from purified molecules on a shelf - that can feed itself, grow, and split into daughter cells through its own genetic activity. Until no...

29 Heinä 46min

Video Is About to Stop Being One-Way (and That Changes Everything) | Victor Riparbelli, Synthesia

Video Is About to Stop Being One-Way (and That Changes Everything) | Victor Riparbelli, Synthesia

Every company is creating content that nobody reads, nobody watches, and nobody remembers, and the CEO of the AI platform that 90% of Fortune 100 companies use to fix that just explained what comes ne...

28 Heinä 39min

6 in 10 Enterprises Can't Find the Root Cause When Their AI Workloads Fail | Paul Appleby, Virtana

6 in 10 Enterprises Can't Find the Root Cause When Their AI Workloads Fail | Paul Appleby, Virtana

Companies are spending billions building AI factories, but most of them can't tell you why their AI workloads are failing, whether their GPUs are actually being used, or what their infrastructure is g...

15 Heinä 44min