Agent Bricks and How Data-AI Integration Changes Everything with Craig Wiley
Analyse Podcast26 Syys 2025

Agent Bricks and How Data-AI Integration Changes Everything with Craig Wiley

"85% of AI use cases are being evaluated by the engineer who built it saying, 'yep, seemed to work pretty well.' If you're gonna build a system that's going to be critical to the business, that's going to be important that it gets it right, then you can't do that without evaluations." - Craig Wiley

Fresh out of the studio, Craig Wiley, Senior Director of Product Management at Databricks who leads Mosaic AI, joins us to discuss the forefront of enterprise AI from model development to deployment at scale. Beginning with his career journey in ML operations, Craig explained how he recognized the critical connection between data and AI layers that could deliver order-of-magnitude acceleration in development cycles. Emphasizing the transition from classical ML operations to LLM operations, he showcased how Databricks' unified platform eliminates training-serving skew through data lineage capabilities and supports both fine-tuning and RAG approaches depending on industrial use case requirements. Highlighting compelling customer success stories including Suncorp's employee productivity platform and AstraZeneca's transformation of 400,000 clinical trial documents into queryable insights, Craig revealed a striking reality about enterprise AI evaluation - that 85% of AI use cases are being evaluated only by the engineers who built them, reinforcing that proper evaluation frameworks remain foundational for trustworthy AI implementation. He concluded by introducing Agent Bricks as Databricks' evaluation-centric approach to building production agents, emphasizing that model flexibility and rigorous testing are essential for enterprises moving from experimentation to production, while sharing his vision that the industry must evolve from the "year of agents" to the "year of evaluation and quality."

Episode Highlights:
[00:00] Quote of the Day by Craig Wiley
[01:21] How Craig Wiley started his work in ML Ops that led him to Databricks
[02:43] Data and AI layer connection creates order-of-magnitude acceleration
[03:47] Mosaic AI acquisition expanded Gen AI solution capabilities
[04:38] Classical ML statistics versus Gen AI evaluation challenges
[05:48] Mosaic AI covers end-to-end from data ingestion
[07:12] Training-serving skew eliminated through unified platform lineage
[08:51] Fine tuning versus RAG depends on use case
[10:49] Industrial agents benefit from fine-tuned smaller models
[12:44] Common governance scheme covers tables through model access
[13:52] Agent Bricks prioritizes accuracy over simplicity alone
[15:44] Model flexibility crucial for speed and accuracy optimization
[16:54] AB testing different models shows immediate performance differences
[17:59] Suncorp and AstraZeneca demonstrate diverse AI applications
[19:37] Asia Pacific shows aggressive AI adoption strategies
[20:59] CFO approval requires proven agent effectiveness evaluation
[22:00] 85% of AI cases evaluated only by building engineer
[23:20] Model agnostic approach beats single-vendor AI strategies
[24:12] Industry terminology evolves rapidly from RAG to agents
[25:39] Customer creativity with governance capabilities inspires product development

Profile: Craig Wiley, Senior Director of Product Management at Databricks and Mosaic AI

LinkedIn: https://www.linkedin.com/in/craigwiley/

Podcast Information: Bernard Leong hosts and produces the show. The proper credits for the intro and end music are "Energetic Sports Drive." G. Thomas Craig mixed and edited the episode in both video and audio format.

Here are the links to watch or listen to our podcast.

Analyse Asia Main Site: https://analyse.asia

Analyse Asia Spotify: https://open.spotify.com/show/1kkRwzRZa4JCICr2vm0vGl

Analyse Asia Apple Podcasts: https://podcasts.apple.com/us/podcast/analyse-asia-with-bernard-leong/id914868245

Analyse Asia LinkedIn: https://www.linkedin.com/company/analyse-asia/

Analyse Asia X (formerly known as Twitter): https://twitter.com/analyseasia

Sign Up for Our This Week in Asia Newsletter: https://www.analyse.asia/#/portal/signup

Subscribe Newsletter on LinkedIn https://www.linkedin.com/build-relation/newsletter-follow?entityUrn=7149559878934540288

Jaksot(515)

The Sentient Startup: Building Companies in the Age of AI with Arnaud Frade

The Sentient Startup: Building Companies in the Age of AI with Arnaud Frade

Fresh out of the studio, Arnaud Frade, Managing Partner at Mesh Advisory and author of the upcoming book The Sentient Startup, joins us to explore how AI is fundamentally transforming entrepreneurship...

12 Marras 202545min

Microsoft's Global Partner Strategy: 400M Businesses & 1 Platform with Ralph Haupter

Microsoft's Global Partner Strategy: 400M Businesses & 1 Platform with Ralph Haupter

Fresh out of the studio, Ralph Haupter, President & CRO, Small Medium Enterprises and Channels at Microsoft, joins us to explore how Microsoft is empowering 400 million small and medium businesses glo...

5 Marras 202550min

500 Episodes Later: What I Learned From 11 Years of Podcasting with Bernard Leong

500 Episodes Later: What I Learned From 11 Years of Podcasting with Bernard Leong

Fresh out of the studio and we hit our 500th episode milestone, guest host Yana Fry from Yana TV turns the tables on Bernard Leong, CEO of Dorje AI and host of Analyse Asia, in a special ask-me-anythi...

3 Marras 202555min

Mastercard and The Future of Money: Crypto, AI Agents & Digital Payments with Ling Hai

Mastercard and The Future of Money: Crypto, AI Agents & Digital Payments with Ling Hai

Fresh out of the studio, Ling Hai, President of Asia Pacific, Europe, Middle East, and Africa at MasterCard, joins us to explore how payment networks are evolving to embrace stable coins, AI agents, a...

21 Loka 202536min

How to Scale Global Teams Without an Office through Esevel with Deng Yuying

How to Scale Global Teams Without an Office through Esevel with Deng Yuying

Fresh out of the studio, Yuying Deng, Co-founder and CEO of Esevel, shares her transformative journey from corporate lawyer to healthcare operator to tech entrepreneur with our guest host Yana Fry fro...

16 Loka 202537min

Why Data Streaming Is the Secret Weapon for AI Success with Kamal Brar

Why Data Streaming Is the Secret Weapon for AI Success with Kamal Brar

"In the context of where Confluent can play a critical part, it's also the interoperable integration with all the respective AI ecosystems. If you think about what AI is doing, it's working across mic...

8 Loka 202545min

Why Startups in China Are Going Global with Jing Yang

Why Startups in China Are Going Global with Jing Yang

“I think this is a sort of coming-of-age moment. When I say coming of age, I mean collectively for Chinese entrepreneurs. Many of these founders are my age, or even younger, and I’ve spoken with some ...

2 Loka 20251h 1min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
rss-rahamania
rss-lahtijat
ostan-asuntoja-podcast
rahapuhetta
rss-neuvottelija-sami-miettinen
rss-h-asselmoilanen
rss-laakispodi
inderespodi
rss-porssipuhetta
rss-startup-ministerio
rss-bisnesta-bebeja
sijoituspodi
rss-strategian-seurassa
asuntoasiaa-paivakirjat
rss-merja-mahkan-rahat
rss-paasipodi