Arize AI in Asia Pacific: LLM Evaluation, Observability & Scale with Patrick Kelly

Arize AI in Asia Pacific: LLM Evaluation, Observability & Scale with Patrick Kelly

Fresh out of the studio, Patrick Kelly, Vice President for Asia Pacific at Arize AI, joins us to explore the critical world of AI observability, evaluation, and infrastructure and how Arize AI will start their go to market across the region. Beginning with his transition from Databricks to Arize AI, Patrick explained how the company's mission centers on making AI work for people by helping teams observe, evaluate, and continuously improve their AI agents in production. Emphasizing that evaluations are the most important requirement for AI systems in 2025-2026, he revealed a striking insight: approximately 50% of AI agents fail silently in production because organizations don't know what's happening. Through compelling case studies from Booking.com, Flipkart, and AT&T, Patrick explained how Arize AI enables real-time observability and online evaluations, achieving results like 40% accuracy improvements and 84% cost reductions. Patrick concluded by sharing his vision for success across Asia Pacific's diverse markets - from regulatory frameworks in Korea and Singapore to language localization challenges in Vietnam - emphasizing the three pillars that remain constant: helping customers make money, control costs, and manage risk in an era where AI governance has become paramount. Last but not least, he shares what great would look like for Arize AI in the Asia Pacific

"The mission is to make AI work for the people. It’s about getting AI working for everybody—consumers, customers, and businesses at large. Evals are the most important things that we’ve seen through 2025 and will see more of into 2026; they are the most important thing for systems to work. When I'm working with a customer, I ask: How are we going to help them make money? How are we going to help them control costs? And how are we going to help them manage risk? A lot of AI now is about managing risk."

Episode Highlights:
[00:00] Quote of the Day by Patrick Kelly
[01:10] Bernard introduces AI evaluation and infrastructure topic
[02:24] Patrick's journey from Databricks to Arize AI
[03:20] Arize AI's mission: making AI work for people
[04:00] Understanding agentic systems and their complexity
[05:18] Observability, evaluation, and development framework explained
[06:27] Creating continuous feedback loops for AI improvement
[07:00] On-premises and air-gapped deployment capabilities
[08:00] Open Telemetry and Open Inference standards
[09:08] Evaluations are critical for 2025-2026 success
[10:36] Booking.com case: real-time production AB testing
[14:36] Phoenix open source and Open Inference: entry to Arize ecosystem
[16:00] Travel industry use cases: Skyscanner and Flipkart
[17:53] AT&T case: 40% accuracy improvement, 84% cost reduction
[19:36] 50% of production agents fail silently
[20:26] Korea and Singapore MAS launches AI risk management framework
[22:08] Arize AI CEO's 10 predictions for AI 2026
[22:41] Cursor for X: AI engineering everywhere
[24:06] Context and session state matter critically
[26:27] Harness: new buzzword for agent orchestration
[34:13] Three pillars: make money, control costs, manage risk
[36:00] Asia Pacific diversity: India to Japan
[37:12] Language and cultural nuances in evaluations
[38:00] Closing

Profile: Patrick Kelly, Vice President, Asia Pacific, Arize AILinkedIn Profile: https://www.linkedin.com/in/patrick-kelly-aab6168/?ref=analyse.asia

Podcast Information: Bernard Leong hosts and produces the show. The proper credits for the intro and end music are "Energetic Sports Drive." G. Thomas Craig mixed and edited the episode in both video and audio format.

Jaksot(515)

Episode 168: Tesla and the Jesus Car with Horace Dediu - Analyse Asia with Bernard Leong

Episode 168: Tesla and the Jesus Car with Horace Dediu - Analyse Asia with Bernard Leong

Horace Dediu from Asymco & Clayton Christensen Institute is back with the second Asymco trilogy on our podcast to discuss the major topics that dominate the world of business and technology: modular revolution, startup strategy, Apple & cars. In the final part of the second trilogy, Horace discussed whether traditional companies such as Toyota and The post Episode 168: Tesla and the Jesus Car with Horace Dediu appeared first on Analyse Asia.

6 Maalis 201730min

Episode 167: The Apple Anomaly & Narrative with Horace Dediu - Analyse Asia with Bernard Leong

Episode 167: The Apple Anomaly & Narrative with Horace Dediu - Analyse Asia with Bernard Leong

Horace Dediu from Asymco & Clayton Christensen Institute is back with the second Asymco trilogy on our podcast to discuss the major topics that dominate the world of business and technology: modular revolution, startup strategy, Apple & cars. In the second part of the second trilogy, Horace discussed the company Apple as an anomaly to the theory The post Episode 167: The Apple Anomaly & Narrative with Horace Dediu appeared first on Analyse Asia.

1 Maalis 201742min

Episode 166: Modular Revolution and Startup Strategy with Horace Dediu - Analyse Asia with Bernard Leong

Episode 166: Modular Revolution and Startup Strategy with Horace Dediu - Analyse Asia with Bernard Leong

Horace Dediu from Asymco & Clayton Christensen Institute is back with the second Asymco trilogy on our podcast to discuss the major topics that dominate the world of business and technology: modular revolution, startup strategy, Apple & cars. In the first part of the second trilogy, Horace discussed his latest work on modular revolution & The post Episode 166: Modular Revolution and Startup Strategy with Horace Dediu appeared first on Analyse Asia.

25 Helmi 201737min

Episode 165: Trends & Predictions for China Tech Industry 2017 Part 2 with Rhea Liu - Analyse Asia with Bernard Leong

Episode 165: Trends & Predictions for China Tech Industry 2017 Part 2 with Rhea Liu - Analyse Asia with Bernard Leong

Rhea Liu from China Tech Insights, Tencent joined in a 2 part conversation on their recent published report “Trends and Predictions for China tech industry in 2017”. In the second part, we discussed how the Baidu-Alibaba-Tencent axis are going global, and the venture capital investment appetite and climate in China with where the major trends The post Episode 165: Trends & Predictions for China Tech Industry 2017 Part 2 with Rhea Liu appeared first on Analyse Asia.

23 Helmi 201727min

Episode 164: Trends & Predictions for China Tech Industry 2017 Part 1 with Rhea Liu - Analyse Asia with Bernard Leong

Episode 164: Trends & Predictions for China Tech Industry 2017 Part 1 with Rhea Liu - Analyse Asia with Bernard Leong

Rhea Liu from China Tech Insights, Tencent joined in a 2 part conversation on their recent published report “Trends and Predictions for China tech industry in 2017”. In the first part of our conversation, we discussed the objectives, methodologies and key results from the report, and deep dived into different themes such as the complete The post Episode 164: Trends & Predictions for China Tech Industry 2017 Part 1 with Rhea Liu appeared first on Analyse Asia.

17 Helmi 201726min

Episode 163: Artificial Intelligence with Carolina Milanesi - Analyse Asia with Bernard Leong

Episode 163: Artificial Intelligence with Carolina Milanesi - Analyse Asia with Bernard Leong

Carolina Milanesi from Creative Strategies & Techpinions joined us for a two parter discussion from Huawei to artificial intelligence & Internet of things. In the second part, we discussed artificial intelligence, Internet of things and how the major companies such as Microsoft, Apple, Amazon, Google & Baidu are approaching the technology through their own core competencies The post Episode 163: Artificial Intelligence with Carolina Milanesi appeared first on Analyse Asia.

13 Helmi 201724min

Episode 162: Huawei in 2016 with Carolina Milanesi - Analyse Asia with Bernard Leong

Episode 162: Huawei in 2016 with Carolina Milanesi - Analyse Asia with Bernard Leong

Carolina Milanesi from Creative Strategies & Techpinions joined us for a two parter discussion from Huawei to artificial intelligence & Internet of Things. In the first part, we discussed Huawei, the leading hardware technology giant from China on their global focus on the consumer sector with smartphones in 2016, and what to expect from them in The post Episode 162: Huawei in 2016 with Carolina Milanesi appeared first on Analyse Asia.

9 Helmi 201724min

Episode 161: Post CES 2017 Part 2 with Ben Bajarin - Analyse Asia with Bernard Leong

Episode 161: Post CES 2017 Part 2 with Ben Bajarin - Analyse Asia with Bernard Leong

Ben Bajarin from Creative Strategies and Techpinions joined us in a two part conversation to discuss the recent Consumer Electronics Show (CES) 2017 in Las Vegas. In the 2nd part of the conversation, we dived deeper into the themes that Ben has summarized in the earlier episode focusing on the TV, home automation, digital assistants The post Episode 161: Post CES 2017 Part 2 with Ben Bajarin appeared first on Analyse Asia.

3 Helmi 201724min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
rss-lahtijat
rahapuhetta
rss-rahamania
rss-neuvottelija-sami-miettinen
rss-porssipuhetta
ostan-asuntoja-podcast
rss-laakispodi
rss-bisnesta-bebeja
rss-porssipodi
taloudellinen-mielenrauha
rss-strategian-seurassa
rss-h-asselmoilanen
rss-startup-ministerio
rss-yrittajat-ymparillani
rss-merja-mahkan-rahat
rss-paasipodi