Arize AI in Asia Pacific: LLM Evaluation, Observability & Scale with Patrick Kelly

Arize AI in Asia Pacific: LLM Evaluation, Observability & Scale with Patrick Kelly

Fresh out of the studio, Patrick Kelly, Vice President for Asia Pacific at Arize AI, joins us to explore the critical world of AI observability, evaluation, and infrastructure and how Arize AI will start their go to market across the region. Beginning with his transition from Databricks to Arize AI, Patrick explained how the company's mission centers on making AI work for people by helping teams observe, evaluate, and continuously improve their AI agents in production. Emphasizing that evaluations are the most important requirement for AI systems in 2025-2026, he revealed a striking insight: approximately 50% of AI agents fail silently in production because organizations don't know what's happening. Through compelling case studies from Booking.com, Flipkart, and AT&T, Patrick explained how Arize AI enables real-time observability and online evaluations, achieving results like 40% accuracy improvements and 84% cost reductions. Patrick concluded by sharing his vision for success across Asia Pacific's diverse markets - from regulatory frameworks in Korea and Singapore to language localization challenges in Vietnam - emphasizing the three pillars that remain constant: helping customers make money, control costs, and manage risk in an era where AI governance has become paramount. Last but not least, he shares what great would look like for Arize AI in the Asia Pacific

"The mission is to make AI work for the people. It’s about getting AI working for everybody—consumers, customers, and businesses at large. Evals are the most important things that we’ve seen through 2025 and will see more of into 2026; they are the most important thing for systems to work. When I'm working with a customer, I ask: How are we going to help them make money? How are we going to help them control costs? And how are we going to help them manage risk? A lot of AI now is about managing risk."

Episode Highlights:
[00:00] Quote of the Day by Patrick Kelly
[01:10] Bernard introduces AI evaluation and infrastructure topic
[02:24] Patrick's journey from Databricks to Arize AI
[03:20] Arize AI's mission: making AI work for people
[04:00] Understanding agentic systems and their complexity
[05:18] Observability, evaluation, and development framework explained
[06:27] Creating continuous feedback loops for AI improvement
[07:00] On-premises and air-gapped deployment capabilities
[08:00] Open Telemetry and Open Inference standards
[09:08] Evaluations are critical for 2025-2026 success
[10:36] Booking.com case: real-time production AB testing
[14:36] Phoenix open source and Open Inference: entry to Arize ecosystem
[16:00] Travel industry use cases: Skyscanner and Flipkart
[17:53] AT&T case: 40% accuracy improvement, 84% cost reduction
[19:36] 50% of production agents fail silently
[20:26] Korea and Singapore MAS launches AI risk management framework
[22:08] Arize AI CEO's 10 predictions for AI 2026
[22:41] Cursor for X: AI engineering everywhere
[24:06] Context and session state matter critically
[26:27] Harness: new buzzword for agent orchestration
[34:13] Three pillars: make money, control costs, manage risk
[36:00] Asia Pacific diversity: India to Japan
[37:12] Language and cultural nuances in evaluations
[38:00] Closing

Profile: Patrick Kelly, Vice President, Asia Pacific, Arize AILinkedIn Profile: https://www.linkedin.com/in/patrick-kelly-aab6168/?ref=analyse.asia

Podcast Information: Bernard Leong hosts and produces the show. The proper credits for the intro and end music are "Energetic Sports Drive." G. Thomas Craig mixed and edited the episode in both video and audio format.

Jaksot(515)

Episode 160: Post CES 2017 Part 1 with Ben Bajarin - Analyse Asia with Bernard Leong

Episode 160: Post CES 2017 Part 1 with Ben Bajarin - Analyse Asia with Bernard Leong

Ben Bajarin from Creative Strategies and Techpinions joined us in a two part conversation to discuss the recent Consumer Electronics Show (CES) 2017 in Las Vegas. We discussed the major themes which have emerged from the show: the developing television sets and screens from Asian OEMs, the dominance of the Amazon Echo, the rising average The post Episode 160: Post CES 2017 Part 1 with Ben Bajarin appeared first on Analyse Asia.

30 Tammi 201726min

Episode 159: Are Asia Telcos dumb pipes? with Grace Chng - Analyse Asia with Bernard Leong

Episode 159: Are Asia Telcos dumb pipes? with Grace Chng - Analyse Asia with Bernard Leong

Grace Chng, author of “Intelligent Island” & former correspondent of SPH, joined us to provide a broad overview of the telecommunications industry across Asia and whether the telcos are just dumb pipes in Asia Pacific or evolving with new business models and products. With an overview on China, India and rest of Asia Pacific (including The post Episode 159: Are Asia Telcos dumb pipes? with Grace Chng appeared first on Analyse Asia.

25 Tammi 201735min

Episode 158: Wechat Mini Apps with Matthew Brennan - Analyse Asia with Bernard Leong

Episode 158: Wechat Mini Apps with Matthew Brennan - Analyse Asia with Bernard Leong

Matthew Brennan from China Channel and a well-known expert on Wechat joined us for an in-depth discussion on the recent launch of the Wechat mini-apps or programs, the philosophy behind them with interpretations on Allen Zhang, the founder of Wechat and their impact to the Wechat developers, businesses & brands living within the ecosystem. He The post Episode 158: Wechat Mini Apps with Matthew Brennan appeared first on Analyse Asia.

20 Tammi 201735min

Episode 157: Musical.ly with Eva Xiao - Analyse Asia with Bernard Leong

Episode 157: Musical.ly with Eva Xiao - Analyse Asia with Bernard Leong

Eva Xiao, China reporter for Tech In Asia joined us to discuss an interesting video and entertainment company from China, Musical.ly and how it has skipped the domestic market and built a massive following from US, Europe and rest of the world with an impressive portfolio of investors from Silicon Valley and China. She provided The post Episode 157: Musical.ly with Eva Xiao appeared first on Analyse Asia.

15 Tammi 201722min

Episode 156: Low Power Wide Area Networks in Asia Pacific with Charles Anderson - Analyse Asia with Bernard Leong

Episode 156: Low Power Wide Area Networks in Asia Pacific with Charles Anderson - Analyse Asia with Bernard Leong

Charles Anderson from Charles Reed Anderson & Associates joined us in a conversation on lower power wide area networks aka WANs in Asia Pacific and its significance to smart cities & Internet of things. Charles dissect the three major players: NB-IoT, LoRA & SigFox and their backers & operators behind the scenes and explained the The post Episode 156: Low Power Wide Area Networks in Asia Pacific with Charles Anderson appeared first on Analyse Asia.

10 Tammi 201722min

Episode 155: 5 Predictions for Asia in 2017 with Sameer Singh - Analyse Asia with Bernard Leong

Episode 155: 5 Predictions for Asia in 2017 with Sameer Singh - Analyse Asia with Bernard Leong

Sameer Singh from App Annie and our host Bernard Leong offer their five predictions to what will rock the Asia landscape in 2017 and examine side events that hit the road ahead after a turbulent and unpredictable 2016. We discuss: (a) Softbank’s gambit with Sprint & T-Mobile, (b) Asia messaging apps vs Facebook & Whatsapp The post Episode 155: 5 Predictions for Asia in 2017 with Sameer Singh appeared first on Analyse Asia.

4 Tammi 201719min

Episode 154: The 5 Major Events in 2016 with Sameer Singh - Analyse Asia with Bernard Leong

Episode 154: The 5 Major Events in 2016 with Sameer Singh - Analyse Asia with Bernard Leong

Sameer Singh from App Annie and our host Bernard Leong discuss the five major events which rocked the Asia landscape in 2016: (a) Softbank’s acquisition of ARM for US$32B, (b) Pokemon Go, (c) Uber and Didi’s deal in China, (d) the Indian unicorn startups apocalypse & (e) the ecommerce war between Amazon & Alibaba in The post Episode 154: The 5 Major Events in 2016 with Sameer Singh appeared first on Analyse Asia.

29 Joulu 201626min

Episode 153: Cloudera in Asia & the 4th Industrial Revolution with Amr Awadallah - Analyse Asia with Bernard Leong

Episode 153: Cloudera in Asia & the 4th Industrial Revolution with Amr Awadallah - Analyse Asia with Bernard Leong

Amr Awadallah, the chief technology & co-founder of Cloudera joined us in a conversation on the data and analytics platform’s footprint in Asia. We began with his story from how he moved from Cairo, Egypt to Silicon Valley in the US, and how he eventually become the founding team of Cloudera. We discussed the interesting The post Episode 153: Cloudera in Asia & the 4th Industrial Revolution with Amr Awadallah appeared first on Analyse Asia.

24 Joulu 201627min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
rss-lahtijat
rahapuhetta
rss-rahamania
rss-neuvottelija-sami-miettinen
rss-porssipuhetta
ostan-asuntoja-podcast
rss-laakispodi
rss-bisnesta-bebeja
rss-porssipodi
taloudellinen-mielenrauha
rss-strategian-seurassa
rss-h-asselmoilanen
rss-startup-ministerio
rss-yrittajat-ymparillani
rss-merja-mahkan-rahat
rss-paasipodi