Arize AI in Asia Pacific: LLM Evaluation, Observability & Scale with Patrick Kelly

Arize AI in Asia Pacific: LLM Evaluation, Observability & Scale with Patrick Kelly

Fresh out of the studio, Patrick Kelly, Vice President for Asia Pacific at Arize AI, joins us to explore the critical world of AI observability, evaluation, and infrastructure and how Arize AI will start their go to market across the region. Beginning with his transition from Databricks to Arize AI, Patrick explained how the company's mission centers on making AI work for people by helping teams observe, evaluate, and continuously improve their AI agents in production. Emphasizing that evaluations are the most important requirement for AI systems in 2025-2026, he revealed a striking insight: approximately 50% of AI agents fail silently in production because organizations don't know what's happening. Through compelling case studies from Booking.com, Flipkart, and AT&T, Patrick explained how Arize AI enables real-time observability and online evaluations, achieving results like 40% accuracy improvements and 84% cost reductions. Patrick concluded by sharing his vision for success across Asia Pacific's diverse markets - from regulatory frameworks in Korea and Singapore to language localization challenges in Vietnam - emphasizing the three pillars that remain constant: helping customers make money, control costs, and manage risk in an era where AI governance has become paramount. Last but not least, he shares what great would look like for Arize AI in the Asia Pacific

"The mission is to make AI work for the people. It’s about getting AI working for everybody—consumers, customers, and businesses at large. Evals are the most important things that we’ve seen through 2025 and will see more of into 2026; they are the most important thing for systems to work. When I'm working with a customer, I ask: How are we going to help them make money? How are we going to help them control costs? And how are we going to help them manage risk? A lot of AI now is about managing risk."

Episode Highlights:
[00:00] Quote of the Day by Patrick Kelly
[01:10] Bernard introduces AI evaluation and infrastructure topic
[02:24] Patrick's journey from Databricks to Arize AI
[03:20] Arize AI's mission: making AI work for people
[04:00] Understanding agentic systems and their complexity
[05:18] Observability, evaluation, and development framework explained
[06:27] Creating continuous feedback loops for AI improvement
[07:00] On-premises and air-gapped deployment capabilities
[08:00] Open Telemetry and Open Inference standards
[09:08] Evaluations are critical for 2025-2026 success
[10:36] Booking.com case: real-time production AB testing
[14:36] Phoenix open source and Open Inference: entry to Arize ecosystem
[16:00] Travel industry use cases: Skyscanner and Flipkart
[17:53] AT&T case: 40% accuracy improvement, 84% cost reduction
[19:36] 50% of production agents fail silently
[20:26] Korea and Singapore MAS launches AI risk management framework
[22:08] Arize AI CEO's 10 predictions for AI 2026
[22:41] Cursor for X: AI engineering everywhere
[24:06] Context and session state matter critically
[26:27] Harness: new buzzword for agent orchestration
[34:13] Three pillars: make money, control costs, manage risk
[36:00] Asia Pacific diversity: India to Japan
[37:12] Language and cultural nuances in evaluations
[38:00] Closing

Profile: Patrick Kelly, Vice President, Asia Pacific, Arize AILinkedIn Profile: https://www.linkedin.com/in/patrick-kelly-aab6168/?ref=analyse.asia

Podcast Information: Bernard Leong hosts and produces the show. The proper credits for the intro and end music are "Energetic Sports Drive." G. Thomas Craig mixed and edited the episode in both video and audio format.

Episoder(515)

Community in a Box with March Birch

Community in a Box with March Birch

"The key theme is you can be incredibly successful with the community, but you have to be intentional. Oftentimes what happened in my experience of observing other communities is that people would get really excited at the beginning. They would do a whole lot of work. And then after hosting, maybe three events, the enthusiasm would die and they wouldn't do anything else. So it was actually easy for people to start. It's not very easy to grow and scale, and that's why I talk a lot about intentionality" - Mark Birch Fresh out of the studio, Mark Birch, global startup advocate from Amazon Web Services (AWS) joined us in a conversation to discuss his new book "Community in a Box" and the key initiatives to engage startups and developer communities globally from New York to Asia Pacific through AWS. We start from Mark's background and discuss the inspiration, key themes and main takeaways on how to build event-driven professional communities. Last but not least, he discuss how to build the community flywheel and provided the aspiration to what a great community would look like in the future. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is mixed edited by Geoffrey Thomas Craig (LinkedIn).

5 Mar 202252min

South China Morning Post's Digital Transformation Journey with Gary Liu

South China Morning Post's Digital Transformation Journey with Gary Liu

"I believe that we have made great change. I think five years is going to be the same, I think in five years when we look back, even if it doesn't look that way, as we build piece by piece, we will be a technically advanced, user-first global news organization that is sustained by a diversified revenue model." - Gary Liu Fresh out of the studio, Gary Liu, chief executive officer of South China Morning Post (SCMP) joined us in a conversation on the digital transformation journey and where it is heading in a web3 world. We began the conversation with Gary reiterating the important role that SCMP plays as a bridge between China and the rest of the world. From there, he shared the early days and reflected on the key lessons from the first phase of their digital transformation with a focused video strategy. Continuing on, Gary shared SCMP's move into the Web3 world with the ARTIFACTS NFT project and how it jumpstarts the next phase of the digital transformation. Last but not least, he shared what great looks like for SCMP in the next 3-5 years. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is mixed edited by Geoffrey Thomas Craig (LinkedIn).

24 Feb 202253min

Global Coin Research & Web3 101 with Joyce Yang, Jin Kang & Daniel Kim

Global Coin Research & Web3 101 with Joyce Yang, Jin Kang & Daniel Kim

"I want GCR to build its brand verbally from the founders that we support. And we don't even ever have to promote ourselves at any point, it's that founders are able to recognize our value- add, or introduce us to projects and identify our unique position, that we can support them in ways that VCs or crypto investors cannot do. It's something that I think will really speak to the hard work that we do without ever having to promote ourselves." - Joyce Yang Fresh out of the studio, Joyce Yang, Jin Kang and Daniel Kim from Global Coin Research discuss the Global Coin Research DAO and its investment focus in Web3. We start with the vision and mission of the GCR DAO and then move into an in-depth conversation on web3 discussing the varying valuations of web3 companies, the choice of blockchains by web3 startups and where this is all moving towards at this instant of time. Author's Note: Bernard Leong is a supporter of the GCR DAO. BL might have taken positions in web3 DAOs and companies, hence this is not financial advice and if you want to invest, please do your own research. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is mixed edited by Geoffrey Thomas Craig (LinkedIn).

19 Feb 20221h 27min

Pace Enterprise & the Future of Finance in Asia Pacific with Turochas Fuad

Pace Enterprise & the Future of Finance in Asia Pacific with Turochas Fuad

"If the goal is to really democratize finance of businesses and consumers imagine that Mastercard and Visa has built an interchange network to facilitate payments across the globe. What if Pace can establish a similar global interchange network? For digital financing, covering a myriad of services to consumers, businesses, and even financial institutions, basically building the digital financing engine that lives on the cloud powered by blockchain on a web3 infrastructure and serving the needs of, you know, the future consumers, businesses, and even financial institutions down the road." - Turochas Fuad Fresh out of the studio, Turochas "T" Fuad, CEO and co-founder of Pace Enterprise joined us in a conversation to discuss his latest venture, Pace Enterprise and dived deep into the weeds of the "Buy Now, Pay Later" (or BNPL) space. He shared his thoughts on why BNPL can lead to sustainable companies and not just being a feature of a fintech company. Last but not least, Turochas offered his perspectives on how the different accelerating trends: fintech, decentralized finance and web3 are converging towards a coherent future of finance. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is mixed edited by Geoffrey Thomas Craig (LinkedIn).

13 Feb 202235min

Rainforest & the rise of Ecommerce Aggregators in Asia Pacific with JJ Chai

Rainforest & the rise of Ecommerce Aggregators in Asia Pacific with JJ Chai

But fundamentally the core of the business, at least the way we see it, is that, we need to be great operators of these brands as a start, in fact the best operators for these brands. For us here, it's about looking into ways to be differentiated around how to run those brands better than anyone else, and definitely better than the last owner. - JJ Chai Fresh out of the studio, JJ Chai, CEO and co-founder of Rainforest, joined us in a discussion on his company, a leading eCommerce aggregator that focuses on brands and products for the modern mum and offered his perspectives on the rise of ecommerce aggregators in Asia Pacific region. We dived into how JJ shared the vision and mission of Rainforest and their customer focus for the ecommerce aggregator. From there, we broadened the conversation with JJ explaining how ecommerce aggregators work with platforms such as Amazon and their playbook in selecting the right brands to acquire, scale and distribute. Last but not least, JJ offered his perspectives on how the landscape of ecommerce aggregators will change in the next couple of years globally. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is mixed edited by Geoffrey Thomas Craig (LinkedIn).

7 Feb 202235min

AppWorks & Investing in Web3 with Jamie Lin

AppWorks & Investing in Web3 with Jamie Lin

"So as of today, I think the choice between DAO and equity is how bullish you are in the project. So if you're thinking that companies launching its first or second project, there's still a highly likelihood that it's not gonna be hugely successful and you want to bet on the entire life cycle of the company, then right now, maybe equity is still a better tool. If you're really bullish on the project, but you're not as bullish on the company that maybe the DAO is a better way to go." - Jamie Lin Fresh out of the studio, Jamie Lin, chairman and partner of AppWorks, an accelerator and venture capital form shares the backstory of the company and how it started his investments across Taiwan and Southeast Asia and grew to its present state today. Jamie shares the investment thesis of the firm and the key traits of entrepreneurs and verticals which they can invest into. Last but not least, Jamie shares his perspectives in how venture capital will be transformed by web3 and offers his point of view on how AppWorks will position itself in this new era. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is edited by Geoffrey Thomas Craig.

18 Jan 202237min

Meta & What the Metaverse Opportunity means for Asia Pacific with Dan Neary

Meta & What the Metaverse Opportunity means for Asia Pacific with Dan Neary

"The important thing is, look, our mission hasn't changed. We're still focusing on helping people connect and finding communities and, and grow businesses. We've just very clearly put a stake in the ground around what we believe is the future. And more and more that's going to take place in the metaverse." - Dan Neary Fresh out of the studio, Dan Neary, Vice President for Meta (formerly Facebook) APAC joined us for an interesting conversation on the company’s re-brand, vision for the metaverse and why this may the biggest opportunity for businesses in Asia Pacific. In the conversation, Dan describes how Meta is helping to build the metaverse & talks about how the current ecosystem of communities, creators, commerce will converge with the next computing platform and create a completely new generation of experiences. Last but not least, he also shares how Meta is working with small businesses to support their digital transformation journey and get them future-ready. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is edited by Geoffrey Thomas Craig.

9 Jan 202230min

The State of China in 2021 with Shai Oster

The State of China in 2021 with Shai Oster

"There's definitely decoupling happening in terms of tech. And I actually was really skeptical of the coupling until this year. And I'm like, wow, you're really going to be seeing it. But on the other hand, the financial services sector is opening up much more this year than before." - Shai Oster Fresh out of the studio, Shai Oster, the Asia Bureau Chief for The Information returns for the sixth year to discuss the state of China in 2021. Shai reviewed his predictions in 2021 and offered his perspectives on what surprised him the most on China tech from the regulatory tsunami from the Chinese government to dwindling funding of the startup ecosystem. We discuss how the Chinese economy is undergoing major transformation and whether we have a China tech ecosystem in 2022. Last but not least, Shai Oster provided glimpse of what is to come for 2022. Podcast Information: The show is hosted and produced by Bernard Leong (@bernardleong, Linkedin) and Carol Yin (@CarolYujiaYin, LinkedIn). Sound credits for the intro and end music: "Run it" by DJ Snake, Rick Ross and Rich Brian and the episode is edited by Geoffrey Thomas Craig.

2 Jan 202240min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
e24-podden
rss-borsmorgen-okonominyhetene
rss-penger-polser-og-politikk
pengepodden-2
utbytte
finansredaksjonen
morgenkaffen-med-finansavisen
rss-sunn-okonomi
livet-pa-veien-med-jan-erik-larssen
okonomiamatorene
tid-er-penger-en-podcast-med-peter-warren
pengesnakk
lederpodden
rss-fa-makro
rss-markedspuls-2
lederskap-nhhs-podkast-om-ledelse
boligbobla
rss-andelige-tanker-med-camillo