Beyond The Prompt - How to use AI in your company8 Jul 2025

Chief of Staff for the Masses: How Meta’s Joshua To Designs Wearables with AI

In this episode, Joshua To, VP of Product Design at Meta, shares how AI is reshaping how—and where—we interact with technology. He walks us through Meta’s evolving approach to AR and wearables, why notifications are still the killer use case, and how AI is becoming the “brain behind empathy.”

We dig into what it means to build interfaces that understand you, why audio might be the future’s most underrated platform, and how designing for emotion changes everything—from form factor to function. Joshua also reflects on his path from launching a clothing brand to leading design at Google and Meta, and what those worlds taught him about craft, context, and human-centered systems.

This one’s for anyone designing AI into the real world—where every interface choice carries weight, and intelligence starts with listening.

Key takeaways:

Empathy Is the Real Intelligence — Joshua flips the definition of smart tech. It’s not just about outputs—it’s about understanding you. Context, tone, emotion—that’s what great AI will sense and respond to.
Design for the Moment, Not the Feed — AR’s killer use case isn’t games—it’s restraint. Joshua shares why the best AI product might just be the one that knows not to ping you. Context-aware computing is the real unlock.
Audio Is the Interface to Watch — Forget screens. The most powerful interface might be your ears. From wearables to ambient signals, Joshua explains why audio design is the next big frontier for human-centered AI.
AR Isn’t a Feature—It’s a System of Consideration — Joshua reframes augmented reality as quiet, ambient infrastructure. The real power of AR isn’t spectacle—it’s subtlety. It helps you move through the world with less friction, not more.

LinkedIn: Joshua To | LinkedIn
Website: Home - Joshua To
Meta: Meta Careers

00:00 Intro: Fixing Notifications With AI
00:54 Meet Josh: VP of Product Design at Meta
02:06 From Hoodies to Hardware: Josh's Journey
03:53 The Google Experience: From Ads to Product Management
10:37 The Evolution of Google Glass and AR
19:12 The Role of AI in Josh's Career
22:25 Designing the Future: AR, VR, and Attention Management
32:49 Contextually Aware Suggestions
33:38 Leveraging Generative AI in Design
34:52 AI's Role in Concept Art and Storyboarding
41:24 AI Tools and Model Capabilities
45:54 The Future of AI and Wearables
51:58 Reflections and Takeaways

📜 Read the transcript for this episode: Transcript of Chief of Staff for the Masses: How Meta’s Joshua To Designs Wearables with AI

For more prompts, tips, and AI tools. Check out our website: https://www.beyondtheprompt.ai/ or follow Jeremy or Henrik on Linkedin:

Henrik: https://www.linkedin.com/in/werdelin
Jeremy: https://www.linkedin.com/in/jeremyutley

Show edited by Emma Cecilie Jensen.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(69)

How Do You Run a Company When You Can’t See Six Months Ahead? - with Axios CEO Jim VandeHei

Jim VandeHei joins Henrik and Jeremy around the launch of his new book, Simplify: Do 50% More With 50% Less, co-authored with Mike Allen and Roy Schwartz. In the conversation, Jim shares how he’s lead...

16 Sep 1h 2min

From Knowledge Worker to Intelligence Worker: Why Human Judgment Matters More With AI - with OpenAI’s Brice Challamel

After helping lead AI adoption at Moderna, Brice Chalamel has a new goal at OpenAI: help create 1,000 AI adoption success stories across large organizations. Brice takes Henrik and Jeremy inside how w...

2 Sep 1h 13min

What Happens When AI Adoption Actually Works? - with Eric Porres, Chief AI Officer of Logitech

A year ago, Logitech had people experimenting with AI. Today, Eric says he can’t think of a single part of the company that isn’t building, exploring, or creating something with it. Eric shares what h...

19 Aug 1h 5min

Why Companies That Are Great at Innovation Still Fail - with Stanford Professor Charles O'Reilly

Most companies know how to innovate. Far fewer know how to scale innovation. Charles introduces the explore versus exploit framework, explaining why the same systems that help organizations succeed to...

5 Aug 43min

What You Can Learn From Asking AI for Brutal Honesty About Yourself - with Bestselling Author Daniel Pink

The conversation begins with an experiment that caught Jeremy's attention. Dan asked ChatGPT to tell him what his friends wouldn't. From questions about his blind spots to what people might say behind...

22 Jul 50min

Are You Qualified to Challenge Your Team on AI? - with Geoff Woods, Author of The AI-Driven Leader

Geoff Woods returns to Beyond the Prompt to discuss the updated edition of The AI-Driven Leader and what has changed over the past 18 months. Rather than focusing on the latest AI models, Geoff argues...

8 Jul 53min

The Unexpected Economics of AGI - with Christian Catalini, Tech Founder and Co-Creator of Libra

Christian believes the AI era will be defined less by generating outputs and more by evaluating them. As intelligence becomes cheaper and more accessible, the people who create the most value may be t...

24 Jun 53min

Why Fear Kills Curiosity and What That Means for AI - with Chantel Prat, Cognitive Neuroscientist

Chantel Prat studies how different brains make sense of the world. Her work starts from a simple idea: every experience leaves a mark. The inputs we consume shape how we think, what we notice, and ult...

10 Jun 1h 1min