DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world
AI Today17 Elo 2025

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.

Taking a snapshot is one thing. Remembering the molecular topology and their constant changes of state is truly what separates fact from fiction.

It seemed like an impossible target to hit. Until M3-Agent, the work of researchers associated with ByteDance at Shanghai Jiao Tong University, showed up with long-term multimodal memory - allowing the agent to see, hear, remember, and reason just like humans.

M3-Agent's potential is groundbreaking.

Here are just three use cases that will blow all our minds:

  • Autonomous robotics: Robots in homes or warehouses remember object locations, user habits, and past errors, adapting tasks dynamically, such as a caregiver bot recalling a patient's routines for personalized aid
  • Enhanced surveillance: Security systems analyse live video/audio feeds, building memory of normal patterns to detect anomalies, predict threats, and reason through scenarios, like identifying intruders based on historical behaviours
  • Personalised education: AI tutors process student interaction videos, remember progress and misconceptions over time, and deliver tailored lessons, such as adapting math explanations from weeks of observed struggles.


Read the paper: Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory.

Jaksot(90)

Moonshots: The Rise of Conversational AI - Just Say What You Want

Moonshots: The Rise of Conversational AI - Just Say What You Want

We're about to blast off into the thrilling world of AI moonshots, where the seemingly impossible is not only conceivable but within reach. This isn't your everyday AI news; it's a glimpse into a futu...

27 Syys 202410min

Your Digital Doppelganger - AI Delegates are Coming

Your Digital Doppelganger - AI Delegates are Coming

AI isn't just about automating tasks. It's about creating a digital version of yourself - an AI delegate - that can interact with the world on your behalf. Imagine having an AI negotiate your salary, ...

27 Syys 202418min

From Sci-Fi to Reality: AI's Impact on Your World

From Sci-Fi to Reality: AI's Impact on Your World

Dive into the fascinating world of AI knowledge and discover how language models learn and retain information, going beyond simple language processing. This episode uncovers the secrets behind AI's ab...

27 Syys 202411min

AI Weather Wizards: Revolutionising Forecasts and Reshaping Industries

AI Weather Wizards: Revolutionising Forecasts and Reshaping Industries

Imagine a world where you know exactly when it will rain on your street, down to the minute. Where businesses can plan with near-perfect weather foresight, and where life-saving storm warnings arrive ...

26 Syys 202411min

AI Unleashed: Transforming Industries and Redefining Leadership

AI Unleashed: Transforming Industries and Redefining Leadership

In a world where artificial intelligence is reshaping industries at breakneck speed, staying ahead of the curve isn't just an advantage—it's a necessity. Did you know that by 2030, AI is projected to ...

26 Syys 202411min

Emotion Recognition AI: A Game-Changer for Business Growth

Emotion Recognition AI: A Game-Changer for Business Growth

The ability to accurately detect and interpret human emotions using AI and fNIRS technology has far-reaching implications for businesses across various sectors. This breakthrough could revolutionise c...

25 Syys 202418min

Decoding the Future: AI's Leap Towards Human-like Understanding

Decoding the Future: AI's Leap Towards Human-like Understanding

Dive into the future of AI-powered business growth with our latest episode of AI Today. We explore groundbreaking developments in context-aware chatbots and culturally sensitive AI that are set to rev...

24 Syys 202423min

AI in Agriculture: From Avocado-Picking Robots to Food Knowledge Graphs 🤖🥑

AI in Agriculture: From Avocado-Picking Robots to Food Knowledge Graphs 🤖🥑

In this episode of AI Today, we explore the fascinating intersection of AI and agriculture. Discover how AI-powered robots are revolutionizing avocado picking, ensuring delicate handling and reducing ...

23 Syys 202410min