DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world
AI Today17 Elo 2025

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.

Taking a snapshot is one thing. Remembering the molecular topology and their constant changes of state is truly what separates fact from fiction.

It seemed like an impossible target to hit. Until M3-Agent, the work of researchers associated with ByteDance at Shanghai Jiao Tong University, showed up with long-term multimodal memory - allowing the agent to see, hear, remember, and reason just like humans.

M3-Agent's potential is groundbreaking.

Here are just three use cases that will blow all our minds:

  • Autonomous robotics: Robots in homes or warehouses remember object locations, user habits, and past errors, adapting tasks dynamically, such as a caregiver bot recalling a patient's routines for personalized aid
  • Enhanced surveillance: Security systems analyse live video/audio feeds, building memory of normal patterns to detect anomalies, predict threats, and reason through scenarios, like identifying intruders based on historical behaviours
  • Personalised education: AI tutors process student interaction videos, remember progress and misconceptions over time, and deliver tailored lessons, such as adapting math explanations from weeks of observed struggles.


Read the paper: Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory.

Jaksot(90)

Your Data, Your AI: Unlock the Power of Decentralised Learning

Your Data, Your AI: Unlock the Power of Decentralised Learning

Navigating the high costs and data challenges of cloud-based AI is a significant barrier for many businesses looking to innovate.But there's a powerful, practical alternative emerging.This episode exp...

10 Touko 202514min

When full stack AI businesses rule the world...

When full stack AI businesses rule the world...

Fasten your seatbelts, business leaders!We're diving deep into Y Combinator's Summer 2025 Request for Startups, their signal flare for what's NEXT in innovation.2025 is shaping up to be the year of th...

9 Touko 202514min

How to get your ideas heard at work

How to get your ideas heard at work

I'd just about had it with bosses choosing to hear your ideas spoken by consulting firms - when they could have saved a fortune listening to them coming from their creator, many months ago.Now, with A...

3 Touko 202513min

Dogfooding The Era of Experience with Mobility AI

Dogfooding The Era of Experience with Mobility AI

On the last episode we discussed a new way to train AI models: themselves, by capturing signals and insights from our world.Today we look at one such approach - Mobility AI, another Google initiative ...

24 Huhti 202512min

Where AI goes next: The Age of Experience

Where AI goes next: The Age of Experience

Now generative AI has inhaled all human knowledge, it's time to create its own. We review a very exciting new paper, called The Age of Experience, that explains how AI agents will create their own dat...

21 Huhti 202518min

How to create an annual report with AI

How to create an annual report with AI

I built a team of AI agents to create an annual report - one of the journalist's worst nightmares. And it did a remarkable job.Read all about it:https://medium.com/@DaveThackeray/how-to-create-an-annu...

15 Huhti 202517min

Do everything faster, and smarter - with Google's A2A

Do everything faster, and smarter - with Google's A2A

Are your AI agents brilliant but lonely?Do they operate in isolation, unable to tap into data and capabilities across your organisation, hindering your potential for true automation and growth?Then ge...

14 Huhti 202515min

How to avoid being scammed by AI

How to avoid being scammed by AI

We're seeing a continuing growth in the number of duplicitous attacks by AI agents on individuals.Previously cyber criminals focused most of their efforts where the greatest gains were to be made - ph...

14 Maalis 202513min