DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world
AI Today17 Elo 2025

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.

Taking a snapshot is one thing. Remembering the molecular topology and their constant changes of state is truly what separates fact from fiction.

It seemed like an impossible target to hit. Until M3-Agent, the work of researchers associated with ByteDance at Shanghai Jiao Tong University, showed up with long-term multimodal memory - allowing the agent to see, hear, remember, and reason just like humans.

M3-Agent's potential is groundbreaking.

Here are just three use cases that will blow all our minds:

  • Autonomous robotics: Robots in homes or warehouses remember object locations, user habits, and past errors, adapting tasks dynamically, such as a caregiver bot recalling a patient's routines for personalized aid
  • Enhanced surveillance: Security systems analyse live video/audio feeds, building memory of normal patterns to detect anomalies, predict threats, and reason through scenarios, like identifying intruders based on historical behaviours
  • Personalised education: AI tutors process student interaction videos, remember progress and misconceptions over time, and deliver tailored lessons, such as adapting math explanations from weeks of observed struggles.


Read the paper: Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory.

Jaksot(90)

How to prepare your business for huge growth with AI

How to prepare your business for huge growth with AI

You will never hear a more important episode of AI Today.This show will transform your business.Unlock immense value.And help you take that step towards putting your business on autopilot - so you can...

12 Maalis 202539min

Vexis: the world's first AI programming language

Vexis: the world's first AI programming language

We've been moaning for months about the limitations of AI when coding.Which is because we're asking AI to jive with our human world.It's impossible. In its current state, AI can only predict the next ...

11 Maalis 202524min

Small models - massive impact

Small models - massive impact

Sick of paying a fortune to get answers from AI?Small language models (SLMs) are the answer.Learn how these efficient AIs offer comparable performance to large language models at a fraction of the cos...

11 Maalis 202511min

Wyndham Hotels and Resorts

Wyndham Hotels and Resorts

Many years ago I was an editor with the business they now call Wyndham Hotels and Resorts.So I decided to give it an AI makeover - with my co-hosts recommending opportunities for the hospitality indus...

8 Maalis 202510min

Hello, buy: AI-first selling with Microsoft Dynamics 365

Hello, buy: AI-first selling with Microsoft Dynamics 365

Sales is tough as old boots. Waiting months for a decision, trying to get your foot in the door, negotiations, mindreading - it's more than enough to justify an MBE.What if every salesperson had their...

5 Maalis 202523min

Cracking the code: Adventures in building with AI

Cracking the code: Adventures in building with AI

Crikey! You won't believe what's happening in the world of AI. This ain't your nan's tech anymore.We're talking AI animating logos using mere pico frames, filming entire movies inside video games, and...

4 Maalis 202520min

Cloudy days are over: How local AI saves millions delivering excellence

Cloudy days are over: How local AI saves millions delivering excellence

Want 98% accuracy mining huge document libraries while saving more than 80% on your AI spend?Stanford researchers developed minionS, a ridiculously smart process prompting single-step instructions on ...

25 Helmi 202517min

Evo 2, AI co-scientist, and the Majorana 1 quantum chip: How the second scientific revolution was revealed in 24 hours...

Evo 2, AI co-scientist, and the Majorana 1 quantum chip: How the second scientific revolution was revealed in 24 hours...

We just redefined 'fast'.In less than one revolution of the Earth, boffins announced a triple upgrade to humanity’s operating system: AI that writes DNA like Shakespearean sonnets, and A quantum chip ...

20 Helmi 202517min