DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world
AI Today17 Elo 2025

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.

Taking a snapshot is one thing. Remembering the molecular topology and their constant changes of state is truly what separates fact from fiction.

It seemed like an impossible target to hit. Until M3-Agent, the work of researchers associated with ByteDance at Shanghai Jiao Tong University, showed up with long-term multimodal memory - allowing the agent to see, hear, remember, and reason just like humans.

M3-Agent's potential is groundbreaking.

Here are just three use cases that will blow all our minds:

  • Autonomous robotics: Robots in homes or warehouses remember object locations, user habits, and past errors, adapting tasks dynamically, such as a caregiver bot recalling a patient's routines for personalized aid
  • Enhanced surveillance: Security systems analyse live video/audio feeds, building memory of normal patterns to detect anomalies, predict threats, and reason through scenarios, like identifying intruders based on historical behaviours
  • Personalised education: AI tutors process student interaction videos, remember progress and misconceptions over time, and deliver tailored lessons, such as adapting math explanations from weeks of observed struggles.


Read the paper: Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory.

Jaksot(90)

World-class customer research - without the customers!

World-class customer research - without the customers!

If you're familiar with the Eisenhower matrix you'll be familiar with businesses and customer research - they simply don't know what they don't know! But thanks to two crucial AI research studies, we'...

16 Tammi 202512min

2025: AI and what I'm building

2025: AI and what I'm building

The past few weeks in AI have shattered my brain into a billion fragments of wonder. We've even found a new way to do AI, beyond transformers - that could change even what's been the most changeful we...

23 Joulu 202410min

BIG LAUNCHES: Devin and Gemini 2 Flash overshadow Santa's sack

BIG LAUNCHES: Devin and Gemini 2 Flash overshadow Santa's sack

You've heard the pandemonium all about Google launching its fastest and smartest frontier model yet. But what does it mean for your business? And what about Devin - the grown-up AI copilot for your en...

12 Joulu 202418min

AI Tomorrow

AI Tomorrow

Finally - an overdue appearance from AI Today creator, Dave Thackeray! What a year it's been. And it's just the beginning. Join me taking a look at 2024 and the indisputable delights and miracles co...

9 Joulu 202414min

EXCLUSIVE: AI gets memory!

EXCLUSIVE: AI gets memory!

The last barrier to enterprise adoption of AI was memory. Baking into every prompt what the algorithm needed to know, was enough to send business leaders scurrying for the Luddite hills. But now Googl...

20 Marras 202427min

CMO wet dream: Predicting human behaviour

CMO wet dream: Predicting human behaviour

Understanding human behaviour is critical to business success. Behavioural science informs every growth stage and product decision - yet so few businesses pay any attention to human behaviour and psyc...

7 Marras 202416min

Accelerating R&D with AI

Accelerating R&D with AI

Tired of research and development (R&D) bottlenecks? Today's episode of AI Today explores how AI can supercharge product development by rapidly uncovering game-changing insights from mountains of data...

1 Marras 202422min

AI as your full-stack engineer: with Databutton, it's finally time!

AI as your full-stack engineer: with Databutton, it's finally time!

I've tested 20 AI coding editors. My tech skills are basic, at best. None turned my ideas into apps. That's when I found Databutton. And now I'm an app developer. Listen in to find out how Databutton ...

30 Loka 202427min