DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world
AI Today17 Elo 2025

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.

Taking a snapshot is one thing. Remembering the molecular topology and their constant changes of state is truly what separates fact from fiction.

It seemed like an impossible target to hit. Until M3-Agent, the work of researchers associated with ByteDance at Shanghai Jiao Tong University, showed up with long-term multimodal memory - allowing the agent to see, hear, remember, and reason just like humans.

M3-Agent's potential is groundbreaking.

Here are just three use cases that will blow all our minds:

  • Autonomous robotics: Robots in homes or warehouses remember object locations, user habits, and past errors, adapting tasks dynamically, such as a caregiver bot recalling a patient's routines for personalized aid
  • Enhanced surveillance: Security systems analyse live video/audio feeds, building memory of normal patterns to detect anomalies, predict threats, and reason through scenarios, like identifying intruders based on historical behaviours
  • Personalised education: AI tutors process student interaction videos, remember progress and misconceptions over time, and deliver tailored lessons, such as adapting math explanations from weeks of observed struggles.


Read the paper: Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory.

Jaksot(90)

What happens when AI fires all the hirers?

What happens when AI fires all the hirers?

Recruitment is being radically remodelled by AI.And according to a brand new piece of research, AI is already humiliating humans at hiring.Hear the story behind the headlines that AI-led interviews in...

21 Elo 20251h 5min

The AI revelation: unlocking simpler, superior LLMs

The AI revelation: unlocking simpler, superior LLMs

Wrestling with the 'Wild West' of Large Language Models (LLMs)?While LLMs are poised to redefine business, the crucial 'secret sauce' of reinforcement learning (RL) has become a labyrinth of conflicti...

12 Elo 202540min

Faster, Smarter, Better: How vibe coding transforms product development

Faster, Smarter, Better: How vibe coding transforms product development

Businesses are looking at vibe coding all wrong. They're trying to brute force products using 0 engineers, all vibe coding.It's a bugger's muddle. You can't win. AI doesn't understand you, your custom...

11 Elo 202553min

Secrets of writing with AI - from a 30-year journalist

Secrets of writing with AI - from a 30-year journalist

That journalist is me, your host and producer of AI Today - Dave Thackeray.I was approached by a researcher from the data labs at London School of Economics who wanted to find out how writing had chan...

1 Elo 202547min

ASI made easy?

ASI made easy?

ASI-ARCH is an Artificial Superintelligence (ASI) that's a game-changer for AI research.Like a tireless super-scientist, it has autonomously invented 106 ground-breaking AI 'brains', unearthing surpri...

1 Elo 202516min

The secret of AI mastery that no one wants to share...

The secret of AI mastery that no one wants to share...

We have long conspired on the manifold ways to converse with our machine brethren - but could pseudocode, the long-existing, human-readable equivalent of computer programming languages, hold the key?T...

15 Kesä 202552min

Meet the team: AI agents running The Grand Serenity Hotel

Meet the team: AI agents running The Grand Serenity Hotel

I just finished the second part of my presentation on agentic AI in hotel operations.It's impossible to overlook the immense opportunities in AI across any business. People don't have time, and have t...

5 Kesä 202514min