DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world
AI Today17 Elo 2025

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.

Taking a snapshot is one thing. Remembering the molecular topology and their constant changes of state is truly what separates fact from fiction.

It seemed like an impossible target to hit. Until M3-Agent, the work of researchers associated with ByteDance at Shanghai Jiao Tong University, showed up with long-term multimodal memory - allowing the agent to see, hear, remember, and reason just like humans.

M3-Agent's potential is groundbreaking.

Here are just three use cases that will blow all our minds:

  • Autonomous robotics: Robots in homes or warehouses remember object locations, user habits, and past errors, adapting tasks dynamically, such as a caregiver bot recalling a patient's routines for personalized aid
  • Enhanced surveillance: Security systems analyse live video/audio feeds, building memory of normal patterns to detect anomalies, predict threats, and reason through scenarios, like identifying intruders based on historical behaviours
  • Personalised education: AI tutors process student interaction videos, remember progress and misconceptions over time, and deliver tailored lessons, such as adapting math explanations from weeks of observed struggles.


Read the paper: Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory.

Jaksot(90)

Enzyme in plastic - it's FANTASTIC!

Enzyme in plastic - it's FANTASTIC!

Oh, Barbie Girl. Anyone remember Aqua? And in one fell swoop, the AI Today podcast lost 49 subscribers...Ready for a masterclass in competitive advantage?Picture this: AI’s next battleground isn’t jus...

19 Helmi 202518min

REVEALED: The truth about AI coding

REVEALED: The truth about AI coding

Imagine a world where software engineers are replaced by other software engineers that are entirely digital.No coffee breaks, no office politics, just pure, unadulterated code. It sounds like science ...

18 Helmi 202519min

Decoding Grok-3: Elon Musk's AI and the future of everything

Decoding Grok-3: Elon Musk's AI and the future of everything

This morning we woke to a new dawn for AI.Grok-3 is a cutting-edge large language model (LLM) from Elon Musk's XAI, designed to understand and generate human-like text, outperforming competitors in se...

18 Helmi 202514min

Table stakes: Businesses bet big on AI and data

Table stakes: Businesses bet big on AI and data

There are so many examples of ballsy businesses finding gems in their mountains of documents and datasets, thanks to the superpowered excavator that's AI, that cynics and sceptics are heading for the ...

17 Helmi 202523min

How to win with AI at work

How to win with AI at work

I've pulled together some really simple ways to make AI your best friend - or at least, frenemy - during the 9 to 5. This episode is dedicated to business leaders and everyone doing the real work. It'...

5 Helmi 202519min

The wildest month in genAI history...

The wildest month in genAI history...

What just happened? January 2025: a month of unprecedented change in generative AI. The open-source community is shaking up the industry, challenging the dominance of tech giants. This episode of AI T...

28 Tammi 202515min

42 years to build an app

42 years to build an app

This is the most personal episode I have ever recorded. It's my near half-century journey to building an app. And how AI made it possible. I'm a pre-beginner coder. Yet eventually - and I mean, eventu...

27 Tammi 202523min

25 extraordinary business AI use cases

25 extraordinary business AI use cases

Warning: After listening to this podcast, you won't be able to sit still. The possibilities revealed by AI will have you leaping into action, driving innovation, and revolutionising your business. Are...

16 Tammi 202530min