Have we finally figured out how to make efficient AI?
AI Today25 Syys 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Jaksot(90)

What happens when AI fires all the hirers?

What happens when AI fires all the hirers?

Recruitment is being radically remodelled by AI.And according to a brand new piece of research, AI is already humiliating humans at hiring.Hear the story behind the headlines that AI-led interviews in...

21 Elo 20251h 5min

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

DeepMind's wet dream is M3-Agent's reality: how long-term multimodal memory is modelling the real world

Google DeepMind's Demis Hassabis and his team have a bold mission: penetrating the 4D chess game that's AI embracing our ever-changing biological, physical world.Taking a snapshot is one thing. Rememb...

17 Elo 202556min

The AI revelation: unlocking simpler, superior LLMs

The AI revelation: unlocking simpler, superior LLMs

Wrestling with the 'Wild West' of Large Language Models (LLMs)?While LLMs are poised to redefine business, the crucial 'secret sauce' of reinforcement learning (RL) has become a labyrinth of conflicti...

12 Elo 202540min

Faster, Smarter, Better: How vibe coding transforms product development

Faster, Smarter, Better: How vibe coding transforms product development

Businesses are looking at vibe coding all wrong. They're trying to brute force products using 0 engineers, all vibe coding.It's a bugger's muddle. You can't win. AI doesn't understand you, your custom...

11 Elo 202553min

Secrets of writing with AI - from a 30-year journalist

Secrets of writing with AI - from a 30-year journalist

That journalist is me, your host and producer of AI Today - Dave Thackeray.I was approached by a researcher from the data labs at London School of Economics who wanted to find out how writing had chan...

1 Elo 202547min

ASI made easy?

ASI made easy?

ASI-ARCH is an Artificial Superintelligence (ASI) that's a game-changer for AI research.Like a tireless super-scientist, it has autonomously invented 106 ground-breaking AI 'brains', unearthing surpri...

1 Elo 202516min

The secret of AI mastery that no one wants to share...

The secret of AI mastery that no one wants to share...

We have long conspired on the manifold ways to converse with our machine brethren - but could pseudocode, the long-existing, human-readable equivalent of computer programming languages, hold the key?T...

15 Kesä 202552min

Meet the team: AI agents running The Grand Serenity Hotel

Meet the team: AI agents running The Grand Serenity Hotel

I just finished the second part of my presentation on agentic AI in hotel operations.It's impossible to overlook the immense opportunities in AI across any business. People don't have time, and have t...

5 Kesä 202514min