Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

10x your AI results with this ultimate context engineering lesson

10x your AI results with this ultimate context engineering lesson

On today's show we create a business to show you the huge improvements in gravitating beyond prompt engineering to the new community of practice we call context engineering.You'll be rocked by the res...

5 Nov 202549min

When's the right time to go all-in with AI?

When's the right time to go all-in with AI?

Two of the most important voices in AI spoke out this week. Andrej Karpathy, one of the algorithm's greatest philosophers, was in conversation with Dwarkesh Patel talking praisingly and cautiously abo...

18 Okt 202514min

ELephantLM: the AI that never forgets!

ELephantLM: the AI that never forgets!

If only that was the real name. After all this time begging frontier labs to build an LLM that learns from its mistakes and applies its discoveries at inference time...Welcome to AI Today!

13 Okt 202537min

brAIn: thinking of the future?

brAIn: thinking of the future?

The Dragon Hatchling is a remarkable research paper that reboots modern AI as a model that approximates how our brains work.Today's show is a fascinating discussion and I implore you to both enjoy it ...

1 Okt 202529min

Does AI work?

Does AI work?

It's the one thing every business leader needs to know.If I put AI to work in my organisation, will it screw everything up?While we should all be in experiment mode right now - until someone figures o...

26 Sep 202527min

China's got AI in the bag

China's got AI in the bag

30 years in journalism has sharpened my mind.I've spent years in AI.And months researching China and the US as they fight silently for AI supremacy.$500bn in The Stargate Project does not come close t...

14 Sep 202523min

I'm working on the Zeitgeist

I'm working on the Zeitgeist

I've been working on a business intelligence platform leveraging AI and 30 years in journalism and content strategy. It's the toughest professional project of my career. And I have no idea if I will w...

3 Sep 202518min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden