Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(93)

The collapse of training

The collapse of training

When AI ingests all your company's documents and makes it easy for every colleague to get answers on every facet of their job, are we empowering people - or lobotomising them?Is the training struggle,...

10 Maj 20min

Who Taught the Machine to Forget?

Who Taught the Machine to Forget?

Three companies. Three crises. One unsettling question about what happens when you let machines do the remembering.In this episode: how a cheese shop and a 313-ship fleet solved the same problem from ...

8 Maj 26min

Why Your Company is a Giant, Amnesiac Goldfish (And How to Finally Build It a Brain)

Why Your Company is a Giant, Amnesiac Goldfish (And How to Finally Build It a Brain)

Your organisation generates a staggering mountain of data every single day. Slack threads ping, Jira tickets multiply, and emails fly back and forth at the speed of light. You have terabytes of perfec...

7 Maj 53min

10x your AI results with this ultimate context engineering lesson

10x your AI results with this ultimate context engineering lesson

On today's show we create a business to show you the huge improvements in gravitating beyond prompt engineering to the new community of practice we call context engineering.You'll be rocked by the res...

5 Nov 202549min

When's the right time to go all-in with AI?

When's the right time to go all-in with AI?

Two of the most important voices in AI spoke out this week. Andrej Karpathy, one of the algorithm's greatest philosophers, was in conversation with Dwarkesh Patel talking praisingly and cautiously abo...

18 Okt 202514min

ELephantLM: the AI that never forgets!

ELephantLM: the AI that never forgets!

If only that was the real name. After all this time begging frontier labs to build an LLM that learns from its mistakes and applies its discoveries at inference time...Welcome to AI Today!

13 Okt 202537min

brAIn: thinking of the future?

brAIn: thinking of the future?

The Dragon Hatchling is a remarkable research paper that reboots modern AI as a model that approximates how our brains work.Today's show is a fascinating discussion and I implore you to both enjoy it ...

1 Okt 202529min

Does AI work?

Does AI work?

It's the one thing every business leader needs to know.If I put AI to work in my organisation, will it screw everything up?While we should all be in experiment mode right now - until someone figures o...

26 Sep 202527min

Populärt inom Teknik

uppgang-och-fall
natets-morka-sida
elbilsveckan
bilar-med-sladd
market-makers
rss-technokratin
rss-laddstationen-med-elbilen-i-sverige
bli-saker-podden
rss-elektrikerpodden
rss-uppgang-och-fall
skogsforum-podcast
ai-sweden-podcast
hej-bruksbil
rss-heja-framtiden
rss-en-ai-till-kaffet
rss-snacka-om-ai
kodsnack
rss-digitala-influencer-podden
rss-milpodden
rss-vaxtpressenpodden