Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

World-class customer research - without the customers!

World-class customer research - without the customers!

If you're familiar with the Eisenhower matrix you'll be familiar with businesses and customer research - they simply don't know what they don't know! But thanks to two crucial AI research studies, we'...

16 Jan 202512min

2025: AI and what I'm building

2025: AI and what I'm building

The past few weeks in AI have shattered my brain into a billion fragments of wonder. We've even found a new way to do AI, beyond transformers - that could change even what's been the most changeful we...

23 Dec 202410min

BIG LAUNCHES: Devin and Gemini 2 Flash overshadow Santa's sack

BIG LAUNCHES: Devin and Gemini 2 Flash overshadow Santa's sack

You've heard the pandemonium all about Google launching its fastest and smartest frontier model yet. But what does it mean for your business? And what about Devin - the grown-up AI copilot for your en...

12 Dec 202418min

AI Tomorrow

AI Tomorrow

Finally - an overdue appearance from AI Today creator, Dave Thackeray! What a year it's been. And it's just the beginning. Join me taking a look at 2024 and the indisputable delights and miracles co...

9 Dec 202414min

EXCLUSIVE: AI gets memory!

EXCLUSIVE: AI gets memory!

The last barrier to enterprise adoption of AI was memory. Baking into every prompt what the algorithm needed to know, was enough to send business leaders scurrying for the Luddite hills. But now Googl...

20 Nov 202427min

CMO wet dream: Predicting human behaviour

CMO wet dream: Predicting human behaviour

Understanding human behaviour is critical to business success. Behavioural science informs every growth stage and product decision - yet so few businesses pay any attention to human behaviour and psyc...

7 Nov 202416min

Accelerating R&D with AI

Accelerating R&D with AI

Tired of research and development (R&D) bottlenecks? Today's episode of AI Today explores how AI can supercharge product development by rapidly uncovering game-changing insights from mountains of data...

1 Nov 202422min

AI as your full-stack engineer: with Databutton, it's finally time!

AI as your full-stack engineer: with Databutton, it's finally time!

I've tested 20 AI coding editors. My tech skills are basic, at best. None turned my ideas into apps. That's when I found Databutton. And now I'm an app developer. Listen in to find out how Databutton ...

30 Okt 202427min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden