Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

Your Data, Your AI: Unlock the Power of Decentralised Learning

Your Data, Your AI: Unlock the Power of Decentralised Learning

Navigating the high costs and data challenges of cloud-based AI is a significant barrier for many businesses looking to innovate.But there's a powerful, practical alternative emerging.This episode exp...

10 Maj 202514min

When full stack AI businesses rule the world...

When full stack AI businesses rule the world...

Fasten your seatbelts, business leaders!We're diving deep into Y Combinator's Summer 2025 Request for Startups, their signal flare for what's NEXT in innovation.2025 is shaping up to be the year of th...

9 Maj 202514min

How to get your ideas heard at work

How to get your ideas heard at work

I'd just about had it with bosses choosing to hear your ideas spoken by consulting firms - when they could have saved a fortune listening to them coming from their creator, many months ago.Now, with A...

3 Maj 202513min

Dogfooding The Era of Experience with Mobility AI

Dogfooding The Era of Experience with Mobility AI

On the last episode we discussed a new way to train AI models: themselves, by capturing signals and insights from our world.Today we look at one such approach - Mobility AI, another Google initiative ...

24 Apr 202512min

Where AI goes next: The Age of Experience

Where AI goes next: The Age of Experience

Now generative AI has inhaled all human knowledge, it's time to create its own. We review a very exciting new paper, called The Age of Experience, that explains how AI agents will create their own dat...

21 Apr 202518min

How to create an annual report with AI

How to create an annual report with AI

I built a team of AI agents to create an annual report - one of the journalist's worst nightmares. And it did a remarkable job.Read all about it:https://medium.com/@DaveThackeray/how-to-create-an-annu...

15 Apr 202517min

Do everything faster, and smarter - with Google's A2A

Do everything faster, and smarter - with Google's A2A

Are your AI agents brilliant but lonely?Do they operate in isolation, unable to tap into data and capabilities across your organisation, hindering your potential for true automation and growth?Then ge...

14 Apr 202515min

How to avoid being scammed by AI

How to avoid being scammed by AI

We're seeing a continuing growth in the number of duplicitous attacks by AI agents on individuals.Previously cyber criminals focused most of their efforts where the greatest gains were to be made - ph...

14 Mars 202513min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden