Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

Enzyme in plastic - it's FANTASTIC!

Enzyme in plastic - it's FANTASTIC!

Oh, Barbie Girl. Anyone remember Aqua? And in one fell swoop, the AI Today podcast lost 49 subscribers...Ready for a masterclass in competitive advantage?Picture this: AI’s next battleground isn’t jus...

19 Feb 202518min

REVEALED: The truth about AI coding

REVEALED: The truth about AI coding

Imagine a world where software engineers are replaced by other software engineers that are entirely digital.No coffee breaks, no office politics, just pure, unadulterated code. It sounds like science ...

18 Feb 202519min

Decoding Grok-3: Elon Musk's AI and the future of everything

Decoding Grok-3: Elon Musk's AI and the future of everything

This morning we woke to a new dawn for AI.Grok-3 is a cutting-edge large language model (LLM) from Elon Musk's XAI, designed to understand and generate human-like text, outperforming competitors in se...

18 Feb 202514min

Table stakes: Businesses bet big on AI and data

Table stakes: Businesses bet big on AI and data

There are so many examples of ballsy businesses finding gems in their mountains of documents and datasets, thanks to the superpowered excavator that's AI, that cynics and sceptics are heading for the ...

17 Feb 202523min

How to win with AI at work

How to win with AI at work

I've pulled together some really simple ways to make AI your best friend - or at least, frenemy - during the 9 to 5. This episode is dedicated to business leaders and everyone doing the real work. It'...

5 Feb 202519min

The wildest month in genAI history...

The wildest month in genAI history...

What just happened? January 2025: a month of unprecedented change in generative AI. The open-source community is shaking up the industry, challenging the dominance of tech giants. This episode of AI T...

28 Jan 202515min

42 years to build an app

42 years to build an app

This is the most personal episode I have ever recorded. It's my near half-century journey to building an app. And how AI made it possible. I'm a pre-beginner coder. Yet eventually - and I mean, eventu...

27 Jan 202523min

25 extraordinary business AI use cases

25 extraordinary business AI use cases

Warning: After listening to this podcast, you won't be able to sit still. The possibilities revealed by AI will have you leaping into action, driving innovation, and revolutionising your business. Are...

16 Jan 202530min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden