Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

Prompt engineering masterclass

Prompt engineering masterclass

Here at AI Today, we know how to listen. We spent hours analysing Lenny Rachitsky - host of Lenny's Podcast - interviewing pro prompt engineer Mike Taylor to bring you this deep dive into all the tech...

30 Okt 202416min

How to make a ton of Monet with AI art...

How to make a ton of Monet with AI art...

Botto's 15,000 curators are celebrating a big win this week after six of their carefully-chosen, pixel-pushed masterpieces, sold for more than $350,000 at a Sotheby's auction in New York. It's a story...

29 Okt 202415min

Autonomous agents: Rebooting your business the right way

Autonomous agents: Rebooting your business the right way

Imagine if you had massive balls - crystal ones - to accurately forecast future business needs. That's one of the thousands of ways autonomous agents - popularised in organisations of all sizes throug...

27 Okt 202413min

Lose your RAG

Lose your RAG

Retrieval augmented generation is how we used to chunk content in huge corpuses of data. Now there's a new sheriff in town - contextual retrieval preprocessing, or contextual RAG. No more relying on k...

25 Okt 202416min

#FutureOfWork: AI as the enterprise nervous system with Microsoft's new Copilot

#FutureOfWork: AI as the enterprise nervous system with Microsoft's new Copilot

Let's take a look at how the latest version of Copilot can change the game for your business. Imagine a manufacturing company developing a new electric vehicle (EV) charging station. This complex proc...

24 Okt 202418min

How to build a video editor with Anthropic's Claude AI

How to build a video editor with Anthropic's Claude AI

If there's anyone left in the world yet to be convinced AI is changing it, have a chat with Meng To (@mengto on X). He just wrapped up Dreamcut.ai - what he calls his perfect video editor - after spen...

23 Okt 20249min

Claude Takes Control: AI That Uses Computers Like We Do

Claude Takes Control: AI That Uses Computers Like We Do

Forget everything you thought you knew about AI assistants. We're not talking simple chatbots that can barely string a sentence together. Claude 3.5 Sonnet, the latest iteration of Anthropic's groundb...

22 Okt 20249min

Solver brings full self driving to AI coding

Solver brings full self driving to AI coding

Engineering teams are frazzled. And we've all been down the Cursor, Aider, Cline, Bolt, and Replit rabbit roles questing for AI coding nirvana. But there are more potholes in the process than a worn-o...

22 Okt 20249min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden