Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

Eye of Horus with xAI's API

Eye of Horus with xAI's API

Now anyone can know what everyone is doing in real time! xAI's API gives you access to the 560Gb of data generated every day by the millions of users on X, formerly Twitter. There are some fantastic o...

22 Okt 20249min

Automation and collaboration with AI communication protocol Agora

Automation and collaboration with AI communication protocol Agora

Business is a spider's web of complex processes. And up until now, it's been super hard to get AI working on multi-task processes, without some PhD-level hacking which, unless you're using open source...

21 Okt 202411min

Secrets to next-level AI results

Secrets to next-level AI results

Efficiency. Productivity. Growth. That's why we're here. And on today's show, we're hitting all three with the force of a bullet train. 3 AI experts share how they create the best results, in three to...

20 Okt 202416min

Understanding our physical world, with Archetype AI's Newton Large Behaviour Model

Understanding our physical world, with Archetype AI's Newton Large Behaviour Model

AI's made its name in the digital space. But thanks to Archetype AI, it's broken away from its silicon prison to learn about our physical world. Archetype's Newton, a Large Behaviour Model, is current...

18 Okt 202422min

Get to the heart of Microsoft's AI for Health

Get to the heart of Microsoft's AI for Health

Imagine a world where a doctor, armed with an AI-powered assistant, can diagnose diseases like pancreatic cancer earlier, potentially saving thousands of lives annually. This isn't science fiction; it...

17 Okt 20247min

Thinking of the future - with Meta's Thought Preference Optimisation

Thinking of the future - with Meta's Thought Preference Optimisation

Imagine your marketing team brainstorming hundreds of genuinely inspired ideas in seconds. That's the potential of Thought Preference Optimisation (TPO), a new AI technology from Meta. TPO is like giv...

16 Okt 20246min

How to win a $180,000 AI job

How to win a $180,000 AI job

Former Deloitte consultant Varun Kulkarni spent 8 months honing his application strategy to score a huge payday as a senior AI product manager gig with Cisco. On today's show we explore how he did it ...

16 Okt 202411min

Playbooks to moonshots: how AI is upsetting our apple carts...

Playbooks to moonshots: how AI is upsetting our apple carts...

AI is a paradigm shift for thinking and understanding. Our old frameworks and models are being challenged into obscurity by a new way of looking at the world. And even the things we used to think of a...

16 Okt 20248min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden