Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Episoder(90)

How to prepare your business for huge growth with AI

How to prepare your business for huge growth with AI

You will never hear a more important episode of AI Today.This show will transform your business.Unlock immense value.And help you take that step towards putting your business on autopilot - so you can...

12 Mar 202539min

Vexis: the world's first AI programming language

Vexis: the world's first AI programming language

We've been moaning for months about the limitations of AI when coding.Which is because we're asking AI to jive with our human world.It's impossible. In its current state, AI can only predict the next ...

11 Mar 202524min

Small models - massive impact

Small models - massive impact

Sick of paying a fortune to get answers from AI?Small language models (SLMs) are the answer.Learn how these efficient AIs offer comparable performance to large language models at a fraction of the cos...

11 Mar 202511min

Wyndham Hotels and Resorts

Wyndham Hotels and Resorts

Many years ago I was an editor with the business they now call Wyndham Hotels and Resorts.So I decided to give it an AI makeover - with my co-hosts recommending opportunities for the hospitality indus...

8 Mar 202510min

Hello, buy: AI-first selling with Microsoft Dynamics 365

Hello, buy: AI-first selling with Microsoft Dynamics 365

Sales is tough as old boots. Waiting months for a decision, trying to get your foot in the door, negotiations, mindreading - it's more than enough to justify an MBE.What if every salesperson had their...

5 Mar 202523min

Cracking the code: Adventures in building with AI

Cracking the code: Adventures in building with AI

Crikey! You won't believe what's happening in the world of AI. This ain't your nan's tech anymore.We're talking AI animating logos using mere pico frames, filming entire movies inside video games, and...

4 Mar 202520min

Cloudy days are over: How local AI saves millions delivering excellence

Cloudy days are over: How local AI saves millions delivering excellence

Want 98% accuracy mining huge document libraries while saving more than 80% on your AI spend?Stanford researchers developed minionS, a ridiculously smart process prompting single-step instructions on ...

25 Feb 202517min

Evo 2, AI co-scientist, and the Majorana 1 quantum chip: How the second scientific revolution was revealed in 24 hours...

Evo 2, AI co-scientist, and the Majorana 1 quantum chip: How the second scientific revolution was revealed in 24 hours...

We just redefined 'fast'.In less than one revolution of the Earth, boffins announced a triple upgrade to humanity’s operating system: AI that writes DNA like Shakespearean sonnets, and A quantum chip ...

20 Feb 202517min

Populært innen Teknologi

romkapsel
rss-avskiltet
teknisk-sett
tomprat-med-gunnar-tjomlid
energi-og-klima
lydartikler-fra-aftenposten
rss-impressions-2
shifter
nasjonal-sikkerhetsmyndighet-nsm
fornybaren
elektropodden
hans-petter-og-co
smart-forklart
pedagogisk-intelligens
rss-alt-vi-kan
rss-fish-ships
teknologi-og-mennesker
rss-for-alarmen-gar
rss-ki-praten
rss-alt-som-gar-pa-strom