Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Avsnitt(90)

Room for agentic AI? How hotels become smooth operators with the technological touch

Room for agentic AI? How hotels become smooth operators with the technological touch

AI Today creator Dave Thackeray today presented his own deep dive into how agentic AI is ready to be the key to efficient hotel operations - giving staff more time to deliver exceptional guest experie...

3 Juni 202543min

Safe or just plain woke: Anthropic's Claude 4 system card

Safe or just plain woke: Anthropic's Claude 4 system card

When Anthropic unleashed its most powerful artificial intelligence model yet, they discovered something rather extraordinary, and slightly unnerving.Claude 4 Opus developed an unexpected habit of tryi...

3 Juni 202519min

Mary Meeker's AI Trends

Mary Meeker's AI Trends

Hugely important work. But what does it mean to us? Today our hosts created their own company imagining how insights from this celebrated report would apply to the modern business environment.

1 Juni 202520min

AI to HR: Welcome, intelligence optimisation!

AI to HR: Welcome, intelligence optimisation!

What happens to the People team when it's juggling bodies AND bots?Thanks for listening to this special episode of AI Today. Read along with the show, here.

25 Maj 202510min

25 ways to put AI agents to work - right now!

25 ways to put AI agents to work - right now!

We've been waiting a hot minute for some genuinely useful AI agent case studies to drop.Now we have 25 on our plate.Take a listen to the highlights reel and then download them for yourself:https://www...

21 Maj 202513min

Google I/O 2025: What happens now?

Google I/O 2025: What happens now?

Read the full story here:https://medium.com/@DaveThackeray/a-world-beyond-google-i-o-2025-ea56bcd5e208We're on the cusp of some major announcements that will send shockwaves, and a spike in defibrilla...

19 Maj 202516min

Hallucination solution : Customer service ready for revolution!

Hallucination solution : Customer service ready for revolution!

Researchers have made huge strides fixing bad trips for AI.One of the latest breakthroughs is attentive reasoning queries (ARQs).You can see them in action using the open source Parlant application.Wh...

15 Maj 202518min

Hallucination: a bitter pill to swallow

Hallucination: a bitter pill to swallow

AI hallucinates 100% of the time. That's by design - without hallucinating the next word, this transformer architecture wouldn't exist.Thankfully, LLMs built for general purpose applications are right...

13 Maj 202530min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bosse-bildoktorn-och-hasse-p
bilar-med-sladd
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
rss-uppgang-och-fall
developers-mer-an-bara-kod
skogsforum-podcast
gubbar-som-tjotar-om-bilar
rss-veckans-ai
rss-technokratin
hej-bruksbil
rss-it-sakerhetspodden
rss-heja-framtiden
rss-fabriken-2
rss-digitala-influencer-podden
rss-milpodden