Have we finally figured out how to make efficient AI?
AI Today25 Sep 2025

Have we finally figured out how to make efficient AI?

A fantastic research paper published in this month's Nature Computational Science suggests a solution may be in our midst for the incredible inefficiency in generative AI.

Large Language Models' (LLMs) transformer architecture requires the next token (generally part of a word) be predicted based on all the output tokens before it.

Power demands for this process are huge. Shuffling data between memory and processors isn't an easy pipeline, and when you need it to work quickly, those energy demands quickly stack up.

And in an AI arms race, where everyone wants bigger and better models, requiring increasingly powerful compute is required to stretch their limits, the dependence on energy to power, and cool, those processing units grows exponentially.

But what if there was a different, and better, way, to make AI work? That's the driving force behind work of Nathan Leroux and his team proposing a totally different paradigm: analog in-memory computing.

And that's exactly what we're discussing today.

Zip yourself in that flame retardant suit: things are about to get hot in here...

Ping me at dave@wordandmouth.com to get on the show or talk about AI in your world.

Episoder(90)

Room for agentic AI? How hotels become smooth operators with the technological touch

Room for agentic AI? How hotels become smooth operators with the technological touch

AI Today creator Dave Thackeray today presented his own deep dive into how agentic AI is ready to be the key to efficient hotel operations - giving staff more time to deliver exceptional guest experie...

3 Jun 202543min

Safe or just plain woke: Anthropic's Claude 4 system card

Safe or just plain woke: Anthropic's Claude 4 system card

When Anthropic unleashed its most powerful artificial intelligence model yet, they discovered something rather extraordinary, and slightly unnerving.Claude 4 Opus developed an unexpected habit of tryi...

3 Jun 202519min

Mary Meeker's AI Trends

Mary Meeker's AI Trends

Hugely important work. But what does it mean to us? Today our hosts created their own company imagining how insights from this celebrated report would apply to the modern business environment.

1 Jun 202520min

AI to HR: Welcome, intelligence optimisation!

AI to HR: Welcome, intelligence optimisation!

What happens to the People team when it's juggling bodies AND bots?Thanks for listening to this special episode of AI Today. Read along with the show, here.

25 Mai 202510min

25 ways to put AI agents to work - right now!

25 ways to put AI agents to work - right now!

We've been waiting a hot minute for some genuinely useful AI agent case studies to drop.Now we have 25 on our plate.Take a listen to the highlights reel and then download them for yourself:https://www...

21 Mai 202513min

Google I/O 2025: What happens now?

Google I/O 2025: What happens now?

Read the full story here:https://medium.com/@DaveThackeray/a-world-beyond-google-i-o-2025-ea56bcd5e208We're on the cusp of some major announcements that will send shockwaves, and a spike in defibrilla...

19 Mai 202516min

Hallucination solution : Customer service ready for revolution!

Hallucination solution : Customer service ready for revolution!

Researchers have made huge strides fixing bad trips for AI.One of the latest breakthroughs is attentive reasoning queries (ARQs).You can see them in action using the open source Parlant application.Wh...

15 Mai 202518min

Hallucination: a bitter pill to swallow

Hallucination: a bitter pill to swallow

AI hallucinates 100% of the time. That's by design - without hallucinating the next word, this transformer architecture wouldn't exist.Thankfully, LLMs built for general purpose applications are right...

13 Mai 202530min

Populært innen Teknologi

romkapsel
rss-avskiltet
teknisk-sett
tomprat-med-gunnar-tjomlid
energi-og-klima
lydartikler-fra-aftenposten
rss-impressions-2
shifter
nasjonal-sikkerhetsmyndighet-nsm
fornybaren
elektropodden
hans-petter-og-co
smart-forklart
pedagogisk-intelligens
rss-alt-vi-kan
rss-fish-ships
teknologi-og-mennesker
rss-for-alarmen-gar
rss-ki-praten
rss-alt-som-gar-pa-strom