LOCOMO: Unlocking Long-Term Memory in Conversational AI
GenAI Level UP31 Joulu 2024

LOCOMO: Unlocking Long-Term Memory in Conversational AI

How well can AI remember and use information in long conversations?

This episode explores the groundbreaking LOCOMO dataset, a unique resource designed to evaluate long-term conversational memory in Large Language Models (LLMs).

We delve into the challenges of current AI in maintaining coherent, empathetic conversations over multiple sessions. Discover how the LOCOMO dataset, generated through a human-machine pipeline with unique personas, temporal event graphs, and multimodal dialogue capabilities, is pushing the boundaries of conversational AI.

We discuss key findings from experiments using base models, long-context LLMs, and Retrieval Augmented Generation (RAG) techniques, revealing limitations and promising approaches for improving long-term memory. We'll also examine the ethical considerations of creating realistic conversational agents that can remember our past interactions.

Learn about the importance of structured information like observations about speakers and retrieval based methods, in order to create truly conversational AI.


    • Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

    Jaksot(45)

    Recursive Self Improvement

    Recursive Self Improvement

    Imagine holding a wrench on an assembly line. Suddenly, it leaps from your hand, sprouts its own mechanical arms, and begins forging a faster, lighter wrench without you. You are no longer the creator...

    7 Kesä 1h

    Master the New Physics of AI with Context Graphs & GraphRAG

    Master the New Physics of AI with Context Graphs & GraphRAG

    Stop trying to find the "magic words" to hack your LLM. The era of the Prompt Engineer—tweaking adjectives and hoping for the best—is officially over. We are entering the age of the Context Engineer, ...

    1 Helmi 17min

    Context Graph

    Context Graph

    Stop feeding your AI static facts in a dynamic world.Most RAG systems and Knowledge Graphs rely on a fundamental unit called the "Triple" (Subject, Verb, Object). It’s efficient, but it’s brittle. It ...

    25 Tammi 19min

    Nested Learning: The Illusion of Deep Learning Architectures

    Nested Learning: The Illusion of Deep Learning Architectures

    Why do today's most powerful Large Language Models feel... frozen in time? Despite their vast knowledge, they suffer from a fundamental flaw: a form of digital amnesia that prevents them from truly le...

    14 Marras 202513min

    Memento: Fine-tuning LLM Agents without Fine-tuning LLMs

    Memento: Fine-tuning LLM Agents without Fine-tuning LLMs

    What if you could build AI agents that get smarter with every task, learning from successes and failures in real-time—without the astronomical cost and complexity of constant fine-tuning? This isn't a...

    1 Marras 202518min

    MemGPT: Towards LLMs as Operating Systems

    MemGPT: Towards LLMs as Operating Systems

    Have you ever felt the frustration of an LLM losing the plot mid-conversation, its brilliant insights vanishing like a dream? This "goldfish memory"—the limited context window—is the Achilles' heel of...

    1 Marras 202518min

    DeepSeek-OCR: Contexts Optical Compression

    DeepSeek-OCR: Contexts Optical Compression

    The single biggest bottleneck for Large Language Models isn't intelligence—it's cost. The quadratic scaling of self-attention makes processing truly long documents prohibitively expensive, a fundament...

    24 Loka 202513min

    A Definition of AGI

    A Definition of AGI

    For decades, Artificial General Intelligence has been a moving target, a nebulous concept that shifts every time a new AI masters a complex task. This ambiguity fuels unproductive debates and obscures...

    23 Loka 202519min