LOCOMO: Unlocking Long-Term Memory in Conversational AI
GenAI Level UP31 Des 2024

LOCOMO: Unlocking Long-Term Memory in Conversational AI

How well can AI remember and use information in long conversations?

This episode explores the groundbreaking LOCOMO dataset, a unique resource designed to evaluate long-term conversational memory in Large Language Models (LLMs).

We delve into the challenges of current AI in maintaining coherent, empathetic conversations over multiple sessions. Discover how the LOCOMO dataset, generated through a human-machine pipeline with unique personas, temporal event graphs, and multimodal dialogue capabilities, is pushing the boundaries of conversational AI.

We discuss key findings from experiments using base models, long-context LLMs, and Retrieval Augmented Generation (RAG) techniques, revealing limitations and promising approaches for improving long-term memory. We'll also examine the ethical considerations of creating realistic conversational agents that can remember our past interactions.

Learn about the importance of structured information like observations about speakers and retrieval based methods, in order to create truly conversational AI.


  • Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

    Episoder(45)

    Recursive Self Improvement

    Recursive Self Improvement

    Imagine holding a wrench on an assembly line. Suddenly, it leaps from your hand, sprouts its own mechanical arms, and begins forging a faster, lighter wrench without you. You are no longer the creator...

    7 Jun 1h

    Master the New Physics of AI with Context Graphs & GraphRAG

    Master the New Physics of AI with Context Graphs & GraphRAG

    Stop trying to find the "magic words" to hack your LLM. The era of the Prompt Engineer—tweaking adjectives and hoping for the best—is officially over. We are entering the age of the Context Engineer, ...

    1 Feb 17min

    Context Graph

    Context Graph

    Stop feeding your AI static facts in a dynamic world.Most RAG systems and Knowledge Graphs rely on a fundamental unit called the "Triple" (Subject, Verb, Object). It’s efficient, but it’s brittle. It ...

    25 Jan 19min

    Nested Learning: The Illusion of Deep Learning Architectures

    Nested Learning: The Illusion of Deep Learning Architectures

    Why do today's most powerful Large Language Models feel... frozen in time? Despite their vast knowledge, they suffer from a fundamental flaw: a form of digital amnesia that prevents them from truly le...

    14 Nov 202513min

    Memento: Fine-tuning LLM Agents without Fine-tuning LLMs

    Memento: Fine-tuning LLM Agents without Fine-tuning LLMs

    What if you could build AI agents that get smarter with every task, learning from successes and failures in real-time—without the astronomical cost and complexity of constant fine-tuning? This isn't a...

    1 Nov 202518min

    MemGPT: Towards LLMs as Operating Systems

    MemGPT: Towards LLMs as Operating Systems

    Have you ever felt the frustration of an LLM losing the plot mid-conversation, its brilliant insights vanishing like a dream? This "goldfish memory"—the limited context window—is the Achilles' heel of...

    1 Nov 202518min

    DeepSeek-OCR: Contexts Optical Compression

    DeepSeek-OCR: Contexts Optical Compression

    The single biggest bottleneck for Large Language Models isn't intelligence—it's cost. The quadratic scaling of self-attention makes processing truly long documents prohibitively expensive, a fundament...

    24 Okt 202513min

    A Definition of AGI

    A Definition of AGI

    For decades, Artificial General Intelligence has been a moving target, a nebulous concept that shifts every time a new AI masters a complex task. This ambiguity fuels unproductive debates and obscures...

    23 Okt 202519min

    Populært innen Teknologi

    lydartikler-fra-aftenposten
    teknisk-sett
    tomprat-med-gunnar-tjomlid
    rss-ki-praten
    shifter
    elektropodden
    rss-ai-forklart
    rss-alt-som-gar-pa-strom
    pedagogisk-intelligens
    nasjonal-sikkerhetsmyndighet-nsm
    smart-forklart
    rss-polypod
    rss-fish-ships
    fornybaren
    rss-bouvet-bobler
    rss-kunstig-intelligens-med-elisabeth-maren-og-morten
    hans-petter-og-co
    rss-fisketimen
    teknologi-og-mennesker
    rss-digitaliseringspadden