
Ep49. Artificial Intelligence, Scientific Discovery, and Product Innovation
This research paper examines the impact of an artificial intelligence tool for materials discovery on the productivity and performance of scientists working in a large U.S. firm's R&D lab. The study e...
18 Marras 20249min

Ep48. Large Language Models Can Self-Improve in Long-context Reasoning
This research paper investigates how large language models (LLMs) can improve their ability to reason over long contexts. The authors propose a self-improvement method called SEALONG that involves sam...
16 Marras 202411min

Ep47. Personalization of Large Language Models: A Survey
This paper is a survey of personalized large language models (LLMs), outlining different ways to adapt these models for user-specific needs. It analyzes how to personalize LLMs based on various user-s...
16 Marras 202426min

Ep46. Number Cookbook: Number Understanding of Language Models and How to Improve It
This research paper investigates the numerical understanding and processing abilities (NUPA) of large language models (LLMs). The authors introduce a benchmark, covering various numerical representati...
14 Marras 202417min

Ep44. Mixtures of In-Context Learners
The provided text describes a novel approach to in-context learning (ICL) called Mixtures of In-Context Learners (MOICL) that addresses key limitations of traditional ICL, such as context length const...
11 Marras 202417min

Ep43. Project Sid: Many-agent simulations toward AI civilization
This technical report describes "Project Sid," an experiment that aims to create and study AI civilizations within a Minecraft environment. The researchers introduce a new cognitive architecture calle...
10 Marras 202412min

Ep42. The Geometry of Concepts: Sparse Autoencoder Feature Structure
This research paper investigates the structure of the concept universe represented by large language models (LLMs), specifically focusing on how sparse autoencoders (SAEs) can be used to discover and ...
9 Marras 202413min