Tülu 3 opens language model post-training up to more tasks and more people | #ai #llm #allenai #2024
AI Today27 Marras 2024

Tülu 3 opens language model post-training up to more tasks and more people | #ai #llm #allenai #2024

Blog: https://allenai.org/blog/tulu-3 Summary The Allen Institute for Artificial Intelligence (Ai2) has released Tülu 3, an open-source family of post-trained language models. Unlike closed models from companies like OpenAI, Tülu 3's training data, methods, and code are publicly available, allowing researchers to replicate and build upon the work. This release aims to bridge the performance gap between open and closed models by providing comprehensive tools and datasets for post-training, including techniques for improving model safety and capabilities without losing general abilities. The project includes various model sizes, a user-friendly evaluation framework, and detailed documentation to aid researchers. Ai2's goal is to foster collaboration and innovation in open-source language model development. ai , llm, allenai, artificial intelligence , arxiv , research , paper , publication

Jaksot(30)

OpenAI's o3 and o3-mini: A New Frontier in AI | #ai #2024 #genai

OpenAI's o3 and o3-mini: A New Frontier in AI | #ai #2024 #genai

Blog: https://openai.com/12-days/ OpenAI announced two new large language models, o3 and o3-mini, showcasing significantly improved performance on various benchmarks, including coding, mathematics, ...

21 Joulu 202422min

Alignment Faking in Large Language Models | #ai #2024 #genai

Alignment Faking in Large Language Models | #ai #2024 #genai

Paper: https://arxiv.org/pdf/2412.14093 This research paper explores "alignment faking" in large language models (LLMs). The authors designed experiments to provoke LLMs into concealing their true pr...

21 Joulu 202414min

Veo 2, Imagen 3, and Whisk: State-of-the-Art AI Image and Video Generation | #ai #2024 #genai

Veo 2, Imagen 3, and Whisk: State-of-the-Art AI Image and Video Generation | #ai #2024 #genai

Blog: https://blog.google/technology/google... Google announced updates to its AI video and image generation models, Veo 2 and Imagen 3, boasting state-of-the-art capabilities in realism and style d...

21 Joulu 202419min

Allegro: Open the Black Box of Commercial-Level Video Generation Model | #ai #2024 #genai

Allegro: Open the Black Box of Commercial-Level Video Generation Model | #ai #2024 #genai

Paper: https://arxiv.org/pdf/2411.01747 This research report introduces Allegro, a novel, open-source text-to-video generation model that surpasses existing open-source and many commercial models in ...

4 Joulu 202419min

DynaSaur : Large Language Agents Beyond Predefined Actions | #ai #2024 #genai

DynaSaur : Large Language Agents Beyond Predefined Actions | #ai #2024 #genai

Paper: https://arxiv.org/pdf/2411.01747 The paper "DynaSaur: Large Language Agents Beyond Predefined Actions" introduces a novel large language model (LLM) agent framework that dynamically generates ...

4 Joulu 202419min

STAR ATTENTION: EFFICIENT LLM INFERENCE OVER LONG SEQUENCES | #ai #2024 #genai

STAR ATTENTION: EFFICIENT LLM INFERENCE OVER LONG SEQUENCES | #ai #2024 #genai

Paper: https://arxiv.org/pdf/2411.17116 The paper introduces Star Attention, a novel two-phase attention mechanism for efficient Large Language Model (LLM) inference on long sequences. It improves co...

4 Joulu 202416min

FERRET-UI 2: MASTERING UNIVERSAL USER INTERFACE UNDERSTANDING ACROSS PLATFORMS | #ai #2024 #genai

FERRET-UI 2: MASTERING UNIVERSAL USER INTERFACE UNDERSTANDING ACROSS PLATFORMS | #ai #2024 #genai

Paper: https://arxiv.org/pdf/2410.18967 The paper introduces Ferret-UI 2, a multimodal large language model (MLLM) that significantly improves upon its predecessor, Ferret-UI, by enabling universal u...

27 Marras 202414min

Adapting While Learning: Grounding LLMs for Scientific Problems I-Tool Usage Adaptation | #ai #2024

Adapting While Learning: Grounding LLMs for Scientific Problems I-Tool Usage Adaptation | #ai #2024

Paper: https://arxiv.org/abs/2411.00412 This research introduces a novel two-stage training method to improve Large Language Models' (LLMs) ability to solve complex scientific problems. The method, c...

27 Marras 202414min