DeepMind's self-improving robotic agent, RoboCat, and Microsoft's new AI model, Orca. They also discuss two research papers, "RED FM" and "SqueezeLLM," that introduce new resources for multilingual relation extraction and a post-training quantization framework, respectively.
Contact: sergi@earkind.com
Timestamps:
00:34 Introduction
01:37 DeepMind Announces RoboCat: A self-improving robotic agent
03:35 Meet Orca, Microsoft’s new 13 billion parameter AI model that can imitate GPT-4
05:40 Levanter — Legible, Scalable, Reproducible Foundation Models with JAX
06:57 Fake sponsor
09:15 RED$^{\rm FM}$: a Filtered and Multilingual Relation Extraction Dataset
11:06 Fast Diffusion Model
12:38 SqueezeLLM: Dense-and-Sparse Quantization
14:25 Outro
