OpenAI drama: Leaked documents and a resignation from a policy researcher.
DeepSeek-Prover: A new approach to formal theorem proving using synthetic data.
Dense Connector for MLLMs: A plug-and-play vision-language connector that enhances existing models.
Thermodynamic Natural Gradient Descent: A new algorithm for training neural networks using natural gradient descent.
Contact: sergi@earkind.com
Timestamps:
00:34 Introduction
01:29 On OpenAI's Sky Voice
03:04 Successful language model evals
03:58 Generative Molecular Design Isn't As Easy As People Make It Look
05:21 Fake sponsor
07:30 DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data
09:15 Dense Connector for MLLMs
10:43 Thermodynamic Natural Gradient Descent
12:37 Outro
