Shows
Intelligent Machines (Audio)Dust and Deli Meat - Open Source AI Revolution
Can open-source AI models really be truly neutral, or are they just another conduit for hidden agendas? Hear how the founder of Nous Research is battling Silicon Valley giants to put ethical, user-controlled AI in everyone's hands.
TOpinion | The A.I. Prompt That Could End the World
AI videos of dead celebrities are horrifying many of their families
(20) Sam Altman on X: "We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems, but given the...
2025-10-163h 03Intelligent Machines (Video)Dust and Deli Meat - Open Source AI Revolution
Can open-source AI models really be truly neutral, or are they just another conduit for hidden agendas? Hear how the founder of Nous Research is battling Silicon Valley giants to put ethical, user-controlled AI in everyone's hands.
TOpinion | The A.I. Prompt That Could End the World
AI videos of dead celebrities are horrifying many of their families
(20) Sam Altman on X: "We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems, but given the...
2025-10-163h 03
Into the Bytecode#51 – Jeffrey Quesnelle on Nous Research, large language models, and the human mindThis is my conversation with Jeffrey Quesnelle, cofounder of Nous Research.Timestamps:- (00:00:00) intro- (00:01:08) working with new technologies- (00:06:15) Nous Research origin story- (00:14:08) open frontiers in research- (00:26:07) fourier transforms for gradient compression- (00:32:58) math behind distributed training- (00:38:18) sponsor: Splits- (00:39:02) neural networks history and fundamentals- (00:51:29) the human mind and AI, hyperdimensional representation- (01:01:15) intuition and reasoning- (01:15:00) parallels with reinforcement learning- (01:19:15) the cat is out of the bag- (01:47:11) deeper mysteriesLinks:- Jeffrey Quesnelle...
2025-03-182h 05
New Paradigm: AI Research SummariesExploring the DeMo Optimizer by Nous Research: Enhancing Large Neural Network TrainingThis episode analyzes the research paper "DeMo: Decoupled Momentum Optimization" by Bowen Peng, Jeffrey Quesnelle, and Diederik P. Kingma from Nous Research, published on November 29, 2024. The discussion focuses on the innovative approach proposed by the authors to enhance the efficiency of training large neural networks. By decoupling momentum updates and utilizing the Discrete Cosine Transform (DCT) to isolate and share only the most critical components of momentum, DeMo significantly reduces the communication overhead between accelerators. The analysis highlights how this method maintains or even improves the performance of models with billions of parameters compared to traditional optimizers like AdamW, while...
2024-12-2705 min
AI + a16zDisTrO and the Quest for Community-Trained AI ModelsIn this episode of AI + a16z, Bowen Peng and Jeffrey Quesnelle of Nous Research join a16z General Partner Anjney Midha to discuss their mission to keep open source AI research alive and activate the community of independent builders. The focus is on a recent project called DisTrO, which demonstrates it's possible to train AI models across the public internet much faster than previously thought possible. However, Nous is behind a number of other successful open source AI projects, including the popular Hermes family of "neutral" and guardrail-free language models.Here's an excerpt of Jeffrey explaining...
2024-09-271h 12
Detroit StoriesThe Church and Artificial IntelligenceDoes AI present a threat to humanity? Can it improve lives? And what can the Church say about it? Two Catholic experts discuss(0:03) The narrator recalls a media firestorm last year involving an AI-generated image of Pope Francis wearing a white “puffer” jacket. Though the image was fake, it was a prime example of the power of artificial intelligence to alter perceptions and a wake-up call to the possibilities and dangers of the emerging technology. (1:46) Matthew Harvey Sanders, a former seminarian and tech entrepreneur, talks about a project his company oversees called Magisterium AI, an AI-p...
2024-01-2427 min