Shows
mbanerjeepalmer+listennotes 's Listen LaterThe RLVR Revolution — with Nathan Lambert (AI2, Interconnects.ai) Podcast: Latent Space: The AI Engineer Podcast (LS 43 · TOP 1.5% what is this?)Episode: The RLVR Revolution — with Nathan Lambert (AI2, Interconnects.ai)Pub date: 2025-07-31Get Podcast Transcript →powered by Listen411 - fast audio-to-text and summarizationWe first had Nathan on to give us his RLHF deep dive when he was joining AI2, and now he’s back to help us catch up on the evolution to RLVR (Reinforcement Learning with Verifiable Rewards), first proposed in his Tulu 3 paper. While RLHF remains foundational, RLVR has emerged as a powerful approac...
2025-08-161h 18
The Retort AI PodcastTom leaves stealth: Hortus AIAn exciting week for Tom, who tells Nate about his company Hortus AI, whose mission is to make AI accountable to local communities. We cover a lot of classic Retort themes as Tom makes a case for what's missing from AI development, and how models could be more healthily integrated into everyday people's lives.Press release: https://hortus.ai/wp-content/uploads/2025/02/Hortus-AI-Press-Release_Feb25.pdfCompany website: https://hortus.ai/Link to whitepaper: https://www.newamerica.org/rethinkai/policy-papers/a-sustainable-path-for-ai-development/ This is a public episode. If you would like to discuss this with...
2025-02-1853 min
Brilliant Minds’ DigestDeepSeek, OpenAI, and the Future of Intelligence with with Dylan Patel & Nathan Lambert - Competition, Ethics & AGI Dylan Patel and Nathan LambertIs China taking the lead in artificial intelligence? What’s the next big breakthrough in AI research? In this 17-minute episode of Brilliant Minds’ Digest, we distill insights from Lex Fridman’s conversation with AI experts Dylan Patel & Nathan Lambert, covering DeepSeek AI, AGI timelines, and the global AI arms race.
This conversation dives deep into the competition between AI giants, the challenges of scaling large models, and the escalating costs of AI research. Ethical concerns surrounding open-source models, data biases, and AI safety are also discussed, alongside the geopolitical implications of AI development and export controls.
Key...
2025-02-0817 min
AI SummerNathan Lambert on the rise of "thinking" language modelsNathan Lambert is the author of the popular AI newsletter Interconnects. He is also a research scientist who leads post-training at the Allen Institute for Artificial Intelligence, a research organization funded by the estate of Paul Allen. This means that the organization can afford to train its own models—and it’s one of the only such organizations committed to doing so in an open manner. So Lambert is one of the few people with hands-on experience building cutting-edge LLMs who can talk freely about his work. In this December 17 conversation, Lambert walked us through the steps required to trai...
2025-01-141h 00
The Retort AI PodcastWe ask again: Is AI a science?Tom and Nate sit down for a classic discussion of the role of AI in the modern philosophy of science. Much of this discussion is based on Thomas Samuel Kuhn's influential book The Structure of Scientific Revolutions. We ask -- is AI a science in the Kuhn'ian sense? Will the "paradigm" worldview apply to other sciences post AI? How will scientific institutions manage the addition of AI?We promised an AI for science reading list, so here it is:[Dario interview with Lex] https://youtu.be/ugvHCXCOmm4?si=1hnlvue8M4pV2TqCLevers for biological progress https://o...
2025-01-1053 min
The Retort AI PodcastThe Retort's biggest AI stories of 2024We're back! Tom and Nate catch up after the Thanksgiving holiday. Our main question was -- what were the biggest AI stories of the year? We touch on the core themes of the show: infrastructure, AI realities, and and antitrust. The power buildout to scale out AI is going to have very real long-term impacts.Some links this week:* Ben Thompson's, The End of the Beginning: https://stratechery.com/2020/the-end-of-the-beginning/* Miles Brundage's Substack: https://milesbrundage.substack.com/p/why-im-leaving-openai-and-what-im* Stochastic Parrots paper: https://dl.acm.org/doi/10.1145/3442188.3445922Thanks for listening! G...
2024-12-0647 min
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player AnalysisEverything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AIIn this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one...
2024-11-211h 47
The Retort AI PodcastThe Nobel AlbatrossTom and Nate catch up on the happenings in AI. Of course, we're focused on the biggest awards available to us as esteemed scientists (or something close enough) -- the Nobel Prizes! What does it mean in the trajectory of AI for Hinton and Hassabis to carry added scientific weight. Honestly, feels like a sinking ship. Some links:* Schmidhuber tweet: https://x.com/SchmidhuberAI/status/1844022724328394780* Hinton "I'm proud my student fired Sam": https://x.com/Grady_Booch/status/184414542282424329000:00 Introduction04:43 Criticism of AI-related Nobel Prize awards09:06 Geoffrey Hinton's comments on winning the N...
2024-10-1144 min
InterconnectsInterviewing Riley Goodside on the science of promptingRiley Goodside is a staff prompting engineer at Scale AI. Previously working in data science, he is often seen as the default for the new role of a “prompt engineer.” He regularly posts incisive prompts that illicit notable behavior from the most popular AI models.I really resonated with this saying from Anthropic’s recent podcast on prompt engineering — “now we write essays and treat them as code.” In order to be good at prompting, you need to understand that natural language operates as our code used to.This episode is a masterclass on why you should c...
2024-09-301h 08
The Retort AI PodcastClaude Needs a Constitutional ConventionTom and Nate catch up on recent events (before the OpenAI o1 release) and opportunities in transparency/policy. We recap the legendary scam of Matt from IT department, why disclosing the outcomes of process is not enough, and more. This is a great episode on understanding why the process technology was birthed from is just as important as the outcome!Some links:* Nathan's post on Model Specs for regulation https://www.interconnects.ai/p/a-post-training-approach-to-ai-regulation* Nathan's post on inference spend https://www.interconnects.ai/p/openai-strawberry-and-inference-scaling-lawsSend your questions to mail at retortai...
2024-09-1342 min
The Retort AI PodcastAvoiding the AI burnoutTom and Nate catch up on core themes of AI after a somewhat unintended summer break. We discuss the moral groundings and philosophy of what we're building, our travels, The Anxious Generation, AGI obsessions, an update on AI Ethics vs. AI Safety, and plenty more in between.As always, contact us at mail@retortai.comSome links we mention in the episode:* The Emotional Dog and its Rational Tail https://motherjones.com/wp-content/uploads/emotional_dog_and_rational_tail.pdf* The Anxious Generation https://www.amazon.com/Anxious-Generation-Rewiring-Childhood-Epidemic/dp/0593655036* Shadow Lake Lodge...
2024-08-2636 min
InterconnectsInterviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agentsI had the pleasure of Talking with Ross Taylor, who has a great spectrum of unique experiences in the language modeling space — evaluation experience, Galactica lead author, Llama post training, etc. This is a really great conversation on the frontier of language model (LM) reasoning, LM deployments and demos, LM’s for science, RLHF, and other topics. I’ve been trying to get Ross to come on for a bit. He’s one of those people in the LM space that doesn’t speak too much, but when you do, you listen.Ross Taylor was previously an LLM lead a...
2024-08-081h 02
InterconnectsInterviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI educationThis week, I had the pleasure of chatting with Sebastian Raschka. Sebastian is doing a ton of work on the open language model ecosystem and AI research broadly. He’s been writing the great Ahead of AI newsletter (that has the biggest audience overlap with Interconnects, at 26%, so a lot of you know him) and multiple educational books, all on top of being a full time machine learning engineer at Lightning.ai, where he maintains LitGPT, which he described as being like Karpathy’s NanoGPT, with slightly more abstractions.This conversation mostly surrounds keeping up with AI rese...
2024-08-011h 03
The Retort AI PodcastWhat we are getting wrong about AI regulationTom and Nate catch up on the rapidly evolving (and political) space of AI regulation. We cover CA SB 1047, recent policing of data scraping, presidential appointees, antitrust intention vs. implementation, FLOP thresholds, and everything else touching the future of large ML models.Nate's internet cut out, so this episode ends a little abruptly. Reach out with any questions to mail at retortai.comSome links:- night falls on the cumberlands https://en.wikipedia.org/wiki/Night_Comes_to_the_Cumberlands- hillbilly elegy https://en.wikipedia.org/wiki/Hillbilly_Elegy...
2024-07-1934 min
Missions TodayReimagining Short Term Missions with Nathan NelsonSummer seems to be a prime time for short term mission trips. But are those short-term trips you are making really doing the MOST good? Join Collin this weekend as he speaks with Nathan Nelson about reimagining short term missions to do the absolute most good for all involved. That’s this weekend on Missions Today!
For more information on our guest this week and his work, please check out the links below:
Nathan Nelson
Bethany Community Church
Reimagining Short Term Missions
#missions #mission #shorttermmissions #missiontrips #mostgood #church #service #faith #relationships #church #seattle #na...
2024-07-0626 min
The Retort AI PodcastAI, feedback, and population public healthTom and Nate revisit one of their old ideas -- AI through the lens of public health infrastructure, and especially alignment. Sorry about Tom's glitchy audio, I figured it out after the fact that he was talking into the microphone at the wrong angle. Regardless, here are some links for this week. Links:- Data foundry for AI https://scale.com/blog/scale-ai-series-f - Information piece on Scale AI ($) https://www.theinformation.com/articles/why-a-14-billion-startup-is-now-hiring-phds-to-train-ai-from-their-living-rooms?shared=168f685a864ca709 - ChatGPT compounding math: https://chatgpt.com/share/2c19a357-acb2-441d-8203-946b74ce785c ...
2024-06-2841 min
InterconnectsInterviewing Dean Ball on AI policy: CA SB 1047, upcoming AI disaster response, Llama 3 405B, Chinese open-source AI, and scaling lawsI’m really excited to resume the Interconnects Interviews with Dean W. Ball from the Hyperdimensional Substack (you should subscribe). We cover the whole stack of recent happenings in AI policy, focusing of course on California’s bill SB 1047. We cover many, many more great topics here including:* What will happen in the case of a minor AI disaster,* If Meta will release the 405B model, and why,* The status of Chinese open-source AI,* Training on model outputs,* Anthropic’s recent strategy,* What scaling laws actually mean,...
2024-06-2756 min
The Retort AI PodcastApple sends a memo to the AGI faithfulTom and Nate caught up last week (sorry for the editing delay) on the big two views of the AI future: Apple Intelligence and Situational Awareness (Nationalistic AI doom prevention). One of our best episodes, here are the links:* The Kekulé Problem https://en.wikipedia.org/wiki/The_Kekul%C3%A9_Problem* Truth and Method https://en.wikipedia.org/wiki/Truth_and_Method* Situational Awareness https://situational-awareness.ai/00:00 A Hypothetical Life: From Germany to AGI01:20 Leopold Aschenbrenner: Situational Awareness and Extrapolation02:01 The Retort: Apple vs. Doomsday AI03:40 Credentials and Social Choice T...
2024-06-2152 min
Super Data Science: ML & AI Podcast with Jon Krohn791: Reinforcement Learning from Human Feedback (RLHF), with Dr. Nathan LambertReinforcement learning through human feedback (RLHF) has come a long way. In this episode, research scientist Nathan Lambert talks to Jon Krohn about the technique’s origins of the technique. He also walks through other ways to fine-tune LLMs, and how he believes generative AI might democratize education.This episode is brought to you by AWS Inferentia (go.aws/3zWS0au) and AWS Trainium (go.aws/3ycV6K0), and Crawlbase (crawlbase.com), the ultimate data crawling platform. Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information.
2024-06-1157 min
The Retort AI PodcastMurky waters in AI policyTom and Nate catch up on many AI policy happenings recently. California's "anti open source" 1047 bill, the senate AI roadmap, Google's search snaifu, OpenAI's normal nonsense, and reader feedback! A bit of a mailbag. Enjoy.00:00 Murky waters in AI policy00:33 The Senate AI Roadmap05:14 The Executive Branch Takes the Lead08:33 California's Senate AI Bill22:22 OpenAI's Two Audiences28:53 The Problem with OpenAI Model Spec39:50 A New World of AI RegulationA bunch of links...Data and society whitepaper: https://static1.squarespace.com/static/66465fcd83d1881b974fe099/t/664b866...
2024-05-3143 min
The Retort AI PodcastChatGPT talks: diamond of the season or quite the scandal?Tom and Nate discuss two major OpenAI happenings in the last week. The popular one, the chat assistant, and what it reveals about OpenAI's worldview. We pair this with discussion of OpenAI's new Model Spec, which details their RLHF goals: https://cdn.openai.com/spec/model-spec-2024-05-08.htmlThis is a monumental week for AI. The product transition is completed, we can't just be researchers anymore.00:00 Guess the Donkey Kong Character00:50 OpenAI's New AI Girlfriend07:08 OpenAI's Business Model and Responsible AI08:45 GPT-2 Chatbot Thing and OpenAI's Weirdness12:48 OpenAI and the...
2024-05-1751 min
The Retort AI PodcastThree pillars of AI powerTom and Nate discuss the shifting power landscape in AI. They try to discern what is special about Silicon Valley's grasp on the ecosystem and what other types of power (e.g. those in New York and Washington DC) will do to mobilize their influence. Here's the one Tweet we referenced on the FAccT community: https://twitter.com/KLdivergence/status/165384349793226752000:00: Introduction and Cryptozoologists02:00: DC and the National AI Research Resource (NAIR)05:34: The Three Legs of the AI World: Silicon Valley, New York, and DC11:00: The AI Safety vs. Ethics Debate13:42: The R...
2024-05-1056 min
The Retort AI PodcastLlama 3: Can't Compete with a CapuchinTom and Nate cover the state of the industry after Llama 3. Is Zuck the best storyteller in AI? Is he the best CEO? Are CEOs doing anything other than buying compute? We cover what it means to be successful at the highest level this week. Links:Dwarkesh interview with Zuck https://www.dwarkeshpatel.com/p/mark-zuckerberg Capuchin monkey https://en.wikipedia.org/wiki/Capuchin_monkey 00:00 Introductions & advice from a wolf00:45 Llama 307:15 Resources and investment required for large language models14:10 What it means to be a leader in the rapidly evolving AI...
2024-04-2646 min
The Retort AI PodcastInto the AI Trough of DisillusionmentTom and Nate catch up after a few weeks off the pod. We discuss what it means for the pace and size of open models to get bigger and bigger. In some ways, this disillusionment is a great way to zoom our into the big picture. These models are coming. These models are getting cheaper. We need to think about risks and infrastructure more than open vs. closed.00:00 Introduction 01:16 Recent developments in open model releases 04:21 Tom's experience viewing the total solar eclipse09:38 The Three-Body Problem book and Netflix14:06 The Gartner Hype Cycle22:51 In...
2024-04-1251 min
The Retort AI PodcastAI's Eras Tour: Performance, Trust, and LegitimacyTom and Nate catch up on the ridiculous of Nvidia GTC, the lack of trust in AI, and some important taxonomies and politics around governing AI. Safety institutes, reward model benchmarks, Nathan's bad joke delivery, and all the normal good stuff in this episode! Yes, we're also sick of the Taylor Swift jokes, but they get the clicks.The Taylor moment: https://twitter.com/DrJimFan/status/176981794893007293000:00 Intros and discussion on NVIDIA's influence in AI and the Bay Area09:08 Mustafa Suleyman's new role and discussion on AI safety11:31 The shift from performance to trust...
2024-03-2246 min
The Retort AI PodcastClaude 3: Is Nathan too bought into the hype?Tom and Nate sit down to discuss Claude 3 and some updates on what it means to be open. Not surprisingly, we get into debating some different views. We cover Dune 2's impact on AI and have a brief giveaway at the end. Cheers!More at retortai.com. Contact us at mail at domain.Some topics:- The pace of progress in AI and whether it feels meaningful or like "progress fatigue" to different groups- The role of hype and "vibes" in driving interest and investment in new AI models ...
2024-03-0843 min
The Retort AI PodcastModel release therapy session #1This week Tom and Nate cover all the big topics from the big picture lens. Sora, Gemini 1.5's context length, Gemini's bias backlash, Gemma open models, it was a busy week in AI. We come to the conclusion that we can no longer trust a lot of these big companies to do much. We are the gladiators playing the crowd of AI. This was a great one, I'm proud on one of Tom's all time best jokes. Thanks for listening, and reach out with any questions. This is a public episode. If you would like t...
2024-02-2352 min
The Retort AI PodcastWaymo vs. the time honored human experiences, vandalism and defacementA metaphor episode! We are trying to figure how much the Waymo incident is or is not about AI. We bring back our Berkeley roots and talk about traditions in the Bay around distributed technology. Scooters and robots are not safe in this episode, sadly. Here's the link to the Verge piece Tom read from: https://www.theverge.com/2024/2/11/24069251/waymo-driverless-taxi-fire-vandalized-video-san-francisco-china-town This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-02-1637 min
The Retort AI PodcastWe believe in the metaverse... and you should too. We catch up this week on all things Apple Vision Pro and how these devices will intersect with AI. It really turned more into a commentary on the future of society, and how various technologies may or may not tap into our subconscious. The only link we've got for you is DeepDream: https://en.wikipedia.org/wiki/DeepDream This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-02-0937 min
The Retort AI PodcastHow to OLMost find a WaifuWow, one of our favorites. This week Tom and Nate have a lot to cover. We cover AI2's new OPEN large language models (OLMo) and all that means, the alchemical model merging craze powering waifu factories, model weight leaks from Mistral, the calling card for our loyal fans, and more topics.We have a lot of links you'll enjoy as you'll go through it:The Mistral leak: https://huggingface.co/miqudev/miqu-1-70b/discussions/10 Writing on model merging: https://www.interconnects.ai/p/model-merging Writing on open LLMs: https://www.interconnects.ai/p/olmo The...
2024-02-0246 min
The Retort AI PodcastTom's Story: to get through grad school, become a sperm whaleWe recovered this episode from the depth of lost podcast recordings! We carry on and Tom tells the story of his wonderful sociology turned AI Ph.D. at Berkeley. This comes with plenty of great commentary on the current state of the field and striving for impact. We cover the riverbank of Vienna, the heart of the sperm whale, and deep life lessons. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-01-2657 min
The Retort AI PodcastNon-profits need to be businesses tooThis week Tom and Nate catch up on two everlasting themes of ML: compute and evaluation. We chat about AI2, Zuck's GPUs, evaluation as procurement, NIST comments, neglecting reward models, and plenty of other topics. We're on the tracks for 2024 and waiting for some things to happen. Links for what we covered this week:Zuck interview on The VergeSaturday night live George Washington during revolutionary warNIST RFISam Altman's uncomfortable proposition This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-01-1937 min
The Retort AI PodcastHow the US could lose (and win!) against China in AI, with Jordan Schneider of ChinaTalkWe're excited to bring you something special today! Our first cross over episode brings some fresh energy to the podcast. Tom and Nate are joined by Jordan Schneider of ChinaTalk (A popular Substack-based publication covering all things China https://www.chinatalk.media/). We cover lots of great ground here, from the economics of Hirschman to the competition from France. All good Patriots should listen to this episode, as we give a real assessment of where competition lies on the U.S.'s path to commercializing AI. Enjoy our best effort at a journal club! This is...
2024-01-1256 min
The Retort AI PodcastAI is literally the culture war, figuratively speakingTom and Nate are ready to kick off the year, but not too ready! There's a ton to be excited about this year, but we're already worried for some parts of it. In this episode, we'll teach you how to be mindful of the so called "other side of ML".Some links:- Link to NYT lawsuit techdirt article https://www.techdirt.com/2023/12/28/the-ny-times-lawsuit-against-openai-would-open-up-the-ny-times-to-all-sorts-of-lawsuits-should-it-win/- Link to AI generated talk tool https://github.com/natolambert/interconnects-tools?tab=readme-ov-file#generated-research--video- They just want to learn https://twitter.com/hamishivi/status/1730633057999483085 and pod episode https://www...
2024-01-0546 min
The Retort AI PodcastWhat I wish someone had told meThe end of the year is upon us! Tom and Nate bring a reflective mood to the podcast along with some surprises that may be a delight.Here are some links for the loyal fans:* RAND + executive order piece: https://www.politico.com/news/2023/12/15/billionaire-backed-think-tank-played-key-role-in-bidens-ai-order-00132128 * Sam Altman's blog post we were reading: https://blog.samaltman.com/what-i-wish-someone-had-told-me This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-12-2250 min
InterconnectsInterviewing Tri Dao and Michael Poli of Together AI on the future of LLM architecturesThis interview is on YouTube and podcast players.Giving a voice to researchers is the best way to cut through the noise and understand what is happening with core developments of LLM technologies. I’m excited to get to talk with Michael Poli (Stanford PhD student + research at Together AI) and Tri Dao (incoming professor at Princeton + Chief Scientist at Together AI). This builds on the mega-post from yesterday on the same topics, though the interview is obviously less math heavy:Interconnects is a reader-supported publication. Consider becoming a subscriber.Topics: Introd...
2023-12-2135 min
The Retort AI PodcastEveryone wants fair benchmarks, but do you even lift?No stone is left unturned on this episode. As the end of the year approaches, Tom and Nate check in on all the vibes of the machine learning world: torrents, faked demos, alchemy, weightlifting, actual science, and blogs are all not safe in this episode. Some links for your weekend:- AI Alliance: https://thealliance.ai/ - Evaluation gaming on Interconnects: https://www.interconnects.ai/p/evals-are-marketing- Fupi: https://www.youtube.com/watch?v=WtVknbxzn7Q This is a public episode. If you would like to discuss this with other subscribers...
2023-12-1549 min
The Retort AI PodcastCybernetics, Feedback, and Reinventionism in CSIn this episode, Tom gives us a lesson on all things feedback, mostly where our scientific framings of it came from. Together, we link this to RLHF, our previous work in RL, and how we were thinking about agentic ML systems before it was cool.Join us, on another great blast from the past on The Retort!We also have brought you video this week! This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-12-0841 min
The Retort AI PodcastQ* and OpenAI's Strange Loop: We Pecan't EvenWe break down all the recent events of AI, and live react to some of the news about OpenAI's new super-method, codenamed Q*. From CEOs to rogue AI's, no one can be trusted in today's episode. Some links to relevant content on Interconnects:* Discussing how OpenAI's blunders open the doors for openness.* Detailing what Q* probably is. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-11-2443 min
The Retort AI PodcastOpenAI: Developers, Hegemons, and OriginsWe cover all things OpenAI as they embrace their role as a consumer technology company with their first developer keynote.Lots of links:Dev. day keynote https://www.youtube.com/watch?v=U9mJuUkhUzk Some papers we coverMultinational AGI consortium (by non technical folks) https://arxiv.org/abs/2310.09217 Frontier model risk paper that DC loves https://arxiv.org/abs/2307.03718 Our Choices, Risk, and Reward Reports paper https://cltc.berkeley.edu/reward-reports/ GPT 2 release blog with discussion of "dangers" of LLMs in 2019 https://openai.com/research/better-language-models 1984 Apple ad https://www.youtube.com/watch?v=VtvjbmoDx-I This i...
2023-11-1047 min
The Retort AI PodcastExecutive Orders, Safety Summits, and Open Letters, Oh My!We discuss all the big regulation steps in AI this week, from the Biden Administration's Executive Order to the UK AI Safety Summit. Links:Link the Executive OrderLink the Mozilla Open Letter The Slaughterbots video UK AI Safety Summit graph/meme This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-11-0353 min
The Retort AI PodcastTransparency (Tom and Nate's Version)This week, we dunk on The Center for Research on Foundation Models's (Stanford) Foundation Model Transparency Index.Yes, the title is inspired by Taylor.Some links:The Index itself. And Nathan's critique.Anthropic's Collective Constitutional AI work, coverage in New York Times.New paper motivating transparency for reward models in RLHF.Jitendra Malik dunks on the idea of foundation models. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-10-2745 min
The Retort AI PodcastTechno-optimism: Safety, Ethics, or Fascism?Tom and Nate sit down to discuss Marc Andreessen's Techno-Optimist Manifesto. A third wave of AI mindsets that squarely takes on both AI Safety and AI Ethics communities.Some links: * An example of the Shoggoth Monster we referenced.Thanks for listening! This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-10-2041 min
The Retort AI PodcastMethods of Rationality in the Time of HypeThis week, Tom and Nate discuss some of the core and intriguing dynamics of AI. We discuss the history of the rationality movement and where Harry Potter fan fiction fits in, if AI will ever not feel hypey, the do's and don'ts of Sam Altman, and other topics.(Editor note: sorry for some small issues in Nate's audio. That will be fixed in the next episode)Some links that are references:* HP MOR (Harry Potter and the Methods of Rationality). * A tweet referencing Sam Altman's funny (?) profile change.* Nathan's recent post on...
2023-10-1353 min
The Retort AI PodcastDeveloping LLMs: Open, closed, or democratic?This is a big one. Getting going on if LLMs should be more open or more closed. We cover everything, OpenAI, scaling, openness for openness sake (relative to OpenAI), actual arguments for open-source values in LLMs, AI as infrastructure, LLMs as platforms, what this means we need, and other topics.Lot's of related links this time from Nathan.Most recent article on Interconnects explaining how open-source startups may be deluding themselves."What is an open-source LLM" on Interconnects.How the open-source economy works on Interconnects. This is a public episode. If you would like...
2023-10-0657 min
The Retort AI PodcastAs Above, So Below: Alchemy, AI Safety, and RLHFTom and Nate discuss a few core topics of the show. First, we touch base on the core of the podcast -- the difference between empirical science, alchemy, and magic. Next, we explain some of our deeper understandings of AI safety as a field, then that leads into a discussion of what RLHF means.Lot's of links to share this time:Tom's coverage on alchemy in VentureBeat, and an active thread on Twitter.As Above, So Below: a calling of alchemy,A NeurIPs test of time award speech on alchemy,A bizarre Facebook debate between Yoshua...
2023-09-2957 min
The Retort AI PodcastAI in public: education, roads, and institutionsTom and Nate discuss some of the public institutions that form the bedrock of society -- education and roads -- and how AI is poised to shake them up.Some related reading on Interconnects, specifically about Tesla's system design and the self-driving roll-out in San Francisco. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-09-2250 min
The Retort AI PodcastAlchemy, Oppenheimer, and the quest for AGITom and Nate discuss some of the most dominant metaphors in machine learning these days -- alchemy and deep learning's roots, the Oppenheimer film and a modern "Manhattan Project for AI", and of course, a sprinkle of AGI.Some related reading on Interconnects: https://www.interconnects.ai/p/ai-research-tensions-oppenheimerThanks for listening! Reach out if you have any questions. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-09-151h 04
The Retort AI PodcastTeaser: Welcome to The RetortA brief introduction to the many problems facing AI and a sneak peak into episode 1, coming soon! This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-09-0605 min
Practically IntelligentE4: Evaluating Large Language Models with Nathan LambertOn the fourth episode of Practically Intelligent, Sinan and Akshay sit down with the esteemed Nathan Lambert, a prominent Machine Learning researcher and analyst. With his keen goal of understanding and developing safe and societally beneficial autonomous systems, Nathan shares valuable insights from his experience as a Research Scientist at HuggingFace 🤗. We dive deep into the nuances of evaluating large language models (LLMs) and the role of the HuggingFace's Open LLM Leaderboard.
2023-08-1737 min
The Geek In ReviewLawyer vs. AI or Lawyers + AI: Embracing the Future of Legal Practice with BriefPoint.ai's Nathan Walter and Bridget AlbieroIn this riveting episode of our podcast, we delve into the fascinating world of AI in the legal industry with our esteemed guests, Nathan Walter and Bridget Albiero. Walter, a former attorney and founder of BriefPoint.ai, has leveraged his legal expertise and passion for technology to automate the manual processes that often bog down law firms. Bridget Albiero, a User Experience (UX) and User Design (UD) expert, underscores the significance of intuitive design in making these AI tools not just effective, but user-friendly.
Nathan Walter has been instrumental in creating BriefPoint.ai, a tool designed specifically...
2023-05-1247 min
Slate ChurchThe Book of Matthew (Part 2) - Nathan LambertJesus completes the story, but the story completes our understanding of Jesus. In "The Book of Matthew" (Part 2), Pastor Nathan Lambert of Slate Church teaches us that the book of Matthew was written after Jesus lived, died, and rose again. The author of Matthew is reminding us that Jesus completes the genealogy and the covenant. To understand who Jesus is, we must understand that this story helps us understand the story of Jesus.
2021-10-2536 minSlate ChurchThe Good Life (Week 4) - Nathan LambertIn The Good Life (Week 4), Pastor Nathan Lambert encourages us to root ourselves in the Word of God and embrace the practice of gratitude and thankfulness in our lives.
2021-10-1135 min
Fireplace MessagesLe secret, la force, le but et les moyens de la vie chrétienne - Nathan LambertLe secret, la force, le but et les moyens de la vie chrétienne - Nathan Lambert
2021-07-1256 min2021-05-0544 minFireplace MessagesTous représentants de Dieu ! - Nathan LambertTous représentants de Dieu ! - Nathan Lambert
2021-04-2838 min2021-04-1351 min
TalkRL: The Reinforcement Learning PodcastNathan LambertNathan Lambert is a PhD Candidate at UC Berkeley. Featured References Learning Accurate Long-term Dynamics for Model-based Reinforcement Learning Nathan O. Lambert, Albert Wilcox, Howard Zhang, Kristofer S. J. Pister, Roberto Calandra Objective Mismatch in Model-based Reinforcement Learning Nathan Lambert, Brandon Amos, Omry Yadan, Roberto Calandra Low Level Control of a Quadrotor with Deep Model-Based Reinforcement Learning Nathan O. Lambert, Daniel S. Drew, Joseph Yaconelli, Roberto Calandra, Sergey Levine, Kristofer S.J. Pister On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning Baohe Zhang, Raghu Raj...
2021-03-2250 minFireplace MessagesUne vision de l'église de Jésus - Nathan LambertUne vision de l'église de Jésus - Nathan Lambert
2021-03-1139 minFireplace MessagesReprendre du poil de la bête - Nathan LambertReprendre du poil de la bête - Nathan Lambert
2021-03-1139 minFireplace MessagesL'argent, les responsables et l'église - Nathan LambertL'argent, les responsables et l'église - Nathan Lambert
2021-02-0848 min
Machine Learning Archives - Software Engineering DailyReinforcement Learning and Robotics with Nathan Lambert
Reinforcement learning is a paradigm in machine learning that uses incentives- or “reinforcement”- to drive learning. The learner is conceptualized as an intelligent agent working within a system of rewards and penalties in order to solve a novel problem. The agent is designed to maximize rewards while pursuing a solution by trial-and-error.
Programming a system to respond to the complex and unpredictable “real world” is one of the principal challenges in robotics engineering. One field which is finding new applications for reinforcement learning is the study of MEMS devices- robots or other electronic devices built at...
2021-01-2755 min2021-01-1840 min2020-12-1818 min2020-11-2440 minFireplace MessagesL’immoralité dans l’église et en dehors - Nathan LambertL’immoralité dans l’église et en dehors - Nathan Lambert
2020-11-1045 minFireplace MessagesLe discernement et internet - Nathan LambertLe discernement et internet - Nathan Lambert
2020-10-2252 minFireplace MessagesLe discernement dans l'église - Nathan LambertLe discernement dans l'église - Nathan Lambert
2020-10-2038 minFireplace MessagesLa maturité des enfants de Dieu - Nathan LambertLa maturité des enfants de Dieu - Nathan Lambert
2020-10-0539 min2020-09-1446 min
Bokeh - The Photography Podcast#402: A Journey to Sony Artisanship - Kesha LambertHave you dreamed of being a brand ambassador for a big name photography company? Our friend, Kesha Lambert, was just honored with the title of Sony Artisan and we're so proud of her!In episode 402 of the Bokeh Podcast, Kesha joins us to discuss what her journey to becoming a Sony Artisan looked like and the important principles she focused on while pursuing this opportunity. Listen in as she describes significance of this opportunity not only for her career, but also in regards to the important conversations currently happening in the photography industry about racial equity.
2020-07-0927 minFireplace Messages"Je suis la vigne" - Ce que Jésus dit sur lui-même - Nathan Lambert"Je suis la vigne" - Ce que Jésus dit sur lui-même - Nathan Lambert
Je suis la vigne-CequeJésusditsurlui-mêmeNathanLambert
2020-06-3046 min
Theology of Music"What A Beautiful Name" (Part 2) feat. Pastor Nathan DoddThis episode is part 2 of episode on "What A Beautiful Name" written by Ben Fielding and Brooke Ligertwood from Hillsong Worship. Join Pastor Joel and Pastor Nathan Dodd (from Liberty Baptist) as they finish their discussion.Verse 1:You were the Word at the beginningOne with God the Lord Most HighYour hidden glory in creationNow revealed in You our ChristChorus:What a beautiful Name it isWhat a beautiful Name it isThe Name of Jesus Christ my KingWhat...
2020-06-2615 min2020-06-2437 minTheology of Music"What A Beautiful Name" (Part 1) feat. Pastor Nathan DoddIn this episode, Pastor Joel and Pastor Nathan Dodd (from Liberty Baptist) talk about the song "What A Beautiful Name" written by Ben Fielding and Brooke Ligertwood from Hillsong Worship. Verse 1:You were the Word at the beginningOne with God the Lord Most HighYour hidden glory in creationNow revealed in You our ChristChorus:What a beautiful Name it isWhat a beautiful Name it isThe Name of Jesus Christ my KingWhat a beautiful Name it is...
2020-06-2016 min
Fireplace Messages"Je suis la résurrection et la vie" - Ce que Jésus dit sur lui-même - Nathan Lambert"Je suis la résurrection et la vie" - Ce que Jésus dit sur lui-même - Nathan Lambert
Je suis la résurrection et la vie-CequeJésusditsurlui-mêmeNathanLambert
2020-06-1647 min
dot innovateMarcus Lambert discusses moving business operations to the cloudMarcus Lambert is an entrepreneurial CTO and software architect for Omobono, the digital agency for business brands.
He measures success by delivering exactly what the user needs wrapped in a compelling UX on time and on budget.
We discussed:
How have their business continuity plans changed
What does that look like with an agency with 100 people?
How should we be thinking about scenario planning?
How his role has changed as CTO
How Omobono are thinking about sales and new business?
How do B2B salespeople sell in this environment?
Pitching/workshops
Digital transformation
Marcus’ silver linings
I...
2020-06-1122 min
Fireplace Messages"Je suis le bon berger" - Ce que Jésus dit sur lui-même - Nathan Lambert"Je suis le bon berger" - Ce que Jésus dit sur lui-même - Nathan Lambert
2020-06-0840 min
Fireplace MessagesL'anniversaire de l'église - Nathan LambertL'anniversaire de l'église - Nathan Lambert
Actes 2
2020-06-0838 min
Fireplace Messages"Je suis la porte des brebis" - Ce que Jésus dit sur lui-même - Nathan Lambert"Je suis la porte des brebis" - Ce que Jésus dit sur lui-même - Nathan Lambert
2020-05-2851 min
Fireplace Messages"Je suis la Lumière du Monde" - Ce que Jésus dit sur lui-même - Nathan Lambert"Je suis la Lumière du Monde" - Ce que Jésus dit sur lui-même - Nathan Lambert
Je suis la Lumière du Monde-CequeJésusditsurlui-mêmeNathanLambertLeMessageduDimanche
2020-05-2843 min
Fireplace Messages"Je suis le pain de vie" - Nathan Lambert - Le Message du Dimanche"Je suis le pain de vie" - Nathan Lambert - Le Message du Dimanche
2020-05-1143 min
Fireplace Messages"Je suis JE SUIS" - Nathan Lambert - Le Message du Dimanche"Je suis JE SUIS" - Nathan Lambert - Le Message du Dimanche
2020-05-0457 min
Fireplace MessagesLe contrôle technique, la fenêtre ouverte et le creuset - Nathan LambertLe contrôle technique, la fenêtre ouverte et le creuset - Nathan Lambert
2020-04-2449 min
Agency Dealmasters podcastMarcus Lambert discusses business continuity planningMarcus Lambert is an entrepreneurial CTO and software architect for Omobono, the digital agency for business brands. He measures success by delivering exactly what the user needs wrapped in a compelling UX on time and on budget. We discussed: How have their business continuity plans changed What does that look like with an agency with 100 people? How should we be thinking about scenario planning? How his role has changed as CTO How Omobono are thinking about sales and new business? How do B2B salespeople sell in this environment? Pitching/workshops Digital transformation Marcus' si...
2020-04-2222 min
Fireplace MessagesLa Prière dans un Monde de Dingues - Nathan LambertLa Prière dans un Monde de Dingues - Nathan Lambert
2020-03-1847 min
Fireplace MessagesLa Parole de Dieu Dans un Monde de Dingues - Nathan LambertLa Parole de Dieu Dans un Monde de Dingues - Nathan Lambert
2020-03-1645 min
Fireplace MessagesChercher Dieu au Milieu de l'Ambition- Nathan LambertChercher Dieu au Milieu de l'Ambition- Nathan Lambert
2020-01-2844 min
Fireplace MessagesChercher Dieu au milieu de la confusion - Nathan LambertChercher Dieu au milieu de la confusion - Nathan Lambert
2020-01-2445 min
Fireplace MessagesTrouver Dieu dans l'humilité - Nathan LambertTrouver Dieu dans l'humilité - Nathan Lambert
2020-01-0424 min
Fireplace MessagesCréer des Disciples : Explosivité - Nathan LambertCréer des Disciples : Explosivité - Nathan Lambert by Eglise Fireplace
2019-12-0244 min
Fireplace MessagesCréer des Disciples : Redevabilité - Nathan LambertCréer des Disciples : Redevabilité - Nathan Lambert by Eglise Fireplace
2019-12-0252 min
Fireplace MessagesCréer des Disciples : Communauté - Nathan LambertCréer des Disciples : Communauté - Nathan Lambert by Eglise Fireplace
2019-11-1427 min
Fireplace MessagesEnseigner comme Jésus - Nathan LambertEnseigner comme Jésus - Nathan Lambert by Eglise Fireplace
2019-10-1447 min
Fireplace MessagesBastonner comme Jésus - Nathan LambertBastonner comme Jésus - Nathan Lambert by Eglise Fireplace
2019-09-2352 min
Fireplace MessagesUn agenda comme Jésus - Nathan LambertUn agenda comme Jésus - Nathan Lambert by Eglise Fireplace
2019-09-1752 min
Fireplace MessagesSois Un Disciple - Nathan LambertSois Un Disciple - Nathan Lambert by Eglise Fireplace
2019-09-0143 min