podcast
details
.com
Print
Share
Look for any podcast host, guest or anyone
Search
Showing episodes and shows of
Nathan Lambert
Shows
The Retort AI Podcast
Tom leaves stealth: Hortus AI
An exciting week for Tom, who tells Nate about his company Hortus AI, whose mission is to make AI accountable to local communities. We cover a lot of classic Retort themes as Tom makes a case for what's missing from AI development, and how models could be more healthily integrated into everyday people's lives.Press release: https://hortus.ai/wp-content/uploads/2025/02/Hortus-AI-Press-Release_Feb25.pdfCompany website: https://hortus.ai/Link to whitepaper: https://www.newamerica.org/rethinkai/policy-papers/a-sustainable-path-for-ai-development/ This is a public episode. If you would like to discuss this with...
2025-02-18
53 min
Brilliant Minds’ Digest
DeepSeek, OpenAI, and the Future of Intelligence with with Dylan Patel & Nathan Lambert - Competition, Ethics & AGI Dylan Patel and Nathan Lambert
Is China taking the lead in artificial intelligence? What’s the next big breakthrough in AI research? In this 17-minute episode of Brilliant Minds’ Digest, we distill insights from Lex Fridman’s conversation with AI experts Dylan Patel & Nathan Lambert, covering DeepSeek AI, AGI timelines, and the global AI arms race. This conversation dives deep into the competition between AI giants, the challenges of scaling large models, and the escalating costs of AI research. Ethical concerns surrounding open-source models, data biases, and AI safety are also discussed, alongside the geopolitical implications of AI development and export controls. Key...
2025-02-08
17 min
AI Summer
Nathan Lambert on the rise of "thinking" language models
Nathan Lambert is the author of the popular AI newsletter Interconnects. He is also a research scientist who leads post-training at the Allen Institute for Artificial Intelligence, a research organization funded by the estate of Paul Allen. This means that the organization can afford to train its own models—and it’s one of the only such organizations committed to doing so in an open manner. So Lambert is one of the few people with hands-on experience building cutting-edge LLMs who can talk freely about his work. In this December 17 conversation, Lambert walked us through the steps required to trai...
2025-01-14
1h 00
The Retort AI Podcast
We ask again: Is AI a science?
Tom and Nate sit down for a classic discussion of the role of AI in the modern philosophy of science. Much of this discussion is based on Thomas Samuel Kuhn's influential book The Structure of Scientific Revolutions. We ask -- is AI a science in the Kuhn'ian sense? Will the "paradigm" worldview apply to other sciences post AI? How will scientific institutions manage the addition of AI?We promised an AI for science reading list, so here it is:[Dario interview with Lex] https://youtu.be/ugvHCXCOmm4?si=1hnlvue8M4pV2TqCLevers for biological progress https://o...
2025-01-10
53 min
The Retort AI Podcast
The Retort's biggest AI stories of 2024
We're back! Tom and Nate catch up after the Thanksgiving holiday. Our main question was -- what were the biggest AI stories of the year? We touch on the core themes of the show: infrastructure, AI realities, and and antitrust. The power buildout to scale out AI is going to have very real long-term impacts.Some links this week:* Ben Thompson's, The End of the Beginning: https://stratechery.com/2020/the-end-of-the-beginning/* Miles Brundage's Substack: https://milesbrundage.substack.com/p/why-im-leaving-openai-and-what-im* Stochastic Parrots paper: https://dl.acm.org/doi/10.1145/3442188.3445922Thanks for listening! G...
2024-12-06
47 min
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
In this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one...
2024-11-21
1h 50
The Retort AI Podcast
The Nobel Albatross
Tom and Nate catch up on the happenings in AI. Of course, we're focused on the biggest awards available to us as esteemed scientists (or something close enough) -- the Nobel Prizes! What does it mean in the trajectory of AI for Hinton and Hassabis to carry added scientific weight. Honestly, feels like a sinking ship. Some links:* Schmidhuber tweet: https://x.com/SchmidhuberAI/status/1844022724328394780* Hinton "I'm proud my student fired Sam": https://x.com/Grady_Booch/status/184414542282424329000:00 Introduction04:43 Criticism of AI-related Nobel Prize awards09:06 Geoffrey Hinton's comments on winning the N...
2024-10-11
44 min
Interconnects
Interviewing Riley Goodside on the science of prompting
Riley Goodside is a staff prompting engineer at Scale AI. Previously working in data science, he is often seen as the default for the new role of a “prompt engineer.” He regularly posts incisive prompts that illicit notable behavior from the most popular AI models.I really resonated with this saying from Anthropic’s recent podcast on prompt engineering — “now we write essays and treat them as code.” In order to be good at prompting, you need to understand that natural language operates as our code used to.This episode is a masterclass on why you should c...
2024-09-30
1h 08
The Retort AI Podcast
Claude Needs a Constitutional Convention
Tom and Nate catch up on recent events (before the OpenAI o1 release) and opportunities in transparency/policy. We recap the legendary scam of Matt from IT department, why disclosing the outcomes of process is not enough, and more. This is a great episode on understanding why the process technology was birthed from is just as important as the outcome!Some links:* Nathan's post on Model Specs for regulation https://www.interconnects.ai/p/a-post-training-approach-to-ai-regulation* Nathan's post on inference spend https://www.interconnects.ai/p/openai-strawberry-and-inference-scaling-lawsSend your questions to mail at retortai...
2024-09-13
42 min
The Retort AI Podcast
Avoiding the AI burnout
Tom and Nate catch up on core themes of AI after a somewhat unintended summer break. We discuss the moral groundings and philosophy of what we're building, our travels, The Anxious Generation, AGI obsessions, an update on AI Ethics vs. AI Safety, and plenty more in between.As always, contact us at mail@retortai.comSome links we mention in the episode:* The Emotional Dog and its Rational Tail https://motherjones.com/wp-content/uploads/emotional_dog_and_rational_tail.pdf* The Anxious Generation https://www.amazon.com/Anxious-Generation-Rewiring-Childhood-Epidemic/dp/0593655036* Shadow Lake Lodge...
2024-08-26
36 min
Interconnects
Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents
I had the pleasure of Talking with Ross Taylor, who has a great spectrum of unique experiences in the language modeling space — evaluation experience, Galactica lead author, Llama post training, etc. This is a really great conversation on the frontier of language model (LM) reasoning, LM deployments and demos, LM’s for science, RLHF, and other topics. I’ve been trying to get Ross to come on for a bit. He’s one of those people in the LM space that doesn’t speak too much, but when you do, you listen.Ross Taylor was previously an LLM lead a...
2024-08-08
1h 02
Interconnects
Interviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI education
This week, I had the pleasure of chatting with Sebastian Raschka. Sebastian is doing a ton of work on the open language model ecosystem and AI research broadly. He’s been writing the great Ahead of AI newsletter (that has the biggest audience overlap with Interconnects, at 26%, so a lot of you know him) and multiple educational books, all on top of being a full time machine learning engineer at Lightning.ai, where he maintains LitGPT, which he described as being like Karpathy’s NanoGPT, with slightly more abstractions.This conversation mostly surrounds keeping up with AI rese...
2024-08-01
1h 03
The Retort AI Podcast
What we are getting wrong about AI regulation
Tom and Nate catch up on the rapidly evolving (and political) space of AI regulation. We cover CA SB 1047, recent policing of data scraping, presidential appointees, antitrust intention vs. implementation, FLOP thresholds, and everything else touching the future of large ML models.Nate's internet cut out, so this episode ends a little abruptly. Reach out with any questions to mail at retortai.comSome links:- night falls on the cumberlands https://en.wikipedia.org/wiki/Night_Comes_to_the_Cumberlands- hillbilly elegy https://en.wikipedia.org/wiki/Hillbilly_Elegy...
2024-07-19
34 min
Missions Today
Reimagining Short Term Missions with Nathan Nelson
Summer seems to be a prime time for short term mission trips. But are those short-term trips you are making really doing the MOST good? Join Collin this weekend as he speaks with Nathan Nelson about reimagining short term missions to do the absolute most good for all involved. That’s this weekend on Missions Today! For more information on our guest this week and his work, please check out the links below: Nathan Nelson Bethany Community Church Reimagining Short Term Missions #missions #mission #shorttermmissions #missiontrips #mostgood #church #service #faith #relationships #church #seattle #na...
2024-07-06
26 min
The Retort AI Podcast
AI, feedback, and population public health
Tom and Nate revisit one of their old ideas -- AI through the lens of public health infrastructure, and especially alignment. Sorry about Tom's glitchy audio, I figured it out after the fact that he was talking into the microphone at the wrong angle. Regardless, here are some links for this week. Links:- Data foundry for AI https://scale.com/blog/scale-ai-series-f - Information piece on Scale AI ($) https://www.theinformation.com/articles/why-a-14-billion-startup-is-now-hiring-phds-to-train-ai-from-their-living-rooms?shared=168f685a864ca709 - ChatGPT compounding math: https://chatgpt.com/share/2c19a357-acb2-441d-8203-946b74ce785c ...
2024-06-28
41 min
Interconnects
Interviewing Dean Ball on AI policy: CA SB 1047, upcoming AI disaster response, Llama 3 405B, Chinese open-source AI, and scaling laws
I’m really excited to resume the Interconnects Interviews with Dean W. Ball from the Hyperdimensional Substack (you should subscribe). We cover the whole stack of recent happenings in AI policy, focusing of course on California’s bill SB 1047. We cover many, many more great topics here including:* What will happen in the case of a minor AI disaster,* If Meta will release the 405B model, and why,* The status of Chinese open-source AI,* Training on model outputs,* Anthropic’s recent strategy,* What scaling laws actually mean,...
2024-06-27
56 min
The Retort AI Podcast
Apple sends a memo to the AGI faithful
Tom and Nate caught up last week (sorry for the editing delay) on the big two views of the AI future: Apple Intelligence and Situational Awareness (Nationalistic AI doom prevention). One of our best episodes, here are the links:* The Kekulé Problem https://en.wikipedia.org/wiki/The_Kekul%C3%A9_Problem* Truth and Method https://en.wikipedia.org/wiki/Truth_and_Method* Situational Awareness https://situational-awareness.ai/00:00 A Hypothetical Life: From Germany to AGI01:20 Leopold Aschenbrenner: Situational Awareness and Extrapolation02:01 The Retort: Apple vs. Doomsday AI03:40 Credentials and Social Choice T...
2024-06-21
52 min
Super Data Science: ML & AI Podcast with Jon Krohn
791: Reinforcement Learning from Human Feedback (RLHF), with Dr. Nathan Lambert
Reinforcement learning through human feedback (RLHF) has come a long way. In this episode, research scientist Nathan Lambert talks to Jon Krohn about the technique’s origins of the technique. He also walks through other ways to fine-tune LLMs, and how he believes generative AI might democratize education.This episode is brought to you by AWS Inferentia (go.aws/3zWS0au) and AWS Trainium (go.aws/3ycV6K0), and Crawlbase (crawlbase.com), the ultimate data crawling platform. Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information.
2024-06-11
57 min
The Retort AI Podcast
Murky waters in AI policy
Tom and Nate catch up on many AI policy happenings recently. California's "anti open source" 1047 bill, the senate AI roadmap, Google's search snaifu, OpenAI's normal nonsense, and reader feedback! A bit of a mailbag. Enjoy.00:00 Murky waters in AI policy00:33 The Senate AI Roadmap05:14 The Executive Branch Takes the Lead08:33 California's Senate AI Bill22:22 OpenAI's Two Audiences28:53 The Problem with OpenAI Model Spec39:50 A New World of AI RegulationA bunch of links...Data and society whitepaper: https://static1.squarespace.com/static/66465fcd83d1881b974fe099/t/664b866...
2024-05-31
43 min
The Retort AI Podcast
ChatGPT talks: diamond of the season or quite the scandal?
Tom and Nate discuss two major OpenAI happenings in the last week. The popular one, the chat assistant, and what it reveals about OpenAI's worldview. We pair this with discussion of OpenAI's new Model Spec, which details their RLHF goals: https://cdn.openai.com/spec/model-spec-2024-05-08.htmlThis is a monumental week for AI. The product transition is completed, we can't just be researchers anymore.00:00 Guess the Donkey Kong Character00:50 OpenAI's New AI Girlfriend07:08 OpenAI's Business Model and Responsible AI08:45 GPT-2 Chatbot Thing and OpenAI's Weirdness12:48 OpenAI and the...
2024-05-17
51 min
The Retort AI Podcast
Three pillars of AI power
Tom and Nate discuss the shifting power landscape in AI. They try to discern what is special about Silicon Valley's grasp on the ecosystem and what other types of power (e.g. those in New York and Washington DC) will do to mobilize their influence. Here's the one Tweet we referenced on the FAccT community: https://twitter.com/KLdivergence/status/165384349793226752000:00: Introduction and Cryptozoologists02:00: DC and the National AI Research Resource (NAIR)05:34: The Three Legs of the AI World: Silicon Valley, New York, and DC11:00: The AI Safety vs. Ethics Debate13:42: The R...
2024-05-10
56 min
The Retort AI Podcast
Llama 3: Can't Compete with a Capuchin
Tom and Nate cover the state of the industry after Llama 3. Is Zuck the best storyteller in AI? Is he the best CEO? Are CEOs doing anything other than buying compute? We cover what it means to be successful at the highest level this week. Links:Dwarkesh interview with Zuck https://www.dwarkeshpatel.com/p/mark-zuckerberg Capuchin monkey https://en.wikipedia.org/wiki/Capuchin_monkey 00:00 Introductions & advice from a wolf00:45 Llama 307:15 Resources and investment required for large language models14:10 What it means to be a leader in the rapidly evolving AI...
2024-04-26
46 min
The Retort AI Podcast
Into the AI Trough of Disillusionment
Tom and Nate catch up after a few weeks off the pod. We discuss what it means for the pace and size of open models to get bigger and bigger. In some ways, this disillusionment is a great way to zoom our into the big picture. These models are coming. These models are getting cheaper. We need to think about risks and infrastructure more than open vs. closed.00:00 Introduction 01:16 Recent developments in open model releases 04:21 Tom's experience viewing the total solar eclipse09:38 The Three-Body Problem book and Netflix14:06 The Gartner Hype Cycle22:51 In...
2024-04-12
51 min
The Retort AI Podcast
AI's Eras Tour: Performance, Trust, and Legitimacy
Tom and Nate catch up on the ridiculous of Nvidia GTC, the lack of trust in AI, and some important taxonomies and politics around governing AI. Safety institutes, reward model benchmarks, Nathan's bad joke delivery, and all the normal good stuff in this episode! Yes, we're also sick of the Taylor Swift jokes, but they get the clicks.The Taylor moment: https://twitter.com/DrJimFan/status/176981794893007293000:00 Intros and discussion on NVIDIA's influence in AI and the Bay Area09:08 Mustafa Suleyman's new role and discussion on AI safety11:31 The shift from performance to trust...
2024-03-22
46 min
The Retort AI Podcast
Claude 3: Is Nathan too bought into the hype?
Tom and Nate sit down to discuss Claude 3 and some updates on what it means to be open. Not surprisingly, we get into debating some different views. We cover Dune 2's impact on AI and have a brief giveaway at the end. Cheers!More at retortai.com. Contact us at mail at domain.Some topics:- The pace of progress in AI and whether it feels meaningful or like "progress fatigue" to different groups- The role of hype and "vibes" in driving interest and investment in new AI models ...
2024-03-08
43 min
The Retort AI Podcast
Model release therapy session #1
This week Tom and Nate cover all the big topics from the big picture lens. Sora, Gemini 1.5's context length, Gemini's bias backlash, Gemma open models, it was a busy week in AI. We come to the conclusion that we can no longer trust a lot of these big companies to do much. We are the gladiators playing the crowd of AI. This was a great one, I'm proud on one of Tom's all time best jokes. Thanks for listening, and reach out with any questions. This is a public episode. If you would like t...
2024-02-23
52 min
The Retort AI Podcast
Waymo vs. the time honored human experiences, vandalism and defacement
A metaphor episode! We are trying to figure how much the Waymo incident is or is not about AI. We bring back our Berkeley roots and talk about traditions in the Bay around distributed technology. Scooters and robots are not safe in this episode, sadly. Here's the link to the Verge piece Tom read from: https://www.theverge.com/2024/2/11/24069251/waymo-driverless-taxi-fire-vandalized-video-san-francisco-china-town This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-02-16
37 min
The Retort AI Podcast
We believe in the metaverse
... and you should too. We catch up this week on all things Apple Vision Pro and how these devices will intersect with AI. It really turned more into a commentary on the future of society, and how various technologies may or may not tap into our subconscious. The only link we've got for you is DeepDream: https://en.wikipedia.org/wiki/DeepDream This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-02-09
37 min
The Retort AI Podcast
How to OLMost find a Waifu
Wow, one of our favorites. This week Tom and Nate have a lot to cover. We cover AI2's new OPEN large language models (OLMo) and all that means, the alchemical model merging craze powering waifu factories, model weight leaks from Mistral, the calling card for our loyal fans, and more topics.We have a lot of links you'll enjoy as you'll go through it:The Mistral leak: https://huggingface.co/miqudev/miqu-1-70b/discussions/10 Writing on model merging: https://www.interconnects.ai/p/model-merging Writing on open LLMs: https://www.interconnects.ai/p/olmo The...
2024-02-02
46 min
The Retort AI Podcast
Tom's Story: to get through grad school, become a sperm whale
We recovered this episode from the depth of lost podcast recordings! We carry on and Tom tells the story of his wonderful sociology turned AI Ph.D. at Berkeley. This comes with plenty of great commentary on the current state of the field and striving for impact. We cover the riverbank of Vienna, the heart of the sperm whale, and deep life lessons. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-01-26
57 min
The Retort AI Podcast
Non-profits need to be businesses too
This week Tom and Nate catch up on two everlasting themes of ML: compute and evaluation. We chat about AI2, Zuck's GPUs, evaluation as procurement, NIST comments, neglecting reward models, and plenty of other topics. We're on the tracks for 2024 and waiting for some things to happen. Links for what we covered this week:Zuck interview on The VergeSaturday night live George Washington during revolutionary warNIST RFISam Altman's uncomfortable proposition This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2024-01-19
37 min
The Retort AI Podcast
How the US could lose (and win!) against China in AI, with Jordan Schneider of ChinaTalk
We're excited to bring you something special today! Our first cross over episode brings some fresh energy to the podcast. Tom and Nate are joined by Jordan Schneider of ChinaTalk (A popular Substack-based publication covering all things China https://www.chinatalk.media/). We cover lots of great ground here, from the economics of Hirschman to the competition from France. All good Patriots should listen to this episode, as we give a real assessment of where competition lies on the U.S.'s path to commercializing AI. Enjoy our best effort at a journal club! This is...
2024-01-12
56 min
The Retort AI Podcast
AI is literally the culture war, figuratively speaking
Tom and Nate are ready to kick off the year, but not too ready! There's a ton to be excited about this year, but we're already worried for some parts of it. In this episode, we'll teach you how to be mindful of the so called "other side of ML".Some links:- Link to NYT lawsuit techdirt article https://www.techdirt.com/2023/12/28/the-ny-times-lawsuit-against-openai-would-open-up-the-ny-times-to-all-sorts-of-lawsuits-should-it-win/- Link to AI generated talk tool https://github.com/natolambert/interconnects-tools?tab=readme-ov-file#generated-research--video- They just want to learn https://twitter.com/hamishivi/status/1730633057999483085 and pod episode https://www...
2024-01-05
46 min
The Retort AI Podcast
What I wish someone had told me
The end of the year is upon us! Tom and Nate bring a reflective mood to the podcast along with some surprises that may be a delight.Here are some links for the loyal fans:* RAND + executive order piece: https://www.politico.com/news/2023/12/15/billionaire-backed-think-tank-played-key-role-in-bidens-ai-order-00132128 * Sam Altman's blog post we were reading: https://blog.samaltman.com/what-i-wish-someone-had-told-me This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-12-22
50 min
Interconnects
Interviewing Tri Dao and Michael Poli of Together AI on the future of LLM architectures
This interview is on YouTube and podcast players.Giving a voice to researchers is the best way to cut through the noise and understand what is happening with core developments of LLM technologies. I’m excited to get to talk with Michael Poli (Stanford PhD student + research at Together AI) and Tri Dao (incoming professor at Princeton + Chief Scientist at Together AI). This builds on the mega-post from yesterday on the same topics, though the interview is obviously less math heavy:Interconnects is a reader-supported publication. Consider becoming a subscriber.Topics: Introd...
2023-12-21
35 min
The Retort AI Podcast
Everyone wants fair benchmarks, but do you even lift?
No stone is left unturned on this episode. As the end of the year approaches, Tom and Nate check in on all the vibes of the machine learning world: torrents, faked demos, alchemy, weightlifting, actual science, and blogs are all not safe in this episode. Some links for your weekend:- AI Alliance: https://thealliance.ai/ - Evaluation gaming on Interconnects: https://www.interconnects.ai/p/evals-are-marketing- Fupi: https://www.youtube.com/watch?v=WtVknbxzn7Q This is a public episode. If you would like to discuss this with other subscribers...
2023-12-15
49 min
The Retort AI Podcast
Cybernetics, Feedback, and Reinventionism in CS
In this episode, Tom gives us a lesson on all things feedback, mostly where our scientific framings of it came from. Together, we link this to RLHF, our previous work in RL, and how we were thinking about agentic ML systems before it was cool.Join us, on another great blast from the past on The Retort!We also have brought you video this week! This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-12-08
41 min
The Retort AI Podcast
Q* and OpenAI's Strange Loop: We Pecan't Even
We break down all the recent events of AI, and live react to some of the news about OpenAI's new super-method, codenamed Q*. From CEOs to rogue AI's, no one can be trusted in today's episode. Some links to relevant content on Interconnects:* Discussing how OpenAI's blunders open the doors for openness.* Detailing what Q* probably is. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-11-24
43 min
The Retort AI Podcast
OpenAI: Developers, Hegemons, and Origins
We cover all things OpenAI as they embrace their role as a consumer technology company with their first developer keynote.Lots of links:Dev. day keynote https://www.youtube.com/watch?v=U9mJuUkhUzk Some papers we coverMultinational AGI consortium (by non technical folks) https://arxiv.org/abs/2310.09217 Frontier model risk paper that DC loves https://arxiv.org/abs/2307.03718 Our Choices, Risk, and Reward Reports paper https://cltc.berkeley.edu/reward-reports/ GPT 2 release blog with discussion of "dangers" of LLMs in 2019 https://openai.com/research/better-language-models 1984 Apple ad https://www.youtube.com/watch?v=VtvjbmoDx-I This i...
2023-11-10
47 min
The Retort AI Podcast
Executive Orders, Safety Summits, and Open Letters, Oh My!
We discuss all the big regulation steps in AI this week, from the Biden Administration's Executive Order to the UK AI Safety Summit. Links:Link the Executive OrderLink the Mozilla Open Letter The Slaughterbots video UK AI Safety Summit graph/meme This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-11-03
53 min
The Retort AI Podcast
Transparency (Tom and Nate's Version)
This week, we dunk on The Center for Research on Foundation Models's (Stanford) Foundation Model Transparency Index.Yes, the title is inspired by Taylor.Some links:The Index itself. And Nathan's critique.Anthropic's Collective Constitutional AI work, coverage in New York Times.New paper motivating transparency for reward models in RLHF.Jitendra Malik dunks on the idea of foundation models. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-10-27
45 min
The Retort AI Podcast
Techno-optimism: Safety, Ethics, or Fascism?
Tom and Nate sit down to discuss Marc Andreessen's Techno-Optimist Manifesto. A third wave of AI mindsets that squarely takes on both AI Safety and AI Ethics communities.Some links: * An example of the Shoggoth Monster we referenced.Thanks for listening! This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-10-20
41 min
The Retort AI Podcast
Methods of Rationality in the Time of Hype
This week, Tom and Nate discuss some of the core and intriguing dynamics of AI. We discuss the history of the rationality movement and where Harry Potter fan fiction fits in, if AI will ever not feel hypey, the do's and don'ts of Sam Altman, and other topics.(Editor note: sorry for some small issues in Nate's audio. That will be fixed in the next episode)Some links that are references:* HP MOR (Harry Potter and the Methods of Rationality). * A tweet referencing Sam Altman's funny (?) profile change.* Nathan's recent post on...
2023-10-13
53 min
The Retort AI Podcast
Developing LLMs: Open, closed, or democratic?
This is a big one. Getting going on if LLMs should be more open or more closed. We cover everything, OpenAI, scaling, openness for openness sake (relative to OpenAI), actual arguments for open-source values in LLMs, AI as infrastructure, LLMs as platforms, what this means we need, and other topics.Lot's of related links this time from Nathan.Most recent article on Interconnects explaining how open-source startups may be deluding themselves."What is an open-source LLM" on Interconnects.How the open-source economy works on Interconnects. This is a public episode. If you would like...
2023-10-06
57 min
The Retort AI Podcast
As Above, So Below: Alchemy, AI Safety, and RLHF
Tom and Nate discuss a few core topics of the show. First, we touch base on the core of the podcast -- the difference between empirical science, alchemy, and magic. Next, we explain some of our deeper understandings of AI safety as a field, then that leads into a discussion of what RLHF means.Lot's of links to share this time:Tom's coverage on alchemy in VentureBeat, and an active thread on Twitter.As Above, So Below: a calling of alchemy,A NeurIPs test of time award speech on alchemy,A bizarre Facebook debate between Yoshua...
2023-09-29
57 min
The Retort AI Podcast
AI in public: education, roads, and institutions
Tom and Nate discuss some of the public institutions that form the bedrock of society -- education and roads -- and how AI is poised to shake them up.Some related reading on Interconnects, specifically about Tesla's system design and the self-driving roll-out in San Francisco. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-09-22
50 min
The Retort AI Podcast
Alchemy, Oppenheimer, and the quest for AGI
Tom and Nate discuss some of the most dominant metaphors in machine learning these days -- alchemy and deep learning's roots, the Oppenheimer film and a modern "Manhattan Project for AI", and of course, a sprinkle of AGI.Some related reading on Interconnects: https://www.interconnects.ai/p/ai-research-tensions-oppenheimerThanks for listening! Reach out if you have any questions. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-09-15
1h 04
The Retort AI Podcast
Teaser: Welcome to The Retort
A brief introduction to the many problems facing AI and a sneak peak into episode 1, coming soon! This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com
2023-09-06
05 min
Practically Intelligent
E4: Evaluating Large Language Models with Nathan Lambert
On the fourth episode of Practically Intelligent, Sinan and Akshay sit down with the esteemed Nathan Lambert, a prominent Machine Learning researcher and analyst. With his keen goal of understanding and developing safe and societally beneficial autonomous systems, Nathan shares valuable insights from his experience as a Research Scientist at HuggingFace 🤗. We dive deep into the nuances of evaluating large language models (LLMs) and the role of the HuggingFace's Open LLM Leaderboard.
2023-08-17
37 min
The Geek In Review
Lawyer vs. AI or Lawyers + AI: Embracing the Future of Legal Practice with BriefPoint.ai's Nathan Walter and Bridget Albiero
In this riveting episode of our podcast, we delve into the fascinating world of AI in the legal industry with our esteemed guests, Nathan Walter and Bridget Albiero. Walter, a former attorney and founder of BriefPoint.ai, has leveraged his legal expertise and passion for technology to automate the manual processes that often bog down law firms. Bridget Albiero, a User Experience (UX) and User Design (UD) expert, underscores the significance of intuitive design in making these AI tools not just effective, but user-friendly. Nathan Walter has been instrumental in creating BriefPoint.ai, a tool designed specifically...
2023-05-12
47 min
Slate Church
The Book of Matthew (Part 2) - Nathan Lambert
Jesus completes the story, but the story completes our understanding of Jesus. In "The Book of Matthew" (Part 2), Pastor Nathan Lambert of Slate Church teaches us that the book of Matthew was written after Jesus lived, died, and rose again. The author of Matthew is reminding us that Jesus completes the genealogy and the covenant. To understand who Jesus is, we must understand that this story helps us understand the story of Jesus.
2021-10-25
36 min
Slate Church
The Good Life (Week 4) - Nathan Lambert
In The Good Life (Week 4), Pastor Nathan Lambert encourages us to root ourselves in the Word of God and embrace the practice of gratitude and thankfulness in our lives.
2021-10-11
35 min
Slate Church
The Good Life (Week 3) - Nathan Lambert
In The Good Life (Week 3), Pastor Nathan Lambert of Slate Church speaks about how we can engage with the world out of a place of peace and hope instead of anger and frustration and how we can live a life worth dying for.
2021-10-04
31 min
Fireplace Messages
Le secret, la force, le but et les moyens de la vie chrétienne - Nathan Lambert
Le secret, la force, le but et les moyens de la vie chrétienne - Nathan Lambert
2021-07-12
56 min
Fireplace Messages
Le repas du Seigneur - Nathan Lambert
Le repas du Seigneur - Nathan Lambert
2021-05-05
44 min
Fireplace Messages
Tous représentants de Dieu ! - Nathan Lambert
Tous représentants de Dieu ! - Nathan Lambert
2021-04-28
38 min
Fireplace Messages
La trinité change tout - Nathan Lambert
La trinité change tout - Nathan Lambert
2021-04-13
51 min
TalkRL: The Reinforcement Learning Podcast
Nathan Lambert
Nathan Lambert is a PhD Candidate at UC Berkeley. Featured References Learning Accurate Long-term Dynamics for Model-based Reinforcement Learning Nathan O. Lambert, Albert Wilcox, Howard Zhang, Kristofer S. J. Pister, Roberto Calandra Objective Mismatch in Model-based Reinforcement Learning Nathan Lambert, Brandon Amos, Omry Yadan, Roberto Calandra Low Level Control of a Quadrotor with Deep Model-Based Reinforcement Learning Nathan O. Lambert, Daniel S. Drew, Joseph Yaconelli, Roberto Calandra, Sergey Levine, Kristofer S.J. Pister On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning Baohe Zhang, Raghu Raj...
2021-03-22
50 min
Fireplace Messages
Une vision de l'église de Jésus - Nathan Lambert
Une vision de l'église de Jésus - Nathan Lambert
2021-03-11
39 min
Fireplace Messages
Reprendre du poil de la bête - Nathan Lambert
Reprendre du poil de la bête - Nathan Lambert
2021-03-11
39 min
Fireplace Messages
L'argent, les responsables et l'église - Nathan Lambert
L'argent, les responsables et l'église - Nathan Lambert
2021-02-08
48 min
Machine Learning Archives - Software Engineering Daily
Reinforcement Learning and Robotics with Nathan Lambert
Reinforcement learning is a paradigm in machine learning that uses incentives- or “reinforcement”- to drive learning. The learner is conceptualized as an intelligent agent working within a system of rewards and penalties in order to solve a novel problem. The agent is designed to maximize rewards while pursuing a solution by trial-and-error. Programming a system to respond to the complex and unpredictable “real world” is one of the principal challenges in robotics engineering. One field which is finding new applications for reinforcement learning is the study of MEMS devices- robots or other electronic devices built at...
2021-01-27
55 min
Fireplace Messages
Connaissance vs Amour - Nathan Lambert
Connaissance vs Amour - Nathan Lambert
2021-01-18
40 min
Fireplace Messages
La vision de Fireplace - Nathan Lambert
La vision de Fireplace - Nathan Lambert
2020-12-18
18 min
Fireplace Messages
La grâce change tout - Nathan Lambert
La grâce change tout - Nathan Lambert
2020-11-24
40 min
Fireplace Messages
L’immoralité dans l’église et en dehors - Nathan Lambert
L’immoralité dans l’église et en dehors - Nathan Lambert
2020-11-10
45 min
Fireplace Messages
Le discernement et internet - Nathan Lambert
Le discernement et internet - Nathan Lambert
2020-10-22
52 min
Fireplace Messages
Le discernement dans l'église - Nathan Lambert
Le discernement dans l'église - Nathan Lambert
2020-10-20
38 min
Fireplace Messages
La maturité des enfants de Dieu - Nathan Lambert
La maturité des enfants de Dieu - Nathan Lambert
2020-10-05
39 min
Fireplace Messages
Unis dans l'humilité - Nathan Lambert
Unis dans l'humilité - Nathan Lambert
2020-09-14
46 min
Bokeh - The Photography Podcast
#402: A Journey to Sony Artisanship - Kesha Lambert
Have you dreamed of being a brand ambassador for a big name photography company? Our friend, Kesha Lambert, was just honored with the title of Sony Artisan and we're so proud of her!In episode 402 of the Bokeh Podcast, Kesha joins us to discuss what her journey to becoming a Sony Artisan looked like and the important principles she focused on while pursuing this opportunity. Listen in as she describes significance of this opportunity not only for her career, but also in regards to the important conversations currently happening in the photography industry about racial equity.
2020-07-09
27 min
Fireplace Messages
"Je suis la vigne" - Ce que Jésus dit sur lui-même - Nathan Lambert
"Je suis la vigne" - Ce que Jésus dit sur lui-même - Nathan Lambert Je suis la vigne-CequeJésusditsurlui-mêmeNathanLambert
2020-06-30
46 min
Theology of Music
"What A Beautiful Name" (Part 2) feat. Pastor Nathan Dodd
This episode is part 2 of episode on "What A Beautiful Name" written by Ben Fielding and Brooke Ligertwood from Hillsong Worship. Join Pastor Joel and Pastor Nathan Dodd (from Liberty Baptist) as they finish their discussion.Verse 1:You were the Word at the beginningOne with God the Lord Most HighYour hidden glory in creationNow revealed in You our ChristChorus:What a beautiful Name it isWhat a beautiful Name it isThe Name of Jesus Christ my KingWhat...
2020-06-26
15 min
Fireplace Messages
Jésus et le Vigneron - Nathan Lambert
Jésus et le Vigneron - Nathan Lambert
2020-06-24
37 min
Theology of Music
"What A Beautiful Name" (Part 1) feat. Pastor Nathan Dodd
In this episode, Pastor Joel and Pastor Nathan Dodd (from Liberty Baptist) talk about the song "What A Beautiful Name" written by Ben Fielding and Brooke Ligertwood from Hillsong Worship. Verse 1:You were the Word at the beginningOne with God the Lord Most HighYour hidden glory in creationNow revealed in You our ChristChorus:What a beautiful Name it isWhat a beautiful Name it isThe Name of Jesus Christ my KingWhat a beautiful Name it is...
2020-06-20
16 min
Fireplace Messages
"Je suis la résurrection et la vie" - Ce que Jésus dit sur lui-même - Nathan Lambert
"Je suis la résurrection et la vie" - Ce que Jésus dit sur lui-même - Nathan Lambert Je suis la résurrection et la vie-CequeJésusditsurlui-mêmeNathanLambert
2020-06-16
47 min
dot innovate
Marcus Lambert discusses moving business operations to the cloud
Marcus Lambert is an entrepreneurial CTO and software architect for Omobono, the digital agency for business brands. He measures success by delivering exactly what the user needs wrapped in a compelling UX on time and on budget. We discussed: How have their business continuity plans changed What does that look like with an agency with 100 people? How should we be thinking about scenario planning? How his role has changed as CTO How Omobono are thinking about sales and new business? How do B2B salespeople sell in this environment? Pitching/workshops Digital transformation Marcus’ silver linings I...
2020-06-11
22 min
Fireplace Messages
"Je suis le bon berger" - Ce que Jésus dit sur lui-même - Nathan Lambert
"Je suis le bon berger" - Ce que Jésus dit sur lui-même - Nathan Lambert
2020-06-08
40 min
Fireplace Messages
L'anniversaire de l'église - Nathan Lambert
L'anniversaire de l'église - Nathan Lambert Actes 2
2020-06-08
38 min
Fireplace Messages
"Je suis la porte des brebis" - Ce que Jésus dit sur lui-même - Nathan Lambert
"Je suis la porte des brebis" - Ce que Jésus dit sur lui-même - Nathan Lambert
2020-05-28
51 min
Fireplace Messages
"Je suis la Lumière du Monde" - Ce que Jésus dit sur lui-même - Nathan Lambert
"Je suis la Lumière du Monde" - Ce que Jésus dit sur lui-même - Nathan Lambert Je suis la Lumière du Monde-CequeJésusditsurlui-mêmeNathanLambertLeMessageduDimanche
2020-05-28
43 min
Fireplace Messages
"Je suis le pain de vie" - Nathan Lambert - Le Message du Dimanche
"Je suis le pain de vie" - Nathan Lambert - Le Message du Dimanche
2020-05-11
43 min
Fireplace Messages
"Je suis JE SUIS" - Nathan Lambert - Le Message du Dimanche
"Je suis JE SUIS" - Nathan Lambert - Le Message du Dimanche
2020-05-04
57 min
Fireplace Messages
Le contrôle technique, la fenêtre ouverte et le creuset - Nathan Lambert
Le contrôle technique, la fenêtre ouverte et le creuset - Nathan Lambert
2020-04-24
49 min
Agency Dealmasters podcast
Marcus Lambert discusses business continuity planning
Marcus Lambert is an entrepreneurial CTO and software architect for Omobono, the digital agency for business brands. He measures success by delivering exactly what the user needs wrapped in a compelling UX on time and on budget. We discussed: How have their business continuity plans changed What does that look like with an agency with 100 people? How should we be thinking about scenario planning? How his role has changed as CTO How Omobono are thinking about sales and new business? How do B2B salespeople sell in this environment? Pitching/workshops Digital transformation Marcus' si...
2020-04-22
22 min
Fireplace Messages
La Prière dans un Monde de Dingues - Nathan Lambert
La Prière dans un Monde de Dingues - Nathan Lambert
2020-03-18
47 min
Fireplace Messages
La Parole de Dieu Dans un Monde de Dingues - Nathan Lambert
La Parole de Dieu Dans un Monde de Dingues - Nathan Lambert
2020-03-16
45 min
Fireplace Messages
Chercher Dieu au Milieu de l'Ambition- Nathan Lambert
Chercher Dieu au Milieu de l'Ambition- Nathan Lambert
2020-01-28
44 min
Fireplace Messages
Chercher Dieu au milieu de la confusion - Nathan Lambert
Chercher Dieu au milieu de la confusion - Nathan Lambert
2020-01-24
45 min
Fireplace Messages
Trouver Dieu dans l'humilité - Nathan Lambert
Trouver Dieu dans l'humilité - Nathan Lambert
2020-01-04
24 min
Fireplace Messages
Créer des Disciples : Explosivité - Nathan Lambert
Créer des Disciples : Explosivité - Nathan Lambert by Eglise Fireplace
2019-12-02
44 min
Fireplace Messages
Créer des Disciples : Redevabilité - Nathan Lambert
Créer des Disciples : Redevabilité - Nathan Lambert by Eglise Fireplace
2019-12-02
52 min
Fireplace Messages
Créer des Disciples : Communauté - Nathan Lambert
Créer des Disciples : Communauté - Nathan Lambert by Eglise Fireplace
2019-11-14
27 min
Fireplace Messages
Enseigner comme Jésus - Nathan Lambert
Enseigner comme Jésus - Nathan Lambert by Eglise Fireplace
2019-10-14
47 min
Fireplace Messages
Bastonner comme Jésus - Nathan Lambert
Bastonner comme Jésus - Nathan Lambert by Eglise Fireplace
2019-09-23
52 min
Fireplace Messages
Un agenda comme Jésus - Nathan Lambert
Un agenda comme Jésus - Nathan Lambert by Eglise Fireplace
2019-09-17
52 min
Fireplace Messages
Sois Un Disciple - Nathan Lambert
Sois Un Disciple - Nathan Lambert by Eglise Fireplace
2019-09-01
43 min