Look for any podcast host, guest or anyone
Showing episodes and shows of

Raza Habib

Shows

High Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersFrom 0 to $40M in 5 Months: Bolt.new Story with Eric SimonsEric Simons discusses the meteoric rise of Bolt.new, an AI-powered web app builder that went from zero to $40 million ARR in just five months. He shares insights on how they built an AI agent capable of creating full-stack web applications from simple prompts, the challenges of rapid growth, and the future of AI in software development. From nearly shutting down the company to becoming one of the fastest-growing AI products in history, Eric offers valuable lessons for anyone building in the AI space.Chapters:00:00 - Introduction and Bolt.new overview06:05 - The journey from...2025-04-0341 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersSaving Pharma Companies Billions with AI l Patrick Leung from Faro HealthIn this episode of High Agency, Patrick Leung from Faro Health explains how they're using AI to revolutionize clinical trial design by both generating regulatory documents and extracting insights from thousands of existing trials. Patrick emphasises the essential collaboration between clinical experts and AI engineers when building reliable systems in healthcare's high-stakes environment. Chapters:00:00 - Introduction04:26 - Clinical trials before: Microsoft Word Documents08:17 - Document generation using AI12:26 - What makes clinical trials so expensive16:26 - Parsing and processing clinical trial data18:04 - Challenges with traditional evaluation metrics21:28 - Importance o...2025-03-2148 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI Builders100x Hiring Speed with Superhuman Recruiters l Metaview Co-FounderIn this episode, Raza is joined by Shahriar Tajbakhsh, the co-founder of Metaview. They discuss how Metaview’s AI scribe automates interview note-taking, how AI agents can surface top candidates from thousands of resumes, and why hiring managers should think of AI as a co-worker, not just a tool. Raza's recomended reading: Creating a LLM-as-a-Judge That Drives Business Results.Chapters:00:00 - Introduction03:32 - How AI Co-Workers Are Transforming Recruiting06:21 - Inside MetaView: AI Scribe and Workflow Automation09:11 - Unlocking Hiring Insights with AI-Driven Conversations11:30 - Balancing AI Innovation and User Adoption14:05...2025-03-0753 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersAI Will Replace Command Lines I Ex-Google Tech Lead and Founder at WarpIn this episode, Raza Habib chats with Zach Lloyd, CEO and founder of Warp, about how AI is transforming the developer experience. They explore how Warp is reimagining the command line, the power of AI-driven automation, and what the future holds for coding workflows.Chapters:00:00 - Introduction04:06 - Why the terminal needed reinvention07:11 - AI’s role in Warp’s evolution08:55 - Key AI features in Warp12:49 - Balancing safety, reliability, and usability19:43 - Challenges in AI-Powered development22:33 - Changing developer behavior with AI27:24 - Prompt engineering and context opti...2025-02-2147 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersGoogle Is Dead: How This 144-GPU Startup Is Building Einstein-Level AI Search I Will Bryk | Exa CEOWill Bryk, CEO of Exa, sits down with Raza Habib to reveal why traditional search engines are becoming obsolete and how his startup is building an AI-powered search engine for the future. From constructing a massive GPU cluster to predicting AI will surpass human mathematicians by 2026, Will shares fascinating insights about the technological breakthroughs that will reshape society in the coming months.Chapters:00:00 - Introduction 05:13 - Exa as a Tool for LLMs and Neural Search  06:19 - Introducing "Websets" and Its Use Cases  10:16 - Building a Compute Cluster: Why Own vs. Rent?  12:00 - Th...2025-02-0738 minData RadicalsData RadicalsLLMs Decoded: A Starter's Guide to AI with Raza Habib, co-founder & CEO of HumanloopAs AI becomes integral to every aspect of business, ensuring its accessibility for everyone—not just specialists—is essential. Companies like Humanloop are leading the charge with innovative platforms that empower non-technical users to harness the power of advanced language models through intuitive tools and frameworks.Democratizing AI access paves the way for transformative business outcomes and a future of collaborative AI systems. However, building a strong AI strategy starts with leveraging powerful models and mastering prompt engineering before considering fine-tuning. Engaging subject matter experts and using robust evaluation and collaboration tools are equally critical to the succ...2025-02-0548 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI Builders$100M raised: How Decagon is building better AI agents I Jesse ZhangIn this episode, Jesse Zhang joins Raza to discuss building cutting-edge AI agents for customer support. They explore how his early passion for LLMs led to creating a company that’s transforming the way businesses like Rippling, Duolingo, and Webflow interact with customers. Jesse breaks down the challenges of scaling AI systems, the importance of customer feedback, and his predictions for the future of AI.Chapters:00:00 - Introduction and Jesse Zhang's Background  01:17 - First Exposure to LLMs and Building Early Projects  04:32 - Decagon’s Rapid Growth and Differentiation in AI  06:37 - Understanding Decagon’s AI Cust...2025-01-2241 minAI Portfolio PodcastAI Portfolio PodcastRaza Habib: Humanloop, LLM and Prompting, Gen AI Performace - AI Portfolio PodcastDr. Raza Habib, CEO of HumanLoop, discussing the complexities of large language model (LLM) deployment, monitoring, and evaluation.Follow/Connect:Raza Linkedin: https://www.linkedin.com/in/humanloop-raza/Mark LinkedIn: https://www.linkedin.com/in/markmoyou/Chapters:00:00 Intro02:19 Humanloop06:08 Prompt Management13:26 LLM System17:57 AI Guardrails22:32 Workflow27:14 User Generated Hyperparameters31:30 LLM Routing34:20 Prompt Engineering38:22 Data Poisoning45:17 Latency in LLMs50:25 Monitoring LLMs57:57 LLM Eval Benchmarks01:03:27 Startup01:17:51 Career Optimization Function01:19:44 Books01:24:27 Career Advice01:27:51 Rapid Round2025-01-111h 31High Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersHow GitHub Copilot Became the First LLM-Powered Developer Tool with Ryan SalvaOn this week's episode, former GitHub Copilot lead Ryan Salva breaks down how AI coding tools became ubiquitous almost overnight. They discuss the critical differences between what novice and expert developers expect from AI, why starting with predictive text was both a blessing and a curse, and how the rapid adoption of AI assistance is reshaping the future of software development.Chapters:00:00 - Introduction 01:09 - The Creation of GitHub Copilot  05:39 - From Prototype to Product: Challenges in Scaling  07:37 - How GitHub Copilot Works Behind the Scenes  11:18 - Metrics That Matter: Evaluating AI Succ...2025-01-0738 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersWhat Gives an AI Founder Staying Power I James Theuerkauf, CEO of Syrup Tech I Sara Ittelson, Partner at AccelIn this week's episode, Raza speaks with James Theuerkauf, CEO of Syrup Tech, and Sara Ittelson, Partner at Accel, to explore the challenges and opportunities for entrepreneurs in this transformative era. They discuss building AI-first companies and the lessons learned from scaling in a rapidly evolving space. With practical tips on leveraging data, creating competitive advantages, and sustaining passion for the long haul, this episode offers invaluable guidance for founders in AI.Chapters:00:00 - Introduction and Guest Backgrounds  01:27 - Syrup Tech’s Approach to AI in Retail  03:29 - The Role of AI in Demand Fore...2024-12-2743 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersHow to build great AI products with Vanta Software Developer Noam RubinIn this episode, Noam Rubin, a Software Developer at Vanta reveals how his team uses data-driven strategies to design, test, and improve cutting-edge AI features. Learn how customer insights, rapid prototyping, and iterative development transform raw ideas into tools that make compliance and security easier for businesses everywhere.Chapters:00:00 - Introduction02:47 - The process of building AI products at Vanta04:51 - The role of customer feedback in product development06:59 - Integrating AI into security and compliance workflows08:06 - Using data specifications to guide product development10:10 - Collaborating with subject matter...2024-12-1840 minFajr Reminders - Mahmood Habib Masjid and Islamic CenterFajr Reminders - Mahmood Habib Masjid and Islamic CenterWe see with our knowledge⚠️ AI-Generated Content: This transcription was automatically generated using AI. In the name of Allah, the most Gracious, the most Merciful. Alhamdulillah, O Lord of the worlds, and peace and blessings be upon the honor of the prophets and messengers, Muhammad is the Messenger of Allah, peace be upon him and upon his family, and he is the one who is most at peace. What is next? My dear respected brothers, sisters, elders, Alhamdulillah, O Lord of the worlds, we are witnessing history in progress. I have already done that and I do it again on my behalf and on the beha...2024-12-1500 minFajr Reminders - Mahmood Habib Masjid and Islamic CenterFajr Reminders - Mahmood Habib Masjid and Islamic CenterWhere are the Kings⚠️ AI-Generated Content: This transcription was automatically generated using AI. As-salamu alaykum. Ummah Madhu, first of all, I think we are very happy and blessed, especially to all our friends and brothers and sisters from Syria. God bless them. Alhamdulillah. There is a news, news of happiness for all of us. Alhamdulillah. But where are the signs of happiness? Where are the sweets? Where? Where is sugar? Where is sugar? Tomorrow. Everybody has sugar. Thank you, Alhamdulillah. Jai Hind. Alhamdulillah. The second thing I want to go into my actual khatara is, Soha Allah, those of them we see here, people who...2024-12-1200 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersPredictions for AI in 2025 I Ex-OpenAI, Ex-Stripe researcher Stanislav PoluIn this episode of High Agency, former OpenAI researcher Stan Polu shares his journey from AI research to founding Dust, an enterprise AI platform. Stan offers a contrarian view on the future of AI, suggesting we may be hitting a plateau in model capabilities since GPT-4. He discusses why startups should focus on product-market fit before investing in GPUs, shares practical lessons for building AI products, and predicts increased competition between AI labs and API developers. Chapters:00:00 - Introducing Dust: an enterprise AI platform06:07 - From Stripe to OpenAI: Stan's journey10:29 - Why research w...2024-12-1144 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersHow Replicate is Democratizing AI with Open-Source ResourcesIn this episode, we explore how Replicate is breaking down barriers in AI development through its open-source platform. CEO Ben Firshman shares how Replicate enables developers without machine learning expertise to run AI models in the cloud.00:00 Introduction 00:29 Overview of Replicate 03:13 Replicate's user base 05:45 Enterprise use cases and lowering the AI barrier 07:45 The complexity of traditional AI deployment 10:24 Simplifying AI with Replicate's API 13:50 ControlNets and the challenges of image models 19:42 Fragmentation in AI models: images vs. language 25:05 Customization and multi-model pipelines in production 26:33 Learning by doing: skills for AI engine...2024-11-1336 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersThe Principles for Building Excellent AI Features with Superhuman’s Lorilyn McCueHow do you build AI tools that actually meet users’ needs? In this episode of High Agency, Raza speaks with Lorilyn McCue, the driving force behind Superhuman’s AI-powered features. Lorilyn lays out the principles that guide her team’s work, from continuous learning to prioritizing user feedback. Learn how Superhuman’s "learning-first" approach allows them to fine-tune features like Ask AI and AI-driven summaries, creating practical solutions for today’s professionals. 00:00 - Introduction04:20 - Overview of the Superhuman06:50 - Instant Reply and Ask AI10:00 - Building On-Demand vs. Always-On AI Features13:45 - Prompt Engi...2024-11-0742 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersJeff Huber of Chroma: Building the open-source toolkit for AI EngineeringThis week on High Agency, Raza Habib is joined by Chroma founder Jeff Huber. They cover the evolution of vector databases in AI engineering, challenge common assumptions about RAG and share insights from Chroma's journey. Jeff shares insights from Chroma's development, including their focus on developer experience and observations about real-world usage patterns. They also get into whether or not we can expect a super AI any time soon and what is over and under hyped in the industry today. 00:00 - Introduction02:30 - Why vector databases matter for AI06:00 - Understanding embeddings and similarity search2024-10-2454 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersHow to Create AI Strategy in Enterprises with Peter Gostev from MoonpigIn this episode of High Agency podcast, Peter Gostev shares his experiences implementing LLMs at NatWest and Moonpig. He discusses creating an AI strategy, talks about challenges in deploying LLMs in large organizations, and shares thoughts on underappreciated AI developments.00:00 - Introduction00:44 - OpenAI dev day reactions  03:47 - Using AI to automate customer service  10:43 - Impact of AI products13:41 - Who are the users of LLMs14:47 - Challenges building with AI in a large enterprise  21:22 - AI use cases at Moonpig24:34 - How to create an AI strategy28:10 - Und...2024-10-1639 minLatent Space: The AI Engineer PodcastLatent Space: The AI Engineer PodcastProduction AI Engineering starts with Evals — with Ankur Goyal of BraintrustWe are in 🗽 NYC this Monday! Join the AI Eng NYC meetup, bring demos and vibes!It is a bit of a meme that the first thing developer tooling founders think to build in AI is all the non-AI operational stuff outside the AI. There are well over 60 funded LLM Ops startups all with hoping to solve the new observability, cost tracking, security, and reliability problems that come with putting LLMs in production, not to mention new LLM oriented products from incumbent, established ops/o11y players like Datadog and Weights & Biases. 2 years in to the...2024-10-121h 56High Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersEx-Coinbase CPO's Next Big Thing: AI Employees I Surojit ChatterjeeIn this episode of High Agency, we're joined by Surojit Chatterjee, former CPO of Coinbase and now CEO of Ema. Surojit unveils his audacious plan to create universal AI employees and revolutionize Fortune 1000 workforce. Drawing from his career at tech giants like Google and Coinbase, he shares how these experiences fueled his vision for Ema. Surojit dives into the challenges of building AI agents, explores the concept of artificial humans, and predicts how this technology could transform the future of SaaS(00:00:00) Introduction and Surojit’s background(00:03:00) Founding story of Ema (Universal AI Employee)(00:04:53) Ho...2024-10-0244 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersWhy Your AI Product Needs Evals with Hamel Husain and SwyxHamel Husain is a seasoned AI consultant and engineer with experience at companies like GitHub, DataRobot, and Airbnb. He is a trailblazer in AI development, known for his innovative work in literate programming and AI-assisted development tools. Shawn Wang (aka Swyx) is the host of the Latent Space podcast, the author of the essay 'Rise of the AI Engineer,' and the founder of the AI Engineer World Fair. In this episode, Hamel and Swyx share their unique insights on building effective AI products, the critical importance of evaluations, and their vision for the future of AI engineering.2024-09-251h 09High Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersHow AI is Changing Product Management with Raz Nussbaum from Gong AIRaz Nussbaum is a Senior Product Manager in AI at Gong — the leading AI platform for revenue teams. He is an absolute legend when it comes to building and scaling AI products that genuinely deliver value. In this episode, he opens up about what it takes to build successful AI products in an era where things change at lightning speed.Chapters00:00 - Introduction01:16 - How LLMs Changed Product Development at Gong AI08:32 - Including Product Managers in Development Process13:05 - Testing and Monitoring Pre vs Post-deployment17:53 - New Challenges in the Face of...2024-09-1830 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersFrom Fiction to Reality: Sudowrite's Journey in AI-Assisted Creative WritingIn this episode, we dive deep into the world of AI-assisted creative writing with James Yu, founder of Sudowrite. James shares the journey of building an AI assistant for novelists, helping writers develop ideas, manage complex storylines, and avoid clichés. James gets into the backlash the company faced when they first released Story Engine and how they're working to build a community of users.00:00 - Introduction and Background of Sudowrite02:26 - The Early Days: Concept, Skepticism, and User Adoption05:20 - Sudowrite's Interface, Features, and User Base10:23 - Developing and Iterating Features in Sudowrite2024-09-1156 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersBuilding the Nervous System for AI with Russ d'Sa from LiveKitIn this episode, LiveKit CEO Russ d'Sa explores the critical role of real-time communication infrastructure in the AI revolution. From building voice demos to powering OpenAI's ChatGPT,  he shares insights on technical challenges around building multimodal AI on the web and what new possibilities are opening up.00:00 - Introduction and Background01:34 - The Evolution of AI and Lessons for Founders05:20 - Timelines and Technological Progress10:32 - Overview of LiveKit and Its Impact on AI Development13:39 - Why LiveKit Matters for AI Developers19:08 - Partnership with OpenAI21:25 - Challenges in Streaming and R...2024-09-0449 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersFrom PyTorch to Fireworks AI: Lin Qiao on Building AI InfrastructureThis week we’re talking to Lin Qiao, former PyTorch lead at Meta and current CEO of Fireworks AI. We discuss the evolution of AI frameworks, the challenges of optimizing inference for generative AI, the future of AI hardware, and open-source models. Lin shares insights on PyTorch design philosophy, how to achieve low latency, and the potential for AI to become as ubiquitous as electricity in our daily lives.Chapters: 00:00 - Introduction and PyTorch Background04:28 - PyTorch's Success and Design Philosophy08:20 - Lessons from PyTorch and Transition to Fireworks AI14:52 - Challenges in Gen...2024-08-2841 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersHow Paras Jain is building the future of AI video creationIn this episode of High Agency, we are speaking to Paras Jain who is the CEO of AI video generation startup Genmo. Paras shares insights from his experience working on autonomous vehicles, why he chose academia over an offer from Tesla, and the research-minded approach that has lead to Genmo's rapid success.Chapters:(00:00) Introduction(01:52) Lessons from selling an AI company to Tesla(07:01) Working within GPU constraints and transformer architecture(11:18) Moving from research to startup success(14:36) Leading the video generation industry(16:05) Training diffusion models for videos(19:36) Evaluating AI video generation(24:06...2024-08-2148 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersAI at Scale: Lessons from Gusto's $9.5 billion journey with Eddie Kim & Ali RowghaniIn this week’s episode of the High Agency podcast, Humanloop Co-Founder and CEO Raza Habib sat down with Eddie Kim, co-founder and Head of Technology at Gusto and guest host Ali Rowghani to discuss how Gusto has applied AI to revolutionize ops-heavy processes like payroll and HR admin. Eddie also elaborates why Gusto is choosing to build, and not buy, the majority of their GenAI tech stack.Chapters00:00 - Introduction and Background02:15 - Overview of Gusto's Business05:59 - Operational Complexity and AI Opportunities08:51 - Build vs. Buy: Internal vs. External AI Tools2024-08-1655 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersBuilding the first LLM-based search engine for developers with Michael RoyzenIn this episode, we sit down with Michael Royzen, CEO and co-founder of Phind. Michael shares insights from his journey in building the first LLM-based search engine for developers, the challenges of creating reliable AI models, and his vision for how AI will transform the work of developers in the near future. Tune in to discover the groundbreaking advancements and practical implications of AI technology in coding and beyond.I hope you enjoy the conversation and if you do, please subscribe!--------------------------------------------------------------------------------------------------------------------------------------------------Humanloop is an Integrated Development Environment for Large Language Models. I...2024-08-0257 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersContrarian Guide to AI: Jason Liu on Betting Against Agents while Doubling Down on RAG & Fine-TuningJason Liu is a true Renaissance Man in the world of AI. He began his career working on traditional ML recommender systems at tech giants like Meta and Stitch Fix and quickly pivoted into LLMs app development when ChatGPT opened its API in 2022. As the creator of Instructor, a Python library that structures LLM outputs for RAG applications, Jason has made significant contributions to the AI community. Today, Jason is a sought-after speaker, course creator, and Fortune 500 advisor. In this episode, we cut through the AI hype to explore effective strategies for building valuable AI products and d...2024-07-2455 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersWhat comes after Open AI? Logan Kilpatrick on how you should prepare for the future of LLMsIf you need to understand the future trajectory of AI, Logan Kilpatrick will help you do just that.  Having seen the frontier at both OpenAI and Google. Logan led developer relations at OpenAI before leading product on the Google AI Studio. He's been closer than anyone to developers building with LLMs and has seen behind the curtain at two frontier labs.Logan and I talked about:🔸 What it was like joining OpenAI the day ChatGPT hit 1 million users 🔸 What you might expect from GPT5🔸 Google's latest innovations and the battle with OpenAI🔸 How can...2024-07-1744 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersAI's Memory Upgrade: Max Rumpf on how to build advanced RAG systemsI'm excited to share this conversation with Max Rumpf the founder of Sid.AI. I wanted to speak to Max because Retrieval Augmented generation has become core to building AI applications and he knows more about RAG than anyone I know.We get deep into the challenges of building RAG systems and the episode is full of technical detail and practical insights. We cover:00:00 - Introduction to Max Rumpf and SID.ai03:39 - How SID.ai's RAG approach differs from basic tutorials07:30 - Challenges of document processing and chunking strategies13:07 - R...2024-07-1146 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersBuilding AI Products at Scale: Lessons from Zapier's CEOIn this episode, I had the pleasure of speaking with Wade Foster, the founder and CEO of Zapier. We discussed Zapier's journey with AI, from their early experiments to the company-wide AI hackathon they held in March. Wade shared insights on how they prioritize AI projects, the challenges they've faced, and the opportunities they see in the AI space. We also talked about the future of AI and how it might impact the way we work2024-07-0340 minLatent Space: The AI Engineer PodcastLatent Space: The AI Engineer Podcast[High Agency] AI Engineer World's Fair PreviewThe World’s Fair is officially sold out! Thanks for all the support and stay tuned for recaps of all the great goings on in this very special celebration of the AI Engineer!Longtime listeners will remember the fan favorite Raza Habib, CEO of HumanLoop, on the pod:Well, he’s caught the podcasting bug and is now flipping the tables on swyx! Subscribe to High Agency wherever the finest Artificial Intelligence podcast are sold.High Agency Pod DescriptionIn this episode, I chatted with Shawn Wang abou...2024-06-2549 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersInventing the AI EngineerIn this episode, I chatted with Shawn Wang about his upcoming AI engineering conference and what an AI engineer really is. It's been a year since he penned the viral essay "Rise of the AI Engineer' and we discuss if this new role will be enduring, the make up of the optimal AI team and trends in machine learning.The Rise of the AI Engineer Blog Post: https://www.latent.space/p/ai-engineerChapters00:00 - Introduction and background on Shawn Wang (Swyx)03:45 - Reflecting on the "Rise of the AI Engineer" essay07:30...2024-06-2548 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersBuilding an AI coding assistant with Beyang Liu CTO of SourcegraphSourcegraph have built the most popular open source AI coding tool in both the dev community and the Fortune 500. I sat down with Beyang Liu their CTO and cofounder to find out how they did it.We dive into the technical details of Cody's architecture, discussing how Sourcegraph handles the challenges of limited context windows in LLMs, why they don't use embeddings in their RAG system, and the importance of starting with the simplest approach before adding complexity.We also touch on the future of software engineering, open-source vs closed LLM models and what areas...2024-06-1851 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersEvaluating LLMs the Right Way: Lessons from Hex's JourneyI recently sat down with Bryan Bischof, AI lead at Hex, to dive deep into how they evaluate LLMs to ship reliable AI agents. Hex has deployed AI assistants that can automatically generate SQL queries, transform data, and create visualizations based on natural language questions. While many teams struggle to get value from LLMs in production, Hex has cracked the code.In this episode, Bryan shares the hard-won lessons they've learned along the way. We discuss why most teams are approaching LLM evaluation wrong and how Hex's unique framework enabled them to ship with confidence. B...2024-06-1145 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersBuilding reliable AI agents with Cai GoGwilt CTO of Ironclad50% of AI contracts at Ironclad’s largest customers are now automatically negotiated with the help of generative AI. Ironclad were one of the earliest adopters of LLMs, starting when the best model was still GPT-3.  There’s a lot of hype around AI agents without many successful examples but Ironclad had successfully deployed them in one of the most sensitive industries imaginable. In this episode Cai explains how they achieved this. Why they had to build their own visual programming language to make agents reliable and shares his advice for AI leaders starting to build...2024-06-0451 minHigh Agency: The Podcast for AI BuildersHigh Agency: The Podcast for AI BuildersWelcome to the High Agency podcast!Welcome to very first episode of the High Agency podcast! High Agency is a new podcast from Humanloop.Every week, I (Raza Habib) will interview leaders from companies, who have already succeeded with AI in production.  We'll share their stories, lessons and playbooks to help you build with LLMs more quickly and with confidence.To get notified of the first episodes with Cai Gogwilt or Ironclad, Bryan Bishof of Hex, Beyang Liu of Sourcegraph and Wade Foster of Zapier please subscribe on youtube, spotify or apple podcasts! (just search for High Agency podcast)----------------------------------------------------------------------------------------------------------------------------------------2024-06-0402 minChangelog Master FeedChangelog Master FeedCollaboration & evaluation for LLM apps (Practical AI #253)Small changes in prompts can create large changes in the output behavior of generative AI models. Add to that the confusion around proper evaluation of LLM applications, and you have a recipe for confusion and frustration. Raza and the Humanloop team have been diving into these problems, and, in this episode, Raza helps us understand how non-technical prompt engineers can productively collaborate with technical software engineers while building AI-driven apps. Leave us a comment Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today! Sponsors: Read...2024-01-2346 minPractical AIPractical AICollaboration & evaluation for LLM appsSmall changes in prompts can create large changes in the output behavior of generative AI models. Add to that the confusion around proper evaluation of LLM applications, and you have a recipe for confusion and frustration. Raza and the Humanloop team have been diving into these problems, and, in this episode, Raza helps us understand how non-technical prompt engineers can productively collaborate with technical software engineers while building AI-driven apps.Join the discussionChangelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!Sponsors:Read Write Own – Re...2024-01-2346 minThe MAD Podcast with Matt TurckThe MAD Podcast with Matt TurckHumanloop: LLM Collaboration and Optimization with CEO Raza HabibToday, we have the pleasure of chatting with Raza Habib, CEO of Humanloop, the platform for LLM collaboration and evaluation. Matt and Raza cover how to understand and optimize model performance, lessons learned about model evaluation and feedback, and explore the future of model fine-tuning.twitter.com/RazRazclehumanloop.comData Driven NYC YouTube Channeltwitter.com/mattturcklinktr.ee/mattturckShownotes: [00:00:47] How Humanloop helps product and engineering teams build reliable applications on top of large...2023-11-2235 minLatent Space: The AI Engineer PodcastLatent Space: The AI Engineer PodcastAGI is Being Achieved Incrementally (DevDay Recap - cleaned audio)We left a high amount of background audio in the Devday podcast, which many of you loved, but we definitely understand that some of you may have had trouble with it. Listener Klaus Breyer ran it through Auphonic with speech islolation and we figured we’d upload it as a backdated pod for people who prefer this. Of course it means that our speakers sound out of place since they now sound like they are talking loudly in a quiet room. Let us know in the comments what you think?Timestampsthe cleaned pa...2023-11-082h 21Latent Space: The AI Engineer PodcastLatent Space: The AI Engineer PodcastAGI is Being Achieved Incrementally (OpenAI DevDay w/ Simon Willison, Alex Volkov, Jim Fan, Raza Habib, Shreya Rajpal, Rahul Ligma, et al)SF folks: join us at the AI Engineer Foundation’s Emergency Hackathon tomorrow and consider the Newton if you’d like to cowork in the heart of the Cerebral Arena.Our community page is up to date as usual!~800,000 developers watched OpenAI Dev Day, ~8,000 of whom listened along live on our ThursdAI x Latent Space, and ~800 of whom got tickets to attend in person:OpenAI’s first developer conference easily surpassed most people’s lowballed expectations - they simply did everything short of announcing GPT-5, including:* ChatGPT (the consumer facing product)* G...2023-11-082h 22Latent Space: The AI Engineer PodcastLatent Space: The AI Engineer PodcastBuilding the Foundation Model Ops Platform — with Raza Habib of HumanloopWant to help define the AI Engineer stack? >500 folks have weighed in on the top tools, communities and builders for the first State of AI Engineering survey! Please fill it out (and help us reach 1000!)The AI Engineer Summit schedule is now live! We are running two Summits and judging two Hackathons this Oct. As usual, see our Discord and community page for all events.A rite of passage for every AI Engineer is shipping a quick and easy demo, and then having to cobble together a bunch of solutions for prompt sharing and versioning...2023-09-291h 21Latent Space: The AI Engineer PodcastLatent Space: The AI Engineer Podcast[Cognitive Revolution] The Tiny Model Revolution with Ronen Eldan and Yuanzhi Li of Microsoft ResearchThanks to the over 1m people that have checked out the Rise of the AI Engineer. It’s a long July 4 weekend in the US, and we’re celebrating with a podcast feed swap!We’ve been big fans of Nathan Labenz and Erik Torenberg’s work at the Cognitive Revolution podcast for a while, which started around the same time as we did and has done an incredible job of hosting discussions with top researchers and thinkers in the field, with a wide range of topics across computer vision (a special focus thanks to Nathan’s work at Wa...2023-07-012h 05\"The Cognitive Revolution" | AI Builders, Researchers, and Live Player AnalysisThe Great Implementation with Raza Habib, CEO of HumanloopRaza Habib is on the front lines of LLM implementation as CEO of Humanloop, a Y Combinator backed startup that helps companies of all kinds, small and large bridge the gap from API access to successful LLM deployment. Nathan sat down with Raza to hear what he has learned in the process of helping so many companies on their LLM implementation journeys – and he did not disappoint – as you'll hear, he shared a bunch of concrete examples of customer use cases, practical challenges that people face, and the strategies they use to overcome them.RECOMMEN...2023-04-271h 23Y Combinator Startup PodcastY Combinator Startup PodcastThe REAL Potential of Generative AIWhat is a large language model? How can it be used to enhance your business? In this conversation, Ali Rowghani, Managing Director of YC Continuity, talks with Raza Habib, CEO of Humanloop, about the cutting-edge AI powering innovations today—and what the future may hold.  They discuss how large language models like Open AI's GPT-3 work, why fine-tuning is important for customizing models to specific use cases, and the challenges involved with building apps using these models. If you're curious about the ethical implications of AI, Raza shares his predictions about the impact of this quickly developing technology on the...2023-03-0620 minFrom The Heart Kuch Dil Se by Shazia HabibFrom The Heart Kuch Dil Se by Shazia HabibDhoop Ki Deewar 1947 seriesDhoop Ki Deewar the Ahad Raza Mir & Sajal Aly web series addresses the human loss when nations are locked in war. Find out what India & Pakistan have to lose, and lost in this teaser reaction2021-06-0411 minMachine Learning Archives - Software Engineering DailyMachine Learning Archives - Software Engineering DailyHumanloop: NLP Model Engineering with Raza HabibData labeling is a major bottleneck in training and deploying machine learning and especially NLP. But new tools for training models with humans in the loop can drastically reduce how much data is required. Humanloop is a platform for annotating text and training NLP models with much less labelled data. Raza Habib, founder of Humanloop, joins the show to to talk about NLP workflows and his work on Humanloop. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Humanloop: NLP Model Engineering with Raza Habib appeared first on Software Engineering Daily. 2020-11-0345 minSoftware Engineering DailySoftware Engineering DailyHumanloop: NLP Model Engineering with Raza HabibData labeling is a major bottleneck in training and deploying machine learning and especially NLP. But new tools for training models with humans in the loop can drastically reduce how much data is required. Humanloop is a platform for annotating text and training NLP models with much less labelled data. Raza Habib, founder of Humanloop, joins the show to to talk about NLP workflows and his work on Humanloop.Sponsorship inquiries: sponsor@softwareengineeringdaily.com Learn more about your ad choices. Visit megaphone.fm/adchoices2020-11-0342 min