Shows
AI Engineering PodcastDesigning Scalable AI Systems with FastMCP: Challenges and InnovationsSummaryIn this episode of the AI Engineering Podcast Jeremiah Lowin, founder and CEO of Prefect Technologies, talks about the FastMCP framework and the design of MCP servers. Jeremiah explains the evolution of FastMCP, from its initial creation as a simpler alternative to the MCP SDK to its current role in facilitating the deployment of AI tools. The discussion covers the complexities of designing MCP servers, the importance of context engineering, and the potential pitfalls of overwhelming AI agents with too many tools. Jeremiah also highlights the importance of simplicity and incremental adoption in software design, and shares insights...
2025-08-261h 13
PodQueuePrefect Dataflow Scheduler with Jeremiah LowinA data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model. The workflow scheduler manages the tasks in that
2024-12-2158 min
ContributorRethinking the Workflow Problem: Windmill with Ruben FiszelRuben Fiszel (@rubenfiszel) is the creator of Windmill, the open-source developer platform that lets users easily turn scripts into workflows and internal apps with auto-generated UIs. Windmill doesn’t force engineers to change their coding style or adopt a convoluted API, and its low-code design makes it accessible to non-technical users. Tune in to find out how Windmill offers speed, performance and flexibility, while avoiding the limitations of rigid tools.
Subscribe to Contributor on Substack for email notifications, and join our Slack community!
In this episode we discuss:
Why many engineers try to re...
2023-07-0526 min
ContributorRethinking the Workflow Problem: Windmill with Ruben FiszelRuben Fiszel (@rubenfiszel) is the creator of Windmill, the open-source developer platform that lets users easily turn scripts into workflows and internal apps with auto-generated UIs. Windmill doesn’t force engineers to change their coding style or adopt a convoluted API, and its low-code design makes it accessible to non-technical users. Tune in to find out how Windmill offers speed, performance and flexibility, while avoiding the limitations of rigid tools.
Subscribe to Contributor on Substack for email notifications, and join our Slack community!
In this episode we discuss:
Why many engineers try to re...
2023-07-0526 min
Founders#288 Ralph LaurenWhat I learned from reading Ralph Lauren: The Man Behind the Mystique by Jeffrey Trachtenberg.----Get access to the World’s Most Valuable Notebook for Founders by investing in a subscription to Founders Notes----Follow one of my favorite podcasts Invest Like The Best and listen to episode 311 John Fio — Creating Magic for Consumers, episode 307 Jeremiah Lowin: Explaining the New AI Paradigm, and episode 293 The Business of Gaming. ----[2:01] When I lumped him together with a handful of other designers during casual conversation, he snapped: “Don't p...
2023-01-311h 01
HUM Curated PodcastsJeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307] Podcast: Invest Like the Best with Patrick O'Shaughnessy (LS 67 · TOP 0.05% what is this?)Episode: Jeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307]Pub date: 2022-12-13Get Podcast Transcript →powered by Listen411 - fast audio-to-text and summarizationMy guest this week is Jeremiah Lowin. Jeremiah has been on the podcast a number of times over the years. He’s one of my oldest friends who has been a sounding board for me throughout my career. Today he is the founder and CEO of Prefect, which helps...
2023-01-081h 02
Invest Like the Best with Patrick O'ShaughnessyJeremiah Lowin: Explaining the New AI ParadigmMy guest this week is Jeremiah Lowin. Jeremiah has been on the podcast a number of times over the years. He’s one of my oldest friends who has been a sounding board for me throughout my career. Today he is the founder and CEO of Prefect, which helps companies automate and orchestrate their dataflows. In full disclosure, Positive Sum is an investor in Prefect. We didn’t plan this conversation, but when OpenAI released ChatGPT, I called Jeremiah for a primer on what’s happening under the hood and how best to contextualize this product amidst the growing AI mov...
2022-12-131h 02
Monday Morning Data Chat#102 - Boring Tech is Exciting! w/ Jeremiah Lowin (Prefect)Jeremiah Lowin (CEO/Co-Founder @ Prefect) joins the show to chat about why he's excited about boring tech, the current VC/startup environment, building trust, meetups, and much more.
#dataengineering #prefect #data
2022-11-141h 01
Infinite LoopsJeremiah Lowin — Make Original MistakesJeremiah Lowin is the founder & CEO of Prefect, a dataflow automation company. Jeremiah joins Jim for his second appearance on Infinite Loops to discuss executing, storytelling, artificial intelligence and, of course, puns. Important Links: Prefect.io Disney Research Hub The story of the fake statue of Venus Show Notes: Slack, puns and the Hitchhiker’s Guide to the Galaxy Planning, executing and the story of Prefect in 2022 Why naming things is a superpower If you can’t pivot, you’re dead Make original mistakes AI, st...
2022-10-271h 31
The Data Exchange with Ben LoricaDataflow AutomationJeremiah Lowin is co-founder and CEO of Prefect, the company behind the popular open source data workflow orchestration system with the same name. We discussed the major design changes in Prefect 2.0, their move towards treating “code as workflows”, data engineering challenges facing data and ML teams today, and implications of looming trends in machine learning and AI.Download the FREE Report: State of Workflow Orchestration → https://www.prefect.io/lp/gradientflow?utm_source=gradientflow&utm_medium=newsletterSubscribe: Apple • Android • Spotify • Stitcher • Google • AntennaPod • RSS.Detailed show notes can be found on The Da...
2022-05-1946 min
Rising Tide Startups6.15 – Jeremiah Lowin – Prefect.ioThis week's special guest is Jeremiah Lowin. Jeremiah is the Founder and CEO of Prefect, which is a workflow management system that helps to eliminate data flow problems for companies’ data teams. They provide a new dataflow automation platform that reduces engineering time by automating pipelines and workflows of any complexity. Prefect combines the convenience of the cloud with the security of on-prem to meet the needs of companies looking to deploy quickly, monitor, and manage their workflows. Jeremiah graduated from Harvard University with both a Bachelors in Economics and a Masters in Statistics.
Learn more at Prefect.io
Rising Tid...
2022-04-1248 min
DatacastEpisode 86: Risk Management, Open-Source Governance, and Negative Engineering with Jeremiah LowinShow Notes(01:29) Jeremiah reflected on his academic interest studying Statistics and Economics at Harvard.(05:33) Jeremiah recalled his four years as a market risk manager at King Street Capital Management.(07:18) Jeremiah explained how the training in risk management has made a huge impact in his career as a startup founder.(09:48) Jeremiah then founded his own consultancy Lowin Data Company that designed and built ML systems for time series data.(12:38) Jeremiah mentioned his fascination with the rapid growth of machine learning in the past decade.(15:54) Jeremiah talked about his contribution to the Apache Airflow project and lessons learned about open-source...
2022-03-161h 21
Hashmap on Tap#120 Bringing Prefection to the Modern Data Stack with Jeremiah Lowin, CEO & Co-Founder at PrefectJeremiah Lowin and host Kelly Kohlleffel discuss how Prefect is making “dataflows as easy as .py.” Jeremiah is Co-Founder and CEO at Prefect where they are providing workflow management, orchestration, scheduling, and dataflow automation. Jeremiah and the team view Prefect as an insurance product. They provide the most value when something has gone wrong rather than when everything is working fine. Listen in to the episode to hear Jeremiah’s story, how Prefect started and where they are today, and how they are eliminating the worry from data pipelines.
Show Notes:
Learn more about Prefect: https://www.pr...
2022-03-1452 min
ContributorMeltano with Douwe MaanEric Anderson (@ericmander) and Douwe Maan (@DouweM) chat about Meltano, the open-source DataOps operating system. Meltano provides the connective tissue that allows teams to treat their data stack as a single software development project. Tune in to learn how Meltano is trying to bring software development best practices into the data world.
In this episode we discuss:
Meltano’s origins as a side project at GitLab
How Meltano glues together open-source technologies like Singer, dbt and Airflow
Douwe’s experience wearing many different hats in the early days of Meltano
Meltano’s shift from an ELT soluti...
2022-02-1639 min
ContributorMeltano with Douwe MaanEric Anderson (@ericmander) and Douwe Maan (@DouweM) chat about Meltano, the open-source DataOps operating system. Meltano provides the connective tissue that allows teams to treat their data stack as a single software development project. Tune in to learn how Meltano is trying to bring software development best practices into the data world.
In this episode we discuss:
Meltano’s origins as a side project at GitLab
How Meltano glues together open-source technologies like Singer, dbt and Airflow
Douwe’s experience wearing many different hats in the early days of Meltano
Meltano’s shift from an ELT soluti...
2022-02-1639 min
The Sequel ShowWhat data teams can learn from finance ft. Jeremiah Lowin, CEO of PrefectBefore we get into the episode notes, I want to take a beat to thank all of you for supporting the Show over the last year. It's been amazing watching it go from a fun way to connect with some of my favorite folks in data to a full, polished podcast (featuring even more awesome people). We couldn't do it without you and I'm looking forward to giving the best and brightest of our industry the stage in the coming year.
To kick things off with season 2, we have a great episode with Jeremiah Lowin, founder and...
2022-01-131h 07
Making MarketsHash Power Ep.2 - Investing in Cryptocurrencies [Invest Like the Best, Replay]Today we are re-sharing our Hash Power documentary. This series was originally released in September 2017 when 1 Bitcoin hovered around $4000 US Dollars. While so much has changed in the years since - these episodes are a great introduction to the technology, the power of decentralization, Bitcoin, Ethereum, ICO's, cryptography, and hashing. You will hear from a variety of industry experts throughout these episodes - please enjoy.For the full show notes, transcript, and links to the best content to learn more, check out the episode page here. ----Original In...
2021-11-181h 16
Making MarketsHash Power Ep.1 - Understanding Blockchains [Invest Like the Best, Replay]Today we are re-sharing our Hash Power documentary. This series was originally released in September 2017 when 1 Bitcoin hovered around $4000 US Dollars. While so much has changed in the years since - these episodes are a great introduction into the technology, the power of decentralization, Bitcoin, Ethereum, ICO's, cryptography, and hashing. You will hear from a variety of industry experts throughout these episodes - please enjoy. For the full show notes, transcript, and links to the best content to learn more, check out the episode page here. ---- Ori...
2021-11-181h 11
intricity101Data Sharks #19: Jeremiah Lowin with PrefectJoin us as we chat with Jeremiah Lowin – the founder and CEO of Prefect. We will discuss their new product release, Orion.
Meet today's Sharks:
- Jeremiah Lowin, CEO of Prefect
- Jared Hillam, EVP of Emerging Technologies at Intricity
- Rich Hathaway, Senior Solution Architect, Snowflake Expert at Intricity
- Arkady Kleyner, Principal, and CoFounder of Intricity
Watch the Video on YouTube
Sign up for future live sessions intricity.com/datasharks
Talk with a Data Shark: intricity.com/intricity101
www.intricity.com
yo...
2021-11-0855 min
Open Source Startup PodcastE10: Prefect - Open-Source Data Flow AutomationJeremiah Lowin, CEO & Founder, Prefect
Jeremiah is the founder of Prefect, the data flow company that sits on top of the open-source workflow project Prefect Core as well as the recently released orchestration engine project Prefect Orion. Unlike many open-source companies, Prefect didn't start out as open-source. Two years into the company-building journey, Prefect Core launched and the traction from there has been very strong.
Today, Prefect has a Slack community of over 10K members and has raised from VCs including Patrick O'Shaughnessy, Tiger Global, and Positive Sum.
In this episode, we discuss th...
2021-11-0550 min
intricity101Data Sharks 11: The Future of Data Orchestration - with Jeremiah Lowin, CEO of PrefectToday's guest Shark is Jeremiah Lowin, Founder, and CEO of Prefect. The Data Sharks discuss the future of Data Orchestration and how Prefect provides the easiest way to automate your data with incredible flexibility. Plus learn how Prefect evolved from a tiny startup in a windowless closet, to the game changers they are today.
intricity.com/datasharks
prefect.io
github.com/prefectHQ
Meet today's Sharks:
- Jared Hillam, EVP of Emerging Technologies at Intricity
- Arkady Kleyner, Principal, and Co-Founder of Intricity
- Jeremiah Lowin, Founder, and CEO of Prefect
...
2021-06-1847 minInfinite LoopsJeremiah Lowin — Embracing UncertaintyIn this episode of Infinite Loops, we speak with Jeremiah Lowin, CEO at Prefect. In this conversation we cover: Overcoming inertia When information challenges your beliefs Choosing the right words for expression Narratives and decision-making Building a culture that appreciates uncertainty And A LOT more Follow Jeremiah on Twitter (https://twitter.com/jlowin), and learn more about Prefect at https://www.prefect.io/
2021-05-061h 19
El podcast de Alexsander Olivares08: When to build vs buy - and when to open sourceThis is the story of Backstage -- a “platform of platforms”, built by Spotify and open to anyone as open source software. Tune in to hear insights about when to build vs buy - and when to open source - or not! Interviews with Jeremiah Lowin, CEO of Prefect.io, a company that runs on what is called an open core model, as well as from Spotify insiders like Pia Nilsson, Director of Engineering and Tyson Singer, Head of Technology and Platforms.
2021-04-2834 min
Spotify: A Product Story08: When to build vs buy - and when to open sourceThis is the story of Backstage -- a “platform of platforms”, built by Spotify and open to anyone as open source software.
Tune in to hear insights about when to build vs buy - and when to open source - or not! Interviews with Jeremiah Lowin, CEO of Prefect.io, a company that runs on what is called an open core model, as well as from Spotify insiders like Pia Nilsson, Director of Engineering and Tyson Singer, Head of Technology and Platforms.
2021-04-2834 min
The Sequel ShowThe Next Generation of Data Tool - Operational Analytics Conference 2021In April 2021, we hosted our first Operational Analytics Conference on Clubhouse. This is the full recording of the first session talking about the next General of Data Tool with this panel
Boris Jabes, - Founder and CEO of Census
Martin Casado- General Partner at a16z
George Fraser - CEO of Fivetran
Jeremiah Lowin - Founder & CEO of Prefect
Barr Moses - Co-Founder and CEO of Monte Carlo
Don't have time to listen to the whole session? you can get the best sound bit on https://blog.getcensus.com/cambrian-explosion-or-consolidation-where-is-data-right-now/
2021-04-201h 05
Founded & FundedBuilding a Healthy Open Source Community with Jeremiah Lowin, Founder and CEO of Prefect In this episode of Founded and Funded, Anu Sharma continues her deep dive into commercial open source projects and talks to Jeremiah Lowin, the founder and CEO of Prefect, a dataflow automation platform that is trusted to build, run, and monitor millions of data workflows and pipelines. Jeremiah talks about how he and his team built this open source community from zero to 5,000, and how the community helps the team at Prefect reach their users and intentionally break out of internal echo chambers that often trap early stage products.
2021-04-0923 min
ContributorPrefect with Jeremiah LowinEric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.
In this episode we discuss:
Solving the “negative engineering problem”
Learning from the complaints of data engineers at Apache Airflow
The difficulty of hav...
2020-10-2148 min
ContributorPrefect with Jeremiah LowinEric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.
In this episode we discuss:
Solving the “negative engineering problem”
Learning from the complaints of data engineers at Apache Airflow
The difficulty of hav...
2020-10-2148 min
AcquiredSpecial: Invest Like the Best on AcquiredOn this special episode of Acquired, we're joined by a master interviewer himself, Patrick O'Shaughnessy from Invest Like the Best. We turn the tables and cover the most fascinating story he's never told on ILTB... his own! What is O’Shaughnessy Asset Management, and how are they bringing "AWS-level" innovation to the sleepy wealth management industry? How did he go from Notre Dame philosophy major to quant researcher to (arguably) technology CEO and now also an early-stage venture investor... all while simultaneously building one of the world's top new business media empires? Acquired is here to explore it all.
2020-10-071h 48
Invest Like the Best with Patrick O'ShaughnessyChetan Puttagunta and Jeremiah Lowin – Open Source Crash CourseMy guests this week are Jeremiah Lowin and Chetan Puttagunta. Jeremiah is the founder of Prefect.io, an open-source software company where my family and I are investors, and Chetan is a partner at Benchmark Capital. Both are past guests and good friends. I asked them on to help the audience understand the open source software business model. I’ve been fascinated with this model in which companies give a huge chunk of their work and value away for free to a community of developers, and then make money by building additional tools, functionality, and services on top of the...
2020-08-251h 02
Software Engineering DailyPrefect Dataflow Scheduler with Jeremiah LowinA data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model. The workflow scheduler manages the tasks in that data pipeline and the logical flow between them. Airflow is a popular data workflow scheduler that was originally created at Airbnb. Since then, the project has been adopted by numerous companies that need workflow orchestration for their data pipelines. Jeremiah Lowin was a...
2020-04-291h 01
Software Engineering DailyPrefect Dataflow Scheduler with Jeremiah LowinA data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model. The workflow scheduler manages the tasks in that
2020-04-291h 04
Data Engineering PodcastThe Workflow Engine For Data Engineers And Data ScientistsSummary
Building a data platform that works equally well for data engineering and data science is a task that requires familiarity with the needs of both roles. Data engineering platforms have a strong focus on stateful execution and tasks that are strictly ordered based on dependency graphs. Data science platforms provide an environment that is conducive to rapid experimentation and iteration, with data flowing directly between stages. Jeremiah Lowin has gained experience in both styles of working, leading him to be frustrated with all of the available tools. In this episode he explains his motivation for creating...
2019-06-251h 08
Invest Like the Best with Patrick O'ShaughnessyAlex Mittal – Early Stage InvestingMy guest this week is Alex Mittal, co-founder of Funders Club. Following past guest Jeremiah Lowin, Alex is my second elementary school friend to appear on the podcast—a trend I hope continues. Funders club is a unique venture firm, because it is build around a network of investors and entrepreneurs who submit deals for consideration and invest together. But as you’ll hear, Alex and his co-founder Boris aren’t just building an open platform for early stage investing: they also then take a very traditional venture approach, making investing decisions themselves when it comes to buildi...
2019-01-291h 00Top Investment Podcasts 2018Jeremiah Lowin – Machine Learning in Investing – [Invest Like the Best, EP.105] Podcast: Invest Like the Best with Patrick O'Shaughnessy (LS 67 · TOP 0.05% what is this?)Episode: Jeremiah Lowin – Machine Learning in Investing – [Invest Like the Best, EP.105]Pub date: 2018-09-25Get Podcast Transcript →powered by Listen411 - fast audio-to-text and summarizationMy guest this week is one of my best and oldest friends, Jeremiah Lowin. Jeremiah has had a fascinating career, starting with advanced work in statistics before moving into the risk management field in the hedge fund world. Through his career he has studied data, risk, statistics, and machine learning—the last...
2018-12-131h 00
Invest Like the Best with Patrick O'ShaughnessyJeremiah Lowin – Machine Learning in InvestingMy guest this week is one of my best and oldest friends, Jeremiah Lowin. Jeremiah has had a fascinating career, starting with advanced work in statistics before moving into the risk management field in the hedge fund world. Through his career he has studied data, risk, statistics, and machine learning—the last of which is the topic of our conversation today. He has now left the world of finance to found a company called Prefect, which is a framework for building data infrastructure. Prefect was inspired by observing frictions between data scientists and data engineers, and solves the...
2018-09-251h 00
Invest Like the Best with Patrick O'ShaughnessyHash Power – Ep. 2 - Investing in CryptocurrenciesIn episode 1 of Hash Power, we explored blockchains as a technology—how they work, why tokens (also known as cryptocurrencies) are an integral part of any blockchain, and how these new networks might change the world. In episode two, we spend time with the leading investors in the field. Like any frenzied asset class, there are countless cryptocurrency hedge funds popping up everywhere. But founders from three of the original firms—Polychain, Metastable, and Blocktower Capital—are our primary guides this week.As I speak, the total market cap of cryptocurrencies is $136B. There are hundreds of tokens...
2017-10-031h 17
Invest Like the Best with Patrick O'ShaughnessyHash Power – Ep. 1 - Understanding BlockchainsWelcome to the first episode of Hash Power, an audio documentary that explores the world of blockchain and cryptocurrencies with leaders in the field like Naval Ravikant, Olaf Carlson-Wee, Fred Ehrsam, & Ari Paul. Hash Power is meant to be an introduction, but really, it is an invitation to explore this emerging world on your own. In the coming weeks, we will cover the technology, the power of decentralization, bitcoin, Ethereum, ICOs, cryptography and hashing. We will spend time with the leading active hedge fund managers in the field, and with outside investors who are both optimistic and s...
2017-09-261h 11
Invest Like the Best with Patrick O'ShaughnessyJeremiah Lowin – Machine Intelligence and Risk ManagementJeremiah Lowin is probably the smartest guy I know, and that is saying something. He is an expert in the fields of statistics, artificial intelligence, and risk management—among many other things. He is currently the Director of Risk Management for a private investment firm in the New York area, but has spent years working with machine learning and AI. This conversation is broken up into two parts. In the first part, we explore artificial intelligence, machine learning, and models. Then we shift to what risk means in a portfolio and how it can be managed or at least redist...
2017-01-171h 25