Shows
Future Is Already HereKafka and. Pulsar: Distributed Messaging ArchitecturesIn this episode, we delve into the world of distributed messaging systems, comparing two of the most prominent platforms: Apache Kafka and Apache Pulsar. This overview provides a concise yet comprehensive exploration of their architectural designs, key concepts, internal mechanisms, and the algorithms they employ to achieve high throughput and scalability.
We begin with an architectural overview of both systems, highlighting the unique approaches they take in message storage, delivery, and fault tolerance. You'll gain insights into the core components of each system, such as brokers, topics, and partitions, and how these components interact.
The...2025-01-2629 min
Software MisadventuresLessons from the early days building Kafka and Confluent | Jay KrepsFrom writing the first lines of Kafka over a Christmas break as a LinkedIn engineer to running a public company as the CEO of Confluent, Jay joins the show to chat about how he and his co-founders convinced investors to take a chance on their vision, what many engineers get wrong about communication, and why engineers can make great CEOs - even when coding is not in the job description. And much more. Segments: (00:01:16) The Shaved Head Bet (00:04:07) Fundraising (00:12:16) The Role of Technical Background in VCs (00:15:48) The power of believing in the...2024-06-041h 16
The Logan Bartlett ShowEP 89: Jay Kreps (CEO, Confluent) on Confluent’s Resilient Rise to Software BehemothIn the episode, Confluent CEO Jay Kreps dives into Confluent's transformation from a LinkedIn spin-out to a publicly traded company. He discusses the challenges of turning an open-source project into a thriving commercial venture and the bold decision to launch a second product while the first was thriving. Additionally, Jay opens up about his transition into the role of CEO, how he only went to one year of high school, and his unique philosophies about steering startups to success.(0:00) Intro(1:26) How being a writer benefited Jay as a CEO(3:05) Building a management team2023-12-151h 51
In DepthWinning with open and closed source products | Neha Narkhede (Co-founder at Confluent and Oscilar)Neha Narkhede is a co-founder at Confluent, a data streaming software that raised at a $9.1b valuation in 2021. Neha later co-founded Oscilar, a no-code platform that helps companies detect and manage fraud. Before building these two companies, Neha was a Principal Software Engineer at LinkedIn where she co-created Apache Kafka. Neha is ranked #50 on Forbes’ list of “America’s Richest Self-Made Women 2023” with an estimated net worth of $520m.—In today’s episode we discuss:
The origins of Confluent, Kafka, and Oscilar
How to become a successful second-time founder
Advice for monetizing open source product
Neha...2023-12-071h 14
Tech DisruptorsConfluent CEO on the Motion to Fast-Data WorldConfluent’s platform provides infrastructure for enterprises to connect, stream and process data across applications and systems in real time. In this episode of the Tech Disruptors podcast, Confluent’s cofounder and CEO Jay Kreps joins Bloomberg Intelligence senior software analyst Sunil Rajgopal to discuss the origins of Apache Kafka and Confluent, the flow of enterprise data and future of software architecture. The two also talk about the opportunity arising from the shift toward real-time data streaming from batch processing, budding artificial intelligence workloads and the company’s new products such as Confluent Cloud for Apache Flink, Kora Engine and KS...2023-11-0945 min
Mad Money w/ Jim CramerFed Pauses, Confluent CEO & Bowlero CEO 6/14/23The Dow fell, snapping a 6-day win streak, while the S&P and Nasdaq rose, and Jim Cramer is breaking down all the action - first, he's taking a closer look at how today's pause from the Federal Reserve shifted the market and how investors should approach it. Then, Cramer dove into Confluent last week and wanted more on the story - CEO Jay Kreps sits down with Cramer to share more about what the data company does and its applications. Plus, Cramer's exclusive with Bowlero CEO Tom Shannon. Mad Money Disclaimer
2023-06-1545 min
Making Our World BetterKelli Kreps | Meeting Households In NeedOne in three families in the U.S. can't weather a $400 emergency. Kelli Kreps, Executive Director of NeighborShare, and her team are addressing this with an innovative new online platform that connects people who want to help their neighbors with "just in time" help that may seem minor but has a major impact.
This podcast was brought to you by JC Charity services. Being a nonprofit leader is hard and I can help you thrive – you can find me a www.makingourworldbetter.com.
To learn more about how NeighborShare is connecting people in communities all ar...2023-06-0625 min
GOTO - The Brightest Minds in TechKafka in Action • Viktor Gamov & Tim BerglundThis interview was recorded for the GOTO Book Club.gotopia.tech/bookclubRead the full transcription of the interview hereViktor Gamov - Principal Developer Advocate at Kong & Co-Autor of "Kafka in Action"Tim Berglund - VP DevRel at StarTree & Author of "Gradle Beyond the Basics"DESCRIPTIONKafka has been on developers’ radars for quite a while now. Viktor Gamov’s co-authored book “Kafka in Action” ensures that you have a list of recipes to dive into. Joined by Tim Berglund, VP DevRel at StarTree, they explore the fundamen...2022-12-0233 min
For Starters with Alexa von TobelHow to Make Good Moves with Jay Kreps of ConfluentIn 2011, Jay Kreps was an engineer at LinkedIn, leading the platform's search, recommendation engine, and social graph. In an effort to figure out how to make real-time streams of data useful to organizations, he started an open-source project called Kafka, and it took off. Realizing a major business opportunity, Jay took the leap into entrepreneurship and started Confluent in 2014. Today, over 70% of Fortune 500 companies use Kafka, and he took Confluent public in 2021. Jay shares what it means to process "data in motion," why it's daunting to go from being a software engineer to CEO, and why he only spent...2022-07-1332 min
Streaming Audio: Apache Kafka® & Real-Time DataBuilding Real-Time Data Governance at Scale with Apache Kafka ft. Tushar TholeData availability, usability, integrity, and security are words that we sometimes hear a lot. But what do they actually look like when put into practice? That’s where data governance comes in. This becomes especially tricky when working with real-time data architectures.Tushar Thole (Senior Manager, Engineering, Trust & Security, Confluent) focuses on delivering features for software-defined storage, software-defined networking (SD-WAN), security, and cloud-native domains. In this episode, he shares the importance of real-time data governance and the product portfolio—Stream Governance, which his team has been building to fostering the collaboration and knowledge sharing necessary to become an e...2022-03-2242 min
GritPresident at Confluent, Erica Schultz: Cashing in on Your CurrencyWhen Confluent’s President of Field Ops Erica Schultz was 23, she was working at Oracle and cold-emailed the manager of the Argentina office, asking to work for him. This experience would open the door to opportunities in Buenos Aires and Miami, a time in Erica’s life she does not take for granted. As a leader today, she hopes to pass on this sentiment, constantly looking for individuals worth taking a chance on: “As I look around my organization, I think, OK, who’s the undiscovered not-yet-fully-realized talent that we should think about for this role?”In th...2022-03-211h 06Streaming Audio: Apache Kafka® & Real-Time DataThe Evolution of Apache Kafka: From In-House Infrastructure to Managed Cloud Service ft. Jay KrepsWhen it comes to Apache Kafka®, there’s no one better to tell the story than Jay Kreps (Co-Founder and CEO, Confluent), one of the original creators of Kafka. In this episode, he talks about the evolution of Kafka from in-house infrastructure to a managed cloud service and discusses what’s next for infrastructure engineers who used to self-manage the workload. Kafka started out at LinkedIn as a distributed stream processing framework and was core to their central data pipeline. At the time, the challenge was to address scalability for real-time data feeds. The social media platform’s initia...2022-02-2446 min
Into the HopperApache Pulsar with Jowanza JosephI talk with Jowanza Joseph about his new book Mastering Apache Pulsar: Cloud Native Event Streaming at Scale.
Links:
Jowanza's Pulsar talks
Jowanza's Twitter
Jowanza's website
Pulsar homepage
The Log: What every software engineer should know about real-time data's unifying abstraction by Jay Kreps
StreamNative - Hosted Pulsar
Datastax Astra Streaming - Hosted Pulsar
Cloud Native Computing Foundation
Pulsar Functions
Pulsar IO
Pulsar SQL
Apache ZooKeeper
Apache BookKeeper
2022-02-0700 min
AHC PodcastKanye WestTo be confident is one thing, but to be Kanye-confident, well, that’s just a whole new level of self-belief. Hip-hop and shoe mogul, Kanye West, has been at or near the top of the rap world going on 2 decades now. Love him or hate him, his albums sell like hot cakes when released and those Yeezy’s continue to fly off the shelves. The self-made billionaire has put himself front and center in many, many headlines over the years, and sometimes, for all the wrong reasons. Do we really understand where Kanye is coming from, or are there more ser...2021-08-151h 33
Software Engineering Radio - The Podcast for Professional Software DevelopersEpisode 433: Jay Kreps on ksqlDBJay Kreps, CEO and Co-founder of Confluent discusses ksqlDB which is a database built specifically for stream processing applications to query streaming events in Kafka with SQL like interface.2020-11-0658 minSoftware Engineering Radio - the podcast for professional software developersEpisode 433: Jay Kreps on ksqlDBJay Kreps, CEO and Co-founder of Confluent discusses ksqlDB which is a database built specifically for stream processing applications to query streaming events in Kafka with SQL like interface.2020-11-0658 min
Sex With GhostsThe IlluminaughtyGive your third eye some love and join Bridget Flaherty (@Bridget_suckit) and Mollie McBreen (@molliemm9) in an investigation into the Free Mason origins to the present day Free Kanye explosion of mayhem and mischief of the Illuminati.
Our resident researcher, Mollie, cites her sources for this doozy of a rabbit hole. We hope you leave illuminated and maybe a little naughty.
Zirm, Jordan. “9 Rappers Accused of Being In The Illuminati.” Complex, Complex, 24 Sept. 2018, www.complex.com/music/2018/09/rappers-accused-of-being-in-the-illuminati/nicki-minaj.
Davis, Ben. “Art History, or the Illuminati? What Jay-Z and Beyoncé Are Really Up to Wit...2020-09-0553 min
Streaming Audio: Apache Kafka® & Real-Time DataOpen Source Workflow Automation with Apache Kafka ft. Bernd RueckerWhat started out as a consulting company, Camunda eventually turned into a developer-friendly, open source vendor that now focuses on workflow automation. Bernd Ruecker, a co-founder and the chief technologist at Camunda, talks through the company's journey, how he ended up in open source, and all things automation, including how it differs from business process management and the issue of diagrams. Bernd also dives into dead letter topics in Apache Kafka®, software interacting with software, orchestration tension, and best practices for approaching challenges that pop up along the way. This episode will take you through a t...2020-06-2943 min
Software Engineering Radio - the podcast for professional software developersEpisode 393: Jay Kreps on Enterprise Integration Architecture with a Kafka Event LogJay Kreps, CEO of Confluent, talks with Robert Blumen about how an enterprise integration architecture organized around a Kafka event log simplifies integration and enables rich forms of data sharing. #podcast #seradio #ieeecs #ComputerSociety2019-12-1858 minSoftware Engineering Radio - The Podcast for Professional Software DevelopersEpisode 393: Jay Kreps on Enterprise Integration Architecture with a Kafka Event LogJay Kreps, CEO of Confluent, talks with Robert Blumen about how an enterprise integration architecture organized around a Kafka event log simplifies integration and enables rich forms of data sharing. #podcast #seradio #ieeecs #ComputerSociety2019-12-1858 min
Software Engineering Radio - the podcast for professional software developersEpisode 393: Jay Kreps on Enterprise Integration Architecture with a Kafka Event LogJay Kreps, CEO of Confluent, talks with Robert Blumen about how an enterprise integration architecture organized around a Kafka event log simplifies integration and enables rich forms of data sharing. #podcast #seradio #ieeecs #ComputerSociety2019-12-1858 min
Streaming Audio: Apache Kafka® & Real-Time DataAnnouncing ksqlDB ft. Jay KrepsJay Kreps (original Co-creator of Apache Kafka and CEO, Confluent) introduces ksqlDB, an event streaming database. As the successor to KSQL, ksqlDB seeks to unify the multiple systems involved in stream processing into a single, easy-to-use solution for building event streaming applications.ksqlDB offers support for running connectors in an embedded mode, in addition to support for both push and pull queries. Push queries allow you to subscribe to changing query results as new events occur, while pull queries allow you to look up a particular value at a single point in time. To use a ride-sharing...2019-11-2026 min
Streaming Audio: Apache Kafka® & Real-Time DataThe Pro’s Guide to Fully Managed Apache Kafka Services ft. Ricardo FerreiraSeveral definitions of a fully managed Apache Kafka® service have floated around, but Ricardo Ferreira (Developer Advocate, Confluent) breaks down what it truly means and why every developer should care. Addressing a handful of questions around Apache Kafka®, Confluent Cloud, hosted solutions, and how they all work, Ricardo describes the benefits of using a fully managed service as a means of simplifying the lives of developers and letting them get back to building—which is why they started out as developers in the first place! EPISODE LINKSThe Rise of Managed Services for Apache KafkaExcerpt from The B...2019-11-0456 min
Streaming Audio: Apache Kafka® & Real-Time DataJay Kreps on the Last 10 Years of Apache Kafka and Event StreamingAs Confluent turns five years old, special guest Jay Kreps (Co-founder and CEO, Confluent) brings us back to his early development days of coding Apache Kafka® over a Christmas holiday while working at LinkedIn. Kafka has become a breakthrough open source distributed streaming platform based on an abstraction of the distributed commit log, and his involvement in the project eventually led him to start Confluent with Jun Rao and Neha Narkhede. In this episode, Jay shares about all the highs and lows along the way, including some of his favorite customer success stories with companies like Lyft an...2019-09-1248 min
BSD NowEpisode 280: FOSS Clothing | BSD Now 280A EULA in FOSS clothing, NetBSD with more LLVM support, Thoughts on FreeBSD 12.0, FreeBSD Performance against Windows and Linux on Xeon, Microsoft shipping NetBSD, and more.
Headlines
A EULA in FOSS clothing?
There was a tremendous amount of reaction to and discussion about my blog entry on the midlife crisis in open source. As part of this discussion on HN, Jay Kreps of Confluent took the time to write a detailed response — which he shortly thereafter elevated into a blog entry.
Let me be clear that I hold Jay in high regard, as both a...2019-01-1052 min