Shows
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovHow Time Kills All Deals in Pre-Sales with Rachel Pedreschi | Ep. 8Listen: https://confluent.buzzsprout.com | In this episode, Tim Berglund talks to his guest, Rachel Pedreschi (DeltaStream), about her career in pre-sales engineering. Her first job: rectory office assistant at her local parish. Her challenge/theme: working at early-stage startups to bridge sales, marketing, and engineering to reach product-market fit.Check out Tim and Rachel's previous podcast, Keyboard and Quill: https://youtube.com/playlist?list=PLihIrF0tCXdeJxpAJgbOsY48B9lD_w24v&si=5NjdA-Rss9Rsmyy1SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter...
2025-11-1027 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovBuilding Parquet into Apache Pinot ft. Neha Pawar | Ep. 5Today, Tim Berglund talks to Neha Pawar (StarTree) about her career in real-time analytics and open source database engineering. Her first job: a year-long internship at NVIDIA. Her challenge: leading the technical effort to add native Parquet support into Apache Pinot.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed t...
2025-10-2026 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovThe Fix That Secured 1000s of Credit Cards ft. Brian Sletten | Ep. 4In this episode, Tim talks to Brian Sletten (Bosatsu Consulting) about his career in software development. His first job: working at a small communications company that built network matrix switch interfaces. His challenge/theme: overhauling credit card storage and security at a major hospitality company.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new...
2025-10-1329 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovHow Tim Berglund Found His Calling | Ep. 2Viktor Gamov interviews his co-host, Tim Berglund, about his career in the world of streaming data. Tim’s first job: Burger King broiler steamer. His challenge/theme: pivoting from working in hardware and firmware to finding his calling in enterprise software and developer relations.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes...
2025-09-2930 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovBuilding Real-time Systems for Apple, Nike & more ft. Adi Polak | Ep. 1The Confluent Developer Podcast is here! For this first episode, Tim Berglund talks to his co-host, Adi Polak (Confluent), about her career in distributed data systems. Her first job: neighborhood dogwalker. Her challenge/theme: early Hadoop, working at Akamai on data optimization and real-time threat detection for huge global customers like Apple, Nike, Facebook and others, and the power of collaboration. SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subs...
2025-09-2232 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovWe're back! Welcome to the Confluent Developer Podcast.Weekly episodes launching Sept. 22! | Hi, I'm Tim Berglund. It's been about four years since I've been podcasting at Confluent, and "Streaming Audio" has been on hiatus for a little more than two, but I've got great news: we are back! We're back with a new name, a new format, and new hosts. Welcome to the Confluent Developer Podcast, where we talk to software developers of all stripes about some of the most interesting problems they've solved in their career. I'll be joined by my co-hosts, Adi Polak and Viktor Gamov. And hey, you kno...
2025-09-0201 min
I Have Some Questions...003: “Are You Asking Too Much of Your Team… Without Realizing It?” (lessons from Tim Whitmire)In this reaction episode, Erik unpacks the deeply resonant conversation he just had with Tim Whitmire, co-founder of F3 Nation. What starts as a personal reflection on F3's impact morphs into a vulnerable and strategic look at leadership, sustainability, and what it really means to see the people we lead clearly. From the power of micro-origin stories to the gift of context-aware leadership, Erik distills the conversation into actionable insights anchored in both experience and empathy.🎯 Top Insights from the InterviewOrganic beginnings can lead to transformational outcomes. F3 was a sim...
2025-06-0908 min
I Have Some Questions...002: “Can a Free Workout Teach You How to Be a Better Man?” ft. Tim WhitmireIn this powerful conversation, Erik sits down with Tim Whitmire, co-founder of F3 Nation and a seasoned leader across journalism, finance, consulting, and operations, to unpack what it takes to build decentralized leadership, sustain impact at scale, and lead with humility and purpose. From the sweaty roots of a Saturday workout in Charlotte to the formation of a nationwide brotherhood, Tim shares timeless insights on human development, organizational growth, and what it really means to step back so others can step up.👤 About the GuestTim Whitmire is the co-founder of F3...
2025-06-0954 min
The Joe Reis ShowTim Berglund - The Art of Developer Relations, Hardware Hacking, and MoreTim Berglund is the OG of DevRel. We chat about the art and craft of developer relations, hacking on hardware, and much more.
2025-04-1654 min
Life Is But A StreamEp 1 - Stream On: Unleashing Innovation with Data StreamingReal-time data streaming is shaking up everything we know about modern data systems. If you’re ready to dive in but unsure where to begin, no worries. That’s why we’re here.Our first episode breaks down the basics of data streaming—from what it is, to its pivotal role in processing and transferring data in a fast-paced digital environment. Your guide is Tim Berglund, VP of Developer Relations at Confluent, where he and his team work to make data streaming data and its emerging toolset accessible to all developers.You’ll learn:The fundam...
2025-02-041h 00
Fireside with VoxgigEpisode 161 Tim Berglund, Vice President of Developer Relations at StarTree“So you’re telling me that a DevRel’s job is more than just posting funny tweets and partying at conferences?”
Yes. Yes we are.
And so is our guest on today’s episode - Tim Berglund. Tim is the Vice President of Developer Relations at Star Tree, and he breaks down for us what DevRel means to him, and how he counteracts people’s misconceptions about the role.
In today’s world, it’s as difficult as ever for a DevRel to describe their job, but Tim gives it a go on this episode of the podcast. What’s important to know...
2024-03-2142 min
Developer VoicesHow Apache Pinot Achieves 200,000 Queries per Second (with Tim Berglund)The likes of LinkedIn and Uber use Pinot to power some astonishingly high-scale queries against realtime data. The numbers alone would make an impressive case-study. But behind the headline lies a fascinating set of architectural decisions and constraints to get there. So how does Pinot work? How does it process queries? How are the various roles split across a cluster? And equally important - what does it *not* try to achieve.Joining me to go through the nuts and bolts of how Pinot handles SQL queries is Tim Berglund, veteran technology explainer of the realtime-data world. He...
2024-03-201h 14
Adventurous EntrepreneursErik Berglund - How to Hold Your People Accountable, Steps to Becoming a Better Leader, and The Power of Cultivating a Community That Pushes You to Reach New HeightsJoining TJ on the Adventurous Entrepreneurs Podcast today is Erik Berglund.Erik Berglund is a dedicated entrepreneur, husband, and father who strives to maintain balance in all aspects of his life. Having worked as a sales leader for a multinational company for almost a decade, he became frustrated with the constant need to micromanage his team and found himself losing time and headspace that could be better spent on his passions and loved ones. This experience inspired him to develop the REACT framework for accountability, which he teaches in his program, the Language of Leadership. T...
2023-07-1459 min
The GeekNarratorTim Berglund on Realtime Analytics with Apache PinotHey Everyone,
In the 43rd episode I speak with Tim Berglund on Realtime Analytics with Apache Pinot.
Chapters:
00:00 Introduction
01:22 What do we mean by analytics and realtime analytics?
05:35 Can we define realtime in millis, seconds or minutes?
08:54 What is the fundamental difference between traditional analytics systems and Apache Pinot?
12:19 Was Kafka one of the reasons Apache Pinot could reach its full potential?
16:50 E-commerce Application example - How do I get my data in?
20:07 How is data stored (structured) on the disk?
23:31 Are joins available in Apache Pinot?
26:07 Joins vs pre-computing at ingestion
27:15 How is historical data ingested into Apache...
2023-07-0351 min
GOTO - The Brightest Minds in TechUnlocking the Power of Real-Time Analytics • Tim Berglund & Adi PolakThis interview was recorded for GOTO Unscripted.gotopia.techRead the full transcription of this interview hereTim Berglund - VP DevRel at StarTree & Author of "Gradle Beyond the Basics"Adi Polak - VP of Developer Experience at Treeverse & Contributing to lakeFS OSSRESOURCESTimtimberglund.comtwitter.com/tlberglundlinkedin.com/in/tlberglundAditwitter.com/AdiPolakinstagram.com/polak.codelinkedin.com/in/polak-adiTools & companiespinot.apache.orgtwitter.com/startreedatalinkedin...
2023-06-0244 min
Monday Morning Data Chat#125 - The Art of Developer Relations w/ Tim BerglundTim Berglund is an OG of developer relations (aka devrel), having worked in devrel before it was cool. He joins the show to chat about the art of devrel and much more.
#devrel #data
2023-05-0800 minThe GeekNarratorKafka, Realtime analytics and Apache Pinot with Tim Berglund Part-2Hey everyone,
This is the part-2 of our episode with Tim Berglund. We have covered some advanced topics on Kafka, Kafka Streams and Apache Pinot.
I hope you like the discussion.
Cheers,
The GeekNarrator
2023-01-0339 minThe GeekNarratorKafka, Realtime analytics and Apache Pinot with Tim Berglund Part-1Hey Everyone,
In this episode I talked to Tim Berglund about his vast experience with Kafka, realtime analytics and Apache Pinot.
I hope you like the episode. Do watch the part-2.
Cheers,
The GeekNarrator
2023-01-0336 minGOTO - The Brightest Minds in TechKafka in Action • Viktor Gamov & Tim BerglundThis interview was recorded for the GOTO Book Club.gotopia.tech/bookclubRead the full transcription of the interview hereViktor Gamov - Principal Developer Advocate at Kong & Co-Autor of "Kafka in Action"Tim Berglund - VP DevRel at StarTree & Author of "Gradle Beyond the Basics"DESCRIPTIONKafka has been on developers’ radars for quite a while now. Viktor Gamov’s co-authored book “Kafka in Action” ensures that you have a list of recipes to dive into. Joined by Tim Berglund, VP DevRel at StarTree, they explore the fundamen...
2022-12-0233 min
Refactor ThisShifting Modernization Paradigms with an Event-Driven Architecture - Tim BerglundIn this episode, we discuss:Why an Event-Driven architecture makes sense for modernization (6:44)Where technical debt creeps in during modernization initiatives (14:00)What is Apache Pinot and what does StarTree do? (19:26)Can you use the Strangler Fig Pattern at the data layer? (29:46)For more information, check out these resources:Introducing StarTree Community Slack: https://www.startree.ai/blog/introducing-startree-community-slackCheck out Tim’s Twitter and LinkedIn profileshttps://twitter.com/tlberglundhttps://www.linkedin.com/in/tlberglund/
2022-12-0137 minConfluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovInternational Podcast Day - Apache Kafka Edition | Streaming Audio SpecialWhat’s your favorite podcast? Would you like to find some new ones? In celebration of International Podcast Day, Kris Jenkins invites 12 experts from the Apache Kafka® community to talk about their favorite podcasts. Unlike other episodes where guests educate developers and tell stories about Kafka, its surrounding technological ecosystem, or the Cloud, this special episode provides a glimpse into what these guests have learned through listening to podcasts that you might also find interesting. Through a virtual international tour, Kris chatted with Bill Bejeck (Integration Architect, Confluent), Nikoleta Verbeck (Senior Solutions Engineer, CSID, Confluent), Ben Stopford (Lead...
2022-09-301h 02
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovOn to the Next Chapter ft. Tim BerglundAfter nearly 200 podcast episodes of Streaming Audio, Tim Berglund bids farewell in his last episode as host of the show. Tim reflects on the many great memories with guests who have appeared on the segment—and each for its own reasons. He has covered a wide variety of topics, ranging from Apache Kafka® fundamentals, microservices, event stream processing, use cases, to cloud-native Kafka, data mesh, and more. As Tim mentions, the Streaming Audio podcast will continue on to explore all things about Kafka and the cloud while featuring new voices and topics. You can subscribe to th...
2022-02-0306 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovModernizing Banking Architectures with Apache Kafka ft. Fotios FilacourisIt’s been said that financial services organizations have been early Apache Kafka® adopters due to the strong delivery guarantees and scalability that Kafka provides. With experience working and designing architectural solutions for financial services, Fotios Filacouris (Senior Solutions Engineer, Enterprise Solutions Engineering, Confluent) joins Tim to discuss how Kafka and Confluent help banks build modern architectures, highlighting key emerging use cases from the sector. Previously, Kafka was often viewed as a simple pipe that connected databases together, which allows for easy and scalable data migration. As the Kafka ecosystem evolves with added components like ksqlDB, Kafka Stre...
2021-12-2834 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovConfluent Platform 7.0: New Features + UpdatesConfluent Platform 7.0 has launched and includes Apache Kafka® 3.0, plus new features introduced by KIP-630: Kafka Raft Snapshot, KIP-745: Connect API to restart connector and task, and KIP-695: Further improve Kafka Streams timestamp synchronization. Reporting from Dubai, Tim Berglund (Senior Director, Developer Advocacy, Confluent) provides a summary of new features, updates, and improvements to the 7.0 release, including the ability to create a real-time bridge from on-premises environments to the cloud with Cluster Linking. Cluster Linking allows you to create a single cluster link between multiple environments from Confluent Platform to Confluent Cloud, which is available on public clouds li...
2021-11-0912 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAutomating Infrastructure as Code with Apache Kafka and Confluent ft. Rosemary WangManaging infrastructure as code (IaC) instead of using manual processes makes it easy to scale systems and minimize errors. Rosemary Wang (Developer Advocate, HashiCorp, and author of “Essential Infrastructure as Code: Patterns and Practices”) is an infrastructure engineer at heart and an aspiring software developer who is passionate about teaching patterns for infrastructure as code to simplify processes for system admins and software engineers familiar with Python, provisioning tools like Terraform, and cloud service providers. The definition of infrastructure has expanded to include anything that delivers or deploys applications. Infrastructure as software or infrastructure as configuration, according to Ro...
2021-10-2630 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovGetting Started with Spring for Apache Kafka ft. Viktor GamovWhat’s the distinction between the Spring Framework and Spring Boot? If you are building a car, the Spring Framework is the engine while Spring Boot gives you the vehicle that you ride in. With experience teaching and answering questions on how to use Spring and Apache Kafka® together, Viktor Gamov (Principal Developer Advocate, Kong) designed a free course on Confluent Developer and previews it in this episode. Not only this, but he also explains why the opinionated Spring Framework would be a good hero in Marvel. Spring is an ever-evolving framework that embraces modern, cloud-native technologies with...
2021-10-1932 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAutomating DevOps for Apache Kafka and Confluent ft. Pere Urbón-BayesAutonomy is key in building a sustainable and motivated team, and this core principle also applies to DevOps. Building self-serve Apache Kafka® and Confluent Platform deployments require a streamlined process with unrestricted tools—a centralized processing tool that allows teams in large or mid-sized organizations to automate infrastructure changes while ensuring shared standards are met. With more than 15 years of engineering and technology consulting experience, Pere Urbón-Bayes (Senior Solution Architect, Professional Services, Confluent) built an open source solution—JulieOps—to enable a self-serve Kafka platform as a service with data governance. JulieOps is one of the first sol...
2021-10-0726 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovIntro to Kafka Connect: Core Components and Architecture ft. Robin MoffattKafka Connect is a streaming integration framework between Apache Kafka® and external systems, such as databases and cloud services. With expertise in ksqlDB and Kafka Connect, Robin Moffatt (Staff Developer Advocate, Confluent) helps and supports the developer community in understanding Kafka and its ecosystem. Recently, Robin authored a Kafka Connect 101 course that will help you understand the basic concepts of Kafka Connect, its key features, and how it works.What’s Kafka Connect, and how does it work with Kafka and brokers? Robin explains that Kafka Connect is a Kafka API that runs separately from the Kafka bro...
2021-09-2831 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovDesigning a Cluster Rollout Management System for Apache Kafka ft. Twesha ModiAs one of the top coders of her Java coding class in high school, Twesha Modi is continuing to follow her passion for computer science as a senior at Cornell University, where she has proven to be one of the top programmers. During Twesha's summer internship at Confluent, she contributed to designing a new service to automate Apache Kafka® cluster rollout management—a process that releases the latest Kafka versions to customer’s clusters in Confluent Cloud.During Twesha’s internship, she was part of the Platform team, which designed a cluster management rollout service—capable of automatin...
2021-09-2330 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka 3.0 - Improving KRaft and an Overview of New FeaturesApache Kafka® 3.0 is out! To spotlight major enhancements in this release, Tim Berglund (Apache Kafka Developer Advocate) provides a summary of what’s new in the Kafka 3.0 release from Krakow, Poland, including API changes and improvements to the early-access Kafka Raft (KRaft). KRaft is a built-in Kafka consensus mechanism that’s replacing Apache ZooKeeper going forward. It is recommended to try out new KRaft features in a development environment, as KRaft is not advised for production yet. One of the major features in Kafka 3.0 is the efficiency for KRaft controllers and brokers to store, load, and replicate snapsh...
2021-09-2115 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovHow to Build a Strong Developer Community with Global Engagement ft. Robin Moffatt and Ale MurrayA developer community brings people with shared interests and purpose together. The fundamental elements of a community are to gather, learn, support, and create opportunities for collaboration. A developer community is also an effective and efficient instrument for exploring and solving problems together. The power of a community is its endless advantages, from knowledge sharing to support, interesting discussions, and much more. Tim Berglund invites Ale Murray (Global Community Manager, Confluent) and Robin Moffatt (Staff Developer Advocate, Confluent) on the show to discuss the art of Q&A in a global community, share tips for building a v...
2021-09-1435 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovWhat Is Data Mesh, and How Does it Work? ft. Zhamak DehghaniThe data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analytical purposes in real time, right at the point of origin. The idea of data mesh was introduced by Zhamak Dehghani (Director of Emerging Technologies, Thoughtworks) in 2019. Here, she provides an introduction to data mesh and the fundamental problems that it’s trying to solve. Zhamak describes that the complexity and ambition to use data have grown in today’s industry. But what is data mesh? For over...
2021-09-0934 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovConfluent Platform 6.2 | What’s New in This Release + UpdatesBased on Apache Kafka® 2.8, Confluent Platform 6.2 introduces Health+, which offers intelligent alerting, cloud-based monitoring tools, and accelerated support so that you can get notified of potential issues before they manifest as critical problems that lead to downtime and business disruption.Health+ provides ongoing, real-time analysis of performance and cluster metadata for your Confluent Platform deployment, collecting only metadata so that you can continue managing your deployment, as you see fit, with complete control.With cluster metadata being continuously analyzed, through an extensive library of expert-tested rules and algorithms, you can quickly get insights to cluster p...
2021-06-1009 min
Anablock PodcastInterview with Tim Berglund, Senior Director of Developer Advocacy at ConfluentThis podcast is brought to you by Anablock. Anablock is a system integrator and Salesforce partner. Anablock's technical team helps organizations to implement, customize, and optimize their Salesforce applications.
In this episode our guest is Tim Berglund. Tim is a teacher, author, and technology leader with Confluent, where he serves as the Senior Director of Developer Advocacy. We talk about Apache Kafka, Confluent, Salesforce Connector for Kafka, Confluent Cloud, and many other interesting topics.
LinkedIn - https://www.linkedin.com/in/tlberglund/
Tim's podcast - Streaming Audio: A Confluent podcast about Apache Kafka‪
2021-04-1150 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovResurrecting In-Sync Replicas with Automatic Observer Promotion ft. Anna McDonaldAs most developers and architects know, data always needs to be accessible no matter what happens outside of the system. This week, Tim Berglund virtually sits down with Anna McDonald (Principal Customer Success Technical Architect, Confluent) to discuss how Automatic Observer Promotion (AOP) can help solve the Apache Kafka® 2.5 datacenter dilemma as a feature now available in Confluent Platform 6.1 and above. Many industries must have a backup plan not only to do the right thing by the data that they collect but because they are regulated by law to do so. Anna has a knack for preparing op...
2021-04-0724 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovEvent-Driven Architecture - Common Mistakes and Valuable Lessons ft. Simon AuburyEvent-driven architecture has taken on numerous meanings over the years—from event notification to event-carried state transfer, to event sourcing, and CQRS. Why has event-driven programming become so popular, and why is it such a topic of interest? For the first time, Simon Aubury (Principal Data Engineer, ThoughtWorks) joins Tim Berglund on the Streaming Audio podcast to tell all, including his own experiences adopting event-driven technologies and common blunders when working in this area.Simon admits that he’s made some mistakes and learned some valuable lessons that can benefit others. Among these are accidentally build...
2021-03-1742 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovIntegrating Spring Boot with Apache Kafka ft. Viktor GamovViktor Gamov (Developer Advocate, Confluent) joins Tim Berglund on this episode to talk all about Spring and Apache Kafka®. Viktor’s main focus lately has been helping developers build their apps with stream processing, and helping them do this effectively with different languages. Viktor recently hosted an online Spring Boot workshop that turned out to be a lot of fun. This means it was time to get him back on the show to talk about this all-important framework and how it integrates with Kafka and Kafka Streams. Spring Boot enables you to do more with less. Its feat...
2021-02-1745 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovBuilding a Microservices Architecture with Apache Kafka at Nationwide Building Society ft. Rob JacksonNationwide Building Society, a financial institution in the United Kingdom with 137 years of history and over 18,000 employees, relies on Apache Kafka® for their event streaming needs. But how did this come to be? In this episode, Tim Berglund talks with Rob Jackson (Principal Architect, Nationwide) about their Kafka adoption journey as they celebrate two years in production. Nationwide chose to adopt Kafka as a central part of their information architecture in order to integrate microservices. You can't have them share a database that's design-time coupling, and maybe you tried having them call each other synchronously. There's a li...
2021-02-0848 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovExamining Apache Kafka Performance Metrics ft. Alok NikhilComing up with an honest test built on open source tools in an easily documented, replicable environment for a distributed system like Apache Kafka® is not simple. Alok Nikhil (Cloud Native Engineer, Confluent) shares about getting Kafka in the cloud and how best to leverage Confluent Cloud for high performance and scalability. His blog post “Benchmarking Apache Kafka, Apache Pulsar, and RabbitMQ: Which is the Fastest?” discusses how Confluent tested Kafka’s performance on the latest cloud hardware using research-based methods to answer this question. Alok and Tim talk through the vendor-neutral framework OpenMessaging Benchmark used for...
2021-02-0150 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovDistributed Systems Engineering with Apache Kafka ft. Guozhang WangTim Berglund picks the brain of a distributed systems engineer, Guozhang Wang, tech lead in the Streaming department of Confluent. Guozhang explains what compelled him to join the Stream Processing team at Confluent coming from the Apache Kafka® core infrastructure. He reveals what makes the best distributed systems infrastructure engineers tick and how to prepare to take on this kind of role—solving failure scenarios, a satisfying challenge. One challenge in distributed systems is achieving agreements from multiple nodes that are connected in a Kafkacluster, but the connection in practice is asynchronous.Guozhang also shares the n...
2021-01-2544 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovScaling Developer Productivity with Apache Kafka ft. Mohinish ShaikhConfluent Cloud and Confluent Platform run efficiently largely because of the dedication of the Developer Productivity (DevProd) team, formerly known as the Tools team. Mohinish Shaikh (Software Engineer, Confluent) talks to Tim Berglund about how his team builds the software tooling and automation for the entire event streaming platform and ensures seamless delivery of several engineering processes across engineering and the rest of the org. With the right tools and the right data, developer productivity can understand the overall effectiveness of a development team and their ability to produce results.The DevProd team helps engineering teams at...
2021-01-2034 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovEvent Streaming Trends and Predictions for 2021 ft. Gwen Shapira, Ben Stopford, and Michael NollComing out of a whirlwind year for the event streaming world, Tim Berglund sits down with Gwen Shapira (Engineering Leader, Confluent), Ben Stopford (Senior Director, Office of the CTO, Confluent), and Michael Noll (Principal Technologist, Office of the CTO, Confluent) to take a guess at what 2021 will bring. The experts share what they believe will happen for analytics, frameworks, multi-cloud services, stream processing, and other topics important to the event streaming space. These Apache Kafka® related predictions include the future of the Kafka cluster partitions and removing restrictions that users have found in the past, such as to...
2021-01-0644 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka 2.7 - Overview of Latest Features, Updates, and KIPsApache Kafka® 2.7 is here! Here are the key Kafka Improvement Proposals (KIPs) and updates in this release, presented by Tim Berglund. KIP-497 adds a new inter-broker API to alter in-sync replicas (ISRs). Every partition leader maintains the ISR list or the list of ISRs. KIP-497 is also related to the removal of ZooKeeper.KIP-599 has to do with throttling the rate of creating topics, deleting topics, and creating partitions. This KIP will add a new feature called the controller mutation rate.KIP-612 adds the ability to limit the connection creation rate on brokers, wh...
2020-12-2110 min
Open Source Archives - Software Engineering DailyKafka Applications with Tim Berglund (Repeat)
Originally published September 17, 2019
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering.
Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout a company such that multiple systems can consume the messages from a single sender.Â
In previous shows, we have covered design patterns within Kafka, Kafka streams, event sourcing with Kafka, and many other s...
2020-12-1652 min
Software Engineering DailyKafka Applications with Tim Berglund (Repeat)Originally published September 17, 2019Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering.Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout a company such that multiple systems can consume the messages from a single sender. In previous shows, we have covered design patterns within Kafka, Kafka streams, event sourcing with Kafka, and many other subjects relating t...
2020-12-1655 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovMulti-Tenancy in Apache Kafka ft. Anna PozvnerMulti-tenancy has been quite the topic within the Apache Kafka® community. Anna Povzner, an engineer on the Confluent team, spends most of her time working on multi-tenancy in Kafka in Confluent Cloud.Anna kicks off the conversation with Tim Berglund (Senior Director of Developer Experience, Confluent) by explaining what multi-tenancy is, why it is worthy to be desired, and advantages over single-tenant architecture. By putting more applications and use cases on the same Kafka cluster instead of having a separate Kafka cluster for each individual application and use case, multi-tenancy helps minimize the costs of physical machines a...
2020-11-2344 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovDistributed Systems Engineering with Apache Kafka ft. Roger HooverRoger Hoover, one of the first engineers to work on Confluent Cloud, joins Tim Berglund (Senior Director of Developer Experience, Confluent) to chat about the evolution of Confluent Cloud, all the stages that it’s been through, and the lessons he’s learned on the way. He talks through the days before Confluent Platform was created, and how he contributed to Apache Kafka® to run it on OpenStack (the feature used to separate advertised hostnames from the internal hostnames).The Confluent Cloud control plane is now run in over 40 regions. Under the covers, Roger and his team are m...
2020-11-1850 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAsk Confluent #18: The Toughest Questions ft. Anna McDonaldIt’s the first work-from-home episode of Ask Confluent, where Gwen Shapira (Core Kafka Engineering Leader, Confluent) virtually sits down with Apache Kafka® expert Anna McDonald (Staff Technical Account Manager, Confluent) to answer questions from Twitter. Find out Anna’s favorite Kafka Improvement Proposal (KIP), which will start to use racially neutral terms in the Kafka community and in our code base, as well as answers to the following questions: If you could pick any one KIP from the backlog that hasn't yet been implemented and have it immediately available, which one would you pick?Are we able...
2020-10-2233 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovJoining Forces with Spring Boot, Apache Kafka, and Kotlin ft. Josh LongWouldn’t it be awesome if there was a language as elegant as Spring Boot is as a framework? In this episode of Streaming Audio, Tim Berglund talks with Josh Long, Spring developer advocate at VMware about Kotlin, about the productivity-focused language from our friends at JetBrains, and how it works with Spring Boot to make the experience leaner, cleaner, and easy to use.Josh shares how the Spring and Kotlin teams have worked hard to make sure that Kotlin and Spring Boot are a first-class experience for all developers trying to get to production faster and sa...
2020-10-2150 min
Hedera Hashgraph - Gossip About Gossip PodcastLow Trust Logging – From Apache Kafka to the Hedera Consensus Service - #66In this episode of Gossip about Gossip, Hedera's Developer Evangelist Cooper Kunz is joined by Tim Berglund, the Sr. Director of Developer Advocacy at Confluent. Tim’s experience in the technology industry spans decades, from writing firmware to some of the early days at GitHub, currently leading outreach and training at the multibillion-dollar enterprise software company Confluent. At Confluent, they're building an ecosystem around the popular event streaming platform Apache Kafka, which powers everything from Fortnite to the "Big Banks'" backend microservices. Listen to this podcast to hear Tim's thoughts on distributed ledgers, Bitcoin, event streaming architectures, an...
2020-10-0834 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovUsing Apache Kafka as the Event-Driven System for 1,500 Microservices at Wix ft. Natan SilnitskyDid you know that a team of 900 developers at Wix is using Apache Kafka® to maintain 1,500 microservices? Tim Berglund sits down with Natan Silnitsky (Backend Infrastructure Engineer, Wix) to talk all about how Wix benefits from using an event streaming platform. Wix (the website that’s made for building websites) is designing a platform that gives people the freedom to create, manage, and develop their web presence exactly the way they want as they look to move from synchronous to asynchronous messaging. In this episode, Natan and Tim talk through some of the vital lessons learn...
2020-09-2149 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovTop 6 Things to Know About Apache Kafka ft. Gwen ShapiraThis year, Confluent turns six! In honor of this milestone, we are taking a very special moment to celebrate with Gwen Shapira by highlighting the top six things everyone should know about Apache Kafka®:Clients have metricsBug fix releases/Kafka Improvement Proposals (KIPs)Idempotent producers and how they workKafka Connect is part of Kafka and Single Message Transforms (SMTs) are worth not missing out onCooperative rebalancing Generating sequence numbers and how Kafka changes the way you thinkListen as Tim and Gwen talk through the importance of Kafka Connect, cooperative rebalancing protocols, and the promise (and warning) th...
2020-09-1547 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov5 Years of Event Streaming and Counting ft. Gwen Shapira, Ben Stopford, and Michael NollWith the explosion of real-time data, Apache Kafka and event stream processing (ESP) have grown in proliferation, with event streaming technology becoming the de facto technology transforming businesses across numerous verticals. Gwen Shapira (Engineering Leader, Confluent), Ben Stopford (Senior Director, OCTO, Confluent), and Michael Noll (Principal Technologist, Confluent) meet up to talk all about their last five years at Confluent and the changes they’ve seen in event streaming. They discuss what they were doing with Apache Kafka® before they arrived at Confluent, challenges in event streaming challenges that have arisen, and their favorite use cases. They then talk thr...
2020-08-3148 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovChampioning Serverless Eventing at Google Cloud ft. Jay SmithJay Smith helps Google Cloud users modernize their applications with serverless eventing. This helps them focus on their code instead of managing infrastructure, as well as ultra-fast deployments and reduced server costs. On today’s show, he discusses the definition of serverless, serverless eventing, data-driven vs. event-driven architecture, sources and sinks, and hybrid cloud with on-prem components. Finally, Jay shares how he sees application architecture changing in the future and where Apache Kafka® fits in.EPISODE LINKSQuine ProgramsGet Started with QwiklabsKubernetes PodcastsJoin the Confluent Community SlackLearn more with Kafka tutorials, resources, and guides at C...
2020-08-2647 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovDisaster Recovery with Multi-Region Clusters in Confluent Platform ft. Anna McDonald and Mitch HendersonMulti-Region Clusters improve high availability in Apache Kafka®, ensure cluster replication across multiple zones, and help with disaster recovery. Making sure users are successful in every area of their Kafka deployment, be it operations or application development for specific use cases, is what Anna McDonald (Team Lead Customer Success Technical Architect) and Mitch Henderson (Principal Customer Success Technical Architect) are passionate about here at Confluent.In this episode, they share common challenges that users often run into with Multi-Region Clusters, uses cases for them, and what to keep in mind when considering replication. Ann...
2020-08-1743 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovDeveloper Advocacy (and Kafka Summit) in the Pandemic EraAll Confluent developer advocates...assemble! COVID-19 has changed the face of meetings and events, halting all in-person gatherings and forcing companies to adapt on the fly. In today's episode of Streaming Audio, the developer advocates come together to discuss how their jobs have changed during the worldwide pandemic. Less than a year ago, this group was constantly on the road or in a plane on their way to present something new about Apache Kafka and event streaming, so how has the current climate affected their work? The group talks about Zoom fatigue, online presenting, online conferences/meetups, a...
2020-08-1241 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka 2.6 - Overview of Latest Features, Updates, and KIPsApache Kafka® 2.6 is out! This release includes progress toward removing ZooKeeper dependency, adding client quota APIs to the admin client, and exposing disk read and write metrics, and support for Java 14. In addition, there are improvements to Kafka Connect, such as allowing source connectors to set topic-specific settings for new topics and expanding Connect worker internal topic settings. Kafka 2.6 also augments metrics for Kafka Streams and adds emit-on-change support for Kafka Streams, as well as other updates. EPISODE LINKSWatch the video version of this podcastRead about what's new in Apache Kafka 2.6Join the Con...
2020-08-0610 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovTesting ksqlDB Applications ft. Viktor GamovViktor Gamov (Developer Advocate, Confluent) returns to Streaming Audio to explain the magic of ksqlDB, ideal testing environments for ksqlDB, and the ksqlDB test runner. For those who are just starting to explore the interface, Viktor provides some tips and best practices for what to look out for too. He also talks about the future of ksqlDB, the future of integration testing, and his favorite new feature among recent upgrades.EPISODE LINKSStreaming Audio episodes on ksqlDBWatch #LiveStreams with Viktor Gamov I Don't Always Test My StreamsJoin the Confluent Community SlackLearn more with Kafka tu...
2020-08-0339 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovFrom Monolith to Microservices with Sam NewmanAuthor Sam Newman catches up with Tim Berglund (Senior Director of Developer Advocacy, Confluent) in the virtual studio on what microservices are, how they work, the drawbacks of microservices, what splitting the monolith looks like, and patterns to look for. The pair talk through Sam's book “Monolith to Microservices” chapter by chapter, looking at key components of microservices in more detail. Sam also walks through database decomposition, integrating with new technology, and performing joins in event streaming architecture. Lastly, Sam shares what he’s excited for in the future, which includes “Monolith to Microservices Volume II.”EPISODE L...
2020-06-1740 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovExploring Event Streaming Use Cases with µKanren ft. Tim BaldridgeTim Baldridge (Senior Software Engineer, Cisco) joins us on Streaming Audio to talk about event streaming, stream processing use cases, and µKanren. First, Tim shares about his work at Cisco related to intaking viruses, the backend, and finding new ways to process data. Later, Tim talks about interesting bank and airline use cases, as well as his time at Walmart, taking a closer look at specific retail use cases and the product that Walmart used to process data streams. If you’re curious about what µKanren is, how it relates to relational programming, the complex math t...
2020-06-0851 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovConnecting Snowflake and Apache Kafka ft. Isaac KunenIsaac Kunen (Senior Product Manager, Snowflake) and Tim Berglund (Senior Director of Developer Advocacy, Confluent) practice social distancing by meeting up in the virtual studio to discuss all things Apache Kafka® and Kafka Connect at Snowflake. Isaac shares what Snowflake is, what it accomplishes, and his experience with developing connectors. The pair discuss the Snowflake Kafka Connector and some of the unique challenges and adaptations it has had to undergo, as well as the interesting history behind the connector. In addition, Isaac talks about how they’re taking on event streaming at Snowflake by implementing the K...
2020-05-2031 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAMA with Tim Berglund | Streaming Audio SpecialHappy 100th episode of Streaming Audio! Thank you to everyone who has listened, subscribed, left a review, and mostly, for sharing our passion for event streaming. We can't wait for the next 100! To celebrate, Ben Stopford (Senior Director of the Office of the CTO, Confluent) hosts an AMA (ask me anything) with Tim, covering 62 questions in total—from his career, his time at Confluent, Marvel vs. DC, and what he looks for in a new hire, to how to nail your next conference talk. We hope you enjoy this special 100th episode of Streaming Audio: a podcast abo...
2020-05-1847 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovKubernetes Meets Apache Kafka ft. Kelsey HightowerKelsey Hightower was already an advocate, just like all other developers, long before joining Google officially as a developer advocate and Kubernetes expert. Gaining trust in your product, process, and the way you develop code requires the ability to explain those things well. Kelsey reflects on the journey that brought him to where he is today and how Kubernetes has evolved over the years too, including what makes Kubernetes so successful. But Tim is not the only one with questions. Kelsey asks a few of his own: does Apache Kafka® want to be a database? Does Kafka wa...
2020-05-1342 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka Fundamentals: The Concept of Streams and Tables ft. Michael NollIf you’ve ever wondered what Apache Kafka® is, what it’s used for, or wanted to learn about Kafka architecture and all its components, buckle up! In today’s episode, Michael Noll (Principal Technologist, Confluent) and Tim Berglund (Senior Director of Developer Advocacy, Confluent) discuss a series of fundamental questions: What is Kafka? What is an event? How do we organize and store events? And what is Kafka Streams? Over the course of this episode, Michael covers an in-depth look into Kafka technology and core concepts: the process of reading from a topic, differences between tables and stre...
2020-05-0448 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovConfluent Platform 5.5 | What's New in This Release + UpdatesConfluent Platform 5.5 is out, and Tim Berglund (Senior Director of Developer Advocacy, Confluent) is here to give you the latest updates! The first is improved schema management and Confluent Schema Registry support for Protobuf and JSON, making these components pluggable. The second is better support for languages other than Java within the sphere of librdkafka. And finally, this release includes an upgrade to ksqlDB, which expands its functionality, supports more data types, increases availability for pull queries, and adds a new aggregate function.EPISODE LINKSConfluent Platform 5.5 Release NotesIntroducing Confluent Platform 5.5Watch the video version of...
2020-04-2411 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka 2.5 – Overview of Latest Features, Updates, and KIPsApache Kafka® 2.5 is here, and we’ve got some Kafka Improvement Proposals (KIPs) to discuss! Tim Berglund (Senior Director of Developer Advocacy, Confluent) shares improvements and changes to over 10 KIPs all within the realm of Core Kafka, Kafka Connect, and Kafka Streams, including foundational improvements to exactly once semantics, the ability to track a connector’s active topics, and adding a new co-group operator to the Streams DSL.EPISODE LINKSCheck out the Apache Kafka 2.5 release notesRead about what’s new in Apache Kafka 2.5Watch the video version of this podcastJoin the Confluent Community SlackLearn about Kafka a...
2020-04-1610 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovExplore, Expand, and Extract with 3X Thinking ft. Kent BeckAs a programmer, Kent Beck chats about various topics of broad interest to developers, including some of his books: “Extreme Programming Explained: Embrace Change,” “Test-Driven Development: By Example,” and “Implementation Patterns.” He wrote “Implementation Patterns” to highlight the positive habits a developer should form in order to write accessible code. He also shares about what it’s like to experiment with new ideas and implement them, especially when others doubt what you're trying to achieve. This relates to the concept behind the explore-to-expand transition and a short piece he wrote titled "Idea to Impact." Finally, Tim and Kent talk through t...
2020-03-2554 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAsk Confluent #17: The “What is Apache Kafka?” Episode ft. Tim BerglundAsk Confluent is back! From questions on Apache Kafka®, data integration, and log aggregation, to potential interview questions that Tim would ask if he were to interview himself, anything goes. If you're already a Kafka expert (or any type of expert), think about becoming a speaker. Gwen and Tim talk through how to submit a proposal and get accepted to conferences. As experienced conference goers, they explain that what makes a successful talk is making sure you present for the attendee instead of making it about yourself. In essence, what can your idea or code do to he...
2020-03-2425 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovDistributed Systems Engineering with Apache Kafka ft. Gwen ShapiraAs an engineering leader managing a team, Gwen Shapira talks through the steps she took to get to Confluent and how she got started working with Apache Kafka®. She shares about what it's like being on the Project Management Committee (PMC) for the Apache Software Foundation as well as some of the responsibilities involved, such as choosing Kafka Improvement Proposals (KIPs), monitoring releases, and making contributions to the community. For Gwen, part of finding Kafka was her willingness to take risks, learn all types of code bases, and leave companies for a new technology that showed promise an...
2020-03-0448 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovHow to Write a Successful Conference Abstract | Streaming Audio SpecialLearn how to write an abstract for conference submissions and call for papers with tips from Tim Berglund, chair of the Kafka Summit Program Committee. Whether you're giving a talk for the very first time or you consider yourself to be an experienced speaker, these guidelines will help you craft a strong story that stands out from the others.EPISODE LINKSJoin #summit-office-hours on the Confluent Community SlackSign up to speak at a meetupWatch the video version of this podcastGet 30% off Kafka Summit London registration with the code KSL20AudioSEASON 2
2020-02-0407 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovCloud-Native Patterns with Cornelia DavisDeveloping cloud-based applications requires unique patterns and practices that make them suitable for modern cloud platforms. Host Tim Berglund catches up with Cornelia Davis, author of Cloud-Native Patterns and VP of Technology at Pivotal, on what cloud-native patterns are, the example code she created, her latest book, and how she wrote the book for the customers she interacts with on a daily basis. EPISODE LINKSGet 40% off Cloud Native Patterns with the code podcon19Join the Confluent Community SlackFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Ti...
2019-12-1653 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovReal-Time Payments with Clojure and Apache Kafka ft. Bobby CalderwoodStreamlining banking technology to help smaller banks and credit unions thrive among financial giants is top of mind for Bobby Calderwood (Founder, Evident Systems), who started out in programming, transitioned to banking, and recently launched Evident Real-Time Payments. Payments leverages Confluent Cloud to help banks of all sizes transform to real-time banking services from traditionally batch-oriented, bankers’ hours operational mode. This is achieved through Apache Kafka® and the Kafka Streams and Kafka Connect APIs with Clojure using functional programming paradigms like transducers. Bobby also shares about his efforts to help financial services companies build their next...
2019-11-2758 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka on Kubernetes, Microsoft Azure, and ZooKeeper with Lena HallLena Hall joins Tim Berglund in the studio to talk about Apache Kafka®, the various ways to run Kafka on Microsoft Azure, Kafka on Kubernetes (K8s), and some exciting events that are happening in the Kafka world. Lena shares about serving double duty as both a senior software engineer and senior cloud developer advocate for Azure Engineering, including her unique roles and responsibilities, and how she balances engineering with advocacy. From writing tech articles to her experience with fuzzing and presence on YouTube, Lena is a strong community supporter and believes in the importance of staying ro...
2019-10-1646 min
AllThingsNew.Tech PodcastI Stream, Therefore I Am?Â
We're excited to share this conversation with Tim Berglund, Director of Developer Relations at Confluent. Confluent has developed technology that processes data as event streams in real-time. In this episode, ATN host Paul Taylor and Tim explore how this revolutionary data paradigm affects our identity, both online and offline. Do we actually exist, or does stuff just happen to shape our existence? How do data change the way we perceive ourselves or want others to perceive us? If we don't have data recorded, does that mean we actually did anything? Listen in for these thought-provoking questions and m...
2019-10-1549 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovMySQL, Cassandra, BigQuery, and Streaming Analytics with Joy GaoJoy Gao chats with Tim Berglund about all things related to streaming ETL—how it works, its benefits, and the implementation and operational challenges involved. She describes the streaming ETL architecture at WePay from MySQL/Cassandra to BigQuery using Apache Kafka®, Kafka Connect, and Debezium.  EPISODE LINKSCassandra Source Connector DocumentationStreaming Databases in Real Time with MySQL, Debezium, and KafkaStreaming Cassandra at WePayChange Data Capture with Debezium ft. Gunnar MorlingJoin the Confluent Community SlackFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov P...
2019-10-0243 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovKIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason GustafsonTim Berglund sits down with Colin McCabe and Jason Gustafson to talk about KIP-500. The pair, who work on the Kafka Core Engineering Team, discuss the history of Kafka, the creation of KIP-500, and what it will do for the community as a whole. They break down ZooKeeper's role in Kafka, the implications of removing ZooKeeper dependency, replacing it with a self-managed metadata quorum, and how they've been combatting security, stability, and compatibility issues. With pending improvements towards scalability and inter-broker communication, and now that KIP-500 has been adopted within the community—there's a lot covered in this episode th...
2019-09-1843 min
Software Engineering DailyKafka Applications with Tim BerglundEver since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout
The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily.
2019-09-1759 minOpen Source Archives - Software Engineering DailyKafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering.
Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout a company such that multiple systems can consume the messages from a single sender.Â
In previous shows, we have covered design patterns within Kafka, Kafka streams, event sourcing with Kafka, and many other subjects relating to the technology. K...
2019-09-1752 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovConnecting to Apache Kafka with Neo4jWhat’s a graph? How does Cypher work? In today's episode of Streaming Audio, Tim Berglund sits down with Michael Hunger (Lead of Neo4j Labs) and David Allen (Partner Solution Architect, Neo4j) to discuss Neo4j basics and get the scoop on major features introduced in Neo4j 3.4 and 3.5. Among these are geospatial and temporal types, but there’s also more to come in 4.0: a multi-database feature, fine-grained security, and reactive drivers/Spring Data Neo4j RX. In addition to sharing a little bit about the history of the integration and features in relation to Apach...
2019-09-0954 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovHelping Healthcare with Apache Kafka and KSQL ft. Ramesh SringeriIn today’s episode of Streaming Audio, Tim Berglund sits down with Senior Applications Developer of Mobile Solutions Ramesh Sringeri to discuss Apache Kafka®—specifically two Kafka use cases that Children’s Healthcare of Atlanta is working on.First, they discuss achieving near-real-time streams of data to support meaningful intracranial pressure prediction and managing intracranial pressure (ICP) in a timely manner to help the care team achieve better outcomes with traumatic brain injuries.Children’s Healthcare of Atlanta is in the process of building machine learning models for predicting ICP values 30 and 60 minutes in the future. T...
2019-08-2852 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovContributing to Open Source with the Kafka Connect MongoDB Sink ft. Hans-Peter GrahslSink and source connectors are important for getting data in and out of Apache Kafka®. Tim Berglund invites Hans-Peter Grahsl (Technical Trainer and Software Engineer, Netconomy Software & Consulting GmbH) to share about his involvement in the Apache Kafka project, spanning from several conference contributions all the way to his open source community sink connector for MongoDB, now part of the official MongoDB Kafka connector code base. Join us in this episode to learn what it’s like to be the only maintainer of a side project that’s been deployed into production by several companies!EPISOD...
2019-08-2150 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovConnecting Apache Cassandra to Apache Kafka with Jeff Carpenter from DataStaxWhenever you see an Apache Cassandra™ in the wild, you probably also see an Apache Kafka®️. In this episode, Tim Berglund (Senior Director of Developer Experience, Confluent) and Jeff Carpenter (Director of Developer Advocacy, DataStax) discuss the best way to get those systems talking using the DataStax Apache Kafka Connector and build a real-time data pipeline. EPISODE LINKSAbout the DataStax Apache Kafka ConnectorDataStax Academy: DataStax Apache Kafka Connector CourseJoin the Confluent Community SlackSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Galla...
2019-08-1247 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovApache Kafka 2.3 | What's New in This Release + Updates and KIPsTim Berglund (Senior Director of Developer Experience, Confluent) explains what’s new in Apache Kafka® 2.3 and highlights some of the most important Kafka Improvement Proposals (KIPs).EPISODE LINKSRead the blogWatch the video version of this podcastSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please lea...
2019-06-2513 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovWhy Kafka Connect? ft. Robin MoffattIn this episode, Tim talks to Robin Moffatt about what Kafka Connect is and why you should almost certainly use it if you're working with Apache Kafka®️. Whether you're building database offload pipelines to Amazon S3, ingesting events from external datastores to drive your applications or exposing messages from your microservices for audit and analysis, Kafka Connect is for you. Tim and Robin cover the motivating factors for Kafka Connect, why people end up reinventing the wheel when they're not aware of it and Kafka Connect's capabilities, including scalability and resilience. They also talk about the importance of s...
2019-06-1246 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovSchema Registry Made Simple by Confluent Cloud ft. Magesh NandakumarTim Berglund and Magesh Nandakumar (Software Engineer, Confluent) discuss why schemas matter for building systems on Apache Kafka®, and how Confluent Schema Registry helps with the problem. They talk about how Schema Registry works, how you can collaborate around schema change through `avsc` files, and what it means for this to be available in Confluent Cloud today.EPISODE LINKSSchema Registry 101Schema ManagementMigrate Schemas to Confluent CloudSchemas, Contracts, and CompatibilityFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced a...
2019-06-0341 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovWhy is Stream Processing Hard? ft. Michael DrogalisTim Berglund and Michael Drogalis (Product Lead for Kafka Streams and KSQL, Confluent) talk about all things stream processing: why it’s complex, how it's evolved, and what’s on the horizon to make it simpler.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please leave us a rating. 🎧 C...
2019-05-2945 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovTesting Kafka Streams Applications with Viktor GamovTim Berglund is joined by Viktor Gamov (Developer Advocate, Confluent) to discuss various approaches to testing Kafka Streams applications.EPISODE LINKSKafkaEmbeddedTopologyTestDriverMocked Streams (Scala)MockafkaTest containersKafka containers SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please leave us a rating. 🎧 Confluent also has a podcast for tech...
2019-05-2042 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovBen Stopford on Microservices and Event StreamingMicroservices are pretty ubiquitous these days. Really “SOA done right,” they reimagine the services pattern in the context of the world we live in today, nearly two decades since the first big service-oriented systems hit production. But what have we learned in this time? There are plenty of war stories. System designers have explored different architectural patterns—REST, events and databases of all types. In this podcast, Tim Berglund and Ben Stopford explore the event-driven paradigm and how it relates to the microservice architectures we build today. Ben dives deep into coupling, evolution and challenges of our increas...
2019-04-0858 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovContainerized Apache Kafka On Kubernetes with Viktor GamovKubernetes provides all the building blocks needed to run stateful workloads, but creating a truly enterprise-grade Apache Kafka® platform that can be used in production is not always intuitive. In this episode, Tim Berglund and Viktor Gamov address some of the challenges and pitfalls of managing Kafka on Kubernetes at scale. They also share lessons learned from the development of the Confluent Operator for Kubernetes, and answer questions like:-What is Kubernetes?-What are stateful workloads?-Why are they hard?-Will Confluent Operator make it easier?EPISODE LINKSJoin the #kubernetes Slack c...
2019-03-1141 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovSplitting and Routing Events with KSQL ft. Pascal VantrepoteTim Berglund chats with System Engineer Pascal Vantrepote about a KSQL recipe he created based on a real-life customer use case in the financial services industry. They also discuss the advantages of KSQL, such as its expressiveness and ease of deployment in places where you’re not already writing a Java application.EPISODE LINKSAbout KSQL Stream Processing CookbookKSQL Recipe: Data Routing Joined with a KTableFor more, you can check out ksqlDB, the successor to KSQL.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Pro...
2019-02-2520 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovUsing Terraform and Confluent Cloud with Ricardo FerreiraTim Berglund hosts Developer Advocate Ricardo Ferreira to discuss the concept of infrastructure as code, as well as the differences between Terraform, Ansible, Puppet and Chef. They also chat about why Terraform is such a big deal, some of the challenges involved with learning it and how Confluent leverages Terraform to achieve multi-cloud support for Confluent Cloud and tools for Confluent Platform.EPISODE LINKSTerraformTools for Confluent Cloud ClustersFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by...
2019-01-2328 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovKafka Streams in Action with Bill BejeckTim Berglund interviews Bill Bejeck about the Kafka Streams API and his new book, Kafka Streams in Action. SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please leave us a rating. 🎧 Confluent also has a podcast for tech leaders: "Life Is But A Stream" hosted by our friend, Josep
2018-09-2749 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovJoins in KSQL 5.0 with Hojjat JafarpourKSQL 5.0 now supports stream-stream, stream-table and table-table joins. Tim Berglund interviews Hojjat Jafarpour about all three join types, how they work, what their limitations are and the new kinds of operations they unlock.For more, you can check out ksqlDB, the successor to KSQL.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch n...
2018-09-2029 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAsk Confluent #5: Kafka, KSQL and Viktor GamovGwen is joined in studio by co-host Tim Berglund and special guest, Viktor Gamov, a new member of Confluent’s Developer Experience Team specializing in Kafka, KSQL and Kubernetes. In this episode, we’ll find out: Does Viktor know what he’s talking about?EPISODE LINKSWatch the video version of this podcastSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to...
2018-09-1031 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovNested Data in KSQL with Hojjat JafarpourInteresting data isn't a polite little list of scalar types. Sometimes you have more complex structures and things like nesting. We'll see how KSQL supports that today as Tim Berglund discusses nested data in KSQL with Hojjat Jafarpour, a software engineer on the KSQL team at Confluent. EPISODE LINKSKSQL demos and infoKSQL GitHub KSQL Slack (#ksql channel) For more, you can check out ksqlDB, the successor to KSQL.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Moh...
2018-08-2913 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAsk Confluent #3: Kafka Upgrades, Cloud APIs and Data DurabilityTim Berglund and Gwen Shapira have a discussion with Koelli Mungee (Customer Operations Lead, Confluent) and cover the latest Apache Kafka upgrades, cloud APIs, and data durability. This is episode #3 of "Ask Confluent," a segment in which Gwen Shapira and guests respond to a handful of questions and comments from Twitter, YouTube, and elsewhere.EPISODE LINKSWatch the video version of this podcastFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie...
2018-07-2022 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor GamovAsk Confluent #1: Kubernetes, Confluent Operator, Kafka and KSQLTim Berglund and Gwen Shapira discuss Kubernetes, Confluent Operator, Kafka, KSQL, and more. This is the first episode of "Ask Confluent," a segment in which Gwen Shapira and guests respond to a handful of questions and comments from Twitter, YouTube and elsewhere.EPISODE LINKSWatch the video version of this podcastSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to pod...
2018-06-2022 min