podcast
details
.com
Print
Share
Look for any podcast host, guest or anyone
Search
Showing episodes and shows of
Tim Berglund
Shows
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
How Time Kills All Deals in Pre-Sales with Rachel Pedreschi | Ep. 8
Listen: https://confluent.buzzsprout.com | In this episode, Tim Berglund talks to his guest, Rachel Pedreschi (DeltaStream), about her career in pre-sales engineering. Her first job: rectory office assistant at her local parish. Her challenge/theme: working at early-stage startups to bridge sales, marketing, and engineering to reach product-market fit.Check out Tim and Rachel's previous podcast, Keyboard and Quill: https://youtube.com/playlist?list=PLihIrF0tCXdeJxpAJgbOsY48B9lD_w24v&si=5NjdA-Rss9Rsmyy1SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter...
2025-11-10
27 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Building Parquet into Apache Pinot ft. Neha Pawar | Ep. 5
Today, Tim Berglund talks to Neha Pawar (StarTree) about her career in real-time analytics and open source database engineering. Her first job: a year-long internship at NVIDIA. Her challenge: leading the technical effort to add native Parquet support into Apache Pinot.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed t...
2025-10-20
26 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
The Fix That Secured 1000s of Credit Cards ft. Brian Sletten | Ep. 4
In this episode, Tim talks to Brian Sletten (Bosatsu Consulting) about his career in software development. His first job: working at a small communications company that built network matrix switch interfaces. His challenge/theme: overhauling credit card storage and security at a major hospitality company.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new...
2025-10-13
29 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
How Tim Berglund Found His Calling | Ep. 2
Viktor Gamov interviews his co-host, Tim Berglund, about his career in the world of streaming data. Tim’s first job: Burger King broiler steamer. His challenge/theme: pivoting from working in hardware and firmware to finding his calling in enterprise software and developer relations.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes...
2025-09-29
30 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Building Real-time Systems for Apple, Nike & more ft. Adi Polak | Ep. 1
The Confluent Developer Podcast is here! For this first episode, Tim Berglund talks to his co-host, Adi Polak (Confluent), about her career in distributed data systems. Her first job: neighborhood dogwalker. Her challenge/theme: early Hadoop, working at Akamai on data optimization and real-time threat detection for huge global customers like Apple, Nike, Facebook and others, and the power of collaboration. SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subs...
2025-09-22
32 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
We're back! Welcome to the Confluent Developer Podcast.
Weekly episodes launching Sept. 22! | Hi, I'm Tim Berglund. It's been about four years since I've been podcasting at Confluent, and "Streaming Audio" has been on hiatus for a little more than two, but I've got great news: we are back! We're back with a new name, a new format, and new hosts. Welcome to the Confluent Developer Podcast, where we talk to software developers of all stripes about some of the most interesting problems they've solved in their career. I'll be joined by my co-hosts, Adi Polak and Viktor Gamov. And hey, you kno...
2025-09-02
01 min
I Have Some Questions...
003: “Are You Asking Too Much of Your Team… Without Realizing It?” (lessons from Tim Whitmire)
In this reaction episode, Erik unpacks the deeply resonant conversation he just had with Tim Whitmire, co-founder of F3 Nation. What starts as a personal reflection on F3's impact morphs into a vulnerable and strategic look at leadership, sustainability, and what it really means to see the people we lead clearly. From the power of micro-origin stories to the gift of context-aware leadership, Erik distills the conversation into actionable insights anchored in both experience and empathy.🎯 Top Insights from the InterviewOrganic beginnings can lead to transformational outcomes. F3 was a sim...
2025-06-09
08 min
I Have Some Questions...
002: “Can a Free Workout Teach You How to Be a Better Man?” ft. Tim Whitmire
In this powerful conversation, Erik sits down with Tim Whitmire, co-founder of F3 Nation and a seasoned leader across journalism, finance, consulting, and operations, to unpack what it takes to build decentralized leadership, sustain impact at scale, and lead with humility and purpose. From the sweaty roots of a Saturday workout in Charlotte to the formation of a nationwide brotherhood, Tim shares timeless insights on human development, organizational growth, and what it really means to step back so others can step up.👤 About the GuestTim Whitmire is the co-founder of F3...
2025-06-09
54 min
The Joe Reis Show
Tim Berglund - The Art of Developer Relations, Hardware Hacking, and More
Tim Berglund is the OG of DevRel. We chat about the art and craft of developer relations, hacking on hardware, and much more.
2025-04-16
54 min
Life Is But A Stream
Ep 1 - Stream On: Unleashing Innovation with Data Streaming
Real-time data streaming is shaking up everything we know about modern data systems. If you’re ready to dive in but unsure where to begin, no worries. That’s why we’re here.Our first episode breaks down the basics of data streaming—from what it is, to its pivotal role in processing and transferring data in a fast-paced digital environment. Your guide is Tim Berglund, VP of Developer Relations at Confluent, where he and his team work to make data streaming data and its emerging toolset accessible to all developers.You’ll learn:The fundam...
2025-02-04
1h 00
Fireside with Voxgig
Episode 161 Tim Berglund, Vice President of Developer Relations at StarTree
“So you’re telling me that a DevRel’s job is more than just posting funny tweets and partying at conferences?” Yes. Yes we are. And so is our guest on today’s episode - Tim Berglund. Tim is the Vice President of Developer Relations at Star Tree, and he breaks down for us what DevRel means to him, and how he counteracts people’s misconceptions about the role. In today’s world, it’s as difficult as ever for a DevRel to describe their job, but Tim gives it a go on this episode of the podcast. What’s important to know...
2024-03-21
42 min
Developer Voices
How Apache Pinot Achieves 200,000 Queries per Second (with Tim Berglund)
The likes of LinkedIn and Uber use Pinot to power some astonishingly high-scale queries against realtime data. The numbers alone would make an impressive case-study. But behind the headline lies a fascinating set of architectural decisions and constraints to get there. So how does Pinot work? How does it process queries? How are the various roles split across a cluster? And equally important - what does it *not* try to achieve.Joining me to go through the nuts and bolts of how Pinot handles SQL queries is Tim Berglund, veteran technology explainer of the realtime-data world. He...
2024-03-20
1h 14
Adventurous Entrepreneurs
Erik Berglund - How to Hold Your People Accountable, Steps to Becoming a Better Leader, and The Power of Cultivating a Community That Pushes You to Reach New Heights
Joining TJ on the Adventurous Entrepreneurs Podcast today is Erik Berglund.Erik Berglund is a dedicated entrepreneur, husband, and father who strives to maintain balance in all aspects of his life. Having worked as a sales leader for a multinational company for almost a decade, he became frustrated with the constant need to micromanage his team and found himself losing time and headspace that could be better spent on his passions and loved ones. This experience inspired him to develop the REACT framework for accountability, which he teaches in his program, the Language of Leadership. T...
2023-07-14
59 min
The GeekNarrator
Tim Berglund on Realtime Analytics with Apache Pinot
Hey Everyone, In the 43rd episode I speak with Tim Berglund on Realtime Analytics with Apache Pinot. Chapters: 00:00 Introduction 01:22 What do we mean by analytics and realtime analytics? 05:35 Can we define realtime in millis, seconds or minutes? 08:54 What is the fundamental difference between traditional analytics systems and Apache Pinot? 12:19 Was Kafka one of the reasons Apache Pinot could reach its full potential? 16:50 E-commerce Application example - How do I get my data in? 20:07 How is data stored (structured) on the disk? 23:31 Are joins available in Apache Pinot? 26:07 Joins vs pre-computing at ingestion 27:15 How is historical data ingested into Apache...
2023-07-03
51 min
GOTO - The Brightest Minds in Tech
Unlocking the Power of Real-Time Analytics • Tim Berglund & Adi Polak
This interview was recorded for GOTO Unscripted.gotopia.techRead the full transcription of this interview hereTim Berglund - VP DevRel at StarTree & Author of "Gradle Beyond the Basics"Adi Polak - VP of Developer Experience at Treeverse & Contributing to lakeFS OSSRESOURCESTimtimberglund.comtwitter.com/tlberglundlinkedin.com/in/tlberglundAditwitter.com/AdiPolakinstagram.com/polak.codelinkedin.com/in/polak-adiTools & companiespinot.apache.orgtwitter.com/startreedatalinkedin...
2023-06-02
44 min
Monday Morning Data Chat
#125 - The Art of Developer Relations w/ Tim Berglund
Tim Berglund is an OG of developer relations (aka devrel), having worked in devrel before it was cool. He joins the show to chat about the art of devrel and much more. #devrel #data
2023-05-08
00 min
The GeekNarrator
Kafka, Realtime analytics and Apache Pinot with Tim Berglund Part-2
Hey everyone, This is the part-2 of our episode with Tim Berglund. We have covered some advanced topics on Kafka, Kafka Streams and Apache Pinot. I hope you like the discussion. Cheers, The GeekNarrator
2023-01-03
39 min
The GeekNarrator
Kafka, Realtime analytics and Apache Pinot with Tim Berglund Part-1
Hey Everyone, In this episode I talked to Tim Berglund about his vast experience with Kafka, realtime analytics and Apache Pinot. I hope you like the episode. Do watch the part-2. Cheers, The GeekNarrator
2023-01-03
36 min
GOTO - The Brightest Minds in Tech
Kafka in Action • Viktor Gamov & Tim Berglund
This interview was recorded for the GOTO Book Club.gotopia.tech/bookclubRead the full transcription of the interview hereViktor Gamov - Principal Developer Advocate at Kong & Co-Autor of "Kafka in Action"Tim Berglund - VP DevRel at StarTree & Author of "Gradle Beyond the Basics"DESCRIPTIONKafka has been on developers’ radars for quite a while now. Viktor Gamov’s co-authored book “Kafka in Action” ensures that you have a list of recipes to dive into. Joined by Tim Berglund, VP DevRel at StarTree, they explore the fundamen...
2022-12-02
33 min
Refactor This
Shifting Modernization Paradigms with an Event-Driven Architecture - Tim Berglund
In this episode, we discuss:Why an Event-Driven architecture makes sense for modernization (6:44)Where technical debt creeps in during modernization initiatives (14:00)What is Apache Pinot and what does StarTree do? (19:26)Can you use the Strangler Fig Pattern at the data layer? (29:46)For more information, check out these resources:Introducing StarTree Community Slack: https://www.startree.ai/blog/introducing-startree-community-slackCheck out Tim’s Twitter and LinkedIn profileshttps://twitter.com/tlberglundhttps://www.linkedin.com/in/tlberglund/
2022-12-01
37 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
International Podcast Day - Apache Kafka Edition | Streaming Audio Special
What’s your favorite podcast? Would you like to find some new ones? In celebration of International Podcast Day, Kris Jenkins invites 12 experts from the Apache Kafka® community to talk about their favorite podcasts. Unlike other episodes where guests educate developers and tell stories about Kafka, its surrounding technological ecosystem, or the Cloud, this special episode provides a glimpse into what these guests have learned through listening to podcasts that you might also find interesting. Through a virtual international tour, Kris chatted with Bill Bejeck (Integration Architect, Confluent), Nikoleta Verbeck (Senior Solutions Engineer, CSID, Confluent), Ben Stopford (Lead...
2022-09-30
1h 02
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
On to the Next Chapter ft. Tim Berglund
After nearly 200 podcast episodes of Streaming Audio, Tim Berglund bids farewell in his last episode as host of the show. Tim reflects on the many great memories with guests who have appeared on the segment—and each for its own reasons. He has covered a wide variety of topics, ranging from Apache Kafka® fundamentals, microservices, event stream processing, use cases, to cloud-native Kafka, data mesh, and more. As Tim mentions, the Streaming Audio podcast will continue on to explore all things about Kafka and the cloud while featuring new voices and topics. You can subscribe to th...
2022-02-03
06 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Modernizing Banking Architectures with Apache Kafka ft. Fotios Filacouris
It’s been said that financial services organizations have been early Apache Kafka® adopters due to the strong delivery guarantees and scalability that Kafka provides. With experience working and designing architectural solutions for financial services, Fotios Filacouris (Senior Solutions Engineer, Enterprise Solutions Engineering, Confluent) joins Tim to discuss how Kafka and Confluent help banks build modern architectures, highlighting key emerging use cases from the sector. Previously, Kafka was often viewed as a simple pipe that connected databases together, which allows for easy and scalable data migration. As the Kafka ecosystem evolves with added components like ksqlDB, Kafka Stre...
2021-12-28
34 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Confluent Platform 7.0: New Features + Updates
Confluent Platform 7.0 has launched and includes Apache Kafka® 3.0, plus new features introduced by KIP-630: Kafka Raft Snapshot, KIP-745: Connect API to restart connector and task, and KIP-695: Further improve Kafka Streams timestamp synchronization. Reporting from Dubai, Tim Berglund (Senior Director, Developer Advocacy, Confluent) provides a summary of new features, updates, and improvements to the 7.0 release, including the ability to create a real-time bridge from on-premises environments to the cloud with Cluster Linking. Cluster Linking allows you to create a single cluster link between multiple environments from Confluent Platform to Confluent Cloud, which is available on public clouds li...
2021-11-09
12 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Automating Infrastructure as Code with Apache Kafka and Confluent ft. Rosemary Wang
Managing infrastructure as code (IaC) instead of using manual processes makes it easy to scale systems and minimize errors. Rosemary Wang (Developer Advocate, HashiCorp, and author of “Essential Infrastructure as Code: Patterns and Practices”) is an infrastructure engineer at heart and an aspiring software developer who is passionate about teaching patterns for infrastructure as code to simplify processes for system admins and software engineers familiar with Python, provisioning tools like Terraform, and cloud service providers. The definition of infrastructure has expanded to include anything that delivers or deploys applications. Infrastructure as software or infrastructure as configuration, according to Ro...
2021-10-26
30 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Getting Started with Spring for Apache Kafka ft. Viktor Gamov
What’s the distinction between the Spring Framework and Spring Boot? If you are building a car, the Spring Framework is the engine while Spring Boot gives you the vehicle that you ride in. With experience teaching and answering questions on how to use Spring and Apache Kafka® together, Viktor Gamov (Principal Developer Advocate, Kong) designed a free course on Confluent Developer and previews it in this episode. Not only this, but he also explains why the opinionated Spring Framework would be a good hero in Marvel. Spring is an ever-evolving framework that embraces modern, cloud-native technologies with...
2021-10-19
32 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Automating DevOps for Apache Kafka and Confluent ft. Pere UrbĂłn-Bayes
Autonomy is key in building a sustainable and motivated team, and this core principle also applies to DevOps. Building self-serve Apache Kafka® and Confluent Platform deployments require a streamlined process with unrestricted tools—a centralized processing tool that allows teams in large or mid-sized organizations to automate infrastructure changes while ensuring shared standards are met. With more than 15 years of engineering and technology consulting experience, Pere Urbón-Bayes (Senior Solution Architect, Professional Services, Confluent) built an open source solution—JulieOps—to enable a self-serve Kafka platform as a service with data governance. JulieOps is one of the first sol...
2021-10-07
26 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Intro to Kafka Connect: Core Components and Architecture ft. Robin Moffatt
Kafka Connect is a streaming integration framework between Apache Kafka® and external systems, such as databases and cloud services. With expertise in ksqlDB and Kafka Connect, Robin Moffatt (Staff Developer Advocate, Confluent) helps and supports the developer community in understanding Kafka and its ecosystem. Recently, Robin authored a Kafka Connect 101 course that will help you understand the basic concepts of Kafka Connect, its key features, and how it works.What’s Kafka Connect, and how does it work with Kafka and brokers? Robin explains that Kafka Connect is a Kafka API that runs separately from the Kafka bro...
2021-09-28
31 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Designing a Cluster Rollout Management System for Apache Kafka ft. Twesha Modi
As one of the top coders of her Java coding class in high school, Twesha Modi is continuing to follow her passion for computer science as a senior at Cornell University, where she has proven to be one of the top programmers. During Twesha's summer internship at Confluent, she contributed to designing a new service to automate Apache Kafka® cluster rollout management—a process that releases the latest Kafka versions to customer’s clusters in Confluent Cloud.During Twesha’s internship, she was part of the Platform team, which designed a cluster management rollout service—capable of automatin...
2021-09-23
30 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka 3.0 - Improving KRaft and an Overview of New Features
Apache Kafka® 3.0 is out! To spotlight major enhancements in this release, Tim Berglund (Apache Kafka Developer Advocate) provides a summary of what’s new in the Kafka 3.0 release from Krakow, Poland, including API changes and improvements to the early-access Kafka Raft (KRaft). KRaft is a built-in Kafka consensus mechanism that’s replacing Apache ZooKeeper going forward. It is recommended to try out new KRaft features in a development environment, as KRaft is not advised for production yet. One of the major features in Kafka 3.0 is the efficiency for KRaft controllers and brokers to store, load, and replicate snapsh...
2021-09-21
15 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
How to Build a Strong Developer Community with Global Engagement ft. Robin Moffatt and Ale Murray
A developer community brings people with shared interests and purpose together. The fundamental elements of a community are to gather, learn, support, and create opportunities for collaboration. A developer community is also an effective and efficient instrument for exploring and solving problems together. The power of a community is its endless advantages, from knowledge sharing to support, interesting discussions, and much more. Tim Berglund invites Ale Murray (Global Community Manager, Confluent) and Robin Moffatt (Staff Developer Advocate, Confluent) on the show to discuss the art of Q&A in a global community, share tips for building a v...
2021-09-14
35 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani
The data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analytical purposes in real time, right at the point of origin. The idea of data mesh was introduced by Zhamak Dehghani (Director of Emerging Technologies, Thoughtworks) in 2019. Here, she provides an introduction to data mesh and the fundamental problems that it’s trying to solve. Zhamak describes that the complexity and ambition to use data have grown in today’s industry. But what is data mesh? For over...
2021-09-09
34 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Confluent Platform 6.2 | What’s New in This Release + Updates
Based on Apache Kafka® 2.8, Confluent Platform 6.2 introduces Health+, which offers intelligent alerting, cloud-based monitoring tools, and accelerated support so that you can get notified of potential issues before they manifest as critical problems that lead to downtime and business disruption.Health+ provides ongoing, real-time analysis of performance and cluster metadata for your Confluent Platform deployment, collecting only metadata so that you can continue managing your deployment, as you see fit, with complete control.With cluster metadata being continuously analyzed, through an extensive library of expert-tested rules and algorithms, you can quickly get insights to cluster p...
2021-06-10
09 min
Anablock Podcast
Interview with Tim Berglund, Senior Director of Developer Advocacy at Confluent
This podcast is brought to you by Anablock. Anablock is a system integrator and Salesforce partner. Anablock's technical team helps organizations to implement, customize, and optimize their Salesforce applications. In this episode our guest is Tim Berglund. Tim is a teacher, author, and technology leader with Confluent, where he serves as the Senior Director of Developer Advocacy. We talk about Apache Kafka, Confluent, Salesforce Connector for Kafka, Confluent Cloud, and many other interesting topics. LinkedIn - https://www.linkedin.com/in/tlberglund/ Tim's podcast - Streaming Audio: A Confluent podcast about Apache Kafka‪
2021-04-11
50 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Resurrecting In-Sync Replicas with Automatic Observer Promotion ft. Anna McDonald
As most developers and architects know, data always needs to be accessible no matter what happens outside of the system. This week, Tim Berglund virtually sits down with Anna McDonald (Principal Customer Success Technical Architect, Confluent) to discuss how Automatic Observer Promotion (AOP) can help solve the Apache Kafka® 2.5 datacenter dilemma as a feature now available in Confluent Platform 6.1 and above. Many industries must have a backup plan not only to do the right thing by the data that they collect but because they are regulated by law to do so. Anna has a knack for preparing op...
2021-04-07
24 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Event-Driven Architecture - Common Mistakes and Valuable Lessons ft. Simon Aubury
Event-driven architecture has taken on numerous meanings over the years—from event notification to event-carried state transfer, to event sourcing, and CQRS. Why has event-driven programming become so popular, and why is it such a topic of interest? For the first time, Simon Aubury (Principal Data Engineer, ThoughtWorks) joins Tim Berglund on the Streaming Audio podcast to tell all, including his own experiences adopting event-driven technologies and common blunders when working in this area.Simon admits that he’s made some mistakes and learned some valuable lessons that can benefit others. Among these are accidentally build...
2021-03-17
42 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Integrating Spring Boot with Apache Kafka ft. Viktor Gamov
Viktor Gamov (Developer Advocate, Confluent) joins Tim Berglund on this episode to talk all about Spring and Apache Kafka®. Viktor’s main focus lately has been helping developers build their apps with stream processing, and helping them do this effectively with different languages. Viktor recently hosted an online Spring Boot workshop that turned out to be a lot of fun. This means it was time to get him back on the show to talk about this all-important framework and how it integrates with Kafka and Kafka Streams. Spring Boot enables you to do more with less. Its feat...
2021-02-17
45 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Building a Microservices Architecture with Apache Kafka at Nationwide Building Society ft. Rob Jackson
Nationwide Building Society, a financial institution in the United Kingdom with 137 years of history and over 18,000 employees, relies on Apache Kafka® for their event streaming needs. But how did this come to be? In this episode, Tim Berglund talks with Rob Jackson (Principal Architect, Nationwide) about their Kafka adoption journey as they celebrate two years in production. Nationwide chose to adopt Kafka as a central part of their information architecture in order to integrate microservices. You can't have them share a database that's design-time coupling, and maybe you tried having them call each other synchronously. There's a li...
2021-02-08
48 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Examining Apache Kafka Performance Metrics ft. Alok Nikhil
Coming up with an honest test built on open source tools in an easily documented, replicable environment for a distributed system like Apache Kafka® is not simple. Alok Nikhil (Cloud Native Engineer, Confluent) shares about getting Kafka in the cloud and how best to leverage Confluent Cloud for high performance and scalability. His blog post “Benchmarking Apache Kafka, Apache Pulsar, and RabbitMQ: Which is the Fastest?” discusses how Confluent tested Kafka’s performance on the latest cloud hardware using research-based methods to answer this question. Alok and Tim talk through the vendor-neutral framework OpenMessaging Benchmark used for...
2021-02-01
50 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Distributed Systems Engineering with Apache Kafka ft. Guozhang Wang
Tim Berglund picks the brain of a distributed systems engineer, Guozhang Wang, tech lead in the Streaming department of Confluent. Guozhang explains what compelled him to join the Stream Processing team at Confluent coming from the Apache Kafka® core infrastructure. He reveals what makes the best distributed systems infrastructure engineers tick and how to prepare to take on this kind of role—solving failure scenarios, a satisfying challenge. One challenge in distributed systems is achieving agreements from multiple nodes that are connected in a Kafkacluster, but the connection in practice is asynchronous.Guozhang also shares the n...
2021-01-25
44 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Scaling Developer Productivity with Apache Kafka ft. Mohinish Shaikh
Confluent Cloud and Confluent Platform run efficiently largely because of the dedication of the Developer Productivity (DevProd) team, formerly known as the Tools team. Mohinish Shaikh (Software Engineer, Confluent) talks to Tim Berglund about how his team builds the software tooling and automation for the entire event streaming platform and ensures seamless delivery of several engineering processes across engineering and the rest of the org. With the right tools and the right data, developer productivity can understand the overall effectiveness of a development team and their ability to produce results.The DevProd team helps engineering teams at...
2021-01-20
34 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Event Streaming Trends and Predictions for 2021 ft. Gwen Shapira, Ben Stopford, and Michael Noll
Coming out of a whirlwind year for the event streaming world, Tim Berglund sits down with Gwen Shapira (Engineering Leader, Confluent), Ben Stopford (Senior Director, Office of the CTO, Confluent), and Michael Noll (Principal Technologist, Office of the CTO, Confluent) to take a guess at what 2021 will bring. The experts share what they believe will happen for analytics, frameworks, multi-cloud services, stream processing, and other topics important to the event streaming space. These Apache Kafka® related predictions include the future of the Kafka cluster partitions and removing restrictions that users have found in the past, such as to...
2021-01-06
44 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka 2.7 - Overview of Latest Features, Updates, and KIPs
Apache Kafka® 2.7 is here! Here are the key Kafka Improvement Proposals (KIPs) and updates in this release, presented by Tim Berglund. KIP-497 adds a new inter-broker API to alter in-sync replicas (ISRs). Every partition leader maintains the ISR list or the list of ISRs. KIP-497 is also related to the removal of ZooKeeper.KIP-599 has to do with throttling the rate of creating topics, deleting topics, and creating partitions. This KIP will add a new feature called the controller mutation rate.KIP-612 adds the ability to limit the connection creation rate on brokers, wh...
2020-12-21
10 min
Open Source Archives - Software Engineering Daily
Kafka Applications with Tim Berglund (Repeat)
Originally published September 17, 2019 Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout a company such that multiple systems can consume the messages from a single sender. In previous shows, we have covered design patterns within Kafka, Kafka streams, event sourcing with Kafka, and many other s...
2020-12-16
52 min
Software Engineering Daily
Kafka Applications with Tim Berglund (Repeat)
Originally published September 17, 2019Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering.Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout a company such that multiple systems can consume the messages from a single sender. In previous shows, we have covered design patterns within Kafka, Kafka streams, event sourcing with Kafka, and many other subjects relating t...
2020-12-16
55 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Multi-Tenancy in Apache Kafka ft. Anna Pozvner
Multi-tenancy has been quite the topic within the Apache Kafka® community. Anna Povzner, an engineer on the Confluent team, spends most of her time working on multi-tenancy in Kafka in Confluent Cloud.Anna kicks off the conversation with Tim Berglund (Senior Director of Developer Experience, Confluent) by explaining what multi-tenancy is, why it is worthy to be desired, and advantages over single-tenant architecture. By putting more applications and use cases on the same Kafka cluster instead of having a separate Kafka cluster for each individual application and use case, multi-tenancy helps minimize the costs of physical machines a...
2020-11-23
44 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Distributed Systems Engineering with Apache Kafka ft. Roger Hoover
Roger Hoover, one of the first engineers to work on Confluent Cloud, joins Tim Berglund (Senior Director of Developer Experience, Confluent) to chat about the evolution of Confluent Cloud, all the stages that it’s been through, and the lessons he’s learned on the way. He talks through the days before Confluent Platform was created, and how he contributed to Apache Kafka® to run it on OpenStack (the feature used to separate advertised hostnames from the internal hostnames).The Confluent Cloud control plane is now run in over 40 regions. Under the covers, Roger and his team are m...
2020-11-18
50 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Ask Confluent #18: The Toughest Questions ft. Anna McDonald
It’s the first work-from-home episode of Ask Confluent, where Gwen Shapira (Core Kafka Engineering Leader, Confluent) virtually sits down with Apache Kafka® expert Anna McDonald (Staff Technical Account Manager, Confluent) to answer questions from Twitter. Find out Anna’s favorite Kafka Improvement Proposal (KIP), which will start to use racially neutral terms in the Kafka community and in our code base, as well as answers to the following questions: If you could pick any one KIP from the backlog that hasn't yet been implemented and have it immediately available, which one would you pick?Are we able...
2020-10-22
33 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Joining Forces with Spring Boot, Apache Kafka, and Kotlin ft. Josh Long
Wouldn’t it be awesome if there was a language as elegant as Spring Boot is as a framework? In this episode of Streaming Audio, Tim Berglund talks with Josh Long, Spring developer advocate at VMware about Kotlin, about the productivity-focused language from our friends at JetBrains, and how it works with Spring Boot to make the experience leaner, cleaner, and easy to use.Josh shares how the Spring and Kotlin teams have worked hard to make sure that Kotlin and Spring Boot are a first-class experience for all developers trying to get to production faster and sa...
2020-10-21
50 min
Hedera Hashgraph - Gossip About Gossip Podcast
Low Trust Logging – From Apache Kafka to the Hedera Consensus Service - #66
In this episode of Gossip about Gossip, Hedera's Developer Evangelist Cooper Kunz is joined by Tim Berglund, the Sr. Director of Developer Advocacy at Confluent. Tim’s experience in the technology industry spans decades, from writing firmware to some of the early days at GitHub, currently leading outreach and training at the multibillion-dollar enterprise software company Confluent. At Confluent, they're building an ecosystem around the popular event streaming platform Apache Kafka, which powers everything from Fortnite to the "Big Banks'" backend microservices. Listen to this podcast to hear Tim's thoughts on distributed ledgers, Bitcoin, event streaming architectures, an...
2020-10-08
34 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Using Apache Kafka as the Event-Driven System for 1,500 Microservices at Wix ft. Natan Silnitsky
Did you know that a team of 900 developers at Wix is using Apache Kafka® to maintain 1,500 microservices? Tim Berglund sits down with Natan Silnitsky (Backend Infrastructure Engineer, Wix) to talk all about how Wix benefits from using an event streaming platform. Wix (the website that’s made for building websites) is designing a platform that gives people the freedom to create, manage, and develop their web presence exactly the way they want as they look to move from synchronous to asynchronous messaging. In this episode, Natan and Tim talk through some of the vital lessons learn...
2020-09-21
49 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Top 6 Things to Know About Apache Kafka ft. Gwen Shapira
This year, Confluent turns six! In honor of this milestone, we are taking a very special moment to celebrate with Gwen Shapira by highlighting the top six things everyone should know about Apache Kafka®:Clients have metricsBug fix releases/Kafka Improvement Proposals (KIPs)Idempotent producers and how they workKafka Connect is part of Kafka and Single Message Transforms (SMTs) are worth not missing out onCooperative rebalancing Generating sequence numbers and how Kafka changes the way you thinkListen as Tim and Gwen talk through the importance of Kafka Connect, cooperative rebalancing protocols, and the promise (and warning) th...
2020-09-15
47 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
5 Years of Event Streaming and Counting ft. Gwen Shapira, Ben Stopford, and Michael Noll
With the explosion of real-time data, Apache Kafka and event stream processing (ESP) have grown in proliferation, with event streaming technology becoming the de facto technology transforming businesses across numerous verticals. Gwen Shapira (Engineering Leader, Confluent), Ben Stopford (Senior Director, OCTO, Confluent), and Michael Noll (Principal Technologist, Confluent) meet up to talk all about their last five years at Confluent and the changes they’ve seen in event streaming. They discuss what they were doing with Apache Kafka® before they arrived at Confluent, challenges in event streaming challenges that have arisen, and their favorite use cases. They then talk thr...
2020-08-31
48 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Championing Serverless Eventing at Google Cloud ft. Jay Smith
Jay Smith helps Google Cloud users modernize their applications with serverless eventing. This helps them focus on their code instead of managing infrastructure, as well as ultra-fast deployments and reduced server costs. On today’s show, he discusses the definition of serverless, serverless eventing, data-driven vs. event-driven architecture, sources and sinks, and hybrid cloud with on-prem components. Finally, Jay shares how he sees application architecture changing in the future and where Apache Kafka® fits in.EPISODE LINKSQuine ProgramsGet Started with QwiklabsKubernetes PodcastsJoin the Confluent Community SlackLearn more with Kafka tutorials, resources, and guides at C...
2020-08-26
47 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Disaster Recovery with Multi-Region Clusters in Confluent Platform ft. Anna McDonald and Mitch Henderson
Multi-Region Clusters improve high availability in Apache Kafka®, ensure cluster replication across multiple zones, and help with disaster recovery. Making sure users are successful in every area of their Kafka deployment, be it operations or application development for specific use cases, is what Anna McDonald (Team Lead Customer Success Technical Architect) and Mitch Henderson (Principal Customer Success Technical Architect) are passionate about here at Confluent.In this episode, they share common challenges that users often run into with Multi-Region Clusters, uses cases for them, and what to keep in mind when considering replication. Ann...
2020-08-17
43 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Developer Advocacy (and Kafka Summit) in the Pandemic Era
All Confluent developer advocates...assemble! COVID-19 has changed the face of meetings and events, halting all in-person gatherings and forcing companies to adapt on the fly. In today's episode of Streaming Audio, the developer advocates come together to discuss how their jobs have changed during the worldwide pandemic. Less than a year ago, this group was constantly on the road or in a plane on their way to present something new about Apache Kafka and event streaming, so how has the current climate affected their work? The group talks about Zoom fatigue, online presenting, online conferences/meetups, a...
2020-08-12
41 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka 2.6 - Overview of Latest Features, Updates, and KIPs
Apache Kafka® 2.6 is out! This release includes progress toward removing ZooKeeper dependency, adding client quota APIs to the admin client, and exposing disk read and write metrics, and support for Java 14. In addition, there are improvements to Kafka Connect, such as allowing source connectors to set topic-specific settings for new topics and expanding Connect worker internal topic settings. Kafka 2.6 also augments metrics for Kafka Streams and adds emit-on-change support for Kafka Streams, as well as other updates. EPISODE LINKSWatch the video version of this podcastRead about what's new in Apache Kafka 2.6Join the Con...
2020-08-06
10 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Testing ksqlDB Applications ft. Viktor Gamov
Viktor Gamov (Developer Advocate, Confluent) returns to Streaming Audio to explain the magic of ksqlDB, ideal testing environments for ksqlDB, and the ksqlDB test runner. For those who are just starting to explore the interface, Viktor provides some tips and best practices for what to look out for too. He also talks about the future of ksqlDB, the future of integration testing, and his favorite new feature among recent upgrades.EPISODE LINKSStreaming Audio episodes on ksqlDBWatch #LiveStreams with Viktor Gamov I Don't Always Test My StreamsJoin the Confluent Community SlackLearn more with Kafka tu...
2020-08-03
39 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
From Monolith to Microservices with Sam Newman
Author Sam Newman catches up with Tim Berglund (Senior Director of Developer Advocacy, Confluent) in the virtual studio on what microservices are, how they work, the drawbacks of microservices, what splitting the monolith looks like, and patterns to look for. The pair talk through Sam's book “Monolith to Microservices” chapter by chapter, looking at key components of microservices in more detail. Sam also walks through database decomposition, integrating with new technology, and performing joins in event streaming architecture. Lastly, Sam shares what he’s excited for in the future, which includes “Monolith to Microservices Volume II.”EPISODE L...
2020-06-17
40 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Exploring Event Streaming Use Cases with µKanren ft. Tim Baldridge
Tim Baldridge (Senior Software Engineer, Cisco) joins us on Streaming Audio to talk about event streaming, stream processing use cases, and µKanren. First, Tim shares about his work at Cisco related to intaking viruses, the backend, and finding new ways to process data. Later, Tim talks about interesting bank and airline use cases, as well as his time at Walmart, taking a closer look at specific retail use cases and the product that Walmart used to process data streams. If you’re curious about what µKanren is, how it relates to relational programming, the complex math t...
2020-06-08
51 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Connecting Snowflake and Apache Kafka ft. Isaac Kunen
Isaac Kunen (Senior Product Manager, Snowflake) and Tim Berglund (Senior Director of Developer Advocacy, Confluent) practice social distancing by meeting up in the virtual studio to discuss all things Apache Kafka® and Kafka Connect at Snowflake. Isaac shares what Snowflake is, what it accomplishes, and his experience with developing connectors. The pair discuss the Snowflake Kafka Connector and some of the unique challenges and adaptations it has had to undergo, as well as the interesting history behind the connector. In addition, Isaac talks about how they’re taking on event streaming at Snowflake by implementing the K...
2020-05-20
31 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
AMA with Tim Berglund | Streaming Audio Special
Happy 100th episode of Streaming Audio! Thank you to everyone who has listened, subscribed, left a review, and mostly, for sharing our passion for event streaming. We can't wait for the next 100! To celebrate, Ben Stopford (Senior Director of the Office of the CTO, Confluent) hosts an AMA (ask me anything) with Tim, covering 62 questions in total—from his career, his time at Confluent, Marvel vs. DC, and what he looks for in a new hire, to how to nail your next conference talk. We hope you enjoy this special 100th episode of Streaming Audio: a podcast abo...
2020-05-18
47 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Kubernetes Meets Apache Kafka ft. Kelsey Hightower
Kelsey Hightower was already an advocate, just like all other developers, long before joining Google officially as a developer advocate and Kubernetes expert. Gaining trust in your product, process, and the way you develop code requires the ability to explain those things well. Kelsey reflects on the journey that brought him to where he is today and how Kubernetes has evolved over the years too, including what makes Kubernetes so successful. But Tim is not the only one with questions. Kelsey asks a few of his own: does Apache Kafka® want to be a database? Does Kafka wa...
2020-05-13
42 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka Fundamentals: The Concept of Streams and Tables ft. Michael Noll
If you’ve ever wondered what Apache Kafka® is, what it’s used for, or wanted to learn about Kafka architecture and all its components, buckle up! In today’s episode, Michael Noll (Principal Technologist, Confluent) and Tim Berglund (Senior Director of Developer Advocacy, Confluent) discuss a series of fundamental questions: What is Kafka? What is an event? How do we organize and store events? And what is Kafka Streams? Over the course of this episode, Michael covers an in-depth look into Kafka technology and core concepts: the process of reading from a topic, differences between tables and stre...
2020-05-04
48 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Confluent Platform 5.5 | What's New in This Release + Updates
Confluent Platform 5.5 is out, and Tim Berglund (Senior Director of Developer Advocacy, Confluent) is here to give you the latest updates! The first is improved schema management and Confluent Schema Registry support for Protobuf and JSON, making these components pluggable. The second is better support for languages other than Java within the sphere of librdkafka. And finally, this release includes an upgrade to ksqlDB, which expands its functionality, supports more data types, increases availability for pull queries, and adds a new aggregate function.EPISODE LINKSConfluent Platform 5.5 Release NotesIntroducing Confluent Platform 5.5Watch the video version of...
2020-04-24
11 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka 2.5 – Overview of Latest Features, Updates, and KIPs
Apache Kafka® 2.5 is here, and we’ve got some Kafka Improvement Proposals (KIPs) to discuss! Tim Berglund (Senior Director of Developer Advocacy, Confluent) shares improvements and changes to over 10 KIPs all within the realm of Core Kafka, Kafka Connect, and Kafka Streams, including foundational improvements to exactly once semantics, the ability to track a connector’s active topics, and adding a new co-group operator to the Streams DSL.EPISODE LINKSCheck out the Apache Kafka 2.5 release notesRead about what’s new in Apache Kafka 2.5Watch the video version of this podcastJoin the Confluent Community SlackLearn about Kafka a...
2020-04-16
10 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Explore, Expand, and Extract with 3X Thinking ft. Kent Beck
As a programmer, Kent Beck chats about various topics of broad interest to developers, including some of his books: “Extreme Programming Explained: Embrace Change,” “Test-Driven Development: By Example,” and “Implementation Patterns.” He wrote “Implementation Patterns” to highlight the positive habits a developer should form in order to write accessible code. He also shares about what it’s like to experiment with new ideas and implement them, especially when others doubt what you're trying to achieve. This relates to the concept behind the explore-to-expand transition and a short piece he wrote titled "Idea to Impact." Finally, Tim and Kent talk through t...
2020-03-25
54 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Ask Confluent #17: The “What is Apache Kafka?” Episode ft. Tim Berglund
Ask Confluent is back! From questions on Apache Kafka®, data integration, and log aggregation, to potential interview questions that Tim would ask if he were to interview himself, anything goes. If you're already a Kafka expert (or any type of expert), think about becoming a speaker. Gwen and Tim talk through how to submit a proposal and get accepted to conferences. As experienced conference goers, they explain that what makes a successful talk is making sure you present for the attendee instead of making it about yourself. In essence, what can your idea or code do to he...
2020-03-24
25 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Distributed Systems Engineering with Apache Kafka ft. Gwen Shapira
As an engineering leader managing a team, Gwen Shapira talks through the steps she took to get to Confluent and how she got started working with Apache Kafka®. She shares about what it's like being on the Project Management Committee (PMC) for the Apache Software Foundation as well as some of the responsibilities involved, such as choosing Kafka Improvement Proposals (KIPs), monitoring releases, and making contributions to the community. For Gwen, part of finding Kafka was her willingness to take risks, learn all types of code bases, and leave companies for a new technology that showed promise an...
2020-03-04
48 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
How to Write a Successful Conference Abstract | Streaming Audio Special
Learn how to write an abstract for conference submissions and call for papers with tips from Tim Berglund, chair of the Kafka Summit Program Committee. Whether you're giving a talk for the very first time or you consider yourself to be an experienced speaker, these guidelines will help you craft a strong story that stands out from the others.EPISODE LINKSJoin #summit-office-hours on the Confluent Community SlackSign up to speak at a meetupWatch the video version of this podcastGet 30% off Kafka Summit London registration with the code KSL20AudioSEASON 2
2020-02-04
07 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Cloud-Native Patterns with Cornelia Davis
Developing cloud-based applications requires unique patterns and practices that make them suitable for modern cloud platforms. Host Tim Berglund catches up with Cornelia Davis, author of Cloud-Native Patterns and VP of Technology at Pivotal, on what cloud-native patterns are, the example code she created, her latest book, and how she wrote the book for the customers she interacts with on a daily basis. EPISODE LINKSGet 40% off Cloud Native Patterns with the code podcon19Join the Confluent Community SlackFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Ti...
2019-12-16
53 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Real-Time Payments with Clojure and Apache Kafka ft. Bobby Calderwood
Streamlining banking technology to help smaller banks and credit unions thrive among financial giants is top of mind for Bobby Calderwood (Founder, Evident Systems), who started out in programming, transitioned to banking, and recently launched Evident Real-Time Payments. Payments leverages Confluent Cloud to help banks of all sizes transform to real-time banking services from traditionally batch-oriented, bankers’ hours operational mode. This is achieved through Apache Kafka® and the Kafka Streams and Kafka Connect APIs with Clojure using functional programming paradigms like transducers. Bobby also shares about his efforts to help financial services companies build their next...
2019-11-27
58 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka on Kubernetes, Microsoft Azure, and ZooKeeper with Lena Hall
Lena Hall joins Tim Berglund in the studio to talk about Apache Kafka®, the various ways to run Kafka on Microsoft Azure, Kafka on Kubernetes (K8s), and some exciting events that are happening in the Kafka world. Lena shares about serving double duty as both a senior software engineer and senior cloud developer advocate for Azure Engineering, including her unique roles and responsibilities, and how she balances engineering with advocacy. From writing tech articles to her experience with fuzzing and presence on YouTube, Lena is a strong community supporter and believes in the importance of staying ro...
2019-10-16
46 min
AllThingsNew.Tech Podcast
I Stream, Therefore I Am?
 We're excited to share this conversation with Tim Berglund, Director of Developer Relations at Confluent. Confluent has developed technology that processes data as event streams in real-time. In this episode, ATN host Paul Taylor and Tim explore how this revolutionary data paradigm affects our identity, both online and offline. Do we actually exist, or does stuff just happen to shape our existence? How do data change the way we perceive ourselves or want others to perceive us? If we don't have data recorded, does that mean we actually did anything? Listen in for these thought-provoking questions and m...
2019-10-15
49 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
MySQL, Cassandra, BigQuery, and Streaming Analytics with Joy Gao
Joy Gao chats with Tim Berglund about all things related to streaming ETL—how it works, its benefits, and the implementation and operational challenges involved. She describes the streaming ETL architecture at WePay from MySQL/Cassandra to BigQuery using Apache Kafka®, Kafka Connect, and Debezium.  EPISODE LINKSCassandra Source Connector DocumentationStreaming Databases in Real Time with MySQL, Debezium, and KafkaStreaming Cassandra at WePayChange Data Capture with Debezium ft. Gunnar MorlingJoin the Confluent Community SlackFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov P...
2019-10-02
43 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
KIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason Gustafson
Tim Berglund sits down with Colin McCabe and Jason Gustafson to talk about KIP-500. The pair, who work on the Kafka Core Engineering Team, discuss the history of Kafka, the creation of KIP-500, and what it will do for the community as a whole. They break down ZooKeeper's role in Kafka, the implications of removing ZooKeeper dependency, replacing it with a self-managed metadata quorum, and how they've been combatting security, stability, and compatibility issues. With pending improvements towards scalability and inter-broker communication, and now that KIP-500 has been adopted within the community—there's a lot covered in this episode th...
2019-09-18
43 min
Software Engineering Daily
Kafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily.
2019-09-17
59 min
Open Source Archives - Software Engineering Daily
Kafka Applications with Tim Berglund
Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout a company such that multiple systems can consume the messages from a single sender. In previous shows, we have covered design patterns within Kafka, Kafka streams, event sourcing with Kafka, and many other subjects relating to the technology. K...
2019-09-17
52 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Connecting to Apache Kafka with Neo4j
What’s a graph? How does Cypher work? In today's episode of Streaming Audio, Tim Berglund sits down with Michael Hunger (Lead of Neo4j Labs) and David Allen (Partner Solution Architect, Neo4j) to discuss Neo4j basics and get the scoop on major features introduced in Neo4j 3.4 and 3.5. Among these are geospatial and temporal types, but there’s also more to come in 4.0: a multi-database feature, fine-grained security, and reactive drivers/Spring Data Neo4j RX. In addition to sharing a little bit about the history of the integration and features in relation to Apach...
2019-09-09
54 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Helping Healthcare with Apache Kafka and KSQL ft. Ramesh Sringeri
In today’s episode of Streaming Audio, Tim Berglund sits down with Senior Applications Developer of Mobile Solutions Ramesh Sringeri to discuss Apache Kafka®—specifically two Kafka use cases that Children’s Healthcare of Atlanta is working on.First, they discuss achieving near-real-time streams of data to support meaningful intracranial pressure prediction and managing intracranial pressure (ICP) in a timely manner to help the care team achieve better outcomes with traumatic brain injuries.Children’s Healthcare of Atlanta is in the process of building machine learning models for predicting ICP values 30 and 60 minutes in the future. T...
2019-08-28
52 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Contributing to Open Source with the Kafka Connect MongoDB Sink ft. Hans-Peter Grahsl
Sink and source connectors are important for getting data in and out of Apache Kafka®. Tim Berglund invites Hans-Peter Grahsl (Technical Trainer and Software Engineer, Netconomy Software & Consulting GmbH) to share about his involvement in the Apache Kafka project, spanning from several conference contributions all the way to his open source community sink connector for MongoDB, now part of the official MongoDB Kafka connector code base. Join us in this episode to learn what it’s like to be the only maintainer of a side project that’s been deployed into production by several companies!EPISOD...
2019-08-21
50 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Connecting Apache Cassandra to Apache Kafka with Jeff Carpenter from DataStax
Whenever you see an Apache Cassandra™ in the wild, you probably also see an Apache Kafka®️. In this episode, Tim Berglund (Senior Director of Developer Experience, Confluent) and Jeff Carpenter (Director of Developer Advocacy, DataStax) discuss the best way to get those systems talking using the DataStax Apache Kafka Connector and build a real-time data pipeline. EPISODE LINKSAbout the DataStax Apache Kafka ConnectorDataStax Academy: DataStax Apache Kafka Connector CourseJoin the Confluent Community SlackSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Galla...
2019-08-12
47 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Apache Kafka 2.3 | What's New in This Release + Updates and KIPs
Tim Berglund (Senior Director of Developer Experience, Confluent) explains what’s new in Apache Kafka® 2.3 and highlights some of the most important Kafka Improvement Proposals (KIPs).EPISODE LINKSRead the blogWatch the video version of this podcastSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please lea...
2019-06-25
13 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Why Kafka Connect? ft. Robin Moffatt
In this episode, Tim talks to Robin Moffatt about what Kafka Connect is and why you should almost certainly use it if you're working with Apache Kafka®️. Whether you're building database offload pipelines to Amazon S3, ingesting events from external datastores to drive your applications or exposing messages from your microservices for audit and analysis, Kafka Connect is for you. Tim and Robin cover the motivating factors for Kafka Connect, why people end up reinventing the wheel when they're not aware of it and Kafka Connect's capabilities, including scalability and resilience. They also talk about the importance of s...
2019-06-12
46 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Schema Registry Made Simple by Confluent Cloud ft. Magesh Nandakumar
Tim Berglund and Magesh Nandakumar (Software Engineer, Confluent) discuss why schemas matter for building systems on Apache Kafka®, and how Confluent Schema Registry helps with the problem. They talk about how Schema Registry works, how you can collaborate around schema change through `avsc` files, and what it means for this to be available in Confluent Cloud today.EPISODE LINKSSchema Registry 101Schema ManagementMigrate Schemas to Confluent CloudSchemas, Contracts, and CompatibilityFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced a...
2019-06-03
41 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Why is Stream Processing Hard? ft. Michael Drogalis
Tim Berglund and Michael Drogalis (Product Lead for Kafka Streams and KSQL, Confluent) talk about all things stream processing: why it’s complex, how it's evolved, and what’s on the horizon to make it simpler.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please leave us a rating. 🎧 C...
2019-05-29
45 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Testing Kafka Streams Applications with Viktor Gamov
Tim Berglund is joined by Viktor Gamov (Developer Advocate, Confluent) to discuss various approaches to testing Kafka Streams applications.EPISODE LINKSKafkaEmbeddedTopologyTestDriverMocked Streams (Scala)MockafkaTest containersKafka containers SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please leave us a rating. 🎧 Confluent also has a podcast for tech...
2019-05-20
42 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Ben Stopford on Microservices and Event Streaming
Microservices are pretty ubiquitous these days. Really “SOA done right,” they reimagine the services pattern in the context of the world we live in today, nearly two decades since the first big service-oriented systems hit production. But what have we learned in this time? There are plenty of war stories. System designers have explored different architectural patterns—REST, events and databases of all types. In this podcast, Tim Berglund and Ben Stopford explore the event-driven paradigm and how it relates to the microservice architectures we build today. Ben dives deep into coupling, evolution and challenges of our increas...
2019-04-08
58 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Containerized Apache Kafka On Kubernetes with Viktor Gamov
Kubernetes provides all the building blocks needed to run stateful workloads, but creating a truly enterprise-grade Apache Kafka® platform that can be used in production is not always intuitive. In this episode, Tim Berglund and Viktor Gamov address some of the challenges and pitfalls of managing Kafka on Kubernetes at scale. They also share lessons learned from the development of the Confluent Operator for Kubernetes, and answer questions like:-What is Kubernetes?-What are stateful workloads?-Why are they hard?-Will Confluent Operator make it easier?EPISODE LINKSJoin the #kubernetes Slack c...
2019-03-11
41 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Splitting and Routing Events with KSQL ft. Pascal Vantrepote
Tim Berglund chats with System Engineer Pascal Vantrepote about a KSQL recipe he created based on a real-life customer use case in the financial services industry. They also discuss the advantages of KSQL, such as its expressiveness and ease of deployment in places where you’re not already writing a Java application.EPISODE LINKSAbout KSQL Stream Processing CookbookKSQL Recipe: Data Routing Joined with a KTableFor more, you can check out ksqlDB, the successor to KSQL.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Pro...
2019-02-25
20 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Using Terraform and Confluent Cloud with Ricardo Ferreira
Tim Berglund hosts Developer Advocate Ricardo Ferreira to discuss the concept of infrastructure as code, as well as the differences between Terraform, Ansible, Puppet and Chef. They also chat about why Terraform is such a big deal, some of the challenges involved with learning it and how Confluent leverages Terraform to achieve multi-cloud support for Confluent Cloud and tools for Confluent Platform.EPISODE LINKSTerraformTools for Confluent Cloud ClustersFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by...
2019-01-23
28 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Kafka Streams in Action with Bill Bejeck
Tim Berglund interviews Bill Bejeck about the Kafka Streams API and his new book, Kafka Streams in Action. SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes. 👍 If you enjoyed this, please leave us a rating. 🎧 Confluent also has a podcast for tech leaders: "Life Is But A Stream" hosted by our friend, Josep
2018-09-27
49 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Joins in KSQL 5.0 with Hojjat Jafarpour
KSQL 5.0 now supports stream-stream, stream-table and table-table joins. Tim Berglund interviews Hojjat Jafarpour about all three join types, how they work, what their limitations are and the new kinds of operations they unlock.For more, you can check out ksqlDB, the successor to KSQL.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to podcasts. ▶️ Subscribe on YouTube, and hit the 🔔 to catch n...
2018-09-20
29 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Ask Confluent #5: Kafka, KSQL and Viktor Gamov
Gwen is joined in studio by co-host Tim Berglund and special guest, Viktor Gamov, a new member of Confluent’s Developer Experience Team specializing in Kafka, KSQL and Kubernetes. In this episode, we’ll find out: Does Viktor know what he’s talking about?EPISODE LINKSWatch the video version of this podcastSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to...
2018-09-10
31 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Nested Data in KSQL with Hojjat Jafarpour
Interesting data isn't a polite little list of scalar types. Sometimes you have more complex structures and things like nesting. We'll see how KSQL supports that today as Tim Berglund discusses nested data in KSQL with Hojjat Jafarpour, a software engineer on the KSQL team at Confluent. EPISODE LINKSKSQL demos and infoKSQL GitHub KSQL Slack (#ksql channel) For more, you can check out ksqlDB, the successor to KSQL.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Moh...
2018-08-29
13 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Ask Confluent #3: Kafka Upgrades, Cloud APIs and Data Durability
Tim Berglund and Gwen Shapira have a discussion with Koelli Mungee (Customer Operations Lead, Confluent) and cover the latest Apache Kafka upgrades, cloud APIs, and data durability. This is episode #3 of "Ask Confluent," a segment in which Gwen Shapira and guests respond to a handful of questions and comments from Twitter, YouTube, and elsewhere.EPISODE LINKSWatch the video version of this podcastFully managed Apache Kafka as a service! Try free.SEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie...
2018-07-20
22 min
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Ask Confluent #1: Kubernetes, Confluent Operator, Kafka and KSQL
Tim Berglund and Gwen Shapira discuss Kubernetes, Confluent Operator, Kafka, KSQL, and more. This is the first episode of "Ask Confluent," a segment in which Gwen Shapira and guests respond to a handful of questions and comments from Twitter, YouTube and elsewhere.EPISODE LINKSWatch the video version of this podcastSEASON 2 Hosted by Tim Berglund, Adi Polak and Viktor Gamov Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed Music by Coastal Kites Artwork by Phil Vo 🎧 Subscribe to Confluent Developer wherever you listen to pod...
2018-06-20
22 min