Shows
Software Engineering DailyA Different Monitoring Philosophy with Costa TsaousisObservability is becoming an increasingly competitive space in the software world. Many developers have heard of Datadog and New Relic, but there are a seemingly countless number of observability products out there.Costa Tsaousis (he/him) is the Founder and CEO of Netdata. His goal was to build an open-source platform that was high-resolution, real-time, and easily scalable. Netdata is the result. It's relatively new to the crowded observability space, but it’s grown into a major presence. Costa joins the show to talk about the design philosophy of Netdata, and how it inverts a common observability de...2023-10-2648 minSoftware Engineering DailyObservability with Eduardo SilvaThere are hundreds of observability companies out there, and many ways to think about observability, such as application performance monitoring, server monitoring, and tracing. In a production application, multiple tools are often needed to get proper visibility on the application. This creates some challenges. Applications can produce lots of different observatory observability data, but how should the data be routed to the various downstream tools? In addition, how can data be selectively sent to different storage tiers to minimize costs?Calyptia is a service that helps manage observability data from source to destination. Eduardo Silva is the...2023-10-1246 minSoftware Engineering DailyUsing AI to supercharge DevX with Deepak Singh of AWSDeveloper experience, or DevX, is a critical aspect of modern software development that focuses on creating a seamless and productive environment for developers. It encompasses everything from the tools and technologies used in the development process to the documentation, libraries, and frameworks available to streamline coding tasks. An emphasis on DevX can enhance individual developer productivity and, as a consequence, boost the overall success and innovation of software projects.Amazon Web Services recently created the Next Gen DevX Division. This new division is using generative AI and foundation models to reimagine the experience of all builders on...2023-09-2651 minSoftware Engineering DailyCatching up with technologist Charlie GerardCharlie Gerard is a highly accomplished software engineer and technologist. She's worked at Stripe, Netlify, and Atlassian and authored the book, Practical Machine Learning in JavaScript. In her spare time, Charlie explores the field of human-computer interaction and builds interactive prototypes using hardware and machine learning. Some of her recent projects include building a DIY aircraft radar system, and creating a gesture-based computer interface using Bluetooth earbuds and machine learning. Charlie joins the podcast today to talk about her work and latest interests. Check the show notes for more about Charlie.Sponsorship inquiries: s...2023-09-1943 minSoftware Engineering DailyBlameless with Ken GavranovicIncident management is the process of responding to unplanned events or service interruptions, and then restoring service to an operational state. Having robust incident management is vital to many software teams. Blameless is a framework designed to help software companies manage their production incidents effectively. It provides a workflow for managing the incident response as well as the post-incident retrospective process. In this way, Blameless aims to give a unified learning and process feedback framework that focuses on actionable insights. Ken Gavranovic is the Chief Operating Officer at Blameless and he's our guest today.Sponsorship i...2023-09-1430 minSoftware Engineering DailyThe Latest on RedwoodJS with Tom Preston-WernerTom Preston-Werner is a renowned software developer, inventor and entrepreneur. He co-founded GitHub and is the creator of the avatar service Gravatar, the TOML configuration file format, and the static site generator software Jekyll. Tom is currently working on the full-stack web framework, RedwoodJS. He joins us today to tell us the latest about RedwoodJS, including its new support for server-side rendering. Check out the show notes for a link to the RedwoodJS conference.Sponsorship inquiries: sponsor@softwareengineeringdaily.comWork OS: To learn more and get started, go to https://softwareengineeringdaily.com...2023-08-221h 06Software Engineering DailyEngineering Insights with Christina ForneyAs Companies scale and their codebase becomes large, it can become difficult to measure team effectiveness. With so many moving pieces, and an increased lack of visibility, Engineering Leaders mostly rely on gut feelings to guide decisions and determine impact.Uplevel pulls meta-data from programs like Git, Slack, Jira and public calendar events and uses machine learning and organizational science to generate actionable insights. With Uplevel Engineering teams can increase velocity, decrease burnout and plan and execute more predictable releases.Christina Forney is the VP of Product at Uplevel and she joins us in this...2023-07-1339 minSoftware Engineering DailyShipping Oxide with Bryan CantrillHyperscalers refer to expansive cloud service providers capable of delivering enterprise-scale computing and storage services. Companies like Google, Amazon, Facebook that have huge data centers and are either running their own software or renting out this infrastructure can be called Hyperscalers. These Hyperscalers realized a long time back that the traditional Network, Storage & Compute server racks were not enough to fulfill the requirements of a modern enterprise at scale. So they built custom solutions for their data center requirements.For all of the other companies and organizations that have their own data centers, they are still running...2023-07-0759 minSoftware Engineering DailyTrusted Software Supply Chain with Vincent DanenAvailable as a cloud service, Red Hat Trusted Software Supply Chain provides a DevSecOps framework to create applications more securely. Vincent Danen is the VP of Product Security at Red Hat and he joins us in this episode.Red Hat has been a secure open source software provider for a long time. We discuss how the Red Hat Trusted Software Supply Chain product allows enterprises to adopt DevSecOps practices successfully, safely, consume open source code and third-party dependencies and build security into the software development lifecycle.Sponsorship inquiries: sponsor@softwareengineeringdaily.com...2023-07-0544 minSoftware Engineering DailySuperfast JVM Startup with Gerrit GrunwaldCRaC (Coordinated Restore at Checkpoint) is a new technology that can improve startup and warmup times by orders of magnitude. It is a project of OpenJDK that was proposed and led by Azul. The CRaC Project defines public Java APIs that allow for the coordination of resources during checkpoint and restore operations. With CRaC, a checkpoint can be set at any point where an application can be safely paused. Azul is releasing a reference implementation of CRaC in JDK 17 with the Azul Zulu Build of OpenJDK for x86 64-bit Linux update. CRaC allows for an "instant" start at any...2023-06-2652 minSoftware Engineering DailyModern Robotics Platform with Eliot HorowitzProgramming robotics software has traditionally been a specialized field. The software industry has seen rapid progress, the operating system that provides the foundation for our software applications is taken care of by companies like Google, Microsoft, and other players like Canonical, Amazon, etc. The robotics industry still needs that OS layer that handles the complexities so that engineers can build robots that serve their business needs. VIAM aspires to be the Operating System for robotics that makes it easy to turn great ideas into production robots.Eliot Horowitz is the Founder and CEO of VIAM and he...2023-06-0639 minSoftware Engineering DailyObservability for Your Cloud Dependencies with Jeff MartensMetrist is an observability platform designed to commoditize application observability. Jeff Martens is the CEO of Metrist, and he joins us today.Sponsorship inquiries: sponsor@softwareengineeringdaily.comBloomberg: Learn more about the opportunities that await you by visiting https://Bloomberg.com/careersWork OS: To learn more and get started, go to https://softwareengineeringdaily.com/workosHightouch: Get started today with a free trial at https://Hightouch.com/sedaily Learn more about your ad choices. Visit megaphone.fm/adchoices2023-05-3037 minSoftware Engineering DailyStartup Investing with Ashmeet SidanaSilicon Valley has many investors and Venture Capital firms, but most are not trying to solve hard technical problems. Engineering Capital partners with companies that are taking a technical risk. These are the companies who have some innovation where there is a doubt on whether it can even be built. Ideally, the market for this innovation exists, but nobody has bothered to build it yet, or nobody has been able to build it yet.In this episode, We sat down with Ashmeet Sidana, Founder and Chief Engineer of Engineering Capital.Sponsorship inquiries...2022-12-2256 minSoftware Engineering DailyThe Enterprise Data Catalog with Ole Olesen-BagneuxWe do it every day. We search on the internet for some information. Many ask, why is that easy? And yet doing the same thing at my company is hard sometimes, not even possible. And when you do get the data, it's unclear where it's from or the degree you can trust it or use it. In a highly regulated firm, there's even more pressure to select the best approved version of the information.Enter the data catalog. Enterprise Data Catalogs are essential for searching for data in an organization. Moreover, their creation, maintenance, and design tap...2022-12-141h 13Software Engineering DailyMinimizing PII in Dev Environments with John CraftData anonymisation is an ever more important problem with many pitfalls, and the legal context requires more and more companies to find a solution to it.In this episode, we talk to John Craft from Privacy Dynamics, who offer data anonymisation as a service.Privacy Dynamics is powering a world where ethics, data insights and personalized technology can all co-exist to support business growth and customer privacy simultaneously.John talks about the different use-cases, technologies, requirements, and challenges he and his team faced throughout Privacy Dynamics' journey so far, and what might be...2022-12-1257 minSoftware Engineering DailyFinancial Data Aggregation for SMB with Jason Dryhurst-SmithFintechs and traditional finance firms want to help their small business customers replace disorganized competing manual processes and multiple data sources with a single unified set of services and data. They could do that. They could more easily offer quicker decisions, better customer experience, and even get more first time customers founded in 2017.Codat wants to be that universal API that can connect financial firms to the platforms their small business customers use. Codat seeks to create a single flow and view for the bus. Small businesses, many accounting, banking, and commerce systems. That goal requires specialized...2022-12-091h 05Software Engineering DailyOpenSSL Vulnerability with Ilkka TurunenOpenSSL is a free, open-source cryptographic library that provides secure communications over computer networks. It is widely used to implement the secure socket layer (SSL) and transport layer security (TLS) protocols, which are the basis for secure, encrypted connections on the internet.On Oct 25th, the OpenSSL project informed its users of a critical vulnerability that affects the 3.0 and later versions of the OpenSSL component. In this episode we sat down with Ilkka Turunen, Ilkka is Sonatype’s Field CTO, we discussed a wide range of topics including Shodan, SBOMs, Software Supply Chain and others.Sp...2022-12-0753 minSoftware Engineering DailySpecial Episode with George HotzComma is a startup aimed at solving self-driving cars. A lot of the new cars in the market have built-in stock Advanced driver assistance systems. Comma takes this system to the next level with Openpilot. Openpilot is an open-source driver assistance system. Currently, with features like Adaptive Cruise Control (ACC), Automated Lane Centering (ALC), Forward Collision Warning (FCW), and Lane Departure Warning (LDW), openpilot is one of the most state-of-the-art solutions in the self-driving space. The Comma Three device is designed to live in your car, and purpose built to run openpilot.In this episode we speak...2022-12-061h 01Software Engineering DailyModernizing the Monolith with Moti Rafalin and Amir RapsonJava Applications became the go-to preference of most developers because of the write-once-run-anywhere advantage it gave over other languages. And it didn't take much time for Java to become the language for the enterprise. Consequently, most enterprises are still running legacy Java Monoliths on their infrastructure.Breaking up a monolith is not an easy process–nor is it something that every company should do just because they have a monolith. In some cases, a monolith is just fine. But sometimes, you do need to decompose a monolith as the complexity of the monolith grows and leads to lo...2022-11-2954 minSoftware Engineering DailyCloud-native WebAssembly with Matt ButcherWhen Web Assembly was created it was supposed to be a compile target, where you could compile your favorite programming language and then execute it inside of a web browser. This made it possible for developers to choose a programming language like C++ for compute intensive applications. Fermyon is taking Web Assembly to the cloud. With Fermyon Cloud deploying and managing cloud-native WebAssembly applications becomes a breeze. Matt Butcher is the CEO at Fermyon Technologies and he joins us today.Sponsorship inquiries: sponsor@softwareengineeringdaily.comPrivacy Dynamics: Sign up for a free...2022-11-261h 02Software Engineering DailyVMware Tanzu with Betty JunodIf you are a company with a large pool of physical servers, and compute resources sitting in the data center, and you want to use them efficiently, one way to do that would be to virtualize them. Then you can use those smaller virtual compute resources to run whatever workloads you need. VMware is a company that's known for virtualization. It's also the creator of Software Defined Data Center. In 2019, VMware acquired Heptio, this acquisition gave VMware the know-how to go full-scale on Kubernetes. Joe Beda and Craig McLuckie, one of the original creators of Kubernetes working at Heptio...2022-11-2037 minSoftware Engineering DailySecure Workflows on Sensitive Data with Amruta MoktaliWith an increasing number of data breaches impacting customer trust, prioritizing data privacy and security is more important than ever. However, as you layer on security and privacy, the overall complexity of a system grows and the data gets harder to use. There’s a constant push and pull between securing and locking down the data but still being able to use it.Skyflow Data Privacy Vault isolates, secures, stores, and tightly controls access to manage and use sensitive data. With secure workflow support, developers are able to securely execute custom code, de-identity and transform data, and se...2022-11-1656 minSoftware Engineering DailyCollaborative Notebooks for DevOps and SRE with Micha HernandezThe complexity of the software infrastructure has been increasing as companies have migrated towards kubernetes, containers, microservices and other distributed systems. However the tools around observability and monitoring have not seen much improvement. These tools are usually managed by teams distributed across different locations and time zones, which results in siloing of knowledge of your infrastructure across individuals.Reasoning about downtime involves bringing together all the pieces. While the teams can communicate through slack, screenshots and google docs, this has been still far from the kind of collaboration tools that other teams have enjoyed for example Figma...2022-11-1543 minSoftware Engineering DailyAccessing Data at Scale with Justin BorgmanThe Presto/Trino project makes distributed querying easier across a variety of data sources. As the need for machine learning and other high volume data applications has increased, the need for support, tooling, and cloud infrastructure for Presto/Trino has increased with it.Starburst helps your teams run fast queries on any data source. With Starburst you get a single point of access to your data, no matter where it's stored and it supports high concurrency. Whether it's fast SQL queries on your data lake or faster queries across multiple datasets, Starburst helps your teams run analytics...2022-11-1151 minSoftware Engineering DailyBuilding on the Data Cloud with Torsten GrabsBuilding and managing data-intensive applications has traditionally been costly and complex, and has placed an operational burden on developers to maintain as their organization scales. Todays’ developers, data scientists, and data engineers need a streamlined, single cloud data platform for building applications, pipelines, and machine learning models — without having to move or copy their data. Platforms like the Snowflake Data Cloud provides a unified tool for developers to easily build data applications with Python using Streamlit’s open source framework and Snowflake’s Native Application Framework, gain a streamlined architecture that natively supports users’ programming languages of choice including Java, Scal...2022-11-0745 minSoftware Engineering DailyCloud Asset Management with Serhat CanCompanies are rapidly moving to the cloud, and modern businesses are operating faster with a myriad of SaaS tools in their day-to-day operations. Provisioning resources has been easier than ever. WIth a few clicks you can spin up resources in any part of the world. While we all love the cloud because of the scalability it offers, assets can quickly pile up with every user, bucket, repository and resource. Keeping resources secure and compliant grows in complexity with every cloud service and SaaS application utilized.Resmo is a continuous cloud and SaaS asset visibility, security and compliance...2022-11-0344 minSoftware Engineering DailyThe Cyber Frontier with Mikko HypponenMikko Hypponen is the CRO of WithSecure and a principal research Officer at F-Secure. In this interview with our host, Jordi Monn, he discusses the eventful and rocky early start of his software engineering career, hybrid warfare, reverse engineering, recent exploits like Log for Shell and heart bleed and more.This episode is packed with valuable career and life lessons on dealing with the unexpected. As well as fascinating stories from the frontiers of cyber security and geopolitics, many of which are discussed in more depth in Mikko's recent book. If it's smart, it's vulnerable....2022-11-0144 minSoftware Engineering DailyTao of React with Alex KondovReact is the most widely used front-end framework. It pioneered the component model and influenced the software design of all modern web applications. React is not an opinionated tool, allowing engineers to shape their applications in a way that fits the problems at hand. However, this freedom of expression can be very confusing to newcomers. Alex Kondov is a principal engineer who has worked with React ever since its inception. In his book, Tao of React, he shares a collection of fundamental architectural principles that aim to help front-end engineers build better web applications.Sponsorship inquiries: sponsor@s...2022-10-2642 minSoftware Engineering DailyModern Application Observability with Berkay MollamustafaogluObservability is a critical aspect of modern digital applications. You can't operate an application at scale that satisfies your customer needs without understanding how the application is currently performing, whether it's understanding the current operating needs of the application, adjusting resource usage, detecting issues before they become serious or solving an ongoing technical issue as it's going on.Thundra is a performance monitoring company that specializes in application, performance monitoring, infrastructure monitoring, and most notably serverless monitoring. Berkay Mollamustafaoglu is the CEO of Thundra and he's our guest.AZUL:Say goodbye to...2022-10-2048 minSoftware Engineering DailyThe Quantum Leap with Dmitri MaslovThe classical computing power has doubled every two years - a pattern known as Moore’s law. However, the ability to fabricate more and more transistors in a computer chip is approaching saturation as we are approaching atomic dimensions. Quantum Computing is a promising technology to take us beyond this. A quantum Computer uses qubits to run multi-dimensional quantum algorithms. Quantum Computers are faster and can solve problems that are beyond the reach of even the most powerful classical supercomputers.Dmitri Maslov is the Chief Software Architect at IBM’s Quantum Computing Division. He joins the show to di...2022-10-1855 minSoftware Engineering DailyAzul with John CeccarelliThe Java Virtual Machine is an abstract machine that makes it possible for you to write Java code once and run it across multiple devices and operating system types. While you can use the OpenJDK it comes with various issues like Security Vulnerabilities and compliance.Azul is a company that specializes in Java for the enterprise. It has the largest Java engineering team after Oracle. John Ceccarelli is the Senior Director of Product Management at Azul Systems responsible for Azul Platform Prime which is their hyper optimized build of OpenJDK.He joins the show to discuss Azul's...2022-10-1536 minSoftware Engineering DailyOpen Source Authentication with Advait Ruia and Rishabh PoddarPasswordless Authentication is a technique in which users are given access to an environment without entering a password or answering a security question. This allows users to access an environment securely and protects organizations against attack vectors like Keylogging, Brute force methods, and phishing. The company SuperTokens provides secure login and session management for your apps in an open-core model.In this episode, we interviewed Advait Ruia and Rishabh Poddar from SuperTokens. We discussed Open source authentication, security considerations for Authentication, recipes for Authentication, and the future of passwords.Sponsorship inquiries: sponsor@softwareengineeringdaily.com2022-10-1343 minSoftware Engineering DailyTwisp: Reinventing the Ledger with Jarred WardMonolithic relational databases are the traditional foundation of financial core ledger systems. Nevertheless, the process of building and operating mission-critical ledgers to track and reconcile payments and money movement is complex. Twisp is rethinking core accounting and financial orchestration on a cloud-native ledger system, so developers can stop re-invented the ledger and focus on building products their customer’s love. When you provision an instance of the Twisp accounting core, you get a transactions ledger for double-entry accounting, a chart of accounts to represent any economic activity, and layered balances for tracking settled, pending, and plann...2022-10-0743 minSoftware Engineering DailyOpen-source Serverless Postgres with Nikita ShamgunovPostgreSQL is a free and open-source relational database management system. Postgres-based databases are widespread and are used by a variety of organizations, from Reddit to the International Space Station, and Postgres databases are a common offering from cloud providers such as AWS, Alibaba Cloud, and Heroku.Neon is a serverless open-source alternative to AWS Aurora Postgres. It separates storage and compute and substitutes the PostgreSQL storage layer by redistributing data across a cluster of nodes.Today, we spoke with Nikita Shamgunov of Neon. We discuss how Neon scales Postgres, how it saves cost and the...2022-10-0552 minSoftware Engineering DailyEdge Impulse with Daniel SitunayakeToday, we spoke with Daniel Situnayake of Edge Impulse. We discussed AI, machine learning, edge devices, TinyML and AI tool chain.Sponsorship inquiries: sponsor@softwareengineeringdaily.comMerge: check out Merge today at https://www.merge.dev/dailyApple Card: https://www.apple.com/apple-card/Keeper Security: Get started by visiting https://www.keepersecurity.com/Wix: Head over to https://Wix.com/Partners and reimagine what your agency can accomplish.Work OS: To learn more and get started, go to https://softwareengineeringdaily.c...2022-09-3054 minSoftware Engineering DailyCodeanywhere with Toma Pujlak and Vedran JukicToday, we spoke with Toma Pujlak and Vedran Jukic of Codeanywhere. We discussed Cloud-based dev environments, Cloud-based IDEs, Infrastructure as code, Dev containers and Live collaboration.Sponsorship inquiries: sponsor@softwareengineeringdaily.comApple Card: https://www.apple.com/apple-card/Work OS: To learn more and get started, go to https://softwareengineeringdaily.com/workosAZUL:Say goodbye to latency lag: download Azul Platform Prime for free.Monte Carlo: Visit https://softwareengineeringdaily.com/montecarlodata to learn more.Cox Automotive: Visit https://coxautotech.com/ to find career opportunities at...2022-09-2747 minSoftware Engineering DailyAutomatic Database Tuning with Andy PavloThe default configuration in most databases is meant for broad compatibility rather than performance. Database tuning is a process in which the configurations of a database are modified to achieve optimal performance. Databases have hundreds of configuration knobs that control various factors, such as the amount of memory to use for caches or how often the data is written to the storage.The problem with these knobs is that
they are not standardized (i.e., two databases may have a different name for the same knob),
not independent (i.e., changing one knob can impact others),
an...2022-09-2344 minSoftware Engineering DailyBridgecrew: Cloud Security with Guy EisenkotCloud computing provides tools, storage, servers, and software products through the internet. Securing these resources is a constant process for companies deploying new code to their cloud environments. It’s easy to overlook security flaws because company applications are very complex and many people work together to develop them. Wyze Labs, for example, had millions of users’ data stolen due to a mistake by a single employee.The company Bridgecrew is a cloud security platform helping to prevent mistakes like that from happening. Bridgecrew integrates into developer workloads to automatically find infrastructure errors in cloud accounts, workloads, and...2022-09-2048 minSoftware Engineering DailyPractical Machine Learning in JavaScript with Charlie GerardOriginally published on January 1, 2022.Charlie Gerard is an incredibly productive developer. In addition to being the author of Practical Machine Learning in JavaScript, her website charliegerard.dev has a long list of really interesting side projects exploring the intersection of human computer interaction, computer vision, interactivity, and art. In this episode we touch on some of these projects and broadly explore how practical it is to bring interesting HCI concepts into one’s work.Sponsorship inquiries: sponsor@softwareengineeringdaily.com Learn more about your ad choices. Visit megaphone.fm/adchoices2022-09-1830 minSoftware Engineering DailyMental Health in Tech with Andy JohnsSoftware engineering can be a surprisingly grueling career. It is both physically and mentally demanding to sit in front of a screen for hours on end producing code.Andy Johns is our guest in this episode. Andy previously worked on growth at Facebook, Twitter, and Quora as an early employee. He’s also an investor in Robinhood, Webflow, and Reforge. Andy joins the show to discuss Mental health in tech, burnout and work/life balance. Check out the show notes to learn more about Andy’s work, specifically his substack blog on Mental Health.Show Note...2022-09-141h 09Software Engineering DailyServerless Clickhouse for Developers with Jorge SanchaData analytics technology and tools have seen significant improvements in the past decade. But, it can still take weeks to prototype, build and deploy new transformations and deployments, usually requiring considerable engineering resources. Plus, most data isn't real-time. Instead, most of it is still batch-processed.Tinybird Analytics provides an easy way to ingest and query large amounts of data in real-time, as well as to automatically create an API to consume those queries. This makes it easy to build fast and scalable applications that query your data; no backend needed!In this episode, we interview...2022-09-1240 minSoftware Engineering DailyPanther: Security as Code with Jack NaglieriApplication security is usually done with a set of tools and services known as SIEM - Security Information and Event Management. SIEM tools usually try to provide visibility into an organization’s security systems, as well as event log management and security event notifications. The company Panther takes traditional SIEM security a step further. Panther processes and retains all of your security data with cloud-first workflows, identifies and alerts in real-time suspicious activity, enables building a high-fidelity alerting pipeline with Python, version control, unit tests, and CI/CD, and provides a security data lake where raw logs are...2022-09-0847 minSoftware Engineering DailyCloud-native Observability with Martin MaoMaintaining availability in a modern digital application is critical to keeping your application operating and available and to keep meeting your customers growing demands. There are many observability platforms out there and certainly Prometheus is a popular open source solution for cloud native companies yet operating an observability platform, costs money, and all of the platforms are highly data intensive.Managing costs and data retention policies is critical to keeping your application operating healthy and operating available. Chronosphere is the leading observability platform for scaling cloud native applications. Focusing on managing costs by managing data. Martin Mao...2022-09-0147 minSoftware Engineering DailyDeveloper-first Observability with Liran HaimovitchAs software engineering teams start to build products that become more and more mature. It becomes necessary to be able to debug complex issues with tooling that enables understanding of the full scenario. This can come from application scenarios where APIs are running multiple versions, where users are using your app from multiple devices, device types, OS versions, browser versions, things like that.You may also run into issues with network connectivity or a functionality that is intermittent based on sort of use cases and user interactions. And for this sort of scenario, we've come to start...2022-08-3151 minSoftware Engineering DailyModular Blockchain Architecture with Nader DabitWeb infrastructure has evolved from individual servers to shared hosting services to virtual machines and virtual functions. The future of the internet however is looking toward a much more distributed computation model blockchain technology is central to the future of this modern internet of blockchains are still in their infancy and the most people blockchains are intimately tied to crypto currencies but the use of blockchain is substantially larger than that of crypto. Auctions provide a model for distributed computation that allows no centralized ownership and no centralized control of large scale applications. Celestia is developing blockchain technology that...2022-08-3045 minSoftware Engineering DailyArchitecting for Scale with Lee AtchisonLee Atchison spent seven years at Amazon working in retail, software distribution, and Amazon Web Services. He then moved to New Relic, where he has spent four years scaling the company’s internal architecture. From his decade of experience at fast-growing web technology companies, Lee has written the book Architecting for Scale, from O’Reilly.As an application scales, it becomes significantly more complicated while at the same time receiving more traffic. The intersection of these two problems leads to a variety of discussions around availability, risk management, and microservices.Sponsorship inquiries: sponsor@softwareengineeringdaily.com...2022-08-2435 minSoftware Engineering DailyData Infrastructure for FinanceData is becoming a bank’s biggest asset. These complex enterprises have a huge opportunity ahead - to transform themselves to become a trusted hub of a much broader data ecosystem that goes beyond the financial industry and helps to form a new class of cross-industry experience architectures that are scalable and transparent. The data physics that is needed for such emerging systems runs on consent and privacy preservation rather than black-boxed data lakes. A foundation for making this happen lies in the ability to use distributed, heterogenous data effectively and transform it into experiences that are relevant to th...2022-08-1853 minSoftware Engineering DailyCloud-native Authorization with Tim HinrichsEnabling authorization policies across disparate cloud-native environments such as containers, microservices and modern application delivery infrastructure is complex and can be a roadblock for software engineering teams.Open Policy Agent, or OPA, is an open, declarative, policy-as-code approach to authorization that reduces security and compliance burden for engineering teams. Business context is translated into declarative policy statements. These policy statements are compiled into code and deployed as agents that can be injected into any process, such as an API gateway, Kubernetes provisioning service, public cloud access controls, or continuous delivery automation service.Styra created and c...2022-08-1754 minSoftware Engineering DailyKubernetes Troubleshooting with Itiel Shwartz and Lee AtchisonCloud native applications utilizing microservice architectures has grown into one of the most popular application architectural patterns in recent years. The value of leveraging dynamic cloud resources, along with the flexibility and scalability of microservice architectures, creates a strong paradigm that's hard to miss. The strong adoption of Kubernetes has strengthened the pattern enormously. The unique structure and requirements of Kubernetes has led to an increased need for Kubernetes specific monitoring and diagnostics tools. There has been a large number of companies who have jumped at this opportunity. One of those companies is Komodor, a Kubernetes diagnostics platform that...2022-08-1738 minSoftware Engineering DailyPermissions and Access-control with Or WeisPermissions are Hard! And they are becoming harder as we move more into the Cloud-native ecosystem. If we go back in time to the point where it was just a single monolith that you were building on your own. You'll probably have a framework to manage the permissions for you. But when you are working with distributed microservices, especially if you are a polyglot, you can't use those solutions anymore. So you end up having to sprinkle a bit of access control into every little microservice and component that you build. In addition, with the scale of modern applications...2022-08-1650 minSoftware Engineering DailyFaking Data Using Tonic.ai with Ian Coe and Adam KamorCompanies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset. Ideally, developers working on a software application wouldn’t need access to production data. Yet without high-quality example data, many technology groups stumble on avoidable problems. Organizations need a solution to protect privacy while simultaneously preserving aspects of the data which are important.Tonic is automating data synthesis to advance data privacy. Their solution gives your production-like data for development and analytical purposes without compromising on data quality or privacy. In this episode, We interv...2022-08-0545 minSoftware Engineering DailyCouchbase with Ravi MayuramCouchbase is a distributed NoSQL cloud database. Since its creation, Couchbase has expanded into edge computing, application services, and most recently, a database-as-a-service called Capella. Couchbase started as an in-memory cache and needed to be rearchitected to be a persistent storage system. In this episode, We interviewed Ravi Mayuram, SVP Products, and Engineering at Couchbase. To learn more about Couchbase, check out couchbase.com/sedaily. Sponsorship inquiries: sponsor@softwareengineeringdaily.comDatadog: Visit https://softwareengineeringdaily.com/datadog to get started.New Relic: Sign up at https://newrelic.com/sedaily...2022-07-2835 minSoftware Engineering DailyRemix with Ryan FlorenceRemix is a full stack web framework that lets you focus on the user interface and work back through web fundamentals to deliver a fast, slick, and resilient user experience that deploys to any Node.js server and even non-Node.js environments at the edge like Cloudflare Workers.In this episode, we interviewed Ryan Florence, co-founder at Remix Software.Sponsorship inquiries: sponsor@softwareengineeringdaily.comSnyk: Sign up for free today at https://snyk.co/sedailyLINKERD: Visit https://softwareengineeringdaily.com/linkerdMerge: check out Merge today...2022-07-2248 minSoftware Engineering DailyContinuous Profiling using eBPF with Frederic BranczykProfiling has been a part of the software engineering toolbox since the 1970s, but it was long regarded to be too high in overhead, so it was only done ad hoc. The problem with profiling that way is that you never catch the moment in time where for example an incident happened. Continuous profiling is the systematic capturing of profiling at all times, Google has been doing it for over a decade, but it comes both with challenges of how to capture the data at low overhead and also storing and querying the enormous amount of data that continuous...2022-07-1651 minSoftware Engineering DailyWorkOS with Michael GrinichEnterprise-grade authentication is often an essential ingredient to virtually all applications in today's world. However, companies often have a hard time understanding the value of that authentication especially during the early stages of product development. And hardening of an application is often left as an afterthought. Add enterprise-level requirements such as single sign-on and two-factor authentication and other requirements that the once afterthought becomes are now major issues. Delaying launch schedules and new feature launches.WorkOS is dramatically shortening this development time by providing tools to allow in integrating complex enterprise standards with just a few lines...2022-07-0636 minSoftware Engineering DailyEarthly Builds with Adam Gordon BellBuild automation tools automate the process of building code, including steps such as compiling, packaging binary code, and running automated tests. Because of this, build automation tools are considered a key part of a continuous delivery pipeline. Build automation tools read build scripts to define how they should perform a build. Common build scripts include Makefile, Dockerfile, and bash. Earthly is a build automation tool that allows you to execute all your builds in containers. Earthly uses Earthfiles, which draws from the best features of Makefile and Dockerfile and provides a common layer between language-specific tooling and t...2022-07-0147 minSoftware Engineering DailyLiveBlocks with Guillaume SallesCreating great creative tools is extremely difficult. There are thousands of paths a user could take, and every aspect of the user experience has to be carefully considered and optimized for performance. And when you try to add real-time collaboration on top of that, you can be sure that you’re left with almost no time to focus on the core user experience of your product.Liveblocks is a set of tools and APIs that helps you create amazing real-time collaborative experiences. With Liveblocks, you can make anything collaborative in minutes so that you can give your co...2022-06-3043 minSoftware Engineering DailyGitcoin Ecosystem with Gloria KimbwalaMost technology companies rely on open source software projects. But open source software projects are often maintained by a group of people that is not affiliated with any particular company. When an open source project develops too much technical debt, it can become a tragedy of the commons. Who is responsible for maintaining these open source projects?This is the motivation for open source bounties. Companies and individuals who rely on open source create bounties, which are financial incentives for developers to solve problems within the open source project.Gitcoin is a platform for open...2022-06-3046 minSoftware Engineering DailyMailchimp Engineering with Eric MuntzMailchimp is an all-in-one marketing platform for growing businesses, empowering millions of customers around the world to launch, build, and grow their businesses with world-class marketing technology, award-winning customer support, and inspiring content.Eric Muntz is Mailchimp's CTO, responsible for the engineering teams that design, implement, and maintain Mailchimp's products and infrastructure.He joins the show to take us through the engineering behind Mailchimp’s infrastructure.Sponsorship inquiries: sponsor@softwareengineeringdaily.comNetapp: Check them out at https://spot.io/sedailyInflux Data: . To learn more and ge...2022-06-2847 minSoftware Engineering DailyTechnical Venture Capital with Tim TullyVenture capital investment has continued to flow into technology startups. No one builds technology from scratch. There are cloud services, software libraries, 3rd party services, and software platforms that modern entrepreneurs must adopt to build their products efficiently and quickly. These layers of infrastructure are a key area for many investors.Tim is a partner at Menlo Ventures where he invests in cloud and data infrastructure, AI/ML and cyber security. He joins the show to discuss what goes into a smart investment.Sponsorship inquiries: sponsor@softwareengineeringdaily.comDatadog: Get start...2022-06-2750 minSoftware Engineering DailyCoinrule Automated Crypto Trading with Zdenek HoflerBetween hyper financialisation and the growth of automation in the world, trade and investments have become an ever more prevalent and important tool for the mass market. But the relative knowledge of professional and hobbyist investors is different, and so is the access to opportunities. Coinrule empowers regular people to compete with professional traders by automating investments without having to learn a single line of code.Zdeněk Höfler is the co-founder of Coinrule and joins the show to discuss what he and his team have built.Sponsorship inquiries: sponsor@softwareengineeringdaily.com2022-06-2547 minSoftware Engineering DailyProtocol Labs Research with Jeromy JohnsonJeromy Johnson is a distributed systems researcher focused on incentive mechanism design and trustless distributed system scalability. He joins us today to share how Protocol Labs is spearheading the innovation in web3.Sponsorship inquiries: sponsor@softwareengineeringdaily.comKeeper Security: Get started by visiting https://www.keepersecurity.com/Cloud Bees: Visit https://www.cloudbees.com/Capital one: Visit https://capitalone.com/MLNetapp: Check them out at https://spot.io/sedailyFullstory : Go to https://fullstory.com/sedaily to activate your free one month trial.2022-06-2445 minSoftware Engineering DailyBuilding for Crypto with Lewis TuffAs crypto gains worldwide attention, the most scalable, resilient and performant systems are required for the industry to thrive. Products must be designed for a mix of technical and non-technical users. Blockchain.com's VP of Engineering Lewis Tuff takes us behind the scenes for a look at the architecture, programming languages and database choices required to build an open, accessible and fair financial future, one piece of software at a time.Sponsorship inquiries: sponsor@softwareengineeringdaily.comDynatrace: See why Dynatrace is radically different and try it free for 15 days at Dynatrace.com...2022-06-2249 minSoftware Engineering DailyKubernetes Spend with Webb BrownThis episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb...2022-06-1745 minSoftware Engineering DailyGlobal State Management with James CowlingConvex makes storing your application's data as easy as using React state management. If you can use React hooks, you can also manage your backend data using Convex. James Cowling is a former Dropbox infrastructure engineer turned startup founder. James joins the show to discuss how Convex offers a simpler full-stack developer experience than the tools developers use today — without many of the compromises of other alternatives. This episode is guest hosted by Jackson Gabbard, a long-time Facebook product engineer who is now the CTO of Cord — the SDK for collaboration in any SaaS tool.Sponsorship inquiries: spon...2022-06-0330 minSoftware Engineering DailyKubernetes Security Compliance with Jimmy MestaThe Kubernetes ecosystem has drastically changed how development teams ship software. While Kubernetes has provided many advancements in cloud infrastructure, it has also left organizations with massive security blindspots. KSOC was created to give developers and security teams a single control plane to harden multi-cluster Kubernetes environments through event-driven analysis, least privilege enforcement, and remediation-as-code. Jimmy Mesta is the Co-Founder and CTO of KSOC and joins the show to discuss modern Kubernetes security challenges and how security teams need to prepare for a future where Kubernetes is the top attack target for adversaries.Sponsorship inquiries: sponsor@softwareengineeringdaily...2022-06-0148 minSoftware Engineering DailyNew Relic Architecture with Nic BendersIn software engineering, telemetry is the data that is collected about your applications. Unlike logging, which is used in the development of apps to pinpoint errors and code flows, telemetry data includes all operational data including logs, metrics, events, traces, usage, and other analytical data. Companies usually visualize this information to troubleshoot problems and understand patterns and opportunities in how their applications are used. The company New Relic is a modern observability platform built to optimize your entire software stack from one place. New Relic includes a Telemetry Data Platform that acts as a single source of t...2022-05-2846 minSoftware Engineering DailyCloudGraph with Tyson KunovskyThe advent of the cloud introduced a new form of technical debt in which organizations can lose track of what infrastructure they have and how it relates to the business. While the cloud's native APIs offer some transparency into your infrastructure, these offerings are often described as necessary but not sufficient. When companies have a non-trivial question about their environments, getting answers can have a big cognitive overhead to get a clear answer.In this episode, I interview Tyson Kunovsky, Co-Founder and CEO at AutoCloud, creators of the open source project Cloud Graph. CloudGraph is a free and...2022-05-2144 minSoftware Engineering DailyBrowser Observability With Jay KhatriHighlight is a tool that helps teams reproduce end-to-end user sessions to better understand their application.With Highlight, engineering teams can replay errors with high precision, which includes a complete session replay, outgoing network requests, dense stack traces and insight into the app's state management system (redux, apollo's cache, etc.). At the same time, product teams can analyze user activity, collaborate with engineering teams and find the reason for user drop offs to gain insight into UX.Jay Khatri is the CEO of Highlight and joins the show to talk about Browser Observability and what...2022-05-2048 minSoftware Engineering DailyStarburst Infrastructure with Justin BorgmanThe Presto/Trino project makes distributed querying easier across a variety of data sources. As the need for machine learning and other high volume data applications has increased, the need for support, tooling, and cloud infrastructure for Presto/Trino has increased with it. Justin Borgman is the CEO of Starburst, and joins the show to talk about the impact of Presto and how his company has architected its product.Sponsorship inquiries: sponsor@softwareengineeringdaily.comCloud Bees: Visit softwareengineeringdaily.com/cloudbees to get a free trial.JS Nation: h...2022-04-2846 minSoftware Engineering DailyJavaScript Supply Chain with Feross AboukhadijehThe JavaScript supply chain includes numerous vulnerabilities due to its expansive nature and the long dependency chains. Socket is a new security company that can protect your most critical apps from supply chain attacks. They are taking an entirely new approach to one of the hardest problems in security in a stagnant part of the industry that has historically been obsessed with just reporting on known vulnerabilities. Feross is the Founder and CEO of Socket Security. He joins the show to talk about Socket’s approach to detecting and blocking supply chain attacks.Sponsorship in...2022-04-2350 minSoftware Engineering DailyLoft Kubernetes Namespaces with Lukas GenteleLoft is a platform for Kubernetes self-service and multi-tenancy. Loft allows you to control Kubernetes clusters with added multi-tenancy and self-service capabilities to get more value out of Kubernetes beyond simply cluster management. It allows for cost optimization, more efficient provisioning, and other features.Lukas Gentele joins the show to talk about Kubernetes multi-tenancy and the engineering behind Loft.Sponsorship inquiries: sponsor@softwareengineeringdaily.comInflux Data: . To learn more and get started for free, visit https://influxdata.com/sedailyNetapp: Check them out at https://s...2022-04-2150 minSoftware Engineering DailyDistributed Tracing Infrastructure with Ben Sigelman and Alex KehlenbeckObservability consists of metrics, logs, and traces. Lightstep is a company that builds distributed tracing infrastructure, which requires them to store and serve high volumes of trace data. There are numerous architectural challenges that come with managing this data. Ben Sigelman and Alex Kehlenbeck join the show to discuss the implementation of Lightstep.Sponsorship inquiries: sponsor@softwareengineeringdaily.comWork OS: To learn more and get started, go to https://softwareengineeringdaily.com/workosPuppet:You can join Puppet for the conversation by registering at https://events.puppet.com/f...2022-04-1950 minSoftware Engineering DailyWarp Terminal with Zach LloydTerminals are a gateway to building and running software, but they have not been reimagined since their initial creation. Warp is a new kind of terminal with visual aids, autocomplete, documentation, customization, and other features. It includes GPU acceleration, its own UI framework, and other engineering systems to increase speed and performance. Zach Lloyd joins the show to talk through the creation of Warp and the future of developer tools. Sponsorship inquiries: sponsor@softwareengineeringdaily.comCODA: Head over to https://coda.io/sedailyCox Communucations: Go to htt...2022-04-0751 minSoftware Engineering DailyData Engineering Trends with Lior Gavish and James DensmoreData infrastructure is a fast-moving sector of the software market. As the volume of data has increased, so too has the quality of tooling to support data management and data engineering. In today’s show, we have a guest from a data intensive company as well as a company that builds a popular data engineering product. James Densmore works at Hubspot, which produces tons of data, and Lior Gavish works at Monte Carlo Data, which sells a data quality product.Sponsorship inquiries: sponsor@softwareengineeringdaily.comPuppet:You can join Pup...2022-04-0547 minSoftware Engineering DailyDeveloper Health with Gabe Greenberg and Michelle BakelsSoftware engineering can be a surprisingly grueling career. It is both physically and mentally demanding to sit in front of a screen for hours on end producing code. During the pandemic, the strains of being an engineer became even more acute, as we were secluded in our homes, in some cases alone.Gabe Greenberg and Michelle Bakels work at G2i, a company that manages a large number of developers. G2i has a focus on developer health, which they believe is an underappreciated topic. They are also helping organize React Miami, a conference that takes place...2022-04-0247 minSoftware Engineering DailyKintaba Incident Response with John EganA company’s response to an incident defines how that company responds to an adverse, unexpected scenario. Kintaba automates the incident management process so teams can quickly report, respond, resolve, and reflect on major incidents collaboratively.Kintaba's incident response platforms gives you instant access to incident management processes based on the practices of companies like Facebook, Google, Stripe, and other successful and resilient organizations. John Egan is Cofounder & CEO at Kintaba and joins the show to talk about Incident Response.Attend The Incident Response Conference April 1, 2022Sponsorship in...2022-03-3045 minSoftware Engineering DailySingleStore with Jordan TiganiSingleStore is a multi-use, multi-model database designed for transactional and analytic workloads, as well as search and other domain specific applications. SingleStore is the evolution of the database company MemSQL, which sought to bring fast, in-memory SQL database technology to market.Jordan Tigani is Chief Product Officer of SingleStore and joins the show to talk through the architecture and engineering of the SingleStore platform.Sponsorship inquiries: sponsor@softwareengineeringdaily.comWork OS: To learn more and get started, go to softwareengineeringdaily.com/workosInflux Data: . To l...2022-03-2946 minSoftware Engineering DailyCloud Carbon Footprint with Steren GianniniCompute resources continue to trend towards being cheaper, easier to use, and faster. Despite these positives, more compute demands more energy and therefore an increasing carbon footprint. With many companies committing to controlling their net carbon emissions, tools are required for engineers to not only measure their cloud infrastructure, but to make informed choices about how to set up the infrastructure.Steren Giannini is a senior product manager. He works on Google Cloud Carbon Footprint. In this interview, we discuss how Google Cloud collects and exposes this data to users and how those users are responding in thei...2022-03-2544 minSoftware Engineering DailyVantage Engineering with Ben SchaechterVantage is a system for optimizing cloud costs. It provides tools and interfaces for developers to analyze how they are spending on AWS resources, and has recently expanded into GCP as well. Vantage users gain an easy interface into their costs that would otherwise be hard to analyze via the raw AWS console. Ben Schaechter is the founder of Vantage. In a previous show he gave an overview of Vantage. In today’s episode he returns to discuss the engineering internals of Vantage and provide a macro perspective on where people are wasting money in the cloud.2022-03-2451 minSoftware Engineering DailyUnion.ai with Ketan UmareAt Lyft, Ketan Umare worked on Flyte, an orchestration system for machine learning. Flyte provides reliability and APIs for machine learning workflows, and is used at companies outside of Lyft such as Spotify.Since leaving Lyft, Ketan founded Union.ai, a company focused on productionizing Flyte as a service. He joins the show to talk about the architecture and usage of Flyte, as well as how he is formulating the company around it.Sponsorship inquiries: sponsor@softwareengineeringdaily.comCox Communucations: Go to cox.career/techjobs to find ou...2022-03-2353 minSoftware Engineering DailyDuckDB with Hannes MuleisenDuckDB is a relational database management system with no external dependencies, with a simple system for deployment and integration into build processes. It enables complex queries in SQL with a large function library, and provides transactional guarantees through multi-version concurrency control.Hannes Mühleisen works on DuckDB and joins the show to talk about query engines and OLAP systemSponsorship inquiries: sponsor@softwareengineeringdaily.comRudder Stack:Visit datastackshow.com/live to register today.Influx Data: To learn more and get started for free, visit influxdata.com/sedaily...2022-03-1953 minSoftware Engineering DailySubstack with Chris BestSubstack is a platform for subscription-based content, covering newsletters, podcasts, and soon video. The design and speed of the platform are notable–with a minimalistic format that simply gets creators paid for its work, Substack has gained massive popularity.Chris Best is the CEO of Substack and joins the show to talk about the platform, architecture, and engineering of Substack.Sponsorship inquiries: sponsor@softwareengineeringdaily.comPrivate Internet Access: .Go to https://privateinternetaccess.com/SEDailyInfluxData: To learn more and get started for free, visit influxdata.com...2022-03-1752 minSoftware Engineering DailyRudderStack Engineering with Soumaydeb MitraCustomer data pipelines power the backend of many successful web platforms. In a customer data pipeline, data is collected from sources such as mobile apps and cloud SaaS tools, transformed and munged using data engineering, stored in data warehouses, and piped to analytics, advertising platforms, and data infrastructure.RudderStack is an open source customer data pipeline system that pulls together this disparate functionality. In a previous episode, we covered the basics of RudderStack. In today’s show, we dive deeper into the engineering of RudderStack with returning guest CEO Soumyadeb Mitra.Sponsorship in...2022-03-1650 minSoftware Engineering DailyNodeless Kubernetes with Madhuri YechuriManaging Kubernetes nodes leads to operational complexity, security issues, and nodes that are perhaps more expensive to run than necessary. Deferring the node management to an underlying platform abstracts away these problems and can improve operations.Madhuri Yechuri runs Elotl, a nodeless Kubernetes platform. She joins the show to talk about the architecture and purpose of her company.Sponsorship inquiries: sponsor@softwareengineeringdaily.comRudder Stack: Sign up today... or just get a free t-shirt for being a Software Engineering Daily listener at rudderstack.com/SED.Influxdata: To learn m...2022-03-1650 minSoftware Engineering DailyRetool Engineering with Snir KodeshRetool is a company that allows customers to build complex internal tools using a high level GUI. Users configure the relationships between these different tools, giving them the ability to build applications even without much background in engineering. Of course, having some engineering expertise helps, as users can write JavaScript to interact with the higher level components.Snir Kodesh is the head of engineering at Retool, and he previously worked at Lyft as a director of engineering. He joins the show to talk about his work at Retool, how it compares to Lyft engineering, and the lower...2022-03-1553 minSoftware Engineering DailySoftware Supply Chain with Barak SchosterThe software supply chain consists of packages, imports, dependencies, containers, and APIs. These different components each have unique security risks. To ensure the security of their software supply chain, many developers use tools to analyze and scan their infrastructure for vulnerabilities.Barak Schoster works at Bridgecrew, a DevSecOps cloud security platform. He joins the show to talk about the risks of the modern software supply chain and what his company does to alleviate it.Sponsorship inquiries: sponsor@softwareengineeringdaily.comGet Stream: Check it out at https://getstream.io/Private Internet Access: .Go...2022-03-1144 minSoftware Engineering DailyNational Instruments with Luke SchreierNational Instruments develops software and hardware for engineering in a wide variety of domains, from aerospace to government technology to application testing. The interface between hardware and software presents a variety of difficult engineering challenges.Luke Schreier is a Senior Vice President at National Instruments and joins the show to discuss the engineering and management of the company.Sponsorship inquiries: sponsor@softwareengineeringdaily.comSupport for the show comes fromStackOverflow stackoverflow.com/teams/sedailyCoda coda.io/sedailyPrivate Internet Access privateinternetaccess.com/SEDailyHoneycomb...2022-03-0853 minSoftware Engineering DailyVideo Search with Mokshith VoodarlaAutomating video search requires a data pipeline that extracts metadata from videos and allows users to annotate the video with information that correlates with that metadata. The video needs to be segmented into intervals that define the search space, and the search space needs to be queryable by a user.Sieve Data is an automated video search platform that enables developers to add video search and analytics to internal tools and applications. Mokshith Voodarla is the CEO of Sieve Data and joins the show to talk about video search and what he and his team have built.2022-03-0453 minSoftware Engineering DailyTaloflow with LV JadavjiIncreasingly, technology groups need to be strategic about the cloud services they adopt to ensure their vendor’s pricing is both fair and measured exactly right for the application’s unique access pattern. Definitely answering questions like these can take a significant amount of time and energy from your most valuable engineers. Taloflow is a company trying to make this decision making process easier for object storage and cloud cost management. In this episode, I interview LV Jadavji about the key questions companies are asking and how Taloflow helps people navigate them.Sponsorship inquiries: sponsor@softwareengineeringdaily.comTot...2022-03-0343 minSoftware Engineering DailyData Catalog in Practice with Mark GroverA data catalog provides an index into the data sets and schemas of a company. Data teams are growing in size, and more companies than ever have a data team, so the market for data catalog is larger than ever.Amundsen is a data catalog that came out of Lyft. We have previously explored the basics of Amundsen. In today’s episode, Mark Grover returns to the show to talk about the art and science of data catalogs. Sponsorship inquiries: sponsor@softwareengineeringdaily.comMONTE CARLO: Visit softwareengineeringdaily.com/montecarlodata to learn more.Mp...2022-02-2555 minSoftware Engineering DailySplunk Platform with Spiros XanthosSplunk is a monitoring and logging platform that has evolved over its 18 years of existence. In its modern focus on observability, it is focused on open source and AIOps. Observability has evolved with the growth of Kubernetes, and Splunk’s work around OpenTelemetry has kept parity with the open-source community of Kubernetes.Spiros Xanthos is the general manager of observability at Splunk. He joins the show to talk about Splunk’s modern product portfolio and his work on his own company prior to being acquired by Splunk.Sponsorship inquiries: sponsor@softwareengineeringdaily.comSupport for...2022-02-2347 minSoftware Engineering DailyErlang Deep Dive with the Erlang Solutions teamFrancesco Cesarini founded Erlang Solutions in 1999 with a mission to help companies adopt Erlang. In this interview, I speak with Francesco and Gabor Olah from Erlang Solutions. We discuss the Erlang language, it's ecosystem, and features like concurrency, resilience, and scalability that motivate adoption. We use Java and the Java Virtual Machine as a comparison point for Erlang and it's virtual machine the BEAM. Lastly, we explore where Erlang fits best in contemporary software engineering projects.Sponsorship inquiries: sponsor@softwareengineeringdaily.comSupport for the show comes from:New Relic: Sign up at newrelic.com/s...2022-02-2148 minSoftware Engineering DailyThe Staging Dichotomy with Senthil PadmanabhanSerious software projects require several environments. Your production environment is obviously mission critical. A staging environment is also necessary to perform validation and regression testing before taking the risk of pushing an update to production. Best practices and approaches for managing these and other environments vary from organization to organization. In some sense, different software systems should be expected to have unique needs. Yet certain commonalities and wisdom can be gained from observing high scale success stories.In this episode, I interview Senthil Padmanabhan about how eBay turned around an impeding staging environment into its biggest asset for d...2022-02-1939 minSoftware Engineering DailyHex Collaborative Data Workspace with Barry McCardel and Caitlin ColgroveIn contrast to other IDEs, the notebook interface offers software developers a unique environment idealized for data professionals. Despite the growth in popularity, a surprising learning curve still exists for setup and configuration. A siloed notebook offers no native collaboration tools. While one can connect to a SQL database programmatically, if you’re looking for an ideal ergonomic environment for some heavy duty SQL queries, many developers seek an external tool for that job.In this episode, Kyle interviews Barry McCardel and Caitlin Colgrove from Hex. Hex is a collaborative data workspace that makes it easy to go fro...2022-02-1848 minSoftware Engineering DailyMicro-Frontends with Luca MezzaliraWhen you visit a web page, the creator’s intent is to present you a seamless experience that fills your browser window. That web page or web application is generally divided up in some meaningful way across navigation elements, content, ads, header, footer, and other components.Those components may represent the work of independent teams. Typically a web app is built in a single code base, pulling all those components into a monolithic software application. For backend software development, these monoliths are often split up in a refactoring towards microservice architecture. In this episode, I interview Luca Mezzal...2022-02-1550 minSoftware Engineering DailyArchitecting for Scale with Lee AtchisonLee Atchison spent seven years at Amazon working in retail, software distribution, and Amazon Web Services. He then moved to New Relic, where he has spent four years scaling the company’s internal architecture. From his decade of experience at fast-growing web technology companies, Lee has written the book Architecting for Scale, from O’Reilly.As an application scales, it becomes significantly more complicated while at the same time receiving more traffic. The intersection of these two problems leads to a variety of discussions around availability, risk management, and microservices.Sponsorship inquiries: sponsor@softwareengineeringdaily.com...2022-02-1340 minSoftware Engineering DailyPatreon Engineering with Utkarsh SrivastavaThe creator economy has seen rapid growth, thanks largely to software solutions like Patreon that are enabling creators. As the creator economy grows, providers must be prepared for scalability issues and the challenges of maintaining and growing a software infrastructure and the team that evolves it. In this episode, I interview Utkarash Srivastava, SVP Engineering at Patreon.Sponsorship inquiries: sponsor@softwareengineeringdaily.comWorkOS: To learn more and get started, go to softwareengineeringdaily.com/workosInflux Data: visit influxdata.com/sedailyCapital One: Visit capitalone.com/MLmpa...2022-02-0937 minSoftware Engineering DailySnyk Engineering with Guy PodjarnySnyk is a platform for security that started with open source scanning and has expanded into container security, infrastructure as code, and other products. Snyk is a simple product to use, but has hidden complexities that build large data structures to manage and scan code dynamically.In a previous episode we discussed the core Snyk product. In today’s show, we talk about the engineering behind Snyk. CEO Guy Podjarny joins the show to talk through the architecture of Snyk and how the company has evolved to serve a variety of use cases.Sponsorship inquiries: spo...2022-02-0752 minSoftware Engineering DailyBuoyant Cloud with William MorganLinkerd is a service mesh that runs efficiently with a low memory footprint. We have covered the details of Linkerd in previous episodes. Buoyant is the company that sells Linkerd as a service, and today’s show focuses on the engineering details of the company, and how Linkerd is architected in 2022.William Morgan is the CEO of Buoyant, and he joins the show to talk in detail about running a leading service mesh company.Support for this show comes from:mParticle: Visit mparticle.comStrongDM: Sign up at st...2022-02-0447 min