Shows
The GeekNarratorHow do vector (search) databases work? ft: turbopufferFor memberships: join this channel as a member here:https://www.youtube.com/channel/UC_mGuY4g0mggeUGM6V1osdA/joinSummary:In this conversation, Kaivalya Apte and Simon Eskildsen talk about vector databases, particularly focusing on TurboPuffer. They discuss the importance of vector search, embeddings, and the challenges associated with building efficient search engines. The conversation covers various aspects such as cost considerations, chunking strategies, multi-tenancy, and performance optimization. Simon shares insights on the future of vector search and the significance of observability and metrics in database performance. The discussion emphasizes the need for practical application and experimentation in...2025-04-071h 08The GeekNarratorHow would you design a database on Object Storage?Join Kaivalya Apte and Simon Hørup Eskildsen from Turbopuffer as they talk about the complexities of building a database on top of object storage. Discover the key challenges, the nuances of various storage formats, and the critical trade-offs involved.
Learn from Simon's rich experience, from his time at Shopify to creating Turbopuffer. This episode covers everything—from approaches to write-ahead logs to multi-tenancy and object storage advancements. Perfect for database enthusiasts and those keen on first-principles thinking!
00:00 Introduction
00:17 Simon's Background and Journey to TurboBuffer
02:42 Challenges in Database Scalability
04:21 Experimenting with Vector Databases
05:02 Cost Implications of Vector Databases
05:52 Architectural Con...2024-12-021h 08
AI and IHow to Use AI to Become a Learning Machine - Ep. 34 with Simon EskildsenThis episode is sponsored by Reflect. It’s the ultra-fast note-taking app that’s about to change the way you take notes. To boost your productivity with advanced features like custom prompts and voice transcripts, give Reflect a try by clicking on this link: https://reflect.app/?utm_source=every&utm_medium=sponsorship&utm_campaign=september2024
Simon Eskildsen is a learning machine.
I first interviewed him in 2020 about how he leveled up from an intern at Shopify to the company’s director of production engineering by reading and applying insights from hundreds of books.
A lot...2024-09-111h 13
AI & IHow to Use AI to Become a Learning Machine - Ep. 34 with Simon EskildsenSimon Eskildsen is a learning machine. I first interviewed him in 2020 about how he leveled up from being an intern at Shopify to becoming the company’s director of production engineering by reading and applying insights from hundreds of books.A lot has changed over the last four years. Language models have made it possible to access and contextualize information faster, easier, and more cheaply than ever before—and in this episode, Simon and I talk about how this changes the way he learns. Simon...2024-09-111h 13
Hacking Creativity263 - Diventare una macchina per l'apprendimento (DAILY)Simon Eskildsen è diventato in breve tempo il direttore dell’ingegneria di produzione di Shopify, e questo gli ha richiesto di dover imparare tante, tante cose in un tempo limitato. Obiettivo riuscito: oggi hackeriamo il suo metodo! P.S. Vuoi provare il tool di Edo che riassume video molto lunghi? Abbiamo il link anche di questo: www.heydrafter.com▫️ Entra nella nostra community: https://bit.ly/3jUs8Ez ▫️ Vuoi ricevere gli Appunti (la nostra newsletter)? https://bit.ly/3RJkbA5CONTATTI▫️ Email: info@hacking-creativity.com▫️ Instagram: https://bit.ly/2HVP8D42023-12-1211 min
Data Engineering PodcastBe Confident In Your Data Integration By Quickly Validating Matching Records With data-diffSummary
The perennial challenge of data engineers is ensuring that information is integrated reliably. While it is straightforward to know whether a synchronization process succeeded, it is not always clear whether every record was copied correctly. In order to quickly identify if and how two data systems are out of sync Gleb Mezhanskiy and Simon Eskildsen partnered to create the open source data-diff utility. In this episode they explain how the utility is implemented to run quickly and how you can start using it in your own data workflows to ensure that your data warehouse isn’t mi...2022-07-031h 10