Shows
Computer Vision DecodedThe Evolution of Image Based 3D ReconstructionIn this episode of Computer Vision Decoded, we bring to you a live recording of Jared Heinly presentation on the evolution of image based 3D reconstruction. This recording was from a Computer Vision Decoded meetup in Pittsburgh with a visual component. If you would like to tune in with the visuals, we recommend watching the episode on our YouTube channel: https://youtu.be/Gwib5IcTKHIFollow:Jared on X: https://x.com/JaredHeinlyJonathan on X: https://x.com/jonstephens85This episode is brought to you by EveryPoint. Learn more about how EveryPoint is building...
2025-07-1432 minComputer Vision DecodedUnderstanding Gaussian Splatting w/ NVIDIA's Ruilong LiIn this episode of Computer Vision Decoded, our hosts Jonathan Stephens and Jared Heinly are joined by Ruilong Li, a researcher at NVIDIA and key contributor to both Nerfstudio and gsplat, to dive deep into 3D Gaussian Splatting. They explore how this relatively new technology works, from the fundamentals of gaussian representations to the optimization process that creates photorealistic 3D scenes. Ruilong explains the technical details behind gaussian splatting, and discusses the development of the popular gsplat library. The conversation covers practical advice for capturing high-quality data, the iterative training process, and how Gaussian splatting compares to other 3D...
2025-06-171h 18Computer Vision DecodedCamera Types for 3D Reconstruction ExplainedIn this episode of Computer Vision Decoded, hosts Jonathan Stephens and Jared Heinly explore the various types of cameras used in computer vision and 3D reconstruction. They discuss the strengths and weaknesses of smartphone cameras, DSLR and mirrorless cameras, action cameras, drones, and specialized cameras like 360, thermal, and event cameras. The conversation emphasizes the importance of understanding camera specifications, metadata, and the impact of different lenses on image quality. The hosts also provide practical advice for beginners in 3D reconstruction, encouraging them to start with the cameras they already own.TakeawaysSmartphones are versatile and user-friendly...
2025-05-141h 15Computer Vision DecodedUnderstanding 3D Reconstruction with COLMAPIn this episode, Jonathan Stephens and Jared Heinly delve into the intricacies of COLMAP, a powerful tool for 3D reconstruction from images. They discuss the workflow of COLMAP, including feature extraction, correspondence search, incremental reconstruction, and the importance of camera models. The conversation also covers advanced topics like geometric verification, bundle adjustment, and the newer GLOMAP method, which offers a faster alternative to traditional reconstruction techniques. Listeners are encouraged to experiment with COLMAP and learn through hands-on experience.This episode is brought to you by EveryPoint. Learn more about how EveryPoint is building an infinitely scalable data...
2025-04-0357 minComputer Vision DecodedTips and Tricks for 3D Reconstruction in Different EnvironmentsIn this episode, we discuss practical tips and challenges in 3D reconstruction from images, focusing on various environments such as urban, indoor, and outdoor settings. We explore issues like repetitive structures, lighting conditions, and the impact of reflections and shadows on reconstruction quality. The conversation also touches on the importance of camera motion, lens distortion, and the role of machine learning in enhancing reconstruction processes. Listeners gain insights into optimizing their 3D capture techniques for better results.Key TakeawaysRepetitive structures can confuse computer vision algorithms.Lighting conditions greatly affect image quality and reconstruction accuracy.Wide-angle...
2025-03-041h 21Computer Vision DecodedExploring Depth Maps in Computer VisionIn this episode of Computer Vision Decoded, Jonathan Stephens and Jared Heinly explore the concept of depth maps in computer vision. They discuss the basics of depth and depth maps, their applications in smartphones, and the various types of depth maps. The conversation delves into the role of depth maps in photogrammetry and 3D reconstruction, as well as future trends in depth sensing and machine learning. The episode highlights the importance of depth maps in enhancing photography, gaming, and autonomous systems.Key Takeaways:Depth maps represent how far away objects are from a sensor.Smartphones use...
2025-02-1857 minComputer Vision DecodedWhat's New in 2025 for Computer Vision?After an 18 month hiatus, we are back! In this episode of Computer Vision Decoded, hosts Jonathan Stephens and Jared Heinly discuss the latest advancements in computer vision technology, personal updates, and insights from the industry. They explore topics such as real-time 3D reconstruction, computer vision research, SLAM, event cameras, and the impact of generative AI on robotics. The conversation highlights the importance of merging traditional techniques with modern machine learning approaches to solve real-world problems effectively.Chapters00:00 Intro & Personal Updates04:36 Real-Time 3D Reconstruction on iPhones09:40 Advancements in SfM14:56 Event Cameras17:39 Neural...
2025-02-1150 minComputer Vision DecodedA Computer Vision Scientist Reacts to the iPhone 15 AnnouncementIn this episode of Computer Vision Decoded, we are going to dive into our in-house computer vision expert's reaction to the iPhone 15 and iPhone 15 Pro announcement.We dive into the camera upgrades, decode what a quad sensor means, and even talk about the importance of depth maps.Episode timeline:00:00 Intro02:59 iPhone 15 Overview05:15 iPhone 15 Main Camera07:20 Quad Pixel Sensor Explained15:45 Depth Maps Explained22:57 iPhone 15 Pro Overview27:01 iPhone 15 Pro Cameras32:20 Spatial Video36:00 A17 Pro ChipsetThis episode is brought to you by EveryPoint. Learn more...
2023-09-1842 minComputer Vision DecodedOpenMVG Decoded: Pierre Moulon's 10 Year Journey Building Open-Source SoftwareIn this episode of Computer Vision Decoded, we are going to dive into Pierre Moulon's 10 years experience building OpenMVG. We also cover the impact of open-source software in the computer vision industry and everything involved in building your own project. There is a lot to learn here!Our episode guest, Pierre Moulon, is a computer vision research scientist and creator of OpenMVG - a library for computer-vision scientists and targeted for the Multiple View Geometry community.The episode follow's Pierre's journey building OpenMVG which he wrote about as an article in his GitHub repository.
2023-05-0655 minComputer Vision DecodedUnderstanding Implicit Neural Representations with Itzik Ben-ShabatIn this episode of Computer Vision Decoded, we are going to dive into implicit neural representations.We are joined by Itzik Ben-Shabat, a Visiting Research Fellow at the Australian National Universit (ANU) and Technion – Israel Institute of Technology as well as the host of the Talking Paper Podcast.You will learn a core understanding of implicit neural representations, key concepts and terminology, how it's being used in applications today, and Itzik's research into improving output with limit input data.Episode timeline:00:00 Intro01:23 Overview of what implicit neural representations are04:08 Ho...
2023-04-2155 minComputer Vision DecodedFrom 2D to 3D: 4 Ways to Make a 3D Reconstruction from ImageryIn this episode of Computer Vision Decoded, we are going to dive into 4 different ways to 3D reconstruct a scene with images. Our cohost Jared Heinly, a PhD in the computer science specializing in 3D reconstruction from images, will dive into the 4 distinct strategies and discuss the pros and cons of each.Links to content shared in this episode:Live SLAM to measure a stockpile with SR Measure: https://srmeasure.com/professionalJared's notes on the iPhone LiDAR and SLAM: https://everypoint.medium.com/everypoint-gets-hands-on-with-apples-new-lidar-sensor-44eeb38db579How to capture images...
2023-03-1654 minComputer Vision DecodedFrom Concept to Reality: The Journey of Building ScaniverseJoin our guest, Keith Ito, founder of Scaniverse as we discuss the challenges of creating a 3D capture app for iPhones. Keith goes into depth on balancing speed with quality of 3D output and how he designed an intuitive user experience for his users.In this episode, we discuss…01:00 - Keith's Ito's background at Google09:44 - What is the Scaniverse app11:43 - What inspired Keith to build Scaniverse17:37 - The challenges of using LiDAR in the early versions of Scaniverse25:54 - How to build a good user experience for 3D capture apps32:00 - The challenges of ru...
2023-01-2450 minComputer Vision DecodedWill NeRFs Replace Photogrammetry?In this episode of Computer Vision Decoded, we are going to dive into one of the hottest topics in the industry: Neural Radiance Fields (NeRFs)We are joined by Matt Tancik, a student pursuing a PhD in the computer science and electrical engineering department at UC Berkeley. He has also contributed research to the original NeRF project in 2020 along with several others since then.Last but not least, he is building NeRFStudio - a collaboration friendly studio for NeRFs.In this episode you will learn about what NeRFs are and more importantly what...
2022-11-1152 minComputer Vision DecodedHow to Capture Images for 3D ReconstructionIn this episode of Computer Vision Decoded, we are going to dive into image capture best practices for 3D reconstruction.At the end of this livestream, you will have learned the basics for capturing scenes and objects. We will also provide a downloadable visual guide for reference on your next 3D reconstruction project.Download the official guide here to follow along: https://tinyurl.com/4n2wspkn00:00 Intro04:40 Camera motion overview07:15 Good camera motions18:43 Transition camera motions30:39 Bad camera motions39:27 How to combine camera motions49:16 Loop Closure57:42...
2022-09-241h 23Computer Vision DecodedIs The iPhone 14 Camera Any Good?In this episode of Computer Vision Decoded, we join Jared Heinly and Jonathan Stephens from EveryPoint for their live reaction to the iPhone 14 series announcement. They go in depth into what all the camera specs mean to the average person. We also explain basics of computational photography and how Apple is able to get great photos from a small camera sensor.00:00 Intro02:43 Apple Watch Review06:58 Airpods Pro Review 09:40 iPhone 14 Initial Reaction15:05 iPhone 14 Camera Specs Breakdown37:13 iPhone 14 Pro Initial Reaction40:47 iPhone 14 Pro Camera Specs BreakdownFollow Jared Heinly on Twitter
2022-09-081h 01Computer Vision Decoded3D Reconstruction in the WildIn this episode of Computer Vision Decoded, we sit down with Jared Heinly, Chief Scientist at EveryPoint, to discuss 3D reconstruction in the wild. What does “in the wild” mean? This means 3D reconstructing objects and scenes in non-controlled environments where you may have limitations with lighting, access, reflective surfaces, etc.00:00 Intro01:30: What are Duplicate Scene Structures and How to Avoid Them14:30: How Jared used 100 million crowdsourced photos to 3d reconstruct 12,903 landmarks27:10: The benefits of capturing video for 3D reconstruction31:30: The benefits of using a drone to capture stills for 3D reconstruction34:20: Cons...
2022-08-091h 01Computer Vision DecodedWhat is the CVPR Conference?In this episode of Computer Vision Decoded we dive into Jared Heinly's recent trip to the CVPR Conference. We cover: what the conference about, who should attend, what are the emerging trends in computer vision, how machine learning is being used in 3D reconstruction, and what NeRFs are for.00:00 - Introduction00:36 - What is CVPR?02:49 - Who should attend CVPR?08:11 - What are emerging trends in Computer Vision?14:34 - What is the value of NeRFs?20:55 - How should you attend as a non-scientist or academic?Follow Jared Heinly on Twitter
2022-07-0229 minComputer Vision DecodedWhat Do the WWDC Announcements Mean for Computer Vision?In this inaugural episode of Computer Vision Decoded we dive into the recent announcements at WWDC 2022 and find out what they mean for the computer vision community. We talk about what Apple is doing with their new RoomPlan API and how computer vision scientists can leverage it for better experiences. We also cover the enhancements to video and photo capture during an active ARKit Session.00:00 - Introduction00:25 - Meet Jared Heinly02:10 - RoomPlan API06:23 - Higher Resolution Video with ARKit09:17 - The importance of pixel size and density13:13 - Copy and Paste...
2022-06-2120 min