DeepGamingAI's video: Create 3D Mesh Of Your Home With This AI Game Futurology 29

This is episode of the video series "Game Futurology" covering the paper "Atlas: End-to-End 3D Scene Reconstruction from Posed Images" by Zak Murez, Tarrence van As, James Bartolozzi, Ayan Sinha, Vijay Badrinarayanan and Andrew Rabinovich. PDF: https://arxiv.org/pdf/2003.10432.pdf Authors' Video: https://www.youtube.com/watch?v=9NOPcOGV6nU&feature=youtu.be Authors' Project Page: http://zak.murez.com/atlas/ Code: https://github.com/magicleap/Atlas Game Futurology: This is a video series consisting of short 2-3 minute overview of research papers in the field of AI and Game Development. This series aims to ponder over what the future games might look like based on the latest academic research going on in the field today. Subscribe for more weekly videos! Abstract: We present an end-to-end 3D reconstruction method for a scene by directly regressing a truncated signed distance function (TSDF) from a set of posed RGB images. Traditional approaches to 3D reconstruction rely on an intermediate representation of depth maps prior to estimating a full 3D model of a scene. We hypothesize that a direct regression to 3D is more effective. A 2D CNN extracts features from each image independently which are then back-projected and accumulated into a voxel volume using the camera intrinsics and extrinsics. After accumulation, a 3D CNN refines the accumulated features and predicts the TSDF values. Additionally, semantic segmentation of the 3D model is obtained without significant computation. This approach is evaluated on the Scannet dataset where we significantly outperform state-of-the-art baselines (deep multiview stereo followed by traditional TSDF fusion) both quantitatively and qualitatively. We compare our 3D semantic segmentation to prior methods that use a depth sensor since no previous work attempts the problem with only RGB input. Music Credits: https://www.fesliyanstudios.com/ ---------------------------------------------------------------- • YouTube - https://www.youtube.com/c/DeepGamingA... • Twitter - https://twitter.com/deepgamingai • Medium - https://medium.com/@chintan.t93 • GitHub - https://github.com/ChintanTrivedi --------------------------------------------------------------------