DeepGamingAI's video: 4K Graphics On Cheap Hardware With Neural Networks Game Futurology 14

This is episode of the video series "Game Futurology" covering the paper "Neural Supersampling for Real-time Rendering" by Lei Xiao, Salah Nouri, Matt Chapman, Alexander Fix, Douglas Lanman and Anton Kaplanyan. PDF: https://research.fb.com/wp-content/uploads/2020/06/Neural-Supersampling-for-Real-time-Rendering.pdf Authors' BlogPost: https://research.fb.com/blog/2020/07/introducing-neural-supersampling-for-real-time-rendering/ Authors' Video: https://www.youtube.com/watch?v=Q19Lp71pA84 Game Futurology: This is a video series consisting of short 2-3 minute overview of research papers in the field of AI and Game Development. This series aims to ponder over what the future games might look like based on the latest academic research going on in the field today. Subscribe for more weekly videos! Abstract: Due to higher resolutions and refresh rates, as well as more photorealistic effects, real-time rendering has become increasingly challenging for video games and emerging virtual reality headsets. To meet this demand, modern graphics hardware and game engines often reduce the computational cost by rendering at a lower resolution and then upsampling to the native resolution. Following the recent advances in image and video superresolution in computer vision, we propose a machine learning approach that is specifically tailored for high-quality upsampling of rendered content in real-time applications. The main insight of our work is that in rendered content, the image pixels are point-sampled, but precise temporal dynamics are available. Our method combines this specific information that is typically available in modern renderers (i.e., depth and dense motion vectors) with a novel temporal network design that takes into account such specifics and is aimed at maximizing video quality while delivering real-time performance. By training on a large synthetic dataset rendered from multiple 3D scenes with recorded camera motion, we demonstrate high fidelity and temporally stable results in real-time, even in the highly challenging 4 × 4 upsampling scenario, significantly outperforming existing superresolution and temporal antialiasing work. Music Credits: https://www.fesliyanstudios.com/ ---------------------------------------------------------------- • YouTube - https://www.youtube.com/c/DeepGamingA... • Twitter - https://twitter.com/deepgamingai • Medium - https://medium.com/@chintan.t93 • GitHub - https://github.com/ChintanTrivedi --------------------------------------------------------------------