NVIDIA DLSS 3 – A Revolution in Neural Graphics
DLSS 3 is a breakthrough in AI-powered graphics that massively improves performance while maintaining excellent image quality and responsiveness. Based on DLSS Super Resolution, DLSS 3 adds Optical Multi Frame Generation to create new frames and integrates low-latency NVIDIA Reflex technology for optimal response. DLSS 3 features a new fourth-generation Tensor core and optical flow accelerator from the NVIDIA Ada Lovelace architecture that powers GeForce RTX 40 Series graphics cards.
DLSS Frame Generation convolutional autoencoder 4 inputs – captures current and previous game frames, optical flow field generated by Ada optical flow accelerator, and game engine data such as motion and depth vectors.
Ada’s optical flow accelerator analyzes two consecutive in-game frames and calculates the optical flow field. The optical flow ground takes the speed and direction in which pixels move from frame 1 to frame 2. The optical Flow Accelerator can capture pixel-level data such as in-game particles, reflections, shadows and lighting. vector calculation of the motion of the machine. In the motorcycle example below, the motion flow of the motorcyclist shows exactly where the shadow on the screen is relative to his bike.
While the optical flow accelerator precisely tracks pixel-level effects such as glare, DLSS 3 also uses the game engine’s motion vectors to precisely track geometric movement in the scene. In the example below, the motion vector game accurately tracks the movement of the road in front of the motorcyclist, but not his shadow. Creating frames using only machine motion vectors will cause visual anomalies such as sticking in shadows.
The Evolution of NVIDIA DLSS
When we first introduced NVIDIA DLSS, we started redefining real-time rendering through AI-based super-resolution – showing more pixels and then using AI to create clearer higher-resolution images. Less than two years later, we introduced the world to NVIDIA DLSS 2, which further improves image quality and performance with a general neural network that can adapt to all games and scenes without special training. DLSS 2 is now widely adopted in 216 games and applications, with support in Unity and Unreal Engine. DLSS 2 continues to improve through ongoing training on NVIDIA’s AI supercomputer, and 4 updates have been released so far that improve image quality.
NVIDIA DLSS 3: AI-powered performance multiplier increases frame rate up to 4X
NVIDIA DLSS 3: AI-powered performance multiplier increases frame rate up to 4X
By Henry C Lin and Andrew Burnes on September 20, 2022, | Featured StoriesGeForce RTX GPUsNVIDIA DLSSNIDIA RTXRay Search
Using NVIDIA DLSS, AI resolution, and sensor cores in GeForce RTX GPUs, NVIDIA has modified graphics to increase frame rates while delivering high-quality images that rival native resolutions. Since its release, 216 games and apps have integrated the technology, providing faster frame rates and performance room for true video-like ray tracing.
Today, we’re excited to announce NVIDIA DLSS 3, the next evolution in neural graphics. DLSS Super Resolution, running on the new hardware capabilities of GeForce RTX 40 Series GPUs, combines the new generation DLSS Framework with NVIDIA Reflex, increasing performance up to 4X the rendering power of DLSS 3. DLSS 3 has been quickly adopted by the ecosystem, integrating more than 35 games and technologies apps, which was first launched in October.
NVIDIA DLSS 3: Available this October
The combination of ghosting and AI technology has revolutionized video at once, with dramatic improvements in image quality and massive performance gains in displays unheard of before the invention of RTX and DLSS.
DLSS 3 builds on our pioneering work in AI for gaming, boosting performance up to 4X, bringing immersive gaming to life and allowing players to enjoy a fully simulated world, as demonstrated by NVIDIA Racer RTX.
DLSS 3 has received support from many of the world’s leading game developers and engines, announcing support for more than 35 games and applications, the first of which will begin in October.
