Nvidia Unveils DLSS 5: Neural Rendering Arrives in Gaming
Nvidia introduced DLSS 5, a new version of its Deep Learning Super Sampling technology, at the company's annual GTC event. The technology, which Nvidia describes as a significant advancement in computer graphics, utilizes an AI model for "neural rendering" to enhance visual fidelity in games. Its announcement was followed by discussions regarding its capabilities, impact on artistic control, and game aesthetics. The release is anticipated in the fall.
Introduction of DLSS 5
Nvidia CEO Jensen Huang unveiled DLSS 5 during his keynote at the GTC event. This technology, an evolution of Nvidia's Deep Learning Super Sampling, is designed to infuse pixels with photorealistic lighting and materials in real-time.
Nvidia characterizes DLSS 5 as a significant advancement in computer graphics, comparing its impact to the introduction of real-time ray tracing in 2018. The company also referred to the AI model powering DLSS 5 as "neural rendering."
Technical Capabilities
DLSS 5 processes a game's color and motion vectors for each frame. An AI model then integrates photorealistic lighting and materials into the scene. This AI model is trained to understand complex scene elements, including characters, hair, fabric, translucent skin, and environmental lighting conditions (such as front-lit, back-lit, or overcast), by analyzing single frames.
The technology aims to ensure consistency across frames and adherence to source 3D content, operating in real-time at resolutions up to 4K. Nvidia states that DLSS 5 involves "content-controlled generative AI."
Jacob Freeman, a GeForce Evangelist for Nvidia, explained that the technology processes a finished frame by drawing a new image that is applied on top.
Nvidia anticipates the technology will eventually run on a single video card.
Demonstrations and Developer Adoption
Demonstrations by Jensen Huang showcased DLSS 5's effects in games such as Starfield, Resident Evil: Requiem, and Hogwarts Legacy. The demonstrations highlighted enhanced human faces with increased definition, realistic skin textures, wrinkles, and facial hair. Huang demonstrated DLSS 5 on a system equipped with two RTX 5090 GPUs.
Major game developers including Bethesda, Capcom, Hotta Studio, NetEase, NCSoft, Tencent, Ubisoft, and Warner Bros. Games have expressed intentions to support the new technology.
Community and Industry Reactions
Following the unveiling, some consumers and industry commentators raised concerns regarding DLSS 5's implementation.
Criticisms included comparisons to AI face filters and suggestions that the technology could create "worse, homogenous" imagery or an "AI sheen" on character models, potentially detracting from video game art.
Specific feedback noted that AI-added effects could sometimes result in hyper-real faces that elicited an "uncanny valley" response. Concerns were also raised about the potential impact on artistic intent, given that the technology overlays a new image onto a finished frame. Hardware requirements were also discussed, with suggestions that DLSS 5 might be optimized for high-end graphics cards, potentially requiring significant VRAM.
Nvidia's Response and Clarifications
Nvidia CEO Jensen Huang addressed these criticisms, stating that critics of the technology were "wrong" or "completely wrong."
Huang clarified that DLSS 5 is intended as a tool for game developers, emphasizing that developers retain control and can fine-tune the technology to match their artistic style.
He described the technology as "geometry-controlled" and "conditioned by the ground truth of the game," asserting that it enhances generative capabilities without altering artistic control.
Nvidia and several game developers provided further clarifications. Nvidia's GeForce PR director Ben Berraondo affirmed that developers maintain "detailed artistic control." Bethesda, the developer of Starfield, stated that the showcased effects were an "very early look" and that their art teams would adjust lighting and final effects to align with their artistic vision, confirming these changes would be under artists' control and "totally optional for players."
Nvidia also indicated that developers would have detailed controls for aspects like intensity, color grading, global contrast, saturation, and gamma, enabling them to define where enhancements are applied to preserve the game’s visual style. Huang drew a parallel between the reception of DLSS 5 and the initial criticism faced by real-time ray tracing when it was introduced in 2018.
Broader Context
The introduction of DLSS 5 occurs as Nvidia's financial focus increasingly shifts towards its AI business. The technology's anticipated launch is in the fall.