Back
Technology

NVIDIA Unveils DLSS 5, Prompting Discussion on Generative AI in Graphics and Artistic Control

Generated on: Last updated: 8 sources
View source

NVIDIA DLSS 5: Generative AI Sparks Debate in Gaming Graphics

NVIDIA has introduced DLSS 5, the latest iteration of its Deep Learning Super Sampling technology, which incorporates generative AI to enhance video game graphics. The announcement at the GTC conference sparked widespread discussion and varied reactions regarding its visual impact, technical implementation, and implications for artistic control in game development. NVIDIA CEO Jensen Huang has addressed criticisms, emphasizing developer control over the technology, while some segments of the gaming community and developers have expressed concerns about potential alterations to original artistic styles.

Technology Overview and Capabilities

DLSS 5 is described by NVIDIA as a "3D guided neural rendering model" designed to improve visual fidelity, particularly by boosting lighting, shadows, and materials in supported games. Unlike previous DLSS versions that primarily focused on upscaling and frame generation using machine learning, DLSS 5 employs generative AI to rework and add new details to visuals.

NVIDIA CEO Jensen Huang characterized DLSS 5 as a "GPT moment for graphics," aiming to blend hand-crafted rendering with generative AI to achieve photorealism.

The AI model is trained to analyze single 2D frames along with motion vectors to comprehend complex scene elements, including characters, hair, fabric, translucent skin, and environmental lighting. NVIDIA states that DLSS 5 then generates visually precise images that manage intricate elements like subsurface scattering on skin, fabric sheen, light-material interactions on hair, while preserving the original scene's structure and semantics. The technology is projected to launch in the fall.

Demonstrations and Initial Visual Impact

NVIDIA showcased DLSS 5 with demonstrations from titles such as "Resident Evil Requiem," "Starfield," "Hogwarts Legacy," and "EA Sports FC." These demonstrations featured side-by-side comparisons showing the technology's application, which in some instances, presented a more photorealistic appearance.

However, observers noted significant changes to character models and lighting in these examples. For instance, the protagonist Grace Ashcroft in "Resident Evil Requiem" appeared with altered facial features, including plumper lips, reduced under-eye bags, and simulated makeup. In "Starfield," the application reportedly resulted in heightened sharpness and prominent highlights on features and hair, which some perceived as inconsistent with the surrounding environmental lighting.

NVIDIA's Stance on Developer Control and Technical Implementation

NVIDIA CEO Jensen Huang responded to the criticism, stating that characterizing DLSS 5 as an "AI filter" is "completely wrong." He clarified that DLSS 5 functions as "content-control generative AI" or "neural rendering" that "fuses the controllability of geometry and textures... with generative AI," rather than being a post-processing effect. Huang emphasized that game developers retain "full, detailed artistic control" and can direct and "fine-tune" the generative AI to align with their specific artistic styles.

NVIDIA has indicated that developers are provided with an SDK offering controls to manage DLSS 5's visual impact. These controls include using the game's color and motion vectors to anchor the output to the source 3D content, along with detailed options for intensity, color grading, blending, contrast, saturation, and gamma. Developers can also mask specific objects or areas to exclude them from enhancements.

There were differing interpretations regarding DLSS 5's integration level. While Huang's statement was interpreted by some as suggesting deep integration at the developer level, reports by HotHardware indicated that this appeared to conflict with statements from NVIDIA engineers and official company slides, which suggested DLSS 5 operates from the same data as previous DLSS iterations and is not more integrated into game engines. YouTuber Daniel Owens confirmed with NVIDIA marketing specialist Jacob Freeman that "DLSS 5 takes a 2D frame plus motion vectors as an input" and is "trained end-to-end to understand complex scene semantics…all by analysing a single frame," further noting that "the underlying geometry is unchanged."

Community and Developer Reactions

Initial public reception to DLSS 5 has been mixed, with some segments of the gaming community expressing dissatisfaction. The official DLSS 5 video on YouTube reportedly received an 84% dislike ratio. Critics on social media platforms described the visual changes as applying an "AI slop filter" or an "AI Yassification filter," arguing that it altered games' intended artistic styles and changed character appearances, making them "unrecognizable" or giving them an "AI generated dating profile picture" look. The visual changes also inspired internet memes satirizing the perceived "airbrushed" or "generic" qualities.

Game developers have also voiced concerns. Kotaku reported a negative consensus among several developers, who expressed worries that the technology could overwrite the work of artists and modelers or detract from artistic direction. Insider Gaming reported that some developers at studios like Ubisoft and Capcom were reportedly unprepared for NVIDIA's announcement.

Conversely, Bethesda Game Studios head Todd Howard offered a positive assessment, stating that DLSS 5 "brought [Starfield] to life" and would allow artistic style and detail to "shine through without being held back by the traditional limits of real-time rendering."

Following community feedback regarding the "Starfield" demonstrations, Bethesda stated it would be adjusting the lighting and final effect of DLSS 5 visuals in the game. Capcom also affirmed its ability to adjust and control DLSS 5's effects. Ongoing criticisms persist among some gamers regarding the potential for AI to standardize graphics and the lack of publicly detailed information about the specific datasets used to train the AI model.

Confirmed Game Support

DLSS 5 is slated for release in the fall and is confirmed to be compatible with a selection of games, including "Resident Evil Requiem," "Starfield," "Hogwarts Legacy," "EA Sports FC," "The Elder Scrolls VI: Oblivion remake," "Assassin’s Creed Shadows," "Delta Force," "Justice," "Phantom Blade Zero," and "Sea of Remnants."