reported that Igor’s laboratory, (opens in new tab) Nvidia’s DLSS 3.0 frame generation works with non-DLSS upscaling algorithms. In testing, Igor was able to run Nvidia’s frame generation technology using his AMD’s FSR 2.1 and Intel’s XeSS temporal upscaler. Spider-Man Remastered. As a result, this gives us a good idea of how AMD’s future FSR 3.0 update will work and whether Intel will add frame generation to XeSS at some point.
DLSS 3.0 is the latest version of Nvidia’s Deep Learning Super Sampling. Yet counterintuitively, version 3.0 adds AI frame generation to the technology rather than beefing up the super sampling portion of the technology. Supported Nvidia GPUs can significantly boost frame rates compared to their native resolution.
This technology works by inserting one AI-generated frame between two actual 3D rendered frames when running this technology in a supported game. Unfortunately, a nasty side effect of this type of frame generation is increased input latency. This is the amount of delay it takes for mouse and keyboard input to register with the screen. As a result, Nvidia is demanding that all DLSS 3.0 enabled games have his Reflex technology added to reduce input lag to playable levels.
One of the cool things Nvidia developed with DLSS 3.0 was separating the frame generation part of the tech from the actual DLSS upscaling tech. This means that the two functions can work independently, allowing the frame generator to be used at its native resolution or in conjunction with other upscalers. This is how Igor conducted his tests, and he confirmed that his Nvidia intended his DLSS 3.0 to behave this way, so this is not a bug.
benchmark
Igor tested DLSS 3.0 frame generation with Nvidia’s real DLSS upscaler, FSR 2.1, and XeSS. spiderman remasteredworks on GeForce RTX 4090 GPUs with all upscaling modes.
With frame generation enabled, the 4090 achieved an average FPS of 167.6 at native resolution. The most demanding upscaling mode is Intel’s XeSS Ultra Quality mode, which stands just one frame above native at 168.5 FPS.
XeSS quality mode at 183 FPS is a bit high. Next, XeSS is balanced at 192.7. Next, Nvidia’s DLSS and FSR qualities outperform XeSS balanced mode at 197.4 FPS and 193.8 FPS respectively. Next is XeSS performance mode at 203.9 FPS, FSR balance at 206.8 FPS and DLSS balance at 209.0 FPS.
Finally, Intel’s XeSS upscaler does not have an ultra performance mode, so the FSR and DLSS performance modes and the ultra performance mode are at the top of the performance charts. As a result, the performance of DLSS and FSR are competing with each other at 220.1 FPS and 220.5 FPS respectively. DLSS Ultra Performance is the second fastest mode with 224.0 FPS while FSR Ultra Performance leads with 231.4 FPS.
All in all, this means that DLSS and FSR 2.1 are about the same in terms of performance, and the frame rate margin isn’t noticeable in-game. XeSS, on the other hand, seems a bit more demanding, with Fast mode being slower overall than his FSR and DLSS slightly higher quality models.
Of course, XeSS Ultra Quality is the slowest, just 1 FPS above native resolution. However, this is still beneficial as XeSS may have better anti-aliasing than the game’s built-in TAA, SMAA, or other AA options.
Frame generation vs.native frame rendering
All upscaling modes reduce what the RTX 4090 can do with native frame rendering compared to when frame generation is disabled. There is an obvious CPU bottleneck here. The game is capped at 133 to 135 FPS in almost all presets, except for Native Resolution, FSR Quality and Ultra Quality which are between 125 FPS and 130 FPS.
However, even between these three slower modes, the frame rate comparisons are very close and can be considered within margin of error.
Image comparison and conclusion
Unfortunately, Igor’s image quality comparison consists only of static scenes without motion. As a result, I can’t see what Nvidia’s frame generation behavior looks like with his FSR 2.1 and XeSS.
Overall, frame generation works very well not only with DLSS, but also with FSR 2.1 and XeSS. Additionally, depending on your upscaler implementation, you can provide your game with another upscaling option that looks better than DLSS.in the current state spiderman remastered FSR 2.1 is the only option that matches DLSS in performance.
Speaking of FSR, Igor’s test provides us with a proof of concept of what FSR 3.0 will look like when AMD releases it in late 2023. From the tests shown, Nvidia’s frame generation works well with his FSR 2.1 performance-wise.
All that’s left is how FSR 3.0 handles frame generation for that version, which I haven’t seen yet. I’m not sure how AMD will design their frame generation version, but this will either make or break FSR 3.0. I’m hoping to be able to use it in , but I don’t know yet. This depends on the hardware requirements of the motion vector solution for FSR 3.0 and whether you want a hardware-only solution or a software solution running on standard GPU cores. it’s different.
