Here’s an interesting article that talks about the Frame Rate Up Conversion (FRUC) of the new Optical Flow hardware and SDK, which I bet is the tech behind DLSS3.
So I guess my question is: is DLSS 3 equivalent to the supersampling of DLSS 2 (but hopefully with some quality improvements in the process too? I hear people aren’t super stoked about quality at the moment) followed by FRUC to increase the frame rate? Or perhaps the otherway around, because I feel that the supersampling part is likely cheaper than FRUC, so better do FRUC on smaller images, then upscale them?
But with FRUC being a form of “backward” frame prediction (“take two consecutive frames and return an interpolated frame in between them”), I have a hard time understanding how this can fit in any low-latency scenario like VR… All forms of reprojection (see my other post) dramatically drop in quality with latency, so assuming that DLSS 3 will increase latency by many ms… it’s also going to make reprojection much less good at its job.
Edit: I’m going to try to draw a diagram of this so we can reason about latency and guesstimate some numbers.