AMD FSR 3 FidelityFX Super Resolution Technology Detailed: 2x The FPS With Frame Interpolation, Easy To Integrate In Existing FSR 2 Titles

AMD FSR 3 Might Generate Up To 4 Interpolated Frames & Be Enabled On Driver-Side 1

AMD has further detailed its FSR 3 FidelityFX Super Resolution technology at GDC 2023, giving us a taste of what's coming to the gaming scene.

At GDC 2023, AMD introduced its next-generation FidelityFX Super Resolution suite named FSR 3. As the third generation of FSR, AMD wants to generate even more pixels in a current frame with interpolated frames, allowing the company to achieve a 2x performance improvement versus the existing FSR 2 technique.

With FSR 3, there's a high probability that there will be at least one sample for every interpolated pixel and no feedback loop since interpolated frame will only be shown once. So any interpolation artifact would only remain for a single frame. AMD has provided a rendering pipeline of a native, FSR 2, and FSR 3 model which can be seen below:

In an early look provided to GDC attendees, AMD revealed that FSR 3 FidelityFX Super Resolution will leverage from:

Motion Vectors and AMD Fluid Motion to produce interpolated frames

Good motion estimation is key for interpolation

Additional internal information from FSR 2 can be leveraged

During the last part of our temporal upscaling session, we also revealed some early information about FSR 3 and talked about the benefits and challenges in development.

With FSR 2 we’re already computing more pixels than we have samples in the current frame, and we realized we could generate even more by introducing interpolated frames. This has allowed us to achieve up to a 2x framerate boost in the process.

Frame interpolation is more complex, as there are several challenges:

We can’t rely on color clamping to correct the color of outdated samples.

Non-linear motion interpolation is hard with 2D screen space motion vectors, which is why we recommend at least 60fps input.

If the final frames are interpolated, then the UI and all post-processing will also need to interpolated.

However, there is good news!

There’s a high probability there will be at least one sample for every interpolated pixel.

There’s no feedback loop as the interpolated frame will only be shown once – any interpolation artifact would only remain for one frame.

via GPU Open

Latency reduction will also be a key focus area for AMD FSR 3 FidelityFX Super Resolution since the company understands that gamers need both, high frame rates and the lowest latency possible. It also looks like FSR 3 will be very easy to migrate to titles that already utilize FSR 2 integrations and finally, an open-source MIT license to allow optimal flexibility of integration will also be available if needed.

In terms of performance, AMD's FSR 3 was shown to offer a 2x performance increase over FSR 2 at 4K resolution. AMD was shown running a demo of Unreal Engine 5 where the FPS jumped from 60 FPS (FSR 2) to 112 FPS (FSR 3). While the release date for AMD's FSR 3 has still not been confirmed, it is expected to launch in the first half of 2023 so that's anywhere between now and June of this year.