At this year’s WWDC, Apple announced a surprising new system coming to its Metal 3 gaming API that may sound familiar to PC gamers: MetalFX Upscaling. Ars Technica reports: The system will leverage Apple’s custom silicon to reconstruct video game graphics using lower-resolution source images so that games can run more efficiently at lower resolutions while looking higher-res. This “temporal reconstruction” system sounds similar to existing offerings from AMD (FidelityFX Super Resolution 2.0) and Nvidia (Deep Learning Super-Sampling), along with an upcoming “XeSS” system from Intel. Based on how the system is described, it will more closely resemble AMD’s system, since Apple has yet to announce a way for MetalFX Upscaling to leverage its custom-made “Neural Engine” system.
By announcing this functionality for some of the world’s most popular processors, Apple is arguably letting more game developers build their games and engines with image reconstruction — even if MetalFX Upscaling isn’t open source, unlike AMD’s FSR 2.0 system. Still, these image reconstruction systems typically have temporal anti-aliasing (TAA) in common. So long as game devs keep that kind of anti-aliasing in mind with their games and engines, they’ll be more likely to take advantage and thus run more efficiently on a wide range of consoles, computers, and smartphones. The report notes that Metal 3 also includes “a new ‘resource-loading’ API designed to streamline asset-loading processes in video games.” The same Metal 3 API benefits will also come to iPadOS 16 later this year.
