We don't know until the game is running if it's using an sRGB color space or not. Add support for hot-swapping swapchain surface formats.
