Went away after updating to one of the 466 drivers, haven’t had the glitchy pixels since and I’m now on the latest hotfix driver 496.84 with AA Gamma correction turned on. GPU is a RTX 3080.
Do you have a screenshot comparison showing the cloud differences between AA Gamma correction on and off? Maybe I’m just not seeing it.