I had a similar problem and following advice originating from MS disabled the Xbox Gamebar and it has been all good for the last week or so. Worth a try if nothing else has been able to fix it for you. I had tried different drivers first without any improvement. Currently running the latest driver and the settings are as per the NVIDA App which works well for me.