After win11 24h2, the previous version 565.90 gave me these strange pauses, I went back to the previous driver too and it seemed fixed. In fact what fixed it was deleting the 3d caches. There is a .bat file that does that. After cleaning all the 3 drivers including this one worked well. Win 11 24h2 was updated twice too. Try the cleaning trick.