GPU drops every time the device manager refreshes

I usually have a pretty stable FPS at ~ 60 but every 1-2 minute, the GPU usage drops to zero and this is always followed by the device manager refreshing.

I don’t know how to stop the device manager from refreshing or what USB device causes the issue. I tried installing usblogview and usbdeview but there is no new device that plugs/unplugs.

These stutter are game breaking.

Remove all your USB devices. Reboot the PC. Then test trying 1 device at a time. When the issue starts you found the device causing the issue.