- Check power supply and connections to gpu. With my 3090, I connected the power cables incorrectly and was dismayed at the poor performance. Once I figured that out using HWiNFO64 (the power draw was waaaaay low under heavy load) and re-cabled it, everything worked great.
- Do a complete deletion of all gpu drivers using DDU and do a clean reinstall of the Nvidia drivers only.