Isn’t this the VRAM issue?
When VRAM is full, the FPS drops to low numbers like 5 FPS because textures have to be fetched from slower memory.
I have full VRAM (16GB) often after landing at an airport. Then it takes some time to recover and the FPS goes up again.