The 32GB of RAM is certainly useful. Yesterday I flew over Paris (Photogrammetry), and it was using 28GB.
You’ve already found that your GPU is the current bottleneck. Nothing really you can do about that, apart from lowering settings. It’s up to you what amount of visual fidelity you’re willing to sacrifice for better framerate.
If you end up upgrading the GPU, you’ll find that your next bottleneck will be the CPU, and quickly you’ll end up in an endless upgrade cycle chasing frames.
My advise is to drop settings until you get the performance you need.
You also didn’t post what framerates you were getting, but my experience is anything above 30 is good.