Do expensive CPU's and GPU's pay off in VR?

I going to say it doesn’t matter what GPU at the moment if the core of the game does not support VR fully. I have 4080 and it works, but not as you would think it should. I thought when I got the 4080 my worries would be over and I could just play as intended. However it feels as if it’s just not enough in VR.