I’ve got a 3080. There was a thread from earlier today I helped someone out with. If you follow that it might give you useful tips for your Quest 2 set up.
I agree that there’s a lot of bottle necking with the 3080 and the sim. Hopefully Nvidia and Asobo will continue to optimise things. I’m really hoping the new Nvidia drivers make a difference in VR.