I too can’t go out of VR in the sim and then back to VR on without stuttering and massive frame rate loss.
Sometimes a switch off from VR just happens when trying to adjust things like weather conditions with the tool bar. I noticed this behaviour since VR beta.