I am using the Pico 4 also. I do not have the same problem. Perhaps you can find some differences in our workflow:
- I use VirtualDesktop to stream (not latest version for the Pico client, latest for the wiondows client)
- Steam VR is installed
- openxr Toolkit is installed
To start the sim in VR:
- start virtual desktop on windows
- start virtual desktop on the pico → the pico connects to the desktop, you shpuld see the desktop inside the pico 4
- bring up the virtual desktop menue in the pico
- goto games
- start MSFS from there - wait until MSFS startet in 2D mode
now you can either do you MSFS config stuff in 2D or press ctrl+tab to enter vr mode (I usually enter vr mode once the flight is loeaded… - do your flight
- exit the flight (still in vr mode)
- ctrl+tab to end vr
- end MSFS
Keep in mind that during loading the flight and exiting the flight the loading menue can hang for short periods of time - this is ok, but can temporarly bring up the steam vr waiting screen
I hope this helps to mitigate your problem.