Yes, that’s pretty much my conclusion at this point also.
VR controllers can be useful/immersive in hand mode if you don’t use a physical HOTAS (which I don’t want to give up for realism’s sake).
In combination with a HOTAS, using the hand mode with these bulky controllers is often not viable. Hopefully gloves or other forms of hand tracking will arrive in the not so distant future.