It takes some getting used to (and remapping the default awful profile/assignments), but to me it is way more intuitive and immersive than using a mouse. I only fly in VR with controllers, everything from the DA40 up to the Fenix and WT Boeings.
Usually have the controllers resting on my lap, if I need to interact with anything not bound to the yoke/throttle I quickly grab one of the controllers and am able to naturally look/move my hand to the switch in the virtual cockpit. Whenever possible I go for “direct” touch, but sometimes the physical stuff is in the way and I have to use the “lightsaber” mode (whatever it’s called).
For me personally the only thing better I could imagine is direct finger/hand recognition, although that would have to be 100% accurate.