Actually, the virtual yoke (and throttle) are the things which are most frustrating about the VR experience as it stands!
There is a thread here which describes my ideal control of the yoke
Basically, I’d like to map the orientation of the VR controller to the control input, ignoring translation, because translation tracking gets lost but orientation is always sent from controllers as it’s measured by the controllers themselves - this may not be applicable to hand tracking but thought I’d point you at the thread anyway because you’re the only genius on these forums who may have the slightest chance of implementing anything like this! (Yourself and CptLucky, of course 
)