Where the hand controllers break immersion for me, is that I don’t have to put my hands on to throw a switch. The head for in DCS disappears until you press a button and it’s fast interaction.
That’s exactly why I choose to use the hand controllers for everything because I hate having to reach for a controller. The only compromise I could see working is one hand for yoke/stick and one hand with a VR controller but then I’d have to sit near my desk and probably smack it with the VR controller all the time. Sitting in the middle of my living room with nothing around but my pedals means I can just use the VR controllers for everything and not worry about banging into things. The only downside is that using VR controllers for the yoke takes some getting used to but for cyclic/collective I actually prefer them to my X52.