Not sure if I misunderstood the question but if you switch to drone mode in VR, you can move freely wherever you want to go by using A, S, D, W, F and R on the keyboard to move left, back, right, forward, down and up.
On the numeric keypad, you can use 4 and 6 to turn left and right, 8 and 2 to tilt up and down etc. Nr 5 will reset the position and view. As I recall it, 1 and 3 or could be 7 and 9 will lean the view left/right.