I have the same problem. It keeps happening just like you said. I use the default USB controller from Microsoft not the Logitech one which seemed to cause more problems. In the USB control panel I “Reset to Default” and sometimes Calibrate. I’m good to go for the rest of the flight, until the next one. I check this and do this before taxi.