I’m sure the majority of my issues (randomly un-seeing peripherals, mouse disappearing) are due to the cheap USB hub I’m using. I have my T.Flight HOTAS One set up for rudder pedals, a VelocityOne, a wireless headset dongle, a wireless mouse dongle and two different wireless keyboard dongles (one for text inputs and the other set up as an autopilot numpad-style keypad. Looking for recommendations from anyone else out there who is stretching Xbox’s USB ports to their limits successfully 
Allot of us in the PC world use powered USB hubs, would they work for XBOX as well?
If so this is the one I run.
This one does the trick for me… Powered.
https://www.bestbuy.ca/fr-ca/produit/startech-7-port-usb-3-0-hub-st7300usb3b/11982519
I‘be got a Xbox Series X, too.
No xbox experience but wanted to +1 powered hubs; they have resolved various issues I experienced with nonpowered hubs