Welcome Peter! See if the below might help. I do have the Xbox X myself as well. I mainly use the PC version of MSFS but did manage to do a couple of successful flights with the default A320 from KSFO to KLAX. Something that really came in handy was using a logitech wireless USB dongle on the Xbox X and being able to use a Wireless mouse. This helps greatly with controls.
I have a full setup for flying including Yokes, Joysticks, rudder pedals etc… for the PC version, but I found that transitioning to the Xbox Controller was actually doable and you can do reasonably complex flights if you develop a basic understanding of navigation and just don’t hesitate to reach out.