They are separate, you just need to go back to your Assistance options. Set everything to Hard/True to Life to turn all of the assist off as a base, then go to the Navigation Aids, and just turn on the Taxi Ribbon, while keeping everything off.
You can bind the Toggle Pause to the joystick button, then also bind Set Pause Off to the same joystick button… problem solved.