How to use push/pull buttons in A320 on Xbox?

The x and a didn’t work for me
I managed to work out that using a mouse and clicking on the button then using the 2nd mouse button thus switches the mode but regardless I can’t seem to get the neo to allow me to use speed mode, Hdg or vs mode
It only reacts to managed mode fir some reason and I can’t seem to disable it