The trick is to switch the AI off, and keep the brake on when you request pushback, and don’t remove it till you see the aircraft beginning to move back slowly with the pushback. Release the brake, and the pushback speed will go up. I never switch my AI on till I’ve finished pushback.
Not realistic I’m sure, but it gets you moving!