Sounds like you don’t have the nose wheel steering on / unlocked.
Have a read through these threads in this post.