I too, often struggle to keep the ac straight whilst taxiing but I believe it is due to my inability to apply brake pressure evenly on both pedals. This is probably due to the lack of feedback through my Logitech G Saitek Pro Flight Rudder Pedals and just pure lack of skill.
I have no issues as a real world and sim driver when using pedals but what you are suggesting is a basic dumbing down of the flight controls which would also prevent turning the plane using braking and I can’t vote for that.