A 320 rudder problem

Try adjusting the rudder reactivity.
It often helps in these cases.
I have heard of settings between 65 and 20%