Yoke delay vs real life input

It seems you might not be the only one.
This thread seems to have a very similar problem, but with the throttle.