No worries.
In the real aircraft if small input is detected, AP should not be effected and when larger pilot input is detected it should indeed disconnect as far as I am aware. I think the roll due to input issue is demonstrated here: Flight controls move in reverse when on autopilot! (roll axis)