I’ve never noticed this personally, but what you’re likely seeing based on whatr you’re describing is the AP fighting you as you turn the physical yoke. When AP is engaged, the yoke in your virtual cockpit will be taking input from the AP over what you’re doing.
So if the plane is trying to go straight and you’re turning right, the AP will turn left to counter what you’re doing.
That’s what it sounds like to me based on what you’re describing. The yoke in the cockpit will prioritize in following the AP when it’s active over what you’re inputting with your physical yoke. And it should be doing the opposite of whatever you’re doing to try to keep the plane on course. Until you fight it too much and AP disengages. lol