Flight Director & Auto Pilot - How to Uncouple?

But what’s the benefit of turning off the FD? I mean, if you want to fly manually, you turn off autopilot. If you want to fly on auto, you turn on the autopilot.

Doesn’t the “smarts” will always apply whenever the autopilot is on? If the “smarts” is off, then what’s the autopilot doing?