It’s quite the opposite, lol. If you want to focus on aviate, navigate and communicate it’s an amazing tool. The AP is having to work quite hard to maintain altitude and track.
It’s about intelligent workloads. Hand flying over long distances or IFR conditions takes a large amount of focus.
In general, I hand fly when low altitude sight seeing, performing aerobatics, takeoff or on approach. I like to take over earlyish when possible on ILS as taking it down to minimums doesn’t give me enough feel to nail center line.