My personal opinion, it won’t work.
If you want to use a smaller motor with gears, you will need a significant reduction. Inevitably, that will make the controls hard when they should be moving freely.
If the reduction is small enough to be not noticeable, then it´s not worth having it, and you can just use a slightly bigger motor.