I think the problem might be control surface authority. Especially with low speeds (low dynamic pressure) the aircraft are too responsive.
Lowering control sensitivity is only a workaround. On top it results in a rather unnatural exponential / logarithmic curve.