The issue of plane moving sideways with rudder centered is not a bug but a real physical effect. Two things can cause it: thrust increased too fast (specially significant on tailwheelers but still noticeable on some single engine propellers) or nose naturally willing to point to the crosswind direction.
You need to correct nose movements with rudder to prevent that and slowly accelerate until tailwheel raises in the case of tailwheelers before speeding up for takeoff or it will put you totally out of runway.
Cheers