Thanks for the tips everyone. I feel silly for not realizing it, but after a few tests with calm winds, I do believe this is being caused from strong crosswinds. Hence why it happens sometimes, and not others. I guess we all start somewhere!
Most of my departures are from Logan, and surrounding airports…a typically windy area in general. That would explain why it happens frequently.
I guess I never realized just how much of a factor cross winds can play in takeoff. Happy to know it’s nothing wrong with my setup.