So I kind of went desperate in trying everything I could to fix the issue. I removed my entire community folder and started a flight from Denver and went straight north from there to fly over as much land as possible. After about 2 hours I had zero stutter frames in the high to low 60s. After this I slowly kept adding 5-10 more addons and then tested another 2 hour flight even testing with some add on aircraft like the FBW A320. After I finally got through my entire folder of add ons put back into the folder and did a test flight I had zero stutter again. This was with all community add ons installed. After testing again with all plugins I did a normal flight and I think one my big issues with the stuttering was the traffic injection with FSLTL and FSHUD. When I didnt have FSHUD running it was fine. When I did the stutter came back.
Hope this can help somebody.
EDIT: Just cancelled my flight in FSHUD and my frames came back instantly. Maybe its less FSLTL and more FSHUD.