As we recently saw with a major mod conflict with AAU3, which was released with no public beta testing and no release notes, untested rollouts can be very rocky.
Problems noticed:
- crashing causing incompatibility (though perhaps not for 100% of users) with a very popular IFR mod (Navigraph data) not detected during internal testing
- users who opted into the beta channel didn’t even get the update until a couple hours after its wide release on the release channel
- release notes were not provided until several hours later
Recommended solutions:
- test all updates publicly through the beta channel before wide release on the release channel. this would’ve shown up the incompatibility almost certainly, while a smaller number of people were using it who had opted in to test bugs
- always publish release notes before the software, so people know what’s in it. not even knowing what was going on in the patch was very worrying
Thanks for your consideration; all us simmers want is to help keep things going smoothly for everyone!