Why do major bugs only appear after Sim Updates, not discovered in Beta Testing?

Discussion Hub General Discussion
, ,
42

When they test in dev, are they doing it in a hybrid environment (different servers, etc, etc), or do they test in the same environment we use?

43

Like I always say: the most consistent thing about MSFS is how inconsistent the experience is from user to user. You can get 2 people with the exact same hardware (like an Xbox for example). One is having no issues, great frame rates, and having a blast. The other is having a low frame rate crash and stutter-fest every time they load in.

Sadly, it’s a reality in all complex software. There will be gremlins. And they’re not always easy to find. Unless 100% of people can reproduce it 100% of the time, there’s no guarantee that devs will be able to find it. Particularly if they can’t reproduce it.

1 Like
44

My favorite was a few SU’s ago when they released it from beta, everyone downloaded the update, started the sim, only to find that we couldn’t use/move the world map.

That’s some quality beta testing.

1 Like
45

They’re in Production from what I can tell.

46

So they’re using the testers are using the same servers as us, and they have people situated around the world using different hardware?

Seems very plausible they would be, and smart.

It’s just really interesting you showed them how to replicate the problem and they couldn’t. I’m just afraid of the black hole our complainints might be going into and why it’s so hard for them to replicate step by step by instructions.

I know it’s a super hard problem, so I’m just trying to understand what’s going on.

1 Like
47

We’ve had very good liaisons to the Dev Team (and still do!), they’re really diligent about repro, as well as the Community Managers.

II really think it’s all about the variety of setups out there. It’s just not possible to cover every PC setup, hardware, software, peripherals. I know I’m speaking the choir in this case, but whenever I see the support effort being done, it’s a sober reminder that they’ve been able to resolve or repro as many things as they have to date. And I know personally that I have to zero (stock) my configuration as much as I can in order to make sure it’s reproducible as possible. I burned myself the last time on an open ticket that way and forgot to remove my NG subscrption.

1 Like
48

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.