Implement telemetry collection system to track regressions and CTDs

You can see a similar system in place for Robert Space Industry’s Star Citizen RSI Public Telemetry

The data is publicly available which allows transparency to the users but is also actively used by developers to track how releases are impacting people.

Features that could help both developers and the community:

Simulator Metrics

  1. Stability index/metric that tracks how often the game crashes to the desktop. This could be implemented naively by tracking start/stop times or leveraging something like the Windows Diagnostics or other framework.
  2. Performance distribution data correlated with various dimensions including aircraft type, object density data, e.g. performance over sparse vs dense areas, and player density to provide a non-exhaustive list of possibilities.
  3. Aircraft stability metrics, for example detection of oscillations when the autopilot is engaged as a means of tracking regressions or stability issues.
  4. Aircraft flight time/preference to allow developers to see what aircraft are being flown the most or least. This could be used with performance or stability metrics to identify aircraft that are not flown because of issues.
  5. Event counts of when the simulator fails to load wind data, traffic, download scenery, etc.
  6. Simulator cache (both streaming and user-defined) failures to download, cache load errors, and cache load distribution times.

Simulator Flight Online Metrics

  1. Download speeds by availability zone and client network over time
  2. Error rates and latency distributions from the load balancer in with a specified SLO
  3. Failures to download AI traffic, terrain, weather, and other data by in-sim area, and by real-world client geolocation, ASN (ISP), and server cluster

We can’t even see the results of surveys for game updates. It’s only visible to staff. We already hit a wall 2 sentences into your request.

I added my vote anyway. Good luck.

2 Likes

I’d like FS24 to include automated telemetry back to MS/Asobo.
For years now, we’ve been dealing with CTD upon CTD for an unending number of causes. People say “it’s your system. it’s his overclock. it’s her 3rd party folder. it’s this. it’s that.” In the end, no one seems to know.

In this case , the community did its own investigation to find an anomalous component in Asobo stock scenery causing CTD.

Having taken a bit of an absence, I’m on the forums now because Asobo pushed update 1.37.19.0 that crashed my sim. I can’t even get to the main menu. There’s a thread here that plays guesswork.

I’m clearly not the only one with problems. Often, the powers that be seem surprised that something has been released that ostensibly has been “QA’d” but then it blows up.

I’m not writing this post to be a negative nancy or critical. I’m writing to propose a feature for FS24. Yes, there will be some data privacy skeptics. Give me the option during install to turn on automatic feedback and telemetry. Other apps do this all the time.

That way you will see what problems there are automatically and start working on fixes immediately rather than wait for error reports.

Title modified from:
“Implement telemetry collection system to track regressions”
to
“Implement telemetry collection system to track regressions and CTDs”

and tag added to improve search visibility.