To the most vocal community members: I am … confused

No, but I’m sure they apply remote code ACTIVATION. :slight_smile:

Experimentation - PlayFab | Microsoft Learn

Overview

PlayFab Experiments feature helps you identify the best strategies for your game. It does so by helping you run multiple concurrent experiments and ensure statistical trustworthiness.

You can elevate the player experience by comparing different versions of game configurations, pricing models, and outreach mechanisms, determining the best variation for your title’s goals (engagement, monetization, retention, etc.) via experiments.

Capabilities of PlayFab’s Experiments

PlayFab Experiments is a tailored solution for running experiments in your games. It is powered by Microsoft’s internal experimentation platform which unlocks the best-in-class capabilities which are used by Minecraft, Azure, Office, Bing, and many other Microsoft products. PlayFab Experiments empowers you by providing the following capabilities:

  • Creation and management of multiple concurrent experiments with the (interactive and self-directing) user interface on PlayFab Game Manager and via scalable APIs.
  • Targeting of the desired audience at random but in a controlled manner by making use of existing traffic. You can experiment over a segment and define the percentage of the target audience in each variant.
  • Scheduling of experiments or to run immediately.
  • Analysis of experiments’ scorecard results. The scorecards are computed reliably and possess enriched statistical details. This gives you an indication of statistical significance and alerts if a Sample Ratio Mismatch is observed.
  • Integrability with other PlayFab services such as Title Data, Player Profile, PlayStream events, CloudScript and Insights Explorer, etc.

Experiments Quickstart - PlayFab | Microsoft Learn

Integrating Experiments with other PlayFab services

Experiments is compatible with Player Profile, PlayStream events, CloudScript and Insights Explorer. For example, you can:

  • Make configuration changes using CloudScript: Virtually any configuration-related game code variation can be enabled using a combination of CloudScript and Experiment’s getTreatmentAssignment API.
  • Make configuration changes using PlayStream events: Use the getTreatmentAssignment API to trigger game configuration changes based on PlayStream events.
  • Do a drill-down analysis using Insights Explorer: A unique identifier of each variant (VariantID) is stamped on all PlayStream v2 events and two specific PlayStream v1 events (player_logged_in and player_realmoney_purchase). This can be used to do further analysis on specific metrics. (The metrics can be based on the PlayStream events or your own game telemetry.) To query, use the Insights Explorer service or connect your own analytics platform.
2 Likes