This will help in reporting non-binary reliability metrics within test results, allowing teams to track the performance of third-party service interactions (e.g., Datadog, LaunchDarkly) as a percentage rather than a strict pass/fail binary outcome.

Currently, test results in the system are stored as binary outcomes — either passed or failed. However, in some testing scenarios, teams may want to monitor the reliability of integrations with external services in a more nuanced way. Or, the system under test may be a metric that should be captured as a number, or percentage.

For instance, during a test suite run, interactions with services like Datadog may have a 90% success rate. This is useful information for observability and debugging, but it does not necessarily warrant failing the test.