Business question
How do we measure whether our position improved?
By re-running the same requirement sequence and comparing against a baseline. Improvement is a measured change in recommendation behavior, not an assumption that an action worked. Because outcomes vary run to run, movement only counts when it shows against the noise of repeated sampling.
The problem
Most changes are made on faith. Without a baseline and a repeatable measurement, you cannot tell whether an intervention moved your position or the result simply varied.
Why it matters
Measured movement is what separates an intervention that worked from one that felt productive. It is also what lets you stop spending on things that do not move the outcome.
What the research studies
The components behind this question.
The evidence so far
What we have run, and what we have seen.
- E-045Video conferencing software: When the field survives and keeps its names
- E-041CRM software: When the recommendation set survives but its members do not
- E-043Accounting software: When the whole field is wiped out and replaced
- E-044Accounting software: When the same kill repeats on a second evaluator
- E-042Project management software: The unexplained recommendation transition
- E-034Clinical trial management software: When the recommendation set collapses
- E-040Project management software: When the recommendation set holds
- Observation · Candidate · 2026-07-20Survival appeared in two modes, and their cause is confounded
- Observation · Candidate · 2026-07-20Survival depended on the category, in at least four ways
What we can conclude
We have observed that recommendation outcomes vary across repeated runs, which is exactly why measurement has to be against a baseline and across multiple draws. Movement reported against a baseline is a real result; a single run is not.
What remains unknown
How much variation is normal for a given category, and whether an observed movement is caused by a specific change, requires a controlled before-and-after design rather than a single comparison.
How Upstream Zero helps
From the evidence to your answer.
Upstream Zero establishes a baseline, re-runs the sequence after a change, and reports movement in recommendation-set frequency, frontrunner frequency, and survivability against that baseline. The number is a measured outcome, reported with its limits.