A buyer question, answered at the evidence tier shown below
Why do some companies consistently make the shortlist while others are never evaluated?
You can lose before anyone compares you to a competitor. More and more, the first thing evaluating you is a language model. It reads what it can find, decides whether you fit, and builds a shortlist. You make that shortlist when the evaluator can connect what you do to the requirements that matter. When that link is missing, weak, or unbacked by evidence, you drop out before the real comparison starts. You might genuinely meet the requirement. What decides it this early is whether the evaluator can tell, from what it can see. Getting left out doesn't mean you fell short. Often it just means nobody could piece together why you fit.
What is actually happening
Making the shortlist isn't about rankings. It's the result of an evaluation. That process is commercial evaluation, what we study. It runs through surfacing, screening, comparison, and validation. Visibility can get you surfaced. It won't carry you through the screening that decides whether you're really in the running.
The structure beneath it
Run enough of these evaluations and you keep hitting the same layer underneath: requirements, the specific things a buyer needs to be true. An RFP is a list of them. A procurement process filters for them. An AI screening a vendor is checking it against the ones it thinks apply. Different surfaces, same structure.
That's why the pattern holds up instead of being random. The companies that keep showing up on shortlists are the ones whose fit is easy to see and check. The ones that never get evaluated are the ones whose fit an evaluator can't piece together from what it can reach. Models and interfaces change; the requirements stay. That's what makes this worth studying properly.
Evidence and how sure we are
This answer is a founding position, not a demonstrated result. We have published zero observations, and the claims beneath this answer sit at the lowest confidence level we track:
- Portions of commercial evaluation have become observable through AI evaluators' behaviorNarrated · 1 of 6
- Organizations will increasingly maintain a machine representation alongside their human representationNarrated · 1 of 6
Whether AI evaluation reaches human shortlists at all runs through the open bridge hypothesis H-1, and the first experiment against this framing is pre-registered in draft as EXP-0001. The full ledger is at Claims.
Limitations
It does not establish which requirements dominate any specific category, that AI evaluation resembles or drives human committee evaluation (that is H-1, held as a hypothesis), or that changing what an evaluator can verify changes the outcome. No intervention effect has been measured. What would change the answer: published observations of evaluator screening that contradict the requirement framing, or stability results too noisy to attribute to evaluation at all (Q-3).
Commercial next step
If this is your situation, the place to start is observation: capture how evaluators assess you today, which requirements they seem to credit you with, and where the gaps are that keep you out. That is what a project measures. It doesn't promise to change any evaluator's behavior, and the answer above should be useful even if you never work with us.
Who is behind this
Upstream Zero is the company doing this work. We study how AI decides which companies to recommend. The work is what matters here, not the company.
Related research objects
The answer above is informed by the claim C-0001 and relates to commercial evaluation, which observes requirements. The bridge hypothesis H-1 and experiment EXP-0001 carry the open evidence. The full machine graph is graph.json.