concept
Validation and evidence
Which sources, proof types, and trust signals an evaluator appears to rely on when it validates a vendor against a requirement.
- Question
- What evidence does an evaluator appear to use when deciding whether a vendor credibly meets a requirement?
Research components
Answers business questions
- Why did we disappear after follow-up questions?
- What must become true to survive evaluation?
- How do we measure whether our position improved?
- How do AI systems evaluate and recommend vendors?
Validation and evidence studies what an evaluator appears to lean on when it decides whether a company credibly meets a requirement: the sources it cites, the kinds of proof it treats as sufficient, and the trust signals that move a vendor from mentioned to recommended.
The core question is which evidence an evaluator appears to use during validation. What remains open is how much of the observed narration reflects the actual mechanism, which is why claims here are held at their evidence tier.
Evidence in this component
What we have run, and what we have seen.
Experiments
- E-044Accounting software: When the same kill repeats on a second evaluator
- E-042Project management software: The unexplained recommendation transition
- EXP-0002Knowledge Reconstruction Fidelity: once recognized and retrieved, can evaluators reconstruct Upstream Zero faithfully?
- EXP-0001Knowledge Propagation: can evaluators discover, retrieve, and recognize a newly published institutional knowledge system?
- E-005Cannabis compliance software: the thin-corpus hypothesis falsified
- E-003Generic HRIS in editorial mode: ads discovered inside the instrument
- E-004Uniform rental and FR garments: the first ground-truth-graded category
- E-001Legal ERP and legal corporate travel: extraction method origin
Observations
- Held · 2026-07-20Two evaluators took opposite stances on the same claim
- Candidate · 2026-07-20The same elimination appeared on two different evaluators
Related components
Relevant business questions
- What evidence are we missing?
- What must become true to survive evaluation?
This object references
- part-of → recommendation-survivability
- cites → evidence-tier
Referenced by
- evaluator-epistemic-posture (part-of)
- surface-independent-kill-effect (part-of)
- E-001 (part-of)
- E-003 (part-of)
- E-004 (part-of)
- E-005 (part-of)
- E-042 (part-of)
- E-044 (part-of)
- EXP-0001 (part-of)
- EXP-0002 (part-of)
Authors
Upstream Zero
Machine rendering