How we work

The experiments are the evidence.

Our method decides what that evidence can support. We record the exact question, the evaluator, and the conditions, we keep the original output, and we keep what happened separate from what we think it means.

The instruments are standardized and still being validated. That means we report what we observed. It does not mean we certify it.


How a run is conducted

Six steps, the same way every time.

  1. 01

    Start with a commercial question

    The run has to connect to a real decision, a company being ruled out, a requirement, or an evidence problem.

  2. 02

    Define the conditions

    We record the exact wording, the evaluator, its version, access mode, date, and sampling conditions.

  3. 03

    Run it fresh, more than once

    Repeated runs reduce the chance that one favourable or unfavourable answer gets mistaken for a pattern.

  4. 04

    Keep the original output

    The raw answer stays available for inspection. A summary is never treated as the source.

  5. 05

    Record only what occurred

    Inclusion, recommendation, exclusion, evidence use, and next-step behaviour are recorded separately.

  6. 06

    State the limitation

    A system's stated reason is evidence of what it said, not proof of how it actually works.

How strong is the evidence

Six levels, weakest to strongest.

  1. 01Narrated
  2. 02Observed
  3. 03Replicated
  4. 04Causally Supported
  5. 05Cross Evaluator
  6. 06Real World Corroborated

The order is settled. What each level requires is not. Everything on this site currently sits at the weakest level.

Published methods

The procedures behind the runs.

Open founder decision
What each evidence level requires is a founder decision, still being worked out: how many runs count as replication, and what counts as real-world corroboration. Until that exists, everything here stays at the weakest level.

Instruments · 0

What does the measuring.

N = 0

None registered yet. As observation scales, each evaluator becomes its own record carrying model, version, and access mode, and every observation carries that stamp. AI systems are the current instrument class, not the only possible one.

Vocabulary · 14

The terms we use precisely.