Skip to content

Evidence · Method

Evidence Standard v1.0

BUILD IT Evidence Standard

Status: Draft — not yet adopted

Draft — not yet adopted.

No formal grades are issued until a version is published.

Version
1.0
Status
Draft — not yet adopted
In force from
Not in force
Published
Not published

How BUILD IT grades the strength of evidence behind a specific claim, and separately judges whether that evidence transfers to a reader's context. A grade is a disclosed judgement made by named reviewers under this published method. It is not a claim of objective truth and does not by itself recommend any decision.

What every assessment examines

The questions Evidence Standard v1.0 asks of the evidence behind a claim.

Evidence strength
How well do the study designs, consistency and precision support the claim as stated?
Applicability
Do the populations, settings and time periods match the context in which the claim is used? (Reported as the Transfer Rating, never folded into the grade.)
Source traceability
Can every source be located, verified and read by anyone? Are DOIs and versions recorded?
Human accountability
Which named reviewers assessed the evidence independently, what did they declare, and who approved the grade?
Currency
How recent is the evidence, when was the card last reviewed, and what new evidence would trigger reassessment?

Grade levels

A grade describes the strength of the evidence for a claim as stated. It is a disclosed judgement by named reviewers, not a claim of objective truth.

  • Grade A · Strong

    Consistent findings from multiple well-conducted studies whose designs can support the claim as stated, with no serious unresolved contrary evidence.

    Criteria

    • Two or more independent studies with designs appropriate to the claim type (e.g. randomised or rigorous quasi-experimental designs for causal claims)
    • Effect direction consistent across studies
    • Sources verified and traceable
    • No unresolved retraction, replication failure or serious conflict of interest
  • Grade B · Moderate

    Supportive evidence with important limitations: fewer studies, weaker designs, imprecision or some inconsistency.

    Criteria

    • At least one study with an appropriate design, or several weaker designs pointing the same way
    • Limitations are material but do not reverse the conclusion
    • Sources verified and traceable
  • Grade C · Limited

    Evidence is sparse, indirect, low in design quality or materially inconsistent. The claim may be true but the evidence does not establish it.

    Criteria

    • Only observational, small or indirect evidence
    • Or substantial inconsistency between studies
    • Or key sources could not be fully verified
  • Grade D · Insufficient or contrary

    No usable evidence for the claim as stated, or the better evidence points the other way.

    Criteria

    • No studies that address the claim
    • Or the strongest evidence contradicts the claim
    • Or the claim rests on retracted or unverifiable sources

Transfer ratings

A separate judgement of whether the evidence applies to the context a card states. It is never folded into the grade.

  • High transfer

    Populations, settings and conditions in the evidence closely match the stated context of use.

  • Moderate transfer

    Some differences in population, setting or time that could change the size but probably not the direction of effect.

  • Low transfer

    Material differences that could change the direction of effect; local validation advised before relying on it.

  • Very low transfer

    The evidence comes from contexts so different that it says little about the stated context.

Limitations of this standard

Grades summarise published evidence available at the review date and can be wrong. They do not assess the quality of a product, organisation or person, and they are not advice. Transfer Ratings depend on the context stated on the card. Grades issued under this version stay attached to it; later versions do not rewrite them.

Change log

Initial draft prepared for founder and governance review. Not yet in force: no grades have been issued under it.

All versions

All versions of the Evidence Standard, newest first.
VersionStatusIn force fromChange log
v1.0 (this page)Status: Draft — not yet adoptedNot in forceInitial draft prepared for founder and governance review. Not yet in force: no grades have been issued under it.