Methodology
DraftThe thesis methodology describes the design of the studies the thesis reports. This page describes the programme-level method: how a question becomes a hypothesis, a hypothesis becomes an experiment, and a result becomes a claim.
The loop
Rules the loop is held to
- A hypothesis is written before the experiment that tests it runs. The
EXP-record names theHYP-it tests, and the hypothesis page is dated earlier. Reordering these is how a post-hoc observation becomes a false prediction. - A failed run is recorded, not deleted. Its status becomes
failedorinvalidated, with the reason. The set of things tried is part of the result. - A number that appears in prose exists in a registered artifact. If it cannot be pointed at, it cannot be written.
- A claim names its evidence. Claims with no evidence are conjectures and are labelled as such.
Evidence standards
| Claim type | Minimum evidence |
|---|---|
| Existence | One reproducible run, fully specified |
| Improvement | Comparison against a named baseline, with uncertainty stated |
| Generality | Results across at least two independent conditions |
| Mechanism | A prediction the mechanism makes that a rival does not, tested |
Uncertainty
Every reported quantity carries an uncertainty. A single-run number with no spread is reported as a single run, never as a measurement.
Last updated on