Skip to contentSkip to Content
ExperimentsExperiments

Experiments

Active

An experiment record is the unit of evidence in this archive. Every number that reaches a chapter or a paper comes from one, and every one of them is complete enough that the run can be repeated by someone else.

IDTestsProjectStatusResultReported in
EXP-001HYP-001PRJ-001plannedNoneCH05
EXP-002HYP-002PRJ-002plannedNoneCH06

Lifecycle

failed means the run did not execute correctly. invalidated means it executed but the result cannot be trusted, usually because a defect was found in the setup afterwards. Both stay on the site: the record of what was tried is part of the result.

What every record must contain

A record missing any of these is not yet an experiment record.

FieldWhy it is mandatory
HypothesisTies the run to a prediction made before it ran
ConfigurationThe exact parameters, in a file, not in prose
EnvironmentHardware, versions, commit pins
InputsDataset identifiers and versions
ResultsRaw observations, with uncertainty
AnalysisHow raw observations became reported numbers
InterpretationWhat it means, kept separate from what was observed
LimitationsWhat this run cannot support
ReproductionThe commands, in order, that repeat it

Adding an experiment

Copy templates/experiment-template.md, take the next number from registry/experiments.yaml, register it in the same commit, and write the hypothesis link before the run starts. The ordering rule in research methodology depends on it.

Last updated on