ML research
Reproduce a research claim within a compute budget
reproduce.py · illustrative excerpt
# Match conditions before comparing methods.
for seed in [11, 23, 37]:
config = ExperimentConfig(
seed=seed, steps=1200,
dataset="fixed_split_v1"
)
baseline = run("baseline", config)
method = run("proposed", config)
log_pair(seed, baseline, method)
# Report all runs, including failed attempts.
write_report(results, compute_budget)Example dialogue showing how working context enters the task.
