Does this paper’s improvement hold under our compute budget, and is the method worth pursuing?
Workspace preview
Discuss a pilot ↗INTERFACE ONLY
No code execution or AI assistance. Explore freely.
Example file
# Match conditions before comparing methods.for seed in [11, 23, 37]:config = ExperimentConfig(seed=seed, steps=1200,dataset="fixed_split_v1")baseline = run("baseline", config)method = run("proposed", config)log_pair(seed, baseline, method)# Report all runs, including failed attempts.write_report(results, compute_budget)
OUTPUT
Code execution is disabled in this preview.
You can browse and edit the example files. Changes stay in this tab until you reset or leave.Scenario context
Browse files. Arrange the workspace. Get a feel for the candidate experience.