$ replaybook

Model results

Mercury 3

inception/mercury-3

Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.

Repairs, timing and cost

ScenarioReleaseProvider / reasoningRepairsMedian timeKnown costEvidence
028-nix-store-disk-pressure v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 67s $0.04293/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261020.0.0OpenRouter / Default 2/30 unavailable 46s $0.03483/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261020.0.0OpenRouter / Default 1/30 unavailable 62s $0.05393/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 43s $0.02993/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 75s $0.03693/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 87s $0.04443/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261020.0.0OpenRouter / Default 3/30 unavailable 33s $0.01763/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 26s $0.02093/3 trials report cost Inspect attempts →

Compare benchmark configurations → · All models