$ replaybook

Model results

Kimi K3.1 Pro

moonshotai/kimi-k3.1-pro

Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.

Repairs, timing and cost

ScenarioReleaseProvider / reasoningRepairsMedian timeKnown costEvidence
033-tls-trust-rotation v2core 20261024.0.0OpenRouter / high 3/30 unavailable 170s $0.63093/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20261024.0.0OpenRouter / high 3/30 unavailable 199s $0.70343/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261024.0.0OpenRouter / high 3/30 unavailable 136s $0.58603/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1core 20261024.0.0OpenRouter / high 3/30 unavailable 166s $0.55783/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261024.0.0OpenRouter / high 3/30 unavailable 198s $0.73683/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261024.0.0OpenRouter / high 3/30 unavailable 137s $0.55863/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261024.0.0OpenRouter / high 3/30 unavailable 181s $0.55483/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1core 20261024.0.0OpenRouter / high 3/30 unavailable 128s $0.39823/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261024.0.0OpenRouter / high 3/30 unavailable 208s $0.42863/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261024.0.0OpenRouter / high 3/30 unavailable 158s $0.56823/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261024.0.0OpenRouter / high 3/30 unavailable 101s $0.35353/3 trials report cost Inspect attempts →

Compare benchmark configurations → · All models