$ replaybook

Model results

DeepSeek V4.1 Flash 1017

deepseek/deepseek-v4.1-flash-1017

Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.

Repairs, timing and cost

ScenarioReleaseProvider / reasoningRepairsMedian timeKnown costEvidence
033-tls-trust-rotation v2core 20261024.0.0OpenRouter / high 3/30 unavailable 103s $0.02163/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20261024.0.0OpenRouter / high 3/30 unavailable 54s $0.05203/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261024.0.0OpenRouter / high 3/30 unavailable 58s $0.09103/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1core 20261024.0.0OpenRouter / high 2/30 unavailable 68s $0.07773/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261024.0.0OpenRouter / high 3/30 unavailable 68s $0.05593/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261024.0.0OpenRouter / high 3/30 unavailable 52s $0.01843/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261024.0.0OpenRouter / high 3/30 unavailable 98s $0.05093/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1core 20261024.0.0OpenRouter / high 3/30 unavailable 90s $0.02253/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261024.0.0OpenRouter / high 3/30 unavailable 150s $0.04883/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261024.0.0OpenRouter / high 3/30 unavailable 74s $0.04213/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261024.0.0OpenRouter / high 3/30 unavailable 50s $0.05523/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 131s $0.24733/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 229s $0.05733/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261020.0.0OpenRouter / Default 2/30 unavailable 659s $0.07853/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 151s $0.09033/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 107s $0.06433/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 412s $0.05133/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261020.0.0OpenRouter / Default 3/30 unavailable 166s $0.01163/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261020.0.0OpenRouter / Default 3/30 unavailable 131s $0.09383/3 trials report cost Inspect attempts →

Compare benchmark configurations → · All models