Model results
deepseek/deepseek-v4.1-flash-1017
Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.
| Scenario | Release | Provider / reasoning | Repairs | Median time | Known cost | Evidence |
|---|---|---|---|---|---|---|
| 033-tls-trust-rotation v2core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 103s | $0.02163/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 54s | $0.05203/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 58s | $0.09103/3 trials report cost | Inspect attempts → |
| 023-auth-secret-rollout v1core | 20261024.0.0 | OpenRouter / high | 2/30 unavailable | 68s | $0.07773/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 68s | $0.05593/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 52s | $0.01843/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 98s | $0.05093/3 trials report cost | Inspect attempts → |
| 016-rails-pool-exhaustion v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 90s | $0.02253/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 150s | $0.04883/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v3core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 74s | $0.04213/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20261024.0.0 | OpenRouter / high | 3/30 unavailable | 50s | $0.05523/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 131s | $0.24733/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 229s | $0.05733/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20261020.0.0 | OpenRouter / Default | 2/30 unavailable | 659s | $0.07853/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 151s | $0.09033/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 107s | $0.06433/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 412s | $0.05133/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v3core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 166s | $0.01163/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 131s | $0.09383/3 trials report cost | Inspect attempts → |