Model results
anthropic/claude-haiku-5.5
Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.
| Scenario | Release | Provider / reasoning | Repairs | Median time | Known cost | Evidence |
|---|---|---|---|---|---|---|
| 028-nix-store-disk-pressure v1core | 20261020.0.0 | OpenRouter / Default | 2/30 unavailable | 66s | $0.09093/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20261020.0.0 | OpenRouter / Default | 2/30 unavailable | 79s | $0.08703/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 65s | $0.06703/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 40s | $0.03973/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 88s | $0.06113/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 111s | $0.07133/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v3core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 48s | $0.04963/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20261020.0.0 | OpenRouter / Default | 3/30 unavailable | 27s | $0.03693/3 trials report cost | Inspect attempts → |