Model results
stepfun/step-5-preview
Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.
| Scenario | Release | Provider / reasoning | Repairs | Median time | Known cost | Evidence |
|---|---|---|---|---|---|---|
| 033-tls-trust-rotation v2core | 20261025.0.1 | OpenRouter / high | 2/30 unavailable | 86s | $0.17943/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 74s | $0.17643/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20261025.0.1 | OpenRouter / high | 2/30 unavailable | 87s | $0.21443/3 trials report cost | Inspect attempts → |
| 023-auth-secret-rollout v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 71s | $0.22703/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 158s | $0.31703/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 67s | $0.17163/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 132s | $0.21473/3 trials report cost | Inspect attempts → |
| 016-rails-pool-exhaustion v1core | 20261025.0.1 | OpenRouter / high | 2/30 unavailable | 88s | $0.16673/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 119s | $0.22453/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v3core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 80s | $0.17733/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20261025.0.1 | OpenRouter / high | 3/30 unavailable | 52s | $0.12623/3 trials report cost | Inspect attempts → |