Model results
z-ai/glm-5.3
Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.
| Scenario | Release | Provider / reasoning | Repairs | Median time | Known cost | Evidence |
|---|---|---|---|---|---|---|
| 033-tls-trust-rotation v2core | 20261026.0.0 | OpenRouter / high | 2/30 unavailable | 105s | $0.08603/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 113s | $0.13023/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 131s | $0.37723/3 trials report cost | Inspect attempts → |
| 023-auth-secret-rollout v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 85s | $0.10593/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 124s | $0.32563/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 80s | $0.10503/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 166s | $0.11583/3 trials report cost | Inspect attempts → |
| 016-rails-pool-exhaustion v1core | 20261026.0.0 | OpenRouter / high | 2/30 unavailable | 79s | $0.09973/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 174s | $0.25523/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v3core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 92s | $0.06723/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20261026.0.0 | OpenRouter / high | 3/30 unavailable | 65s | $0.05373/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 143s | $0.44743/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 326s | $0.57713/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 759s | $1.76423/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 141s | $0.48643/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 341s | $0.38483/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 292s | $0.77023/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v2core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 150s | $0.26123/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20260906.0.0 | OpenRouter / high | 3/30 unavailable | 146s | $0.47803/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 141s | $0.33743/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 121s | $0.44943/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20260822.0.0 | OpenRouter / high | 2/30 unavailable | 430s | $1.00713/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 91s | $0.24773/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 155s | $0.50373/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 243s | $0.48693/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v2core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 78s | $0.20823/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20260822.0.0 | OpenRouter / high | 3/30 unavailable | 68s | $0.13243/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 141s | $0.33743/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 121s | $0.44943/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1core | 20260821.0.1 | OpenRouter / high | 2/30 unavailable | 430s | $1.00713/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 91s | $0.24773/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 155s | $0.50373/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 243s | $0.48693/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v2core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 78s | $0.20823/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1core | 20260821.0.1 | OpenRouter / high | 3/30 unavailable | 68s | $0.13243/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 166s | $0.26103/3 trials report cost | Inspect attempts → |
| 027-partial-service-rollout v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 127s | $0.23123/3 trials report cost | Inspect attempts → |
| 026-discourse-plugin-boot-loop v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 126s | $0.28633/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 162s | $0.33063/3 trials report cost | Inspect attempts → |
| 023-auth-secret-rollout v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 123s | $0.29773/3 trials report cost | Inspect attempts → |
| 022-discourse-multisite-migration v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 119s | $0.32293/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 309s | $0.58253/3 trials report cost | Inspect attempts → |
| 020-python-gunicorn-saturation v1full | 20260819.0.0 | OpenRouter / high | 2/30 unavailable | 154s | $0.21853/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1full | 20260819.0.0 | OpenRouter / high | 2/30 unavailable | 123s | $0.22553/3 trials report cost | Inspect attempts → |
| 018-node-event-loop-blocking v1full | 20260819.0.0 | OpenRouter / high | 2/30 unavailable | 118s | $0.21983/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 178s | $0.29403/3 trials report cost | Inspect attempts → |
| 016-rails-pool-exhaustion v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 109s | $0.16863/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 254s | $0.33443/3 trials report cost | Inspect attempts → |
| 014-missing-rails-migration v2full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 189s | $0.29123/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v2full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 111s | $0.18373/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1full | 20260819.0.0 | OpenRouter / high | 3/30 unavailable | 108s | $0.16203/3 trials report cost | Inspect attempts → |
| 028-nix-store-disk-pressure v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 136s | $0.54263/3 trials report cost | Inspect attempts → |
| 027-partial-service-rollout v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 78s | $0.23363/3 trials report cost | Inspect attempts → |
| 026-discourse-plugin-boot-loop v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 88s | $0.24733/3 trials report cost | Inspect attempts → |
| 024-discourse-interrupted-deploy v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 115s | $0.32163/3 trials report cost | Inspect attempts → |
| 023-auth-secret-rollout v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 88s | $0.26343/3 trials report cost | Inspect attempts → |
| 022-discourse-multisite-migration v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 73s | $0.23513/3 trials report cost | Inspect attempts → |
| 021-discourse-shared-uploads v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 224s | $0.62213/3 trials report cost | Inspect attempts → |
| 020-python-gunicorn-saturation v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 110s | $0.30023/3 trials report cost | Inspect attempts → |
| 019-rust-fd-leak v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 92s | $0.23083/3 trials report cost | Inspect attempts → |
| 018-node-event-loop-blocking v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 101s | $0.24043/3 trials report cost | Inspect attempts → |
| 017-partial-rails-rollout v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 155s | $0.46083/3 trials report cost | Inspect attempts → |
| 016-rails-pool-exhaustion v1full | 20260818.0.0 | OpenRouter / high | 2/30 unavailable | 93s | $0.19823/3 trials report cost | Inspect attempts → |
| 015-sidekiq-poison-pill v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 177s | $0.33483/3 trials report cost | Inspect attempts → |
| 014-missing-rails-migration v2full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 121s | $0.28403/3 trials report cost | Inspect attempts → |
| 013-sidekiq-wrong-redis v2full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 79s | $0.19103/3 trials report cost | Inspect attempts → |
| 001-nginx-502-host v1full | 20260818.0.0 | OpenRouter / high | 3/30 unavailable | 69s | $0.17353/3 trials report cost | Inspect attempts → |