$ replaybook

Model results

GLM 5.3

z-ai/glm-5.3

Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.

Repairs, timing and cost

ScenarioReleaseProvider / reasoningRepairsMedian timeKnown costEvidence
033-tls-trust-rotation v2core 20261026.0.0OpenRouter / high 2/30 unavailable 105s $0.08603/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20261026.0.0OpenRouter / high 3/30 unavailable 113s $0.13023/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261026.0.0OpenRouter / high 3/30 unavailable 131s $0.37723/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1core 20261026.0.0OpenRouter / high 3/30 unavailable 85s $0.10593/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261026.0.0OpenRouter / high 3/30 unavailable 124s $0.32563/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261026.0.0OpenRouter / high 3/30 unavailable 80s $0.10503/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261026.0.0OpenRouter / high 3/30 unavailable 166s $0.11583/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1core 20261026.0.0OpenRouter / high 2/30 unavailable 79s $0.09973/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261026.0.0OpenRouter / high 3/30 unavailable 174s $0.25523/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261026.0.0OpenRouter / high 3/30 unavailable 92s $0.06723/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261026.0.0OpenRouter / high 3/30 unavailable 65s $0.05373/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20260906.0.0OpenRouter / high 3/30 unavailable 143s $0.44743/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20260906.0.0OpenRouter / high 3/30 unavailable 326s $0.57713/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20260906.0.0OpenRouter / high 3/30 unavailable 759s $1.76423/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20260906.0.0OpenRouter / high 3/30 unavailable 141s $0.48643/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20260906.0.0OpenRouter / high 3/30 unavailable 341s $0.38483/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20260906.0.0OpenRouter / high 3/30 unavailable 292s $0.77023/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v2core 20260906.0.0OpenRouter / high 3/30 unavailable 150s $0.26123/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20260906.0.0OpenRouter / high 3/30 unavailable 146s $0.47803/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20260822.0.0OpenRouter / high 3/30 unavailable 141s $0.33743/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20260822.0.0OpenRouter / high 3/30 unavailable 121s $0.44943/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20260822.0.0OpenRouter / high 2/30 unavailable 430s $1.00713/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20260822.0.0OpenRouter / high 3/30 unavailable 91s $0.24773/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20260822.0.0OpenRouter / high 3/30 unavailable 155s $0.50373/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20260822.0.0OpenRouter / high 3/30 unavailable 243s $0.48693/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v2core 20260822.0.0OpenRouter / high 3/30 unavailable 78s $0.20823/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20260822.0.0OpenRouter / high 3/30 unavailable 68s $0.13243/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20260821.0.1OpenRouter / high 3/30 unavailable 141s $0.33743/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20260821.0.1OpenRouter / high 3/30 unavailable 121s $0.44943/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20260821.0.1OpenRouter / high 2/30 unavailable 430s $1.00713/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20260821.0.1OpenRouter / high 3/30 unavailable 91s $0.24773/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20260821.0.1OpenRouter / high 3/30 unavailable 155s $0.50373/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20260821.0.1OpenRouter / high 3/30 unavailable 243s $0.48693/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v2core 20260821.0.1OpenRouter / high 3/30 unavailable 78s $0.20823/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20260821.0.1OpenRouter / high 3/30 unavailable 68s $0.13243/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1full 20260819.0.0OpenRouter / high 3/30 unavailable 166s $0.26103/3 trials report cost Inspect attempts →
027-partial-service-rollout v1full 20260819.0.0OpenRouter / high 3/30 unavailable 127s $0.23123/3 trials report cost Inspect attempts →
026-discourse-plugin-boot-loop v1full 20260819.0.0OpenRouter / high 3/30 unavailable 126s $0.28633/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1full 20260819.0.0OpenRouter / high 3/30 unavailable 162s $0.33063/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1full 20260819.0.0OpenRouter / high 3/30 unavailable 123s $0.29773/3 trials report cost Inspect attempts →
022-discourse-multisite-migration v1full 20260819.0.0OpenRouter / high 3/30 unavailable 119s $0.32293/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1full 20260819.0.0OpenRouter / high 3/30 unavailable 309s $0.58253/3 trials report cost Inspect attempts →
020-python-gunicorn-saturation v1full 20260819.0.0OpenRouter / high 2/30 unavailable 154s $0.21853/3 trials report cost Inspect attempts →
019-rust-fd-leak v1full 20260819.0.0OpenRouter / high 2/30 unavailable 123s $0.22553/3 trials report cost Inspect attempts →
018-node-event-loop-blocking v1full 20260819.0.0OpenRouter / high 2/30 unavailable 118s $0.21983/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1full 20260819.0.0OpenRouter / high 3/30 unavailable 178s $0.29403/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1full 20260819.0.0OpenRouter / high 3/30 unavailable 109s $0.16863/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1full 20260819.0.0OpenRouter / high 3/30 unavailable 254s $0.33443/3 trials report cost Inspect attempts →
014-missing-rails-migration v2full 20260819.0.0OpenRouter / high 3/30 unavailable 189s $0.29123/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v2full 20260819.0.0OpenRouter / high 3/30 unavailable 111s $0.18373/3 trials report cost Inspect attempts →
001-nginx-502-host v1full 20260819.0.0OpenRouter / high 3/30 unavailable 108s $0.16203/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1full 20260818.0.0OpenRouter / high 3/30 unavailable 136s $0.54263/3 trials report cost Inspect attempts →
027-partial-service-rollout v1full 20260818.0.0OpenRouter / high 3/30 unavailable 78s $0.23363/3 trials report cost Inspect attempts →
026-discourse-plugin-boot-loop v1full 20260818.0.0OpenRouter / high 3/30 unavailable 88s $0.24733/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1full 20260818.0.0OpenRouter / high 3/30 unavailable 115s $0.32163/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1full 20260818.0.0OpenRouter / high 3/30 unavailable 88s $0.26343/3 trials report cost Inspect attempts →
022-discourse-multisite-migration v1full 20260818.0.0OpenRouter / high 3/30 unavailable 73s $0.23513/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1full 20260818.0.0OpenRouter / high 3/30 unavailable 224s $0.62213/3 trials report cost Inspect attempts →
020-python-gunicorn-saturation v1full 20260818.0.0OpenRouter / high 3/30 unavailable 110s $0.30023/3 trials report cost Inspect attempts →
019-rust-fd-leak v1full 20260818.0.0OpenRouter / high 3/30 unavailable 92s $0.23083/3 trials report cost Inspect attempts →
018-node-event-loop-blocking v1full 20260818.0.0OpenRouter / high 3/30 unavailable 101s $0.24043/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1full 20260818.0.0OpenRouter / high 3/30 unavailable 155s $0.46083/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1full 20260818.0.0OpenRouter / high 2/30 unavailable 93s $0.19823/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1full 20260818.0.0OpenRouter / high 3/30 unavailable 177s $0.33483/3 trials report cost Inspect attempts →
014-missing-rails-migration v2full 20260818.0.0OpenRouter / high 3/30 unavailable 121s $0.28403/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v2full 20260818.0.0OpenRouter / high 3/30 unavailable 79s $0.19103/3 trials report cost Inspect attempts →
001-nginx-502-host v1full 20260818.0.0OpenRouter / high 3/30 unavailable 69s $0.17353/3 trials report cost Inspect attempts →

Compare benchmark configurations → · All models