$ replaybook

Model results

Grok 4.7

x-ai/grok-4.7

Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.

Repairs, timing and cost

ScenarioReleaseProvider / reasoningRepairsMedian timeKnown costEvidence
033-tls-trust-rotation v2core 20261106.0.1OpenRouter / high 3/30 unavailable 183s $1.47703/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20261106.0.1OpenRouter / high 3/30 unavailable 350s $2.60123/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261106.0.1OpenRouter / high 3/30 unavailable 176s $1.37323/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1core 20261106.0.1OpenRouter / high 3/30 unavailable 220s $1.16783/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261106.0.1OpenRouter / high 2/30 unavailable 566s $3.21113/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261106.0.1OpenRouter / high 3/30 unavailable 212s $1.56023/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261106.0.1OpenRouter / high 3/30 unavailable 316s $1.63313/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1core 20261106.0.1OpenRouter / high 3/30 unavailable 167s $1.17583/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261106.0.1OpenRouter / high 3/30 unavailable 631s $4.49673/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261106.0.1OpenRouter / high 3/30 unavailable 222s $1.72493/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261106.0.1OpenRouter / high 3/30 unavailable 134s $0.85953/3 trials report cost Inspect attempts →

Compare benchmark configurations → · All models