$ replaybook

Model results

Nemotron 3 Ultra 550B A55B

nvidia/nemotron-3-ultra-550b-a55b

Each row is an independent scenario cohort. Releases, providers and reasoning settings remain separate; these results are not pooled into a single model score.

Repairs, timing and cost

ScenarioReleaseProvider / reasoningRepairsMedian timeKnown costEvidence
033-tls-trust-rotation v2core 20261025.0.1OpenRouter / high 2/30 unavailable 195s $0.50093/3 trials report cost Inspect attempts →
028-nix-store-disk-pressure v1core 20261025.0.1OpenRouter / high 2/30 unavailable 87s $0.34073/3 trials report cost Inspect attempts →
024-discourse-interrupted-deploy v1core 20261025.0.1OpenRouter / high 0/30 unavailable 230s $0.47703/3 trials report cost Inspect attempts →
023-auth-secret-rollout v1core 20261025.0.1OpenRouter / high 2/30 unavailable 54s $0.16883/3 trials report cost Inspect attempts →
021-discourse-shared-uploads v1core 20261025.0.1OpenRouter / high 1/30 unavailable 150s $0.69623/3 trials report cost Inspect attempts →
019-rust-fd-leak v1core 20261025.0.1OpenRouter / high 2/30 unavailable 81s $0.18813/3 trials report cost Inspect attempts →
017-partial-rails-rollout v1core 20261025.0.1OpenRouter / high 3/30 unavailable 93s $0.25113/3 trials report cost Inspect attempts →
016-rails-pool-exhaustion v1core 20261025.0.1OpenRouter / high 3/30 unavailable 91s $0.13393/3 trials report cost Inspect attempts →
015-sidekiq-poison-pill v1core 20261025.0.1OpenRouter / high 3/30 unavailable 121s $0.39703/3 trials report cost Inspect attempts →
013-sidekiq-wrong-redis v3core 20261025.0.1OpenRouter / high 3/30 unavailable 51s $0.12003/3 trials report cost Inspect attempts →
001-nginx-502-host v1core 20261025.0.1OpenRouter / high 3/30 unavailable 31s $0.08353/3 trials report cost Inspect attempts →

Compare benchmark configurations → · All models