100.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261103.0.0
High reasoning
33/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.0000 · per repair: $0.0000 · median: 61s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
stealth/crouton-alpha
View attempts, timing and cost ↗
100.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261024.0.0
High reasoning
33/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $6.0769 · per repair: $0.1841 · median: 156s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
moonshotai/kimi-k3.1-pro
View attempts, timing and cost ↗
100.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261027.0.0
High reasoning
33/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $8.6620 · per repair: $0.2625 · median: 180s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
mistralai/mistral-large-4-0
View attempts, timing and cost ↗
100.0 / 100
openrouter · Claux bounded-search 25e7b9c (binary 7a7268af30cf)
Release 20261112.0.0
Default reasoning
33/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.3920 · per repair: $0.0119 · median: 109s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
nex-agi/nex-n2.6
View attempts, timing and cost ↗
100.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261028.0.0
High reasoning
33/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.9534 · per repair: $0.0289 · median: 54s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
particle-ai/particle-1
View attempts, timing and cost ↗
100.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261027.0.0
High reasoning
33/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $1.1666 · per repair: $0.0354 · median: 63s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
reflection/beam-1.0-501b-a23b
View attempts, timing and cost ↗
97.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261024.0.0
High reasoning
32/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.5362 · per repair: $0.0168 · median: 74s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
deepseek/deepseek-v4.1-flash-1017
View attempts, timing and cost ↗
97.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261027.0.1
High reasoning
32/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $4.7909 · per repair: $0.1497 · median: 80s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
fireworks/ember-1
View attempts, timing and cost ↗
97.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261106.0.1
High reasoning
32/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $21.2807 · per repair: $0.6650 · median: 220s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
x-ai/grok-4.7
View attempts, timing and cost ↗
97.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.2
High reasoning
32/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.4277 · per repair: $0.0134 · median: 216s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
qwen/qwen3.8-flash
View attempts, timing and cost ↗
97.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261024.0.0
High reasoning
32/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $11.9356 · per repair: $0.3730 · median: 132s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
qwen/qwen3.8-max-prime
View attempts, timing and cost ↗
97.0 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.2
High reasoning
32/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $2.6799 · per repair: $0.0837 · median: 274s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
tencent/hy4-preview
View attempts, timing and cost ↗
93.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.0
High reasoning
31/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $6.3197 · per repair: $0.2039 · median: 72s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
anthropic/claude-opus-5.5
View attempts, timing and cost ↗
93.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261026.0.0
High reasoning
31/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $1.7215 · per repair: $0.0555 · median: 99s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
z-ai/glm-5.3
View attempts, timing and cost ↗
93.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.1
High reasoning
31/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.4194 · per repair: $0.0135 · median: 72s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
z-ai/glm-5.3-flash
View attempts, timing and cost ↗
93.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.0
High reasoning
31/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: ≥$9.5315 · per repair: ≥$0.3075 · median: 227s
Cost reported for 32/33 trials.
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
google/gemini-4-argon
View attempts, timing and cost ↗
93.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.2
High reasoning
31/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.3198 · per repair: $0.0103 · median: 126s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
xiaomi/mimo-v2.6-flash
View attempts, timing and cost ↗
90.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.0
High reasoning
30/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: ≥$3.5375 · per repair: ≥$0.1179 · median: 81s
Cost reported for 32/33 trials.
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
openai/gpt-6.1-sol
View attempts, timing and cost ↗
90.9 / 100
openrouter · Claux bounded-search 25e7b9c (binary 7a7268af30cf)
Release 20261113.0.0
Default reasoning
30/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $5.8412 · per repair: $0.1947 · median: 84s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
google/gemini-4-hydrogen
View attempts, timing and cost ↗
90.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261026.0.0
High reasoning
30/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.9447 · per repair: $0.0315 · median: 329s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
xiaomi/mimo-v2.6-pro
View attempts, timing and cost ↗
90.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261026.0.0
High reasoning
30/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $6.3746 · per repair: $0.2125 · median: 152s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
bytedance-seed/seed-2-1-turbo
View attempts, timing and cost ↗
90.9 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.1
High reasoning
30/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $2.1953 · per repair: $0.0732 · median: 84s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
stepfun/step-5-preview
View attempts, timing and cost ↗
84.8 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261027.0.0
High reasoning
28/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: ≥$1.4007 · per repair: ≥$0.0500 · median: 540s
Cost reported for 32/33 trials.
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
minimax/minimax-m3.1-flash
View attempts, timing and cost ↗
72.7 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261025.0.1
High reasoning
24/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $3.3572 · per repair: $0.1399 · median: 88s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
nvidia/nemotron-3-ultra-550b-a55b
View attempts, timing and cost ↗
66.7 / 100
openrouter · Claux bounded-search 25e7b9c (binary 7a7268af30cf)
Release 20261115.0.0
Default reasoning
22/33 repairs · 11/11 scenarios
0 unavailable · 100.0% evaluated
Cost: $0.0000 · per repair: $0.0000 · median: 694s
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
inclusionai/ling-3.2-flash:free
View attempts, timing and cost ↗
54.5 / 100
openrouter · Claux custom build b959ef677ff7
Release 20261106.0.0
Default reasoning
18/33 repairs · 11/11 scenarios
2 unavailable · 93.9% evaluated
Cost: ≥$2.3439 · per repair: ≥$0.1302 · median: 759s
Cost reported for 31/33 trials.
Durable repairs by scenario
Scenario ID · passed / recorded. Select a cell to compare outcomes.
Exact model identity
ricursiveai/ripple-65b-preview
View attempts, timing and cost ↗