Run 3a137d39
Jul 10, 2026, 13:17
OpenRouter · 26 models · repeat ×1
3a137d39-c10e-42a9-b5e1-6262a90dc8d7
Downloads
Audit pack
Results
26 models
| # | Adapter | Model | Think | Pass % | Cover % | Score | Outcomes | Time |
|---|---|---|---|---|---|---|---|---|
| 1 | OpenRouter | nemotron-3-nano-30b-a3b | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 6.1s |
#1 nemotron-3-nano-30b-a3bPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 2 | OpenRouter | nemotron-3-super-120b-a12b | Low | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 5.4s |
#2 nemotron-3-super-120b-a12bLowPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 3 | OpenRouter | nemotron-3-super-120b-a12b | Medium | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 7.4s |
#3 nemotron-3-super-120b-a12bMediumPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 4 | OpenRouter | nemotron-3-ultra-550b-a55b | High | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 19.0s |
#4 nemotron-3-ultra-550b-a55bHighPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 5 | OpenRouter | nemotron-3-ultra-550b-a55b | Medium | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 20.7s |
#5 nemotron-3-ultra-550b-a55bMediumPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 6 | OpenRouter | laguna-xs-2.1 | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 617ms |
#6 laguna-xs-2.1Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 7 | OpenRouter | hy3 | High | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 38.3s |
#7 hy3HighPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 8 | OpenRouter | hy3 | Low | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 19.8s |
#8 hy3LowPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 9 | OpenRouter | hy3 | None | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 2.9s |
#9 hy3NonePass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 10 | OpenRouter | dolphin-mistral-24b-venice-edition | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 627ms |
#10 dolphin-mistral-24b-venice-editionPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 11 | OpenRouter | north-mini-code | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 11.1s |
#11 north-mini-codePass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 12 | OpenRouter | lfm-2.5-1.2b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 506ms |
#12 lfm-2.5-1.2b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 13 | OpenRouter | lfm-2.5-1.2b-thinking | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 283ms |
#13 lfm-2.5-1.2b-thinkingPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 14 | OpenRouter | llama-3.2-3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 807ms |
#14 llama-3.2-3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 15 | OpenRouter | llama-3.3-70b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 601ms |
#15 llama-3.3-70b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 16 | OpenRouter | hermes-3-llama-3.1-405b | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 590ms |
#16 hermes-3-llama-3.1-405bPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 17 | OpenRouter | nemotron-nano-9b-v2 | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 21.9s |
#17 nemotron-nano-9b-v2Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 18 | OpenRouter | gpt-oss-120b | High | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 1.7s |
#18 gpt-oss-120bHighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 19 | OpenRouter | gpt-oss-120b | Low | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 1.2s |
#19 gpt-oss-120bLowPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 20 | OpenRouter | gpt-oss-120b | Medium | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 1.0s |
#20 gpt-oss-120bMediumPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 21 | OpenRouter | gpt-oss-20b | High | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 10.8s |
#21 gpt-oss-20bHighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 22 | OpenRouter | gpt-oss-20b | Low | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 10.7s |
#22 gpt-oss-20bLowPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 23 | OpenRouter | gpt-oss-20b | Medium | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 11.0s |
#23 gpt-oss-20bMediumPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 24 | OpenRouter | laguna-m.1 | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 10.4s |
#24 laguna-m.1Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 25 | OpenRouter | qwen3-coder | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 594ms |
#25 qwen3-coderPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 26 | OpenRouter | qwen3-next-80b-a3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 559ms |
#26 qwen3-next-80b-a3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.
Fixtures
1
gmod.player-iterator.v1