Run c0a6995e
Jul 10, 2026, 12:32
OpenRouter · 23 models · repeat ×1
c0a6995e-c299-4720-85b9-41f114cf0fa8
Downloads
Audit pack
Results
23 models
| # | Adapter | Model | Think | Pass % | Cover % | Score | Outcomes | Time |
|---|---|---|---|---|---|---|---|---|
| 1 | OpenRouter | nemotron-3-nano-30b-a3b | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 6.5s |
#1 nemotron-3-nano-30b-a3bPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 2 | OpenRouter | nemotron-3-super-120b-a12b | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 9.4s |
#2 nemotron-3-super-120b-a12bPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 3 | OpenRouter | nemotron-3-ultra-550b-a55b | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 2.1s |
#3 nemotron-3-ultra-550b-a55bPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 4 | OpenRouter | nemotron-nano-12b-v2-vl | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 1.3s |
#4 nemotron-nano-12b-v2-vlPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 5 | OpenRouter | gpt-oss-20b | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 8.3s |
#5 gpt-oss-20bPass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 6 | OpenRouter | laguna-xs-2.1 | — | 0.0% | 100.0% | 50.0% | 0/1/0/0 | 22.8s |
#6 laguna-xs-2.1Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 7 | OpenRouter | nemotron-3-nano-omni-30b-a3b-reasoning | — | 0.0% | 0.0% | 0.0% | 0/0/0/0 | 90.0s |
#7 nemotron-3-nano-omni-30b-a3b-reasoningPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 8 | OpenRouter | dolphin-mistral-24b-venice-edition | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 482ms |
#8 dolphin-mistral-24b-venice-editionPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 9 | OpenRouter | north-mini-code | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 19.8s |
#9 north-mini-codePass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 10 | OpenRouter | gemma-4-26b-a4b-it | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 494ms |
#10 gemma-4-26b-a4b-itPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 11 | OpenRouter | gemma-4-31b-it | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 761ms |
#11 gemma-4-31b-itPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 12 | OpenRouter | lfm-2.5-1.2b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 315ms |
#12 lfm-2.5-1.2b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 13 | OpenRouter | lfm-2.5-1.2b-thinking | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 307ms |
#13 lfm-2.5-1.2b-thinkingPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 14 | OpenRouter | llama-3.2-3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 325ms |
#14 llama-3.2-3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 15 | OpenRouter | llama-3.3-70b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 294ms |
#15 llama-3.3-70b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 16 | OpenRouter | hermes-3-llama-3.1-405b | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 321ms |
#16 hermes-3-llama-3.1-405bPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 17 | OpenRouter | nemotron-3.5-content-safety | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 2.3s |
#17 nemotron-3.5-content-safetyPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 18 | OpenRouter | nemotron-nano-9b-v2 | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 20.2s |
#18 nemotron-nano-9b-v2Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 19 | OpenRouter | gpt-oss-120b | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 531ms |
#19 gpt-oss-120bPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 20 | OpenRouter | laguna-m.1 | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 26.9s |
#20 laguna-m.1Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 21 | OpenRouter | qwen3-coder | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 327ms |
#21 qwen3-coderPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 22 | OpenRouter | qwen3-next-80b-a3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 264ms |
#22 qwen3-next-80b-a3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
| 23 | OpenRouter | hy3 | — | 0.0% | 0.0% | 0.0% | 0/0/0/1 | 21.0s |
#23 hy3Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/1 passed in linked runplayer-iterator | ||||||||
Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.
Fixtures
1
gmod.player-iterator.v1