Run 7b1432b7
Jul 10, 2026, 12:57
OpenRouter · 31 models · repeat ×1
7b1432b7-7796-46eb-a8ec-9b4a6d2c8712
Downloads
Audit pack
Results
31 models
| # | Adapter | Model | Think | Pass % | Cover % | Score | Outcomes | Time |
|---|---|---|---|---|---|---|---|---|
| 1 | OpenRouter | nemotron-3-nano-30b-a3b | — | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 11.4s |
#1 nemotron-3-nano-30b-a3bPass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 2 | OpenRouter | nemotron-3-ultra-550b-a55b | High | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 6.3s |
#2 nemotron-3-ultra-550b-a55bHighPass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 3 | OpenRouter | nemotron-3-ultra-550b-a55b | Medium | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 12.4s |
#3 nemotron-3-ultra-550b-a55bMediumPass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 4 | OpenRouter | gpt-oss-20b | Low | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 3.9s |
#4 gpt-oss-20bLowPass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 5 | OpenRouter | laguna-xs-2.1 | — | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 2.5s |
#5 laguna-xs-2.1Pass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 6 | OpenRouter | hy3 | High | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 23.6s |
#6 hy3HighPass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 7 | OpenRouter | hy3 | Low | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 13.0s |
#7 hy3LowPass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 8 | OpenRouter | hy3 | None | 80.0% | 100.0% | 90.0% | 4/1/0/0 | 2.5s |
#8 hy3NonePass rate80.0% 4 pass · 5 scored Coverage100.0% 5 / 5 evidence-bearing Verified score90.0% 95% interval — · 1 run(s) pass@k80.0% 4/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures4/5 passed in linked runplayer-iteratorents-iteratorhook-addisvalidnet-receivers | ||||||||
| 9 | OpenRouter | north-mini-code | — | 75.0% | 80.0% | 70.0% | 3/1/0/1 | 9.9s |
#9 north-mini-codePass rate75.0% 3 pass · 4 scored Coverage80.0% 4 / 5 evidence-bearing Verified score70.0% 95% interval — · 1 run(s) pass@k75.0% 3/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures3/5 passed in linked runents-iteratorplayer-iteratorhook-addisvalidnet-receivers | ||||||||
| 10 | OpenRouter | nemotron-3-super-120b-a12b | Low | 75.0% | 80.0% | 70.0% | 3/1/0/1 | 8.3s |
#10 nemotron-3-super-120b-a12bLowPass rate75.0% 3 pass · 4 scored Coverage80.0% 4 / 5 evidence-bearing Verified score70.0% 95% interval — · 1 run(s) pass@k75.0% 3/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures3/5 passed in linked runents-iteratorplayer-iteratorhook-addisvalidnet-receivers | ||||||||
| 11 | OpenRouter | nemotron-3-super-120b-a12b | Medium | 75.0% | 80.0% | 70.0% | 3/1/0/1 | 6.4s |
#11 nemotron-3-super-120b-a12bMediumPass rate75.0% 3 pass · 4 scored Coverage80.0% 4 / 5 evidence-bearing Verified score70.0% 95% interval — · 1 run(s) pass@k75.0% 3/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures3/5 passed in linked runhook-addplayer-iteratorents-iteratorisvalidnet-receivers | ||||||||
| 12 | OpenRouter | gpt-oss-20b | Medium | 75.0% | 80.0% | 70.0% | 3/1/0/1 | 6.4s |
#12 gpt-oss-20bMediumPass rate75.0% 3 pass · 4 scored Coverage80.0% 4 / 5 evidence-bearing Verified score70.0% 95% interval — · 1 run(s) pass@k75.0% 3/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures3/5 passed in linked runents-iteratorplayer-iteratorhook-addisvalidnet-receivers | ||||||||
| 13 | OpenRouter | nemotron-nano-12b-v2-vl | — | 100.0% | 40.0% | 40.0% | 2/0/0/2 | 39.2s |
#13 nemotron-nano-12b-v2-vlPass rate100.0% 2 pass · 2 scored Coverage40.0% 2 / 5 evidence-bearing Verified score40.0% 95% interval — · 1 run(s) pass@k100.0% 2/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures2/5 passed in linked runnet-receiversents-iteratorplayer-iteratorhook-addisvalid | ||||||||
| 14 | OpenRouter | gemma-4-26b-a4b-it | — | 100.0% | 20.0% | 20.0% | 1/0/0/4 | 1.2s |
#14 gemma-4-26b-a4b-itPass rate100.0% 1 pass · 1 scored Coverage20.0% 1 / 5 evidence-bearing Verified score20.0% 95% interval — · 1 run(s) pass@k100.0% 1/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures1/5 passed in linked runhook-addisvalidnet-receiversplayer-iteratorents-iterator | ||||||||
| 15 | OpenRouter | gpt-oss-120b | Low | 0.0% | 20.0% | 10.0% | 0/1/0/4 | 5.5s |
#15 gpt-oss-120bLowPass rate0.0% 0 pass · 1 scored Coverage20.0% 1 / 5 evidence-bearing Verified score10.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runhook-addisvalidnet-receiversplayer-iteratorents-iterator | ||||||||
| 16 | OpenRouter | gpt-oss-120b | Medium | 0.0% | 20.0% | 10.0% | 0/1/0/4 | 5.2s |
#16 gpt-oss-120bMediumPass rate0.0% 0 pass · 1 scored Coverage20.0% 1 / 5 evidence-bearing Verified score10.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 17 | OpenRouter | nemotron-3-nano-omni-30b-a3b-reasoning | — | 0.0% | 0.0% | 0.0% | 0/0/0/0 | 120.0s |
#17 nemotron-3-nano-omni-30b-a3b-reasoningPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 18 | OpenRouter | dolphin-mistral-24b-venice-edition | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 710ms |
#18 dolphin-mistral-24b-venice-editionPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 19 | OpenRouter | gemma-4-31b-it | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 1.3s |
#19 gemma-4-31b-itPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 20 | OpenRouter | lfm-2.5-1.2b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 184ms |
#20 lfm-2.5-1.2b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 21 | OpenRouter | lfm-2.5-1.2b-thinking | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 263ms |
#21 lfm-2.5-1.2b-thinkingPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 22 | OpenRouter | llama-3.2-3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 662ms |
#22 llama-3.2-3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 23 | OpenRouter | llama-3.3-70b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 1.0s |
#23 llama-3.3-70b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 24 | OpenRouter | hermes-3-llama-3.1-405b | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 676ms |
#24 hermes-3-llama-3.1-405bPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 25 | OpenRouter | nemotron-3.5-content-safety | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 3.0s |
#25 nemotron-3.5-content-safetyPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 26 | OpenRouter | nemotron-nano-9b-v2 | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 9.9s |
#26 nemotron-nano-9b-v2Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 27 | OpenRouter | gpt-oss-120b | High | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 2.2s |
#27 gpt-oss-120bHighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 28 | OpenRouter | gpt-oss-20b | High | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 10.8s |
#28 gpt-oss-20bHighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 29 | OpenRouter | laguna-m.1 | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 14.7s |
#29 laguna-m.1Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 30 | OpenRouter | qwen3-coder | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 893ms |
#30 qwen3-coderPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
| 31 | OpenRouter | qwen3-next-80b-a3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/5 | 909ms |
#31 qwen3-next-80b-a3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 5 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/5 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/5 passed in linked runents-iteratorhook-addisvalidnet-receiversplayer-iterator | ||||||||
Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.
Fixtures
5
gmod.ents-iterator.v1gmod.hook-add.v1gmod.isvalid.v1gmod.net-receivers.v1gmod.player-iterator.v1