Run a9024895

Name: gmod-bench run a9024895-be0b-4ae8-8ce8-146ec0e338f9
Creator: gmod-bench
License: https://github.com/Iydah/gmod-bench/blob/main/LICENSE

Jul 10, 2026, 13:32

OpenRouter · 31 models · repeat ×1

a9024895-be0b-4ae8-8ce8-146ec0e338f9

Fixtures

Attempts

Models

35m 30s

Duration

OpenRouter×1 repeat

Downloads

Audit pack

Results

31 models

#	Adapter	Model	Think	Pass %	Cover %	Score	Outcomes	Time
1	OpenRouter	nemotron-3-super-120b-a12b	Low	0.0%	100.0%	50.0%	0/1/0/0	3.2s
#1 nemotron-3-super-120b-a12b Low OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 3.2s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-super-120b-a12b:free@low Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
2	OpenRouter	nemotron-3-ultra-550b-a55b	High	0.0%	100.0%	50.0%	0/1/0/0	5.0s
#2 nemotron-3-ultra-550b-a55b High OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 5.0s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
3	OpenRouter	nemotron-3-ultra-550b-a55b	Medium	0.0%	100.0%	50.0%	0/1/0/0	11.8s
#3 nemotron-3-ultra-550b-a55b Medium OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 11.8s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
4	OpenRouter	gpt-oss-120b	High	0.0%	100.0%	50.0%	0/1/0/0	60.3s
#4 gpt-oss-120b High OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 60.3s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/openai/gpt-oss-120b:free@high Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
5	OpenRouter	gpt-oss-20b	Low	0.0%	100.0%	50.0%	0/1/0/0	6.2s
#5 gpt-oss-20b Low OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 6.2s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/openai/gpt-oss-20b:free@low Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
6	OpenRouter	gpt-oss-20b	Medium	0.0%	100.0%	50.0%	0/1/0/0	10.7s
#6 gpt-oss-20b Medium OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 10.7s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/openai/gpt-oss-20b:free@medium Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
7	OpenRouter	laguna-xs-2.1	—	0.0%	100.0%	50.0%	0/1/0/0	804ms
#7 laguna-xs-2.1 OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 804ms Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/poolside/laguna-xs-2.1:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
8	OpenRouter	hy3	High	0.0%	100.0%	50.0%	0/1/0/0	42.1s
#8 hy3 High OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 42.1s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/tencent/hy3:free@high Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
9	OpenRouter	hy3	Low	0.0%	100.0%	50.0%	0/1/0/0	21.7s
#9 hy3 Low OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 21.7s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/tencent/hy3:free@low Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
10	OpenRouter	hy3	None	0.0%	100.0%	50.0%	0/1/0/0	3.3s
#10 hy3 None OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial1 Wrong0 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 3.3s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/tencent/hy3:free@none Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
11	OpenRouter	north-mini-code	—	0.0%	100.0%	0.0%	0/0/1/0	11.2s
#11 north-mini-code OpenRouter Pass rate0.0% 0 pass · 1 scored Coverage100.0% 1 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong1 Invalid output0 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored1 Passed0 Fixtures solved0/1 Run facts Avg time 11.2s Repeat Single-shot Evidence share 1/1 (100.0%) Verified runs 1 95% interval — Raw label openrouter/cohere/north-mini-code:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
12	OpenRouter	nemotron-3-nano-omni-30b-a3b-reasoning	—	0.0%	0.0%	0.0%	0/0/0/0	120.0s
#12 nemotron-3-nano-omni-30b-a3b-reasoning OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output0 Harness1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 120.0s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
13	OpenRouter	dolphin-mistral-24b-venice-edition	—	0.0%	0.0%	0.0%	0/0/0/1	2.0s
#13 dolphin-mistral-24b-venice-edition OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.0s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
14	OpenRouter	gemma-4-26b-a4b-it	—	0.0%	0.0%	0.0%	0/0/0/1	21.7s
#14 gemma-4-26b-a4b-it OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 21.7s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/google/gemma-4-26b-a4b-it:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
15	OpenRouter	gemma-4-31b-it	—	0.0%	0.0%	0.0%	0/0/0/1	4.4s
#15 gemma-4-31b-it OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 4.4s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/google/gemma-4-31b-it:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
16	OpenRouter	lfm-2.5-1.2b-instruct	—	0.0%	0.0%	0.0%	0/0/0/1	2.1s
#16 lfm-2.5-1.2b-instruct OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.1s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/liquid/lfm-2.5-1.2b-instruct:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
17	OpenRouter	lfm-2.5-1.2b-thinking	—	0.0%	0.0%	0.0%	0/0/0/1	2.0s
#17 lfm-2.5-1.2b-thinking OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.0s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/liquid/lfm-2.5-1.2b-thinking:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
18	OpenRouter	llama-3.2-3b-instruct	—	0.0%	0.0%	0.0%	0/0/0/1	2.0s
#18 llama-3.2-3b-instruct OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.0s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/meta-llama/llama-3.2-3b-instruct:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
19	OpenRouter	llama-3.3-70b-instruct	—	0.0%	0.0%	0.0%	0/0/0/1	2.3s
#19 llama-3.3-70b-instruct OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.3s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/meta-llama/llama-3.3-70b-instruct:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
20	OpenRouter	hermes-3-llama-3.1-405b	—	0.0%	0.0%	0.0%	0/0/0/1	2.0s
#20 hermes-3-llama-3.1-405b OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.0s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nousresearch/hermes-3-llama-3.1-405b:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
21	OpenRouter	nemotron-3-nano-30b-a3b	—	0.0%	0.0%	0.0%	0/0/0/1	11.6s
#21 nemotron-3-nano-30b-a3b OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 11.6s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-nano-30b-a3b:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
22	OpenRouter	nemotron-3-super-120b-a12b	Medium	0.0%	0.0%	0.0%	0/0/0/1	4.2s
#22 nemotron-3-super-120b-a12b Medium OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 4.2s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
23	OpenRouter	nemotron-3.5-content-safety	—	0.0%	0.0%	0.0%	0/0/0/1	3.2s
#23 nemotron-3.5-content-safety OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 3.2s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3.5-content-safety:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
24	OpenRouter	nemotron-nano-12b-v2-vl	—	0.0%	0.0%	0.0%	0/0/0/1	28.8s
#24 nemotron-nano-12b-v2-vl OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 28.8s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-nano-12b-v2-vl:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
25	OpenRouter	nemotron-nano-9b-v2	—	0.0%	0.0%	0.0%	0/0/0/1	35.3s
#25 nemotron-nano-9b-v2 OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 35.3s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-nano-9b-v2:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
26	OpenRouter	gpt-oss-120b	Low	0.0%	0.0%	0.0%	0/0/0/1	3.9s
#26 gpt-oss-120b Low OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 3.9s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/openai/gpt-oss-120b:free@low Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
27	OpenRouter	gpt-oss-120b	Medium	0.0%	0.0%	0.0%	0/0/0/1	4.2s
#27 gpt-oss-120b Medium OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 4.2s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/openai/gpt-oss-120b:free@medium Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
28	OpenRouter	gpt-oss-20b	High	0.0%	0.0%	0.0%	0/0/0/1	11.4s
#28 gpt-oss-20b High OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 11.4s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/openai/gpt-oss-20b:free@high Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
29	OpenRouter	laguna-m.1	—	0.0%	0.0%	0.0%	0/0/0/1	8.6s
#29 laguna-m.1 OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 8.6s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/poolside/laguna-m.1:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
30	OpenRouter	qwen3-coder	—	0.0%	0.0%	0.0%	0/0/0/1	2.5s
#30 qwen3-coder OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.5s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/qwen/qwen3-coder:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator
31	OpenRouter	qwen3-next-80b-a3b-instruct	—	0.0%	0.0%	0.0%	0/0/0/1	2.7s
#31 qwen3-next-80b-a3b-instruct OpenRouter Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 1 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/1 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts1 Scored0 Passed0 Fixtures solved0/1 Run facts Avg time 2.7s Repeat Single-shot Evidence share 0/1 (0.0%) Verified runs 1 95% interval — Raw label openrouter/qwen/qwen3-next-80b-a3b-instruct:free Run id a9024895-be0b-4ae8-8ce8-146ec0e338f9 Latest run fixtures 0/1 passed in linked run player-iterator

Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.

Fixtures

gmod.player-iterator.v1

Downloads

Results

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel