# GMod Bench report

Run: `7b1432b7-7796-46eb-a8ec-9b4a6d2c8712`
Fixtures: `gmod.ents-iterator.v1`, `gmod.hook-add.v1`, `gmod.isvalid.v1`, `gmod.net-receivers.v1`, `gmod.player-iterator.v1`
Repeat: 1 · Concurrency: 2
Started: 2026-07-10T12:39:25.296Z · Completed: 2026-07-10T12:57:18.796Z
Wall clock: 1074s · Sum of attempt durations: 1624875ms (avg 10483ms, min 133ms, max 120002ms)

## Model leaderboard

Sorted by **fixture score** (each fixture weighted equally; failures score zero), then fixture solve rate, coverage, and pass rate.

| Rank | Runner / model | Fixture score | Fixture solve | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | Fixture pass | Scored quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `openrouter/nvidia/nemotron-3-nano-30b-a3b:free` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 11364 | 934/2556 |
| 2 | `openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 6323 | 934/2515 |
| 3 | `openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 12403 | 934/4634 |
| 4 | `openrouter/openai/gpt-oss-20b:free@low` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 3921 | 1222/583 |
| 5 | `openrouter/poolside/laguna-xs-2.1:free` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 2498 | 909/318 |
| 6 | `openrouter/tencent/hy3:free@high` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 23582 | 904/9114 |
| 7 | `openrouter/tencent/hy3:free@low` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 12965 | 904/3854 |
| 8 | `openrouter/tencent/hy3:free@none` | 90.0% | 80.0% | 4 | 1 | 0 | 5 | 100.0% | 80.0% | 80.0% | 0.90 | 0 | 4/5 | 2481 | 919/288 |
| 9 | `openrouter/cohere/north-mini-code:free` | 70.0% | 60.0% | 3 | 1 | 0 | 4 | 80.0% | 75.0% | 75.0% | 0.88 | 1 | 3/5 | 9877 | 819/3437 |
| 10 | `openrouter/nvidia/nemotron-3-super-120b-a12b:free@low` | 70.0% | 60.0% | 3 | 1 | 0 | 4 | 80.0% | 75.0% | 75.0% | 0.88 | 1 | 3/5 | 8349 | 934/1746 |
| 11 | `openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium` | 70.0% | 60.0% | 3 | 1 | 0 | 4 | 80.0% | 75.0% | 75.0% | 0.88 | 1 | 3/5 | 6356 | 934/1933 |
| 12 | `openrouter/openai/gpt-oss-20b:free@medium` | 70.0% | 60.0% | 3 | 1 | 0 | 4 | 80.0% | 75.0% | 75.0% | 0.88 | 1 | 3/5 | 6428 | 981/920 |
| 13 | `openrouter/nvidia/nemotron-nano-12b-v2-vl:free` | 40.0% | 40.0% | 2 | 0 | 0 | 2 | 40.0% | 100.0% | 100.0% | 1.00 | 2 | 2/5 | 39157 | 728/3169 |
| 14 | `openrouter/google/gemma-4-26b-a4b-it:free` | 20.0% | 20.0% | 1 | 0 | 0 | 1 | 20.0% | 100.0% | 100.0% | 1.00 | 4 | 1/5 | 1241 | 166/70 |
| 15 | `openrouter/openai/gpt-oss-120b:free@low` | 10.0% | 0.0% | 0 | 1 | 0 | 1 | 20.0% | 0.0% | 0.0% | 0.50 | 4 | 0/5 | 5546 | 235/242 |
| 16 | `openrouter/openai/gpt-oss-120b:free@medium` | 10.0% | 0.0% | 0 | 1 | 0 | 1 | 20.0% | 0.0% | 0.0% | 0.50 | 4 | 0/5 | 5242 | 237/235 |
| 17 | `openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 0 | 0/5 | 120002 | 0/0 |
| 18 | `openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 710 | 0/0 |
| 19 | `openrouter/google/gemma-4-31b-it:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 1293 | 0/0 |
| 20 | `openrouter/liquid/lfm-2.5-1.2b-instruct:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 184 | 0/0 |
| 21 | `openrouter/liquid/lfm-2.5-1.2b-thinking:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 263 | 0/0 |
| 22 | `openrouter/meta-llama/llama-3.2-3b-instruct:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 662 | 0/0 |
| 23 | `openrouter/meta-llama/llama-3.3-70b-instruct:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 1026 | 0/0 |
| 24 | `openrouter/nousresearch/hermes-3-llama-3.1-405b:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 676 | 0/0 |
| 25 | `openrouter/nvidia/nemotron-3.5-content-safety:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 3032 | 2650/1142 |
| 26 | `openrouter/nvidia/nemotron-nano-9b-v2:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 9940 | 909/2272 |
| 27 | `openrouter/openai/gpt-oss-120b:free@high` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 2223 | 0/0 |
| 28 | `openrouter/openai/gpt-oss-20b:free@high` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 10766 | 0/0 |
| 29 | `openrouter/poolside/laguna-m.1:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 14661 | 954/2427 |
| 30 | `openrouter/qwen/qwen3-coder:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 893 | 0/0 |
| 31 | `openrouter/qwen/qwen3-next-80b-a3b-instruct:free` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 5 | 0/5 | 909 | 0/0 |

## Rates

- Scored attempts: 61
- Pass / partial / incorrect: 47 / 14 / 0
- Pass rate (scored): 47/61
- Fixture pass rate (passed fixture groups / scored fixture groups): 47/61
- Overall mean score (pass=1, partial=0.5): —
- Protocol errors: 88
- Policy violations: 0
- Trace errors: 0
- Timeouts: 6
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 17207
- Completion tokens: 41455
- Reasoning tokens: 0
- Total tokens: 58662
- Cached prompt tokens: 464
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 81 (provider 81, estimated 0)
- Answer bytes (sum): 0
- Attempt duration avg/min/max: 10483 / 133 / 120002 ms

## Groups (single-sample result + mean score)

| Fixture | Runner | K | Passes | Passed | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/google/gemma-4-26b-a4b-it:free | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/google/gemma-4-31b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/liquid/lfm-2.5-1.2b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/liquid/lfm-2.5-1.2b-thinking:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/meta-llama/llama-3.2-3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/meta-llama/llama-3.3-70b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/nousresearch/hermes-3-llama-3.1-405b:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | 0 | no | — | timeout |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3.5-content-safety:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-nano-12b-v2-vl:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-nano-9b-v2:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/openai/gpt-oss-120b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/openai/gpt-oss-120b:free@low | 1 | 0 | no | — | partial |
| gmod.ents-iterator.v1 | openrouter/openai/gpt-oss-120b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/openai/gpt-oss-20b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/openai/gpt-oss-20b:free@low | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/openai/gpt-oss-20b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/poolside/laguna-m.1:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/qwen/qwen3-coder:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/qwen/qwen3-next-80b-a3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/google/gemma-4-26b-a4b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/google/gemma-4-31b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/liquid/lfm-2.5-1.2b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/liquid/lfm-2.5-1.2b-thinking:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/meta-llama/llama-3.2-3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/meta-llama/llama-3.3-70b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/nousresearch/hermes-3-llama-3.1-405b:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | 0 | no | — | timeout |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3.5-content-safety:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-nano-12b-v2-vl:free | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-nano-9b-v2:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/openai/gpt-oss-120b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/openai/gpt-oss-120b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/openai/gpt-oss-120b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/openai/gpt-oss-20b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/openai/gpt-oss-20b:free@low | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/openai/gpt-oss-20b:free@medium | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/poolside/laguna-m.1:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/qwen/qwen3-coder:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/qwen/qwen3-next-80b-a3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/google/gemma-4-26b-a4b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/google/gemma-4-31b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/liquid/lfm-2.5-1.2b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/liquid/lfm-2.5-1.2b-thinking:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/meta-llama/llama-3.2-3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/meta-llama/llama-3.3-70b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/nousresearch/hermes-3-llama-3.1-405b:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | 0 | no | — | timeout |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3.5-content-safety:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-nano-12b-v2-vl:free | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-nano-9b-v2:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/openai/gpt-oss-120b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/openai/gpt-oss-120b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/openai/gpt-oss-120b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/openai/gpt-oss-20b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/openai/gpt-oss-20b:free@low | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/openai/gpt-oss-20b:free@medium | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/poolside/laguna-m.1:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/qwen/qwen3-coder:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/qwen/qwen3-next-80b-a3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/google/gemma-4-26b-a4b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/google/gemma-4-31b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/liquid/lfm-2.5-1.2b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/liquid/lfm-2.5-1.2b-thinking:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/meta-llama/llama-3.2-3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/meta-llama/llama-3.3-70b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/nousresearch/hermes-3-llama-3.1-405b:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | 0 | no | — | timeout |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3.5-content-safety:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-nano-12b-v2-vl:free | 1 | 0 | no | — | timeout |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-nano-9b-v2:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/openai/gpt-oss-120b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/openai/gpt-oss-120b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/openai/gpt-oss-120b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/openai/gpt-oss-20b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/openai/gpt-oss-20b:free@low | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/openai/gpt-oss-20b:free@medium | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/poolside/laguna-m.1:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/qwen/qwen3-coder:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/qwen/qwen3-next-80b-a3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/google/gemma-4-26b-a4b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/google/gemma-4-31b-it:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/liquid/lfm-2.5-1.2b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/liquid/lfm-2.5-1.2b-thinking:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/meta-llama/llama-3.2-3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/meta-llama/llama-3.3-70b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/nousresearch/hermes-3-llama-3.1-405b:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | 0 | no | — | timeout |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3.5-content-safety:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-nano-12b-v2-vl:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-nano-9b-v2:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/openai/gpt-oss-120b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/openai/gpt-oss-120b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/openai/gpt-oss-120b:free@medium | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/openai/gpt-oss-20b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/openai/gpt-oss-20b:free@low | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/openai/gpt-oss-20b:free@medium | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/poolside/laguna-m.1:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/qwen/qwen3-coder:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/qwen/qwen3-next-80b-a3b-instruct:free | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | — | partial |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.ents-iterator.v1 | openrouter | cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | protocol_error | 1029 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | protocol_error | 693 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | protocol_error | 610 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | protocol_error | 624 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | cognitivecomputations/dolphin-mistral-24b-venice-edition:free | 1 | protocol_error | 596 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 20276 | 160/1024 | — | — | — | no | OpenRouter message content was empty or missing. |
| gmod.hook-add.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 5793 | 169/500 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 8227 | 166/613 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 4389 | 161/550 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | cohere/north-mini-code:free | 1 | partial | 10699 | 163/750 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | google/gemma-4-26b-a4b-it:free | 1 | pass | 3352 | 166/70 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | google/gemma-4-26b-a4b-it:free | 1 | protocol_error | 1155 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | google/gemma-4-26b-a4b-it:free | 1 | protocol_error | 671 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | google/gemma-4-26b-a4b-it:free | 1 | protocol_error | 738 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | google/gemma-4-26b-a4b-it:free | 1 | protocol_error | 289 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | google/gemma-4-31b-it:free | 1 | protocol_error | 1515 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | google/gemma-4-31b-it:free | 1 | protocol_error | 982 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | google/gemma-4-31b-it:free | 1 | protocol_error | 2093 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | google/gemma-4-31b-it:free | 1 | protocol_error | 884 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | google/gemma-4-31b-it:free | 1 | protocol_error | 993 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | liquid/lfm-2.5-1.2b-instruct:free | 1 | protocol_error | 143 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | liquid/lfm-2.5-1.2b-instruct:free | 1 | protocol_error | 257 | —/— | — | — | — | no | OpenRouter HTTP 502. |
| gmod.isvalid.v1 | openrouter | liquid/lfm-2.5-1.2b-instruct:free | 1 | protocol_error | 133 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | liquid/lfm-2.5-1.2b-instruct:free | 1 | protocol_error | 139 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | liquid/lfm-2.5-1.2b-instruct:free | 1 | protocol_error | 249 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | liquid/lfm-2.5-1.2b-thinking:free | 1 | protocol_error | 144 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | liquid/lfm-2.5-1.2b-thinking:free | 1 | protocol_error | 299 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | liquid/lfm-2.5-1.2b-thinking:free | 1 | protocol_error | 243 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | liquid/lfm-2.5-1.2b-thinking:free | 1 | protocol_error | 364 | —/— | — | — | — | no | OpenRouter HTTP 502. |
| gmod.player-iterator.v1 | openrouter | liquid/lfm-2.5-1.2b-thinking:free | 1 | protocol_error | 264 | —/— | — | — | — | no | OpenRouter HTTP 502. |
| gmod.ents-iterator.v1 | openrouter | meta-llama/llama-3.2-3b-instruct:free | 1 | protocol_error | 716 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | meta-llama/llama-3.2-3b-instruct:free | 1 | protocol_error | 638 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | meta-llama/llama-3.2-3b-instruct:free | 1 | protocol_error | 625 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | meta-llama/llama-3.2-3b-instruct:free | 1 | protocol_error | 664 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | meta-llama/llama-3.2-3b-instruct:free | 1 | protocol_error | 666 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | meta-llama/llama-3.3-70b-instruct:free | 1 | protocol_error | 1513 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | meta-llama/llama-3.3-70b-instruct:free | 1 | protocol_error | 1023 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | meta-llama/llama-3.3-70b-instruct:free | 1 | protocol_error | 1054 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | meta-llama/llama-3.3-70b-instruct:free | 1 | protocol_error | 920 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | meta-llama/llama-3.3-70b-instruct:free | 1 | protocol_error | 621 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | nousresearch/hermes-3-llama-3.1-405b:free | 1 | protocol_error | 645 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | nousresearch/hermes-3-llama-3.1-405b:free | 1 | protocol_error | 627 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | nousresearch/hermes-3-llama-3.1-405b:free | 1 | protocol_error | 670 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | nousresearch/hermes-3-llama-3.1-405b:free | 1 | protocol_error | 695 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | nousresearch/hermes-3-llama-3.1-405b:free | 1 | protocol_error | 742 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 36915 | 183/636 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 3240 | 191/443 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 6295 | 189/418 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 2564 | 186/223 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | partial | 7807 | 185/836 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | timeout | 120002 | —/— | — | — | — | no | HTTP request exceeded the attempt timeout. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | timeout | 120002 | —/— | — | — | — | no | HTTP request exceeded the attempt timeout. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | timeout | 120002 | —/— | — | — | — | no | HTTP request exceeded the attempt timeout. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | timeout | 120002 | —/— | — | — | — | no | HTTP request exceeded the attempt timeout. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 1 | timeout | 120002 | —/— | — | — | — | no | HTTP request exceeded the attempt timeout. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 6028 | 183/396 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 7289 | 191/353 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 7318 | 189/311 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 5797 | 186/365 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | partial | 5349 | 185/508 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 22064 | 183/574 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | pass | 3076 | 191/222 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | pass | 3767 | 189/233 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | pass | 6744 | 186/291 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | partial | 6095 | 185/426 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 16424 | 183/694 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 3453 | 191/303 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 2903 | 189/454 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 4063 | 186/394 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | partial | 4774 | 185/670 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 23908 | 183/1988 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 3662 | 191/381 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 4979 | 189/452 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 4384 | 186/480 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | partial | 25082 | 185/1333 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3.5-content-safety:free | 1 | protocol_error | 3138 | 526/250 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3.5-content-safety:free | 1 | protocol_error | 2715 | 535/213 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3.5-content-safety:free | 1 | protocol_error | 3246 | 532/266 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3.5-content-safety:free | 1 | protocol_error | 3359 | 528/251 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3.5-content-safety:free | 1 | protocol_error | 2701 | 529/162 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-nano-12b-v2-vl:free | 1 | protocol_error | 26287 | 178/1024 | — | — | — | no | OpenRouter message content was empty or missing. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-nano-12b-v2-vl:free | 1 | pass | 10738 | 186/513 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-nano-12b-v2-vl:free | 1 | pass | 17350 | 184/608 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-nano-12b-v2-vl:free | 1 | timeout | 120002 | —/— | — | — | — | no | HTTP request exceeded the attempt timeout. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-nano-12b-v2-vl:free | 1 | protocol_error | 21410 | 180/1024 | — | — | — | no | OpenRouter message content was empty or missing. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-nano-9b-v2:free | 1 | protocol_error | 13943 | 178/470 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-nano-9b-v2:free | 1 | protocol_error | 5344 | 186/311 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-nano-9b-v2:free | 1 | protocol_error | 7317 | 184/314 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-nano-9b-v2:free | 1 | protocol_error | 8135 | 181/392 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-nano-9b-v2:free | 1 | protocol_error | 14962 | 180/785 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.ents-iterator.v1 | openrouter | openai/gpt-oss-120b:free@high | 1 | protocol_error | 2441 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | openai/gpt-oss-120b:free@high | 1 | protocol_error | 2083 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | openai/gpt-oss-120b:free@high | 1 | protocol_error | 2089 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | openai/gpt-oss-120b:free@high | 1 | protocol_error | 2003 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | openai/gpt-oss-120b:free@high | 1 | protocol_error | 2499 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | openai/gpt-oss-120b:free@medium | 1 | protocol_error | 1935 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | openai/gpt-oss-120b:free@medium | 1 | protocol_error | 2045 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | openai/gpt-oss-120b:free@medium | 1 | protocol_error | 2040 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | openai/gpt-oss-120b:free@medium | 1 | protocol_error | 4029 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | openai/gpt-oss-120b:free@medium | 1 | partial | 16161 | 237/235 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | openai/gpt-oss-120b:free@low | 1 | partial | 19519 | 235/242 | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.hook-add.v1 | openrouter | openai/gpt-oss-120b:free@low | 1 | protocol_error | 2015 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | openai/gpt-oss-120b:free@low | 1 | protocol_error | 2086 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | openai/gpt-oss-120b:free@low | 1 | protocol_error | 1972 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | openai/gpt-oss-120b:free@low | 1 | protocol_error | 2137 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | openai/gpt-oss-20b:free@high | 1 | protocol_error | 10755 | —/— | — | — | — | no | OpenRouter error: Internal Server Error |
| gmod.hook-add.v1 | openrouter | openai/gpt-oss-20b:free@high | 1 | protocol_error | 10731 | —/— | — | — | — | no | OpenRouter error: Internal Server Error |
| gmod.isvalid.v1 | openrouter | openai/gpt-oss-20b:free@high | 1 | protocol_error | 10906 | —/— | — | — | — | no | OpenRouter error: Internal Server Error |
| gmod.net-receivers.v1 | openrouter | openai/gpt-oss-20b:free@high | 1 | protocol_error | 10724 | —/— | — | — | — | no | OpenRouter error: Internal Server Error |
| gmod.player-iterator.v1 | openrouter | openai/gpt-oss-20b:free@high | 1 | protocol_error | 10716 | —/— | — | — | — | no | OpenRouter error: Internal Server Error |
| gmod.ents-iterator.v1 | openrouter | openai/gpt-oss-20b:free@medium | 1 | protocol_error | 10697 | —/— | — | — | — | no | OpenRouter error: Internal Server Error |
| gmod.hook-add.v1 | openrouter | openai/gpt-oss-20b:free@medium | 1 | pass | 7865 | 249/181 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | openai/gpt-oss-20b:free@medium | 1 | pass | 2773 | 247/171 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | openai/gpt-oss-20b:free@medium | 1 | pass | 2435 | 242/224 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | openai/gpt-oss-20b:free@medium | 1 | partial | 8369 | 243/344 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | openai/gpt-oss-20b:free@low | 1 | pass | 3830 | 241/227 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | openai/gpt-oss-20b:free@low | 1 | pass | 1929 | 249/73 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | openai/gpt-oss-20b:free@low | 1 | pass | 4051 | 247/81 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | openai/gpt-oss-20b:free@low | 1 | pass | 3222 | 242/76 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | openai/gpt-oss-20b:free@low | 1 | partial | 6572 | 243/126 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | poolside/laguna-m.1:free | 1 | protocol_error | 21315 | 188/973 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.hook-add.v1 | openrouter | poolside/laguna-m.1:free | 1 | protocol_error | 8518 | 195/280 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.isvalid.v1 | openrouter | poolside/laguna-m.1:free | 1 | protocol_error | 14598 | 194/366 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.net-receivers.v1 | openrouter | poolside/laguna-m.1:free | 1 | protocol_error | 9563 | 188/282 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.player-iterator.v1 | openrouter | poolside/laguna-m.1:free | 1 | protocol_error | 19312 | 189/526 | — | — | — | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.ents-iterator.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 595 | 179/66 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 873 | 186/62 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 863 | 185/65 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 614 | 179/50 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 9546 | 180/75 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | qwen/qwen3-coder:free | 1 | protocol_error | 1177 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | qwen/qwen3-coder:free | 1 | protocol_error | 1139 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | qwen/qwen3-coder:free | 1 | protocol_error | 273 | —/— | — | — | — | no | OpenRouter HTTP 404. |
| gmod.net-receivers.v1 | openrouter | qwen/qwen3-coder:free | 1 | protocol_error | 999 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | qwen/qwen3-coder:free | 1 | protocol_error | 877 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | qwen/qwen3-next-80b-a3b-instruct:free | 1 | protocol_error | 1249 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.hook-add.v1 | openrouter | qwen/qwen3-next-80b-a3b-instruct:free | 1 | protocol_error | 1298 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.isvalid.v1 | openrouter | qwen/qwen3-next-80b-a3b-instruct:free | 1 | protocol_error | 727 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.net-receivers.v1 | openrouter | qwen/qwen3-next-80b-a3b-instruct:free | 1 | protocol_error | 599 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.player-iterator.v1 | openrouter | qwen/qwen3-next-80b-a3b-instruct:free | 1 | protocol_error | 671 | —/— | — | — | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 37959 | 177/5283 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 18403 | 186/906 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 12208 | 183/605 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 18536 | 179/982 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | tencent/hy3:free@high | 1 | partial | 30804 | 179/1338 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 11651 | 177/1428 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 8154 | 186/327 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 10079 | 183/488 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 13476 | 179/662 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | tencent/hy3:free@low | 1 | partial | 21467 | 179/949 | — | — | — | yes | Still materializes player.GetAll(). |
| gmod.ents-iterator.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2157 | 180/51 | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2110 | 189/48 | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2448 | 186/50 | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2709 | 182/74 | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | tencent/hy3:free@none | 1 | partial | 2980 | 182/65 | — | — | — | yes | Still materializes player.GetAll(). |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — fixture-normalized model ranking, diagnostics, tokens, and timing
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`