# GMod Bench report

Run: `59029ed6-30eb-4d96-ad76-21deda2a06fa`
Fixtures: 38 fixtures (`bun run bench list`)
Repeat: 1 · Concurrency: 4
Started: 2026-07-11T07:30:31.507Z · Completed: 2026-07-11T07:54:02.673Z
Wall clock: 1411s · Sum of attempt durations: 4974712ms (avg 13091ms, min 0ms, max 120114ms)

## Model leaderboard

Sorted by **fixture score** (each fixture weighted equally; failures score zero), then fixture solve rate, coverage, and pass rate.

| Rank | Runner / model | Fixture score | Fixture solve | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | Fixture pass | Scored quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `openrouter/tencent/hy3:free@none` | 86.8% | 81.6% | 31 | 4 | 2 | 37 | 97.4% | 83.8% | 83.8% | 0.89 | 1 | 31/38 | 8843 | 6303/3483 |
| 2 | `openrouter/tencent/hy3:free@low` | 82.9% | 78.9% | 30 | 3 | 2 | 35 | 92.1% | 85.7% | 85.7% | 0.90 | 3 | 30/38 | 16772 | 6189/36179 |
| 3 | `openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium` | 81.6% | 78.9% | 30 | 2 | 1 | 33 | 86.8% | 90.9% | 90.9% | 0.94 | 5 | 30/38 | 12283 | 6347/16424 |
| 4 | `openrouter/tencent/hy3:free@high` | 80.3% | 76.3% | 29 | 3 | 3 | 35 | 92.1% | 82.9% | 82.9% | 0.87 | 3 | 29/38 | 26851 | 6189/55745 |
| 5 | `openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high` | 76.3% | 71.1% | 27 | 4 | 0 | 31 | 81.6% | 87.1% | 87.1% | 0.94 | 7 | 27/38 | 10879 | 6250/15885 |
| 6 | `openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium` | 68.4% | 63.2% | 24 | 4 | 0 | 28 | 73.7% | 85.7% | 85.7% | 0.93 | 8 | 24/38 | 15953 | 6145/19644 |
| 7 | `openrouter/poolside/laguna-xs-2.1:free` | 68.4% | 60.5% | 23 | 6 | 4 | 33 | 86.8% | 69.7% | 69.7% | 0.79 | 5 | 23/38 | 13798 | 6226/4758 |
| 8 | `openrouter/cohere/north-mini-code:free` | 51.3% | 50.0% | 19 | 1 | 3 | 23 | 60.5% | 82.6% | 82.6% | 0.85 | 15 | 19/38 | 12452 | 5553/28827 |
| 9 | `openrouter/nvidia/nemotron-3-nano-30b-a3b:free` | 47.4% | 42.1% | 16 | 4 | 3 | 23 | 60.5% | 69.6% | 69.6% | 0.78 | 15 | 16/38 | 11655 | 6347/32281 |
| 10 | `openrouter/nvidia/nemotron-3-super-120b-a12b:free@low` | 7.9% | 7.9% | 3 | 0 | 1 | 4 | 10.5% | 75.0% | 75.0% | 0.75 | 34 | 3/38 | 1428 | 817/2529 |

## Rates

- Scored attempts: 282
- Pass / partial / incorrect: 232 / 31 / 19
- Pass rate (scored): 232/282
- Fixture pass rate (passed fixture groups / scored fixture groups): 232/282
- Overall mean score (pass=1, partial=0.5): 0.878
- Protocol errors: 96
- Policy violations: 0
- Trace errors: 0
- Timeouts: 2
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 56366
- Completion tokens: 215755
- Reasoning tokens: 166863
- Total tokens: 272121
- Cached prompt tokens: 2400
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 348 (provider 341, estimated 7)
- Answer bytes (sum): 140815
- Attempt duration avg/min/max: 13091 / 0 / 120114 ms

## Groups (single-sample result + mean score)

| Fixture | Runner | K | Passes | Passed | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.50 | partial |
| gmod.ents-iterator.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.angle-zero.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.angle-zero.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.config-var.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.darkrpvar.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.darkrpvar.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.darkrpvar.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.disttosqr.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.disttosqr.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ents-iterator.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ents-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ents-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ents-iterator.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ents-iterator.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ents-iterator.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-players-near.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-players-near.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.for-vs-while.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.hook-once.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | timeout |
| gmod.perf.local-color.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | timeout |
| gmod.perf.local-vs-global.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.looking-at.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | 0.50 | partial |
| gmod.perf.meta-vs-arg.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.meta-vs-arg.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.meta-vs-arg.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.meta-vs-arg.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.msg-vs-print.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.ply-table-index.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.ply-table-index.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.ply-table-index.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.string-table-concat.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.string-table-concat.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.table-count-hash.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.table-empty.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/cohere/north-mini-code:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/tencent/hy3:free@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/tencent/hy3:free@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | openrouter/tencent/hy3:free@none | 1 | 1 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | openrouter/cohere/north-mini-code:free | 1 | 0 | no | 0.00 | incorrect |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-nano-30b-a3b:free | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@low | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | openrouter/poolside/laguna-xs-2.1:free | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | openrouter/tencent/hy3:free@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.player-iterator.v1 | openrouter/tencent/hy3:free@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.player-iterator.v1 | openrouter/tencent/hy3:free@none | 1 | 0 | no | 0.50 | partial |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.hook-add.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 5132 | 154/493 | 0 | provider | 165 | yes | Registers a named hook with hook.Add. |
| gmod.ents-iterator.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 6608 | 147/727 | 0 | provider | 243 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 7403 | 140/726 | 0 | provider | 220 | yes | Matched a pass pattern. |
| gmod.isvalid.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 7452 | 150/801 | 0 | provider | 119 | yes | Uses IsValid for entity/object validity. |
| gmod.perf.disttosqr.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 3768 | 146/379 | 0 | provider | 225 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 10180 | 148/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.config-var.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 12149 | 153/600 | 0 | provider | 220 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | cohere/north-mini-code:free | 1 | partial | 9974 | 138/965 | 0 | provider | 297 | yes | Matched a partial-answer pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | cohere/north-mini-code:free | 1 | incorrect | 16024 | 145/845 | 0 | provider | 367 | yes | Did not match a fixture answer pattern. |
| gmod.perf.find-ents-near.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 9276 | 159/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.find-players-near.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 6705 | 151/574 | 0 | provider | 415 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 8242 | 144/650 | 0 | provider | 143 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 2875 | 62/0 | — | estimated | — | no | OpenRouter HTTP 429. |
| gmod.perf.hook-once.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 9928 | 156/651 | 0 | provider | 300 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 8934 | 151/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.meta-vs-arg.v1 | openrouter | cohere/north-mini-code:free | 1 | incorrect | 5551 | 148/592 | 0 | provider | 88 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.local-color.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 15708 | 143/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.looking-at.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 14249 | 160/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.localplayer-cache.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 32340 | 146/507 | 0 | provider | 290 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 28058 | 149/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.msg-vs-print.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 30530 | 143/948 | 0 | provider | 161 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 5414 | 161/911 | 0 | provider | 1114 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 23514 | 152/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 4909 | 149/737 | 0 | provider | 186 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 5441 | 142/491 | 0 | provider | 389 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 13353 | 149/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.string-table-concat.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 3930 | 142/560 | 0 | provider | 407 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 7541 | 147/559 | 0 | provider | 356 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 21570 | 145/1022 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.surface-text.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 7855 | 150/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 22771 | 167/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.table-count-hash.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 9675 | 138/622 | 0 | provider | 179 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 8806 | 146/476 | 0 | provider | 220 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 13231 | 145/788 | 0 | provider | 451 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | cohere/north-mini-code:free | 1 | pass | 6310 | 142/511 | 0 | provider | 377 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 16848 | 149/793 | 0 | provider | 297 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 14737 | 173/444 | 434 | provider | 119 | yes | Registers a named hook with hook.Add. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 18382 | 166/762 | 759 | provider | 204 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | cohere/north-mini-code:free | 1 | incorrect | 21022 | 157/635 | 0 | provider | 158 | yes | Keeps pairs() rather than Iterator or a cached numeric for-loop. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 7907 | 169/1024 | 1100 | provider | 4320 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.x-times-x.v1 | openrouter | cohere/north-mini-code:free | 1 | protocol_error | 29896 | 139/1024 | 0 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 8042 | 160/827 | 852 | provider | 147 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 4002 | 173/600 | 675 | provider | 116 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 9117 | 166/1024 | 1003 | provider | 3946 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.darkrpvar.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | incorrect | 3624 | 165/619 | 641 | provider | 166 | yes | Did not match a fixture answer pattern. |
| gmod.perf.disttosqr.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 6916 | 164/1024 | 1041 | provider | 6 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.ents-iterator.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 13514 | 158/1024 | 1093 | provider | 4316 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.find-ents-near.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 11966 | 178/1024 | 1077 | provider | 4226 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.find-players-near.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | partial | 13492 | 170/1001 | 1011 | provider | 274 | yes | Matched a partial-answer pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 14744 | 162/597 | 626 | provider | 94 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 4700 | 160/550 | 549 | provider | 107 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | partial | 11730 | 174/725 | 721 | provider | 329 | yes | Matched a partial-answer pattern. |
| gmod.perf.local-color.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 9969 | 167/893 | 833 | provider | 208 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 5282 | 164/1024 | 1044 | provider | 204 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 17612 | 171/739 | 666 | provider | 349 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | partial | 7452 | 178/989 | 897 | provider | 283 | yes | Matched a partial-answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 16744 | 171/1024 | 1078 | provider | 4208 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 19150 | 168/1024 | 1146 | provider | 4540 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.msg-vs-print.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 20418 | 161/1024 | 1006 | provider | 3979 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.meta-vs-arg.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | incorrect | 30205 | 166/900 | 1012 | provider | 175 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.seq-tables.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 8415 | 168/833 | 764 | provider | 324 | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 4641 | 167/745 | 742 | provider | 121 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | incorrect | 2632 | 185/679 | 708 | provider | 157 | yes | Did not match a fixture answer pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 14108 | 182/1024 | 1063 | provider | 366 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.steamid-cache.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 11654 | 161/1024 | 1072 | provider | 4219 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.ply-table-index.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 22230 | 163/1024 | 983 | provider | 149 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.string-table-concat.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 16059 | 161/739 | 729 | provider | 203 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 15582 | 166/930 | 873 | provider | 164 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 7310 | 168/1024 | 1086 | provider | 4289 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.table-count-hash.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 9119 | 156/917 | 991 | provider | 138 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 6814 | 163/809 | 802 | provider | 166 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 5504 | 160/630 | 680 | provider | 152 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 9940 | 164/592 | 596 | provider | 118 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | protocol_error | 12742 | 167/1024 | 1107 | provider | 4377 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.x-times-x.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | pass | 4929 | 157/657 | 668 | provider | 81 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-nano-30b-a3b:free | 1 | partial | 21492 | 175/768 | 802 | provider | 136 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 17878 | 169/432 | 419 | provider | 160 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 18923 | 173/440 | 443 | provider | 151 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 21725 | 166/748 | 746 | provider | 205 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 3814 | 160/288 | 258 | provider | 172 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.config-var.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 10513 | 173/604 | 555 | provider | 129 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 10977 | 165/778 | 689 | provider | 388 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 11528 | 164/763 | 751 | provider | 278 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | partial | 5820 | 158/435 | 412 | provider | 217 | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 10565 | 170/645 | 588 | provider | 392 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | partial | 26997 | 166/763 | 680 | provider | 347 | yes | Matched a partial-answer pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 10524 | 162/269 | 245 | provider | 165 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.find-ents-near.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 15214 | 178/709 | 638 | provider | 384 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.hook-once.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4494 | 174/489 | 458 | provider | 360 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 9435 | 171/718 | 516 | provider | 465 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 7159 | 164/300 | 275 | provider | 240 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | partial | 5425 | 178/706 | 643 | provider | 385 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 13351 | 166/782 | 830 | provider | 133 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 13022 | 168/489 | 487 | provider | 165 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 9443 | 171/487 | 387 | provider | 539 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4754 | 182/650 | 566 | provider | 612 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 42137 | 161/728 | 716 | provider | 167 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.ply-table-index.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 11139 | 163/791 | 749 | provider | 260 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 8674 | 168/500 | 456 | provider | 304 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 5668 | 167/418 | 374 | provider | 202 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4568 | 185/667 | 689 | provider | 297 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 3866 | 161/517 | 406 | provider | 455 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4546 | 161/393 | 384 | provider | 276 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4110 | 166/439 | 388 | provider | 243 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 3460 | 168/467 | 394 | provider | 377 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | partial | 6092 | 167/658 | 714 | provider | 190 | yes | Matched a partial-answer pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4460 | 163/474 | 370 | provider | 390 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 3190 | 164/403 | 391 | provider | 220 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 2993 | 160/391 | 389 | provider | 198 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 21940 | 156/420 | 431 | provider | 150 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | pass | 4854 | 157/508 | 438 | provider | 221 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | protocol_error | 2747 | 175/375 | 368 | provider | 157 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 2495 | 78/0 | — | estimated | — | no | OpenRouter HTTP 429. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | pass | 5429 | 166/753 | 774 | provider | 232 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | pass | 4134 | 160/265 | 197 | provider | 323 | yes | Matched a pass pattern. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 8058 | 74/0 | — | estimated | — | no | OpenRouter HTTP 429. |
| gmod.perf.local-color.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | timeout | 120080 | 63/0 | — | estimated | — | no | HTTP request exceeded the attempt timeout. |
| gmod.perf.darkrpvar.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.disttosqr.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.ents-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.find-ents-near.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.find-players-near.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.for-vs-while.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.hook-once.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.hudpaint-cache.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.local-color.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.local-vs-global.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.localplayer-cache.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.looking-at.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.meta-vs-arg.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.msg-vs-print.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.player-cache-hooks.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.ply-table-index.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.seq-tables.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.setdrawcolor-split.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.steamid-cache.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.string-table-concat.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.surface-drawrect.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.surface-text.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.table-count-hash.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.table-empty.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.table-hasvalue.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.table-literal.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.table-random.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.x-times-x.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.local-vs-global.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@medium | 1 | timeout | 120114 | 62/0 | — | estimated | — | no | HTTP request exceeded the attempt timeout. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | protocol_error | 0 | —/— | — | — | — | no | Skipped: free model produced no text earlier in this run (will quarantine after run if pattern holds). |
| gmod.perf.config-var.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | pass | 15177 | 173/522 | 494 | provider | 165 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | nvidia/nemotron-3-super-120b-a12b:free@low | 1 | incorrect | 18967 | 166/989 | 940 | provider | 298 | yes | Did not match a fixture answer pattern. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 7877 | 173/163 | 117 | provider | 197 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 7260 | 169/364 | 341 | provider | 150 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 5095 | 160/242 | 200 | provider | 195 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 14665 | 166/377 | 343 | provider | 201 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 10516 | 166/693 | 522 | provider | 508 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.config-var.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 6511 | 173/340 | 288 | provider | 278 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 11143 | 164/327 | 284 | provider | 250 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 15534 | 165/371 | 262 | provider | 458 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | partial | 15906 | 158/792 | 764 | provider | 198 | yes | Matched a partial-answer pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 9082 | 65/0 | — | estimated | — | no | OpenRouter error: Upstream error from Nvidia: ResourceExhausted: Worker local total request limit reached (32/32) (code 502) |
| gmod.perf.find-ents-near.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 21602 | 178/582 | 455 | provider | 597 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 16178 | 170/399 | 329 | provider | 479 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 7835 | 174/301 | 168 | provider | 650 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 6240 | 171/425 | 258 | provider | 493 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 2526 | 160/385 | 345 | provider | 203 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 8543 | 164/451 | 429 | provider | 321 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 13102 | 167/560 | 334 | provider | 614 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | partial | 11698 | 178/425 | 265 | provider | 518 | yes | Matched a partial-answer pattern. |
| gmod.perf.msg-vs-print.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 13030 | 161/342 | 299 | provider | 278 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 21933 | 166/432 | 462 | provider | 103 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 16293 | 168/573 | 539 | provider | 263 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 7696 | 182/277 | 94 | provider | 821 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 16760 | 171/431 | 121 | provider | 1057 | yes | Answer must contain 0 through 2 candidate loops. |
| gmod.perf.ply-table-index.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | partial | 9910 | 163/582 | 532 | provider | 462 | yes | Matched a partial-answer pattern. |
| gmod.perf.seq-tables.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 7569 | 168/544 | 428 | provider | 454 | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 5709 | 167/340 | 310 | provider | 174 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 12056 | 185/447 | 376 | provider | 455 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.steamid-cache.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 8849 | 161/429 | 264 | provider | 632 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | protocol_error | 19801 | 161/233 | 158 | provider | 407 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-text.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 13495 | 168/510 | 382 | provider | 535 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 20049 | 166/923 | 805 | provider | 492 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 14955 | 156/256 | 239 | provider | 153 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 4234 | 163/350 | 214 | provider | 416 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 6826 | 167/777 | 815 | provider | 181 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 3723 | 160/316 | 308 | provider | 242 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 6489 | 164/338 | 322 | provider | 301 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | pass | 4901 | 157/316 | 264 | provider | 210 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@high | 1 | partial | 7792 | 175/272 | 252 | provider | 183 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 15002 | 166/358 | 317 | provider | 232 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 21177 | 173/161 | 116 | provider | 201 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 20296 | 169/313 | 276 | provider | 196 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 16961 | 160/275 | 190 | provider | 316 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 8981 | 173/341 | 316 | provider | 167 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 8516 | 165/388 | 338 | provider | 296 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 7869 | 164/315 | 278 | provider | 230 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | incorrect | 20071 | 166/640 | 500 | provider | 351 | yes | Did not match a fixture answer pattern. |
| gmod.perf.find-ents-near.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | protocol_error | 11688 | 178/466 | 359 | provider | 479 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.ents-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 14749 | 158/763 | 767 | provider | 256 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 13451 | 170/278 | 169 | provider | 492 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 13466 | 162/308 | 290 | provider | 153 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 10169 | 171/487 | 265 | provider | 515 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 11821 | 174/601 | 598 | provider | 374 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 11992 | 167/446 | 352 | provider | 290 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 11917 | 160/386 | 347 | provider | 203 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | partial | 5743 | 178/420 | 256 | provider | 516 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 6737 | 166/430 | 457 | provider | 163 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 12382 | 164/389 | 313 | provider | 490 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 11500 | 161/719 | 754 | provider | 160 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 15319 | 168/512 | 466 | provider | 255 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 15333 | 182/296 | 171 | provider | 619 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | protocol_error | 19921 | 171/425 | 116 | provider | 1110 | yes | Answer must contain 0 through 2 candidate loops. |
| gmod.perf.seq-tables.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | protocol_error | 13774 | 168/778 | 690 | provider | 428 | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.steamid-cache.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 1796 | 161/331 | 121 | provider | 791 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 9550 | 167/224 | 172 | provider | 231 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 8020 | 185/438 | 388 | provider | 377 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | protocol_error | 22184 | 163/778 | 565 | provider | 850 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 10223 | 166/535 | 469 | provider | 206 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | protocol_error | 15532 | 161/262 | 203 | provider | 250 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.table-count-hash.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 14150 | 156/256 | 238 | provider | 153 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 16173 | 168/691 | 515 | provider | 690 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 10461 | 167/689 | 659 | provider | 336 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 8300 | 163/388 | 247 | provider | 426 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 8576 | 164/367 | 300 | provider | 305 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 10185 | 160/326 | 322 | provider | 195 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | partial | 4495 | 175/260 | 233 | provider | 188 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 4312 | 166/69 | 0 | provider | 272 | yes | Matched a partial-answer pattern. |
| gmod.perf.x-times-x.v1 | openrouter | nvidia/nemotron-3-ultra-550b-a55b:free@medium | 1 | pass | 8272 | 157/384 | 363 | provider | 151 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 6982 | 172/70 | 0 | provider | 243 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 11315 | 169/52 | 0 | provider | 220 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 16101 | 158/104 | 0 | provider | 410 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 19828 | 166/153 | 0 | provider | 589 | yes | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 17048 | 171/36 | 0 | provider | 175 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | incorrect | 13912 | 164/45 | 0 | provider | 177 | yes | Did not match a fixture answer pattern. |
| gmod.perf.disttosqr.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | incorrect | 9244 | 164/69 | 0 | provider | 301 | yes | Did not match a fixture answer pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 8335 | 157/49 | 0 | provider | 198 | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 8046 | 170/174 | 0 | provider | 700 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 12739 | 162/74 | 0 | provider | 258 | yes | Matched a partial-answer pattern. |
| gmod.perf.hook-once.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 14575 | 174/141 | 0 | provider | 589 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 13805 | 170/174 | 0 | provider | 530 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 10733 | 167/78 | 0 | provider | 277 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 32031 | 177/71 | 0 | provider | 307 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 8516 | 164/140 | 0 | provider | 630 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | incorrect | 5439 | 166/83 | 0 | provider | 363 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 22129 | 158/111 | 0 | provider | 433 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 12634 | 167/67 | 0 | provider | 203 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | protocol_error | 30942 | 178/751 | 0 | provider | 2640 | yes | Final response exceeds fixture byte cap of 2048. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 15518 | 170/292 | 0 | provider | 1207 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 10648 | 178/187 | 0 | provider | 759 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | incorrect | 29299 | 161/101 | 0 | provider | 351 | yes | Did not match a fixture answer pattern. |
| gmod.perf.ply-table-index.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 6446 | 163/207 | 0 | provider | 814 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | protocol_error | 8270 | 167/134 | 0 | provider | 544 | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 7886 | 184/72 | 0 | provider | 322 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 12229 | 160/140 | 0 | provider | 526 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | protocol_error | 14049 | 160/86 | 0 | provider | 290 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 14378 | 165/197 | 0 | provider | 745 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 11795 | 168/349 | 0 | provider | 1291 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 8657 | 156/39 | 0 | provider | 151 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | protocol_error | 30592 | 71/0 | — | estimated | — | no | OpenRouter HTTP 429. |
| gmod.perf.table-empty.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | protocol_error | 8232 | 166/125 | 0 | provider | 492 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.table-literal.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 8020 | 164/100 | 0 | provider | 317 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 6797 | 160/65 | 0 | provider | 300 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 9838 | 157/32 | 0 | provider | 124 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | partial | 11321 | 174/61 | 0 | provider | 294 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.perf.table-hasvalue.v1 | openrouter | poolside/laguna-xs-2.1:free | 1 | pass | 31691 | 162/60 | 0 | provider | 219 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 23631 | 169/491 | 444 | provider | 175 | yes | Registers a named hook with hook.Add. |
| gmod.ents-iterator.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 36757 | 162/1173 | 1116 | provider | 230 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 18143 | 156/713 | 673 | provider | 145 | yes | Matched a pass pattern. |
| gmod.isvalid.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 35516 | 165/1115 | 1069 | provider | 166 | yes | Uses IsValid for entity/object validity. |
| gmod.perf.config-var.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 20966 | 170/1097 | 1060 | provider | 163 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 24462 | 162/1325 | 1283 | provider | 167 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | openrouter | tencent/hy3:free@high | 1 | incorrect | 18182 | 160/1054 | 1009 | provider | 177 | yes | Did not match a fixture answer pattern. |
| gmod.perf.find-players-near.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 16367 | 165/954 | 829 | provider | 450 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | openrouter | tencent/hy3:free@high | 1 | partial | 28889 | 173/1390 | 1342 | provider | 187 | yes | Matched a partial-answer pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | tencent/hy3:free@high | 1 | partial | 39215 | 153/2000 | 1935 | provider | 243 | yes | Matched a partial-answer pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 18561 | 158/868 | 830 | provider | 142 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | tencent/hy3:free@high | 1 | protocol_error | 73601 | 162/4573 | 4496 | provider | 292 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.local-vs-global.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 12573 | 156/756 | 703 | provider | 175 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 21785 | 166/1255 | 1155 | provider | 312 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 27092 | 170/1581 | 1520 | provider | 272 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 26259 | 157/1259 | 1195 | provider | 256 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 17803 | 157/854 | 820 | provider | 144 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 25340 | 163/1585 | 1555 | provider | 132 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | tencent/hy3:free@high | 1 | partial | 32875 | 174/1731 | 1596 | provider | 421 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 42212 | 160/2115 | 2006 | provider | 436 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 13899 | 164/761 | 714 | provider | 160 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 28140 | 167/1581 | 1426 | provider | 567 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 22902 | 163/1369 | 1305 | provider | 240 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | openrouter | tencent/hy3:free@high | 1 | incorrect | 27369 | 161/1513 | 1439 | provider | 269 | yes | Did not match a fixture answer pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 35321 | 177/1869 | 1721 | provider | 604 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 15262 | 163/745 | 700 | provider | 180 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 17372 | 180/1001 | 945 | provider | 220 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 23644 | 158/1276 | 1180 | provider | 340 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 17281 | 165/1074 | 963 | provider | 427 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 29428 | 162/1459 | 1406 | provider | 198 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 12457 | 153/653 | 614 | provider | 160 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 22575 | 163/1169 | 1131 | provider | 164 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 19495 | 160/985 | 940 | provider | 164 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | tencent/hy3:free@high | 1 | protocol_error | 21608 | 159/1147 | 1068 | provider | 229 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.x-times-x.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 15557 | 153/848 | 803 | provider | 147 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | tencent/hy3:free@high | 1 | pass | 20645 | 156/1040 | 990 | provider | 201 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 10203 | 162/569 | 502 | provider | 245 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 7558 | 169/357 | 311 | provider | 169 | yes | Registers a named hook with hook.Add. |
| gmod.player-iterator.v1 | openrouter | tencent/hy3:free@high | 1 | incorrect | 25642 | 171/1174 | 1139 | provider | 131 | yes | Keeps pairs() rather than Iterator or a cached numeric for-loop. |
| gmod.net-receivers.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 12338 | 156/637 | 589 | provider | 167 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | tencent/hy3:free@high | 1 | protocol_error | 91514 | 156/8192 | 8192 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.isvalid.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 15260 | 165/841 | 794 | provider | 176 | yes | Uses IsValid for entity/object validity. |
| gmod.perf.disttosqr.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 9623 | 160/467 | 420 | provider | 179 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 13573 | 170/703 | 663 | provider | 174 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 16325 | 162/944 | 901 | provider | 152 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 8031 | 165/454 | 335 | provider | 434 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | openrouter | tencent/hy3:free@low | 1 | partial | 14666 | 173/686 | 632 | provider | 198 | yes | Matched a partial-answer pattern. |
| gmod.perf.angle-zero.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 44000 | 162/2165 | 2105 | provider | 257 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | tencent/hy3:free@low | 1 | partial | 22379 | 153/1292 | 1234 | provider | 204 | yes | Matched a partial-answer pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 12881 | 158/667 | 619 | provider | 185 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 14367 | 170/728 | 679 | provider | 206 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 9357 | 157/525 | 448 | provider | 266 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 12900 | 166/712 | 612 | provider | 340 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 12501 | 156/720 | 669 | provider | 177 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | tencent/hy3:free@low | 1 | partial | 13318 | 174/611 | 482 | provider | 422 | yes | Matched a partial-answer pattern. |
| gmod.perf.msg-vs-print.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 10958 | 157/468 | 427 | provider | 179 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 17573 | 163/927 | 892 | provider | 148 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 21028 | 160/921 | 815 | provider | 406 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 10348 | 164/538 | 496 | provider | 138 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 11251 | 163/611 | 544 | provider | 237 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 19039 | 167/1193 | 1026 | provider | 563 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 18322 | 177/1073 | 909 | provider | 663 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | openrouter | tencent/hy3:free@low | 1 | incorrect | 23787 | 161/1128 | 1011 | provider | 423 | yes | Did not match a fixture answer pattern. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 9633 | 163/486 | 440 | provider | 182 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 10239 | 180/564 | 510 | provider | 210 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 10842 | 158/501 | 399 | provider | 359 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 9394 | 153/481 | 436 | provider | 175 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | openrouter | tencent/hy3:free@low | 1 | protocol_error | 17508 | 162/911 | 794 | provider | 399 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-text.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 17207 | 165/894 | 796 | provider | 374 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 14074 | 163/654 | 612 | provider | 176 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 13199 | 160/690 | 647 | provider | 177 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | openrouter | tencent/hy3:free@low | 1 | protocol_error | 16649 | 159/823 | 734 | provider | 274 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.table-random.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 11974 | 156/611 | 562 | provider | 228 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2432 | 165/53 | 0 | provider | 211 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2075 | 172/49 | 0 | provider | 187 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2334 | 168/45 | 0 | provider | 164 | yes | Uses IsValid for entity/object validity. |
| gmod.player-iterator.v1 | openrouter | tencent/hy3:free@low | 1 | incorrect | 12860 | 171/590 | 553 | provider | 140 | yes | Keeps pairs() rather than Iterator or a cached numeric for-loop. |
| gmod.perf.x-times-x.v1 | openrouter | tencent/hy3:free@low | 1 | pass | 15736 | 153/845 | 799 | provider | 138 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2656 | 159/67 | 0 | provider | 276 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | openrouter | tencent/hy3:free@none | 1 | incorrect | 2889 | 165/54 | 0 | provider | 211 | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2450 | 173/49 | 0 | provider | 183 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2241 | 165/54 | 0 | provider | 209 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 2829 | 163/51 | 0 | provider | 195 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | openrouter | tencent/hy3:free@none | 1 | partial | 3279 | 156/53 | 0 | provider | 195 | yes | Matched a partial-answer pattern. |
| gmod.perf.find-ents-near.v1 | openrouter | tencent/hy3:free@none | 1 | partial | 4461 | 176/60 | 0 | provider | 230 | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 9364 | 168/120 | 0 | provider | 407 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 8771 | 161/51 | 0 | provider | 207 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 10079 | 173/85 | 0 | provider | 336 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 4029 | 169/120 | 0 | provider | 380 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 13012 | 160/63 | 0 | provider | 248 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 14800 | 159/43 | 0 | provider | 160 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 16434 | 163/81 | 0 | provider | 315 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | openrouter | tencent/hy3:free@none | 1 | partial | 14686 | 177/106 | 0 | provider | 315 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 14682 | 166/42 | 0 | provider | 199 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | tencent/hy3:free@low | 1 | protocol_error | 96447 | 156/8192 | 8192 | provider | — | no | OpenRouter message content was empty or missing. |
| gmod.perf.msg-vs-print.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 14383 | 160/53 | 0 | provider | 242 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 11108 | 167/62 | 0 | provider | 201 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 10003 | 170/114 | 0 | provider | 438 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 11411 | 180/132 | 0 | provider | 556 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 12122 | 164/110 | 0 | provider | 381 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 8360 | 166/77 | 0 | provider | 260 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 5794 | 166/35 | 0 | provider | 145 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 3754 | 183/56 | 0 | provider | 235 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 4688 | 161/103 | 0 | provider | 368 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 4952 | 165/50 | 0 | provider | 194 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | openrouter | tencent/hy3:free@none | 1 | incorrect | 11250 | 168/98 | 0 | provider | 344 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-count-hash.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 8218 | 156/39 | 0 | provider | 156 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 8905 | 166/38 | 0 | provider | 172 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | openrouter | tencent/hy3:free@none | 1 | protocol_error | 15448 | 159/1024 | 0 | provider | 1024 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.table-hasvalue.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 4750 | 162/68 | 0 | provider | 229 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 13042 | 163/46 | 0 | provider | 160 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 15789 | 159/49 | 0 | provider | 229 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | openrouter | tencent/hy3:free@none | 1 | pass | 15881 | 156/30 | 0 | provider | 107 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | openrouter | tencent/hy3:free@none | 1 | partial | 22689 | 174/53 | 0 | provider | 214 | yes | Uses ipairs but still allocates via player.GetAll() each time. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — fixture-normalized model ranking, diagnostics, tokens, and timing
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`