# GMod Bench report

Run: `c99506be-e7cc-4900-90b0-2a059597aa89`
Fixtures: 38 fixtures (`bun run bench list`)
Repeat: 1 · Concurrency: 1
Started: 2026-07-10T15:41:59.142Z · Completed: 2026-07-10T16:21:33.096Z
Wall clock: 2374s · Sum of attempt durations: 2373326ms (avg 7807ms, min 2346ms, max 67432ms)

## Model leaderboard

Sorted by **fixture score** (each fixture weighted equally; failures score zero), then fixture solve rate, coverage, and pass rate.

| Rank | Runner / model | Fixture score | Fixture solve | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | Fixture pass | Scored quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `agy/Gemini 3.5 Flash (High)` | 88.2% | 84.2% | 32 | 3 | 2 | 37 | 97.4% | 86.5% | 86.5% | 0.91 | 1 | 32/38 | 6920 | 0/0 |
| 2 | `agy/Gemini 3.1 Pro (Low)` | 86.8% | 81.6% | 31 | 4 | 0 | 35 | 92.1% | 88.6% | 88.6% | 0.94 | 3 | 31/38 | 11095 | 0/0 |
| 3 | `agy/Gemini 3.5 Flash (Low)` | 82.9% | 76.3% | 29 | 5 | 3 | 37 | 97.4% | 78.4% | 78.4% | 0.85 | 1 | 29/38 | 6355 | 0/0 |
| 4 | `agy/Gemini 3.5 Flash (Medium)` | 82.9% | 76.3% | 29 | 5 | 3 | 37 | 97.4% | 78.4% | 78.4% | 0.85 | 1 | 29/38 | 5903 | 0/0 |
| 5 | `agy/Gemini 3.1 Pro (High)` | 61.8% | 57.9% | 22 | 3 | 2 | 27 | 71.1% | 81.5% | 81.5% | 0.87 | 11 | 22/38 | 11498 | 0/0 |
| 6 | `agy/Claude Opus 4.6 (Thinking)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 6798 | 0/0 |
| 7 | `agy/Claude Sonnet 4.6 (Thinking)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 6709 | 0/0 |
| 8 | `agy/GPT-OSS 120B (Medium)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 7179 | 0/0 |

## Rates

- Scored attempts: 173
- Pass / partial / incorrect: 143 / 20 / 10
- Pass rate (scored): 143/173
- Fixture pass rate (passed fixture groups / scored fixture groups): 143/173
- Overall mean score (pass=1, partial=0.5): —
- Protocol errors: 131
- Policy violations: 0
- Trace errors: 0
- Timeouts: 0
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 0
- Completion tokens: 0
- Reasoning tokens: 0
- Total tokens: 0
- Cached prompt tokens: 0
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 0 (provider 0, estimated 0)
- Answer bytes (sum): 0
- Attempt duration avg/min/max: 7807 / 2346 / 67432 ms

## Groups (single-sample result + mean score)

| Fixture | Runner | K | Passes | Passed | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.angle-zero.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.plain-lua-vs-fn.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.seq-tables.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 6107 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3878 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4156 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4145 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 7343 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4669 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4791 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3940 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4615 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 3890 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5295 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4701 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5181 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4506 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4018 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3817 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 4151 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 5342 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4965 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4058 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 4715 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 5606 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5541 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5553 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4724 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3756 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4422 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 4308 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (Low) | 1 | protocol_error | 4108 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4463 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5625 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4053 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5143 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 4183 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5456 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4409 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 67432 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4433 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6096 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4289 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4471 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4505 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 9313 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5329 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6403 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5491 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 9052 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 5152 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6021 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5221 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6394 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 7452 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5912 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5303 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 6967 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 8255 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5626 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5660 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 5245 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 5858 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6890 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 7159 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 5570 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4704 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5282 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 6094 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | protocol_error | 4481 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5679 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5846 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4685 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 7058 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5233 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5554 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5353 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4515 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6183 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5971 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4712 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4483 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4540 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 7332 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (High) | 1 | incorrect | 5952 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5406 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5393 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4709 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5748 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6056 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4582 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6160 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6112 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5628 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4475 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 6113 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 7522 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5741 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5100 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5855 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5562 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6563 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6415 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (High) | 1 | incorrect | 5670 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5225 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5285 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 6781 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (High) | 1 | protocol_error | 5424 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6016 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5775 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5686 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 7034 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5508 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5329 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 20391 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5179 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 37526 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 2346 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9386 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9466 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 7952 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13168 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9266 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9987 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9693 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9343 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 10156 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14750 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9825 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14539 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14484 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13895 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8932 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 16802 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 12139 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8931 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8550 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14758 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10705 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13375 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11689 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10490 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11406 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9336 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 14100 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 10961 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 15652 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11937 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8176 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12717 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11357 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10175 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11095 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9919 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 10133 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14333 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8680 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8607 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8565 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16205 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11861 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 11841 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11371 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10403 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 12490 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16236 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10993 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13499 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 25988 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14858 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11686 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 17669 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 19173 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10193 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12648 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11632 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13358 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 20572 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16145 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 10462 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11266 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13742 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6139 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 7308 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 5992 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6971 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6215 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6321 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6454 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 7039 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6990 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6263 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6741 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.ents-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6754 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6173 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7048 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 11740 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6458 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6474 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7960 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7167 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6905 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6967 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6890 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6960 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6805 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6462 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6212 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6990 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6678 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5953 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6221 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6546 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5937 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6190 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6853 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6007 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6173 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6189 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6927 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6477 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6965 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6944 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5734 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7320 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6202 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6246 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6272 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6164 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6752 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6230 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.ents-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6116 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6401 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6342 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5568 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7031 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7131 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5548 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6158 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6222 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7092 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7488 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6838 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 8056 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6272 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7516 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6353 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6238 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6153 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6172 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6238 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6204 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7064 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7270 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6450 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7015 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5808 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6172 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6638 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6180 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6929 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6139 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7175 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6136 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 8056 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6285 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 8745 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 10236 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 8900 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.ents-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 9246 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 8833 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 8162 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 11099 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7430 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6717 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6284 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6948 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6799 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6320 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6768 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5987 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7399 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7847 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7887 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7319 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7911 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6928 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7756 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 8136 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7726 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7346 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7234 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6167 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7055 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6500 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6427 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6591 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6771 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6476 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6662 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6023 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6352 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6845 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6099 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7049 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6486 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7203 | —/— | — | — | — | no | CLI exited without a valid strict response. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — fixture-normalized model ranking, diagnostics, tokens, and timing
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`