# GMod Bench report

Run: `4524afb8-11f9-4d79-b50f-a599f7b0109c`
Fixtures: 38 fixtures (`bun run bench list`)
Repeat: 1 · Concurrency: 8
Started: 2026-07-10T15:44:34.502Z · Completed: 2026-07-10T15:49:32.186Z
Wall clock: 298s · Sum of attempt durations: 2531232ms (avg 8326ms, min 3730ms, max 25349ms)

## Model leaderboard

Sorted by **fixture score** (each fixture weighted equally; failures score zero), then fixture solve rate, coverage, and pass rate.

| Rank | Runner / model | Fixture score | Fixture solve | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | Fixture pass | Scored quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `agy/Gemini 3.1 Pro (Low)` | 90.8% | 86.8% | 33 | 3 | 0 | 36 | 94.7% | 91.7% | 91.7% | 0.96 | 2 | 33/38 | 11490 | 0/0 |
| 2 | `agy/Gemini 3.5 Flash (High)` | 89.5% | 84.2% | 32 | 4 | 1 | 37 | 97.4% | 86.5% | 86.5% | 0.92 | 1 | 32/38 | 6955 | 0/0 |
| 3 | `agy/Gemini 3.1 Pro (High)` | 88.2% | 84.2% | 32 | 3 | 1 | 36 | 94.7% | 88.9% | 88.9% | 0.93 | 2 | 32/38 | 12759 | 0/0 |
| 4 | `agy/Gemini 3.5 Flash (Medium)` | 84.2% | 78.9% | 30 | 4 | 3 | 37 | 97.4% | 81.1% | 81.1% | 0.86 | 1 | 30/38 | 6292 | 0/0 |
| 5 | `agy/Gemini 3.5 Flash (Low)` | 82.9% | 76.3% | 29 | 5 | 3 | 37 | 97.4% | 78.4% | 78.4% | 0.85 | 1 | 29/38 | 4696 | 0/0 |
| 6 | `agy/Claude Sonnet 4.6 (Thinking)` | 76.3% | 73.7% | 28 | 2 | 4 | 34 | 89.5% | 82.4% | 82.4% | 0.85 | 4 | 28/38 | 10101 | 0/0 |
| 7 | `agy/Claude Opus 4.6 (Thinking)` | 39.5% | 36.8% | 14 | 2 | 1 | 17 | 44.7% | 82.4% | 82.4% | 0.88 | 21 | 14/38 | 7744 | 0/0 |
| 8 | `agy/GPT-OSS 120B (Medium)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 6574 | 0/0 |

## Rates

- Scored attempts: 234
- Pass / partial / incorrect: 198 / 23 / 13
- Pass rate (scored): 198/234
- Fixture pass rate (passed fixture groups / scored fixture groups): 198/234
- Overall mean score (pass=1, partial=0.5): —
- Protocol errors: 70
- Policy violations: 0
- Trace errors: 0
- Timeouts: 0
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 0
- Completion tokens: 0
- Reasoning tokens: 0
- Total tokens: 0
- Cached prompt tokens: 0
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 0 (provider 0, estimated 0)
- Answer bytes (sum): 0
- Attempt duration avg/min/max: 8326 / 3730 / 25349 ms

## Groups (single-sample result + mean score)

| Fixture | Runner | K | Passes | Passed | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | partial |
| gmod.perf.angle-zero.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.angle-zero.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | incorrect |
| gmod.perf.config-var.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.hudpaint-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.localplayer-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | incorrect |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | incorrect |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.seq-tables.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | incorrect |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | incorrect |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 6107 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3878 | —/— | — | — | — | log-placeholder | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4156 | —/— | — | — | — | log-placeholder | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4145 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 7343 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4669 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4791 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3940 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4615 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 3890 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5295 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4701 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5181 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4506 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4018 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3817 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 4151 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 5342 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4965 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4058 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 4715 | —/— | — | — | — | log-placeholder | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 5606 | —/— | — | — | — | log-placeholder | Matched an incorrect-answer pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3898 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5179 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5232 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5878 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4104 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3730 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 4720 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (Low) | 1 | protocol_error | 4697 | —/— | — | — | — | no | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5502 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4465 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 4542 | —/— | — | — | — | log-placeholder | Did not match a fixture answer pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5433 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4224 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3989 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4584 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4393 | —/— | — | — | — | log-placeholder | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4656 | —/— | — | — | — | log-placeholder | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5264 | —/— | — | — | — | log-placeholder | Uses IsValid for entity/object validity. |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6616 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4645 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 7416 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5782 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6296 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5193 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 25349 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 6006 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6566 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5258 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6414 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 6089 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5910 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5003 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 5916 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 7856 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5695 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5901 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5045 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6274 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5946 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 8368 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 5699 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4725 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5315 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 6217 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | protocol_error | 5344 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5224 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6737 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5103 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6431 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4759 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4976 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5482 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4775 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4830 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 8594 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4870 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5286 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4585 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 7347 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6006 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5556 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5936 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 11365 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 5359 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5690 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 8605 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 7957 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | incorrect | 7769 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 8442 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5292 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 7541 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 7287 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5926 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5065 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5862 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5473 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 7068 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 12374 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5522 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5101 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 17900 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 6852 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (High) | 1 | protocol_error | 5339 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 13908 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5446 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4858 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6486 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 8141 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4715 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4532 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4584 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5640 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12374 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8114 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9131 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8109 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 18571 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10602 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13969 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8597 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9563 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 8885 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11280 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9714 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14144 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11375 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14461 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9470 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 16344 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 21900 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10730 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10109 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8274 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13115 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 19119 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10677 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10114 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10770 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8333 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 12384 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 8655 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12564 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11152 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10088 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13100 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11350 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9783 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10370 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8462 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 10858 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 18540 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9006 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10185 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9134 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 17235 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11369 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16100 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11075 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11114 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 12363 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 17119 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10592 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14281 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 20340 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 17748 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12716 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 24474 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 13076 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11291 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11340 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12677 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12806 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14760 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13905 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12102 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9129 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8589 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 10591 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 11012 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13743 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12541 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8882 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11981 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11010 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10747 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11340 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9653 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 10275 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 7107 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 6711 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 8327 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 8222 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 12475 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 8791 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9500 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 8165 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9554 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 10114 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 10297 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9717 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 14251 | —/— | — | — | — | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.hudpaint-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9864 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 8258 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9312 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9988 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | partial | 12694 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 8037 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 13387 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 10281 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | incorrect | 14289 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 11083 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | incorrect | 11541 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.seq-tables.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 10726 | —/— | — | — | — | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.setdrawcolor-split.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 6904 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 10073 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 13109 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 9054 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 9127 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | incorrect | 18925 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-count-hash.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 7387 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 12948 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | incorrect | 9963 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-literal.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 10226 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 7698 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | pass | 6979 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | partial | 8770 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 7909 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 7504 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 7498 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 9261 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | partial | 9292 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | incorrect | 10101 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 9371 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 7546 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 8686 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 8492 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 10682 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 9613 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 11627 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 9705 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 8878 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 7651 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | pass | 9413 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | partial | 15371 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6670 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5922 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6118 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5890 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5949 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5744 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5878 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7216 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6524 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6431 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6939 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5868 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6180 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5907 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5968 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6132 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 5864 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7010 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6755 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6720 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.ents-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6911 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6036 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7188 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6732 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6927 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7070 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6074 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7833 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6197 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6315 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7150 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7159 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6682 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6098 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6993 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7029 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5852 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6900 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6538 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6619 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6419 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6927 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5880 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6638 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5882 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6744 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6812 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6079 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6089 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6274 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6063 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6872 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6116 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6891 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6253 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6934 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6712 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5935 | —/— | — | — | — | no | CLI exited without a valid strict response. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — fixture-normalized model ranking, diagnostics, tokens, and timing
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`