# GMod Bench report

Run: `0f05b466-ff5a-469a-9def-8077a159a510`
Fixtures: 38 fixtures (`bun run bench list`)
Repeat: 1 · Concurrency: 4
Started: 2026-07-10T15:43:49.054Z · Completed: 2026-07-10T15:53:30.573Z
Wall clock: 582s · Sum of attempt durations: 2406227ms (avg 7915ms, min 3730ms, max 33576ms)

## Model leaderboard

Sorted by **fixture score** (each fixture weighted equally; failures score zero), then fixture solve rate, coverage, and pass rate.

| Rank | Runner / model | Fixture score | Fixture solve | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | Fixture pass | Scored quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `agy/Gemini 3.1 Pro (High)` | 92.1% | 86.8% | 33 | 4 | 0 | 37 | 97.4% | 89.2% | 89.2% | 0.95 | 1 | 33/38 | 14537 | 0/0 |
| 2 | `agy/Gemini 3.5 Flash (Medium)` | 89.5% | 84.2% | 32 | 4 | 1 | 37 | 97.4% | 86.5% | 86.5% | 0.92 | 1 | 32/38 | 6053 | 0/0 |
| 3 | `agy/Gemini 3.1 Pro (Low)` | 86.8% | 84.2% | 32 | 2 | 2 | 36 | 94.7% | 88.9% | 88.9% | 0.92 | 2 | 32/38 | 11456 | 0/0 |
| 4 | `agy/Gemini 3.5 Flash (High)` | 84.2% | 76.3% | 29 | 6 | 2 | 37 | 97.4% | 78.4% | 78.4% | 0.86 | 1 | 29/38 | 6856 | 0/0 |
| 5 | `agy/Gemini 3.5 Flash (Low)` | 82.9% | 76.3% | 29 | 5 | 3 | 37 | 97.4% | 78.4% | 78.4% | 0.85 | 1 | 29/38 | 4696 | 0/0 |
| 6 | `agy/Claude Opus 4.6 (Thinking)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 6695 | 0/0 |
| 7 | `agy/Claude Sonnet 4.6 (Thinking)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 6543 | 0/0 |
| 8 | `agy/GPT-OSS 120B (Medium)` | 0.0% | 0.0% | 0 | 0 | 0 | 0 | 0.0% | 0.0% | 0.0% | 0.00 | 38 | 0/38 | 6487 | 0/0 |

## Rates

- Scored attempts: 184
- Pass / partial / incorrect: 155 / 21 / 8
- Pass rate (scored): 155/184
- Fixture pass rate (passed fixture groups / scored fixture groups): 155/184
- Overall mean score (pass=1, partial=0.5): —
- Protocol errors: 120
- Policy violations: 0
- Trace errors: 0
- Timeouts: 0
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 0
- Completion tokens: 0
- Reasoning tokens: 0
- Total tokens: 0
- Cached prompt tokens: 0
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 0 (provider 0, estimated 0)
- Answer bytes (sum): 0
- Attempt duration avg/min/max: 7915 / 3730 / 33576 ms

## Groups (single-sample result + mean score)

| Fixture | Runner | K | Passes | Passed | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.ents-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.hook-add.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.isvalid.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.net-receivers.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.angle-zero.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.config-var.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.darkrpvar.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.disttosqr.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.ents-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.find-ents-near.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.find-players-near.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.for-vs-while.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.hook-once.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.hudpaint-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.local-color.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.local-vs-global.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.localplayer-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.looking-at.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.meta-vs-arg.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.msg-vs-print.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.player-cache-hooks.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.ply-table-index.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.seq-tables.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | partial |
| gmod.perf.steamid-cache.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-drawrect.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.surface-text.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-count-hash.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | partial |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-empty.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (High) | 1 | 0 | no | — | incorrect |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 0 | no | — | incorrect |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-hasvalue.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-literal.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.table-random.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (High) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.perf.x-times-x.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Claude Opus 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Claude Sonnet 4.6 (Thinking) | 1 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (High) | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 1 | 0 | no | — | partial |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (High) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (Low) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.5 Flash (Medium) | 1 | 1 | yes | — | pass |
| gmod.player-iterator.v1 | agy/GPT-OSS 120B (Medium) | 1 | 0 | no | — | protocol_error |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 6107 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3878 | —/— | — | — | — | log-placeholder | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4156 | —/— | — | — | — | log-placeholder | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4145 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 7343 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4669 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4791 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3940 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4615 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 3890 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5295 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4701 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5181 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4506 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4018 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3817 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 4151 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 5342 | —/— | — | — | — | log-placeholder | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4965 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4058 | —/— | — | — | — | log-placeholder | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 4715 | —/— | — | — | — | log-placeholder | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 5606 | —/— | — | — | — | log-placeholder | Matched an incorrect-answer pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5878 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5179 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5232 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3898 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4104 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (Low) | 1 | partial | 4720 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (Low) | 1 | protocol_error | 4697 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3730 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5502 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4465 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 5433 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (Low) | 1 | incorrect | 4542 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4224 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4584 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 3989 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (Low) | 1 | pass | 4393 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6616 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4656 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5264 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4645 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 8567 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4853 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5481 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5202 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5879 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 5235 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6109 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5432 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5889 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6726 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5847 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5082 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 7088 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 12348 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5038 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 12286 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | incorrect | 5282 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6290 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6701 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6624 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5906 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5870 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5460 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | partial | 5778 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | protocol_error | 5271 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 6121 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5486 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4809 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5737 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5327 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5564 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5437 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 5335 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (Medium) | 1 | pass | 4759 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6774 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4759 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5237 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4867 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 8393 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 33576 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6160 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4808 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5296 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 6015 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6608 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4660 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6929 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 7534 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4798 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5153 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 6942 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 7533 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5111 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5660 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6889 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.5 Flash (High) | 1 | incorrect | 6541 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5899 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 6461 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 16903 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5189 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5306 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 5501 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.5 Flash (High) | 1 | protocol_error | 4456 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5699 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5675 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5334 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.5 Flash (High) | 1 | partial | 7978 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.5 Flash (High) | 1 | incorrect | 4710 | —/— | — | — | — | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5392 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5319 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 4533 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.5 Flash (High) | 1 | pass | 5926 | —/— | — | — | — | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14701 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8348 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8705 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8266 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 18538 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10726 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 15567 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9777 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10314 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 9968 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11586 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9212 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13909 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14466 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12348 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8094 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14513 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 19316 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9841 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8855 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 10778 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13928 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 16477 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10940 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10543 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12579 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9451 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13330 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 11074 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11080 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11688 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8749 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13863 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8456 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8757 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9603 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 7685 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 9303 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 27214 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8254 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10119 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9505 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 19061 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12040 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13643 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10884 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9956 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13324 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12888 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10189 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13726 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 23131 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16104 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9540 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 24236 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 18769 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12634 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13385 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10906 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 20152 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 15750 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12146 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11898 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12183 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10879 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 15501 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 12369 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 28269 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16849 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11100 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 29261 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10211 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11560 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12924 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10468 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 11363 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6504 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6623 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6138 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6928 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6710 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6818 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5830 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6058 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6548 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6894 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6741 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6944 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6130 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6898 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6967 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6515 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7022 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6132 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7093 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7115 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6194 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6731 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6904 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6143 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6910 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6012 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6936 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 7043 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6748 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6473 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5915 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6897 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6234 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5925 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6926 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 6067 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5993 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Claude Sonnet 4.6 (Thinking) | 1 | protocol_error | 5958 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.ents-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7321 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6900 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6674 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6396 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6123 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6890 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7092 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6877 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6770 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6160 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6381 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7126 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6851 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6150 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6117 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6370 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6987 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6175 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6992 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6153 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6988 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6802 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6186 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6243 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7350 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7201 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7236 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7164 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6188 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6051 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6741 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6838 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7051 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6940 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6158 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 7171 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6833 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Claude Opus 4.6 (Thinking) | 1 | protocol_error | 6755 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.ents-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6919 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.hook-add.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5917 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.isvalid.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6154 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.net-receivers.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7057 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.angle-zero.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6758 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.config-var.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5942 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.darkrpvar.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6590 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.disttosqr.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6103 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ents-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5707 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-ents-near.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7132 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.find-players-near.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6165 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.for-vs-while.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6496 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hook-once.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6395 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.hudpaint-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7077 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-color.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7015 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.local-vs-global.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7250 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.localplayer-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6790 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.looking-at.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7016 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.meta-vs-arg.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5972 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.msg-vs-print.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6737 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.pairs-ipairs-for.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6121 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6204 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.player-cache-hooks.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6146 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7182 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6926 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5946 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5978 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 5894 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6140 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6849 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 7075 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6280 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6942 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6725 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6081 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6286 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6370 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | GPT-OSS 120B (Medium) | 1 | protocol_error | 6164 | —/— | — | — | — | no | CLI exited without a valid strict response. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — fixture-normalized model ranking, diagnostics, tokens, and timing
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`