# GMod Bench report

Run: `6d5384a1-ae22-496a-83dd-92c789967f27`
Fixtures: 38 fixtures (`bun run bench list`)
Repeat: 1 · Concurrency: 20
Started: 2026-07-10T17:24:54.308Z · Completed: 2026-07-10T17:29:33.033Z
Wall clock: 279s · Sum of attempt durations: 4095432ms (avg 13472ms, min 2983ms, max 127769ms)

## Model leaderboard

Sorted by **coverage** (scorable attempts / all attempts), then pass count, repeat consistency, and quality.

| Rank | Runner / model | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | Fixture pass | Quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `codex/gpt-5.4@low` | 32 | 3 | 2 | 37 | 97.4% | 86.5% | 86.5% | 0.91 | 1 | 32/38 | 6128 | 17583/3096 |
| 2 | `codex/gpt-5.4@medium` | 32 | 2 | 2 | 36 | 94.7% | 88.9% | 88.9% | 0.92 | 2 | 32/38 | 9330 | 269622/4238 |
| 3 | `codex/gpt-5.4-mini@high` | 31 | 3 | 2 | 36 | 94.7% | 86.1% | 86.1% | 0.90 | 2 | 31/38 | 14915 | 509381/14292 |
| 4 | `codex/gpt-5.4-mini@xhigh` | 31 | 3 | 2 | 36 | 94.7% | 86.1% | 86.1% | 0.90 | 2 | 31/38 | 26702 | 31716/3972 |
| 5 | `codex/gpt-5.4@xhigh` | 30 | 3 | 3 | 36 | 94.7% | 83.3% | 83.3% | 0.88 | 2 | 30/38 | 21365 | 373440/18994 |
| 6 | `codex/gpt-5.4-mini@medium` | 33 | 2 | 0 | 35 | 92.1% | 94.3% | 94.3% | 0.97 | 3 | 33/38 | 12052 | 193026/5899 |
| 7 | `codex/gpt-5.4@high` | 31 | 2 | 2 | 35 | 92.1% | 88.6% | 88.6% | 0.91 | 3 | 31/38 | 11221 | 76881/4835 |
| 8 | `codex/gpt-5.4-mini@low` | 31 | 1 | 2 | 34 | 89.5% | 91.2% | 91.2% | 0.93 | 4 | 31/38 | 6062 | 190916/3867 |

## Rates

- Scored attempts: 285
- Pass / partial / incorrect: 251 / 19 / 15
- Pass rate (scored): 251/285
- Fixture pass rate (passed fixture groups / scored fixture groups): 251/285
- Overall mean score (pass=1, partial=0.5): 0.914
- Protocol errors: 19
- Policy violations: 0
- Trace errors: 0
- Timeouts: 0
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 1662565
- Completion tokens: 59193
- Reasoning tokens: 31334
- Total tokens: 1721758
- Cached prompt tokens: 1170944
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 304 (provider 112, estimated 192)
- Answer bytes (sum): 99339
- Attempt duration avg/min/max: 13472 / 2983 / 127769 ms

## Groups (single-sample result + mean score)

| Fixture | Runner | K | Passes | Passed | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.hook-add.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.isvalid.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4-mini@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | 0.50 | partial |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4@medium | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.angle-zero.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | 0.50 | partial |
| gmod.perf.config-var.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4-mini@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-ents-near.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | — | protocol_error |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.localplayer-cache.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4-mini@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4@high | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4@low | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4@medium | 1 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | 0.50 | partial |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4@medium | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.ply-table-index.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4-mini@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4@high | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4@low | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4@medium | 1 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.table-random.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.table-random.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | codex/gpt-5.4@xhigh | 1 | 0 | no | 0.00 | incorrect |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4-mini@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4-mini@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4-mini@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4-mini@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | codex/gpt-5.4-mini@high | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | codex/gpt-5.4-mini@low | 1 | 0 | no | 0.00 | incorrect |
| gmod.player-iterator.v1 | codex/gpt-5.4-mini@medium | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | codex/gpt-5.4-mini@xhigh | 1 | 0 | no | 0.50 | partial |
| gmod.player-iterator.v1 | codex/gpt-5.4@high | 1 | 1 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | codex/gpt-5.4@low | 1 | 1 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | codex/gpt-5.4@medium | 1 | 1 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | codex/gpt-5.4@xhigh | 1 | 1 | yes | 1.00 | pass |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.ents-iterator.v1 | codex | gpt-5.4@low | 1 | pass | 4461 | 72/67 | — | estimated | 268 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4@low | 1 | pass | 4607 | 78/54 | — | estimated | 214 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4@low | 1 | pass | 5953 | 74/46 | — | estimated | 184 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4@low | 1 | pass | 5439 | 64/66 | — | estimated | 263 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4@low | 1 | incorrect | 6140 | 71/60 | — | estimated | 239 | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4@low | 1 | pass | 5826 | 82/56 | — | estimated | 223 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4@low | 1 | pass | 6285 | 66/61 | — | estimated | 242 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4@low | 1 | pass | 6008 | 71/56 | — | estimated | 221 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4@low | 1 | pass | 6344 | 66/60 | — | estimated | 238 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4@low | 1 | partial | 5345 | 83/51 | — | estimated | 204 | yes | Matched a partial-answer pattern. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4@low | 1 | pass | 7790 | 79/164 | — | estimated | 654 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4@low | 1 | pass | 5113 | 65/56 | — | estimated | 224 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4@low | 1 | pass | 7454 | 84/158 | — | estimated | 629 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4@low | 1 | pass | 6953 | 76/97 | — | estimated | 385 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4@low | 1 | pass | 6256 | 63/91 | — | estimated | 364 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4@low | 1 | pass | 5511 | 62/50 | — | estimated | 199 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4@low | 1 | partial | 7779 | 70/148 | — | estimated | 590 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4@low | 1 | partial | 17875 | 91/134 | — | estimated | 537 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4@low | 1 | pass | 6314 | 71/52 | — | estimated | 208 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4@low | 1 | pass | 6285 | 63/48 | — | estimated | 191 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4@low | 1 | pass | 5361 | 73/57 | — | estimated | 227 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4@low | 1 | pass | 7178 | 76/126 | — | estimated | 502 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4@low | 1 | pass | 6582 | 88/168 | — | estimated | 670 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4@low | 1 | pass | 5606 | 69/104 | — | estimated | 413 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4@low | 1 | pass | 6409 | 79/75 | — | estimated | 299 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4@low | 1 | pass | 4021 | 71/46 | — | estimated | 181 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4@low | 1 | pass | 4803 | 100/66 | — | estimated | 263 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4@low | 1 | pass | 10268 | 63/186 | — | estimated | 742 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4@low | 1 | protocol_error | 4515 | 14892/104 | 11 | provider | 264 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4@low | 1 | pass | 4658 | 69/56 | — | estimated | 221 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4@low | 1 | pass | 6848 | 76/123 | — | estimated | 492 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4@low | 1 | pass | 6740 | 62/34 | — | estimated | 134 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4@low | 1 | pass | 3744 | 73/47 | — | estimated | 185 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4@low | 1 | incorrect | 6026 | 67/126 | — | estimated | 503 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4@low | 1 | pass | 4663 | 70/67 | — | estimated | 268 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4@low | 1 | pass | 4443 | 66/63 | — | estimated | 252 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4@low | 1 | pass | 3559 | 58/30 | — | estimated | 120 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4@low | 1 | pass | 3690 | 80/43 | — | estimated | 170 | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | codex | gpt-5.4@medium | 1 | pass | 6968 | 72/65 | — | estimated | 258 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4@medium | 1 | pass | 4039 | 78/51 | — | estimated | 202 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4@medium | 1 | pass | 4368 | 74/66 | — | estimated | 263 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4@medium | 1 | pass | 3853 | 64/48 | — | estimated | 191 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4@medium | 1 | incorrect | 9109 | 71/57 | — | estimated | 226 | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4@medium | 1 | pass | 4377 | 82/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4@medium | 1 | pass | 6193 | 66/79 | — | estimated | 316 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4@medium | 1 | pass | 5202 | 71/57 | — | estimated | 225 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4@medium | 1 | pass | 9612 | 66/58 | — | estimated | 230 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4@medium | 1 | protocol_error | 6207 | 14910/212 | 87 | provider | 392 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4@medium | 1 | pass | 7634 | 79/120 | — | estimated | 478 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4@medium | 1 | pass | 20007 | 65/64 | — | estimated | 256 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4@medium | 1 | pass | 4809 | 84/107 | — | estimated | 426 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4@medium | 1 | pass | 5139 | 76/90 | — | estimated | 359 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4@medium | 1 | pass | 4971 | 63/77 | — | estimated | 306 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4@medium | 1 | pass | 3956 | 62/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4@medium | 1 | partial | 8880 | 70/166 | — | estimated | 661 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4@medium | 1 | partial | 6100 | 91/168 | — | estimated | 670 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4@medium | 1 | pass | 4037 | 71/66 | — | estimated | 262 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4@medium | 1 | pass | 5093 | 63/51 | — | estimated | 204 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4@medium | 1 | pass | 11043 | 73/63 | — | estimated | 251 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4@medium | 1 | pass | 13562 | 14912/228 | 60 | provider | 550 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4@medium | 1 | pass | 13476 | 14907/207 | 13 | provider | 698 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4@medium | 1 | incorrect | 14150 | 14894/180 | 69 | provider | 364 | yes | Did not match a fixture answer pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4@medium | 1 | pass | 12690 | 14901/141 | 39 | provider | 292 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4@medium | 1 | pass | 11440 | 14900/90 | 22 | provider | 190 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4@medium | 1 | pass | 11635 | 14922/117 | 38 | provider | 267 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4@medium | 1 | pass | 14399 | 14891/267 | 21 | provider | 840 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4@medium | 1 | protocol_error | 11478 | 14892/122 | 21 | provider | 299 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4@medium | 1 | pass | 11924 | 14896/131 | 47 | provider | 237 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4@medium | 1 | pass | 14999 | 14899/265 | 93 | provider | 525 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4@medium | 1 | pass | 13678 | 14887/50 | 0 | provider | 134 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4@medium | 1 | pass | 12048 | 14894/151 | 63 | provider | 308 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4@medium | 1 | pass | 11622 | 14898/122 | 24 | provider | 266 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4@medium | 1 | pass | 11911 | 14895/111 | 30 | provider | 251 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4@medium | 1 | pass | 11495 | 14893/103 | 41 | provider | 200 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4@medium | 1 | pass | 11290 | 14886/98 | 39 | provider | 152 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4@medium | 1 | pass | 11162 | 14904/82 | 20 | provider | 191 | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | codex | gpt-5.4@high | 1 | pass | 20212 | 14895/602 | 516 | provider | 267 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4@high | 1 | pass | 6908 | 14897/155 | 79 | provider | 209 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4@high | 1 | pass | 23815 | 74/45 | — | estimated | 180 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4@high | 1 | pass | 5364 | 64/50 | — | estimated | 199 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4@high | 1 | incorrect | 9712 | 71/80 | — | estimated | 319 | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4@high | 1 | pass | 8988 | 82/56 | — | estimated | 223 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4@high | 1 | pass | 9945 | 66/66 | — | estimated | 264 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4@high | 1 | pass | 15903 | 71/71 | — | estimated | 283 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4@high | 1 | protocol_error | 16747 | 14893/622 | 516 | provider | 342 | yes | Answer must contain 1 through 1 candidate loops. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4@high | 1 | protocol_error | 18378 | 14910/337 | 217 | provider | 384 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4@high | 1 | pass | 15483 | 79/167 | — | estimated | 665 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4@high | 1 | pass | 20153 | 65/59 | — | estimated | 233 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4@high | 1 | pass | 34907 | 84/159 | — | estimated | 633 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4@high | 1 | pass | 6950 | 76/117 | — | estimated | 466 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4@high | 1 | pass | 6298 | 63/88 | — | estimated | 351 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4@high | 1 | pass | 5437 | 62/54 | — | estimated | 213 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4@high | 1 | partial | 14663 | 70/171 | — | estimated | 684 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4@high | 1 | partial | 17802 | 91/124 | — | estimated | 493 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4@high | 1 | pass | 7569 | 71/71 | — | estimated | 284 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4@high | 1 | pass | 5478 | 63/56 | — | estimated | 221 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4@high | 1 | pass | 7327 | 73/74 | — | estimated | 293 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4@high | 1 | pass | 16115 | 76/164 | — | estimated | 653 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4@high | 1 | pass | 9685 | 88/165 | — | estimated | 658 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4@high | 1 | incorrect | 12273 | 69/121 | — | estimated | 483 | yes | Did not match a fixture answer pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4@high | 1 | pass | 8046 | 79/83 | — | estimated | 331 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4@high | 1 | pass | 6530 | 71/51 | — | estimated | 202 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4@high | 1 | pass | 8669 | 100/74 | — | estimated | 296 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4@high | 1 | pass | 14965 | 63/133 | — | estimated | 530 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4@high | 1 | protocol_error | 6493 | 14894/216 | 76 | provider | 416 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4@high | 1 | pass | 7067 | 69/60 | — | estimated | 238 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4@high | 1 | pass | 10952 | 76/132 | — | estimated | 528 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4@high | 1 | pass | 4863 | 62/48 | — | estimated | 190 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4@high | 1 | pass | 7262 | 73/60 | — | estimated | 239 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4@high | 1 | pass | 5560 | 67/68 | — | estimated | 271 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4@high | 1 | pass | 7375 | 70/75 | — | estimated | 297 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4@high | 1 | pass | 7403 | 66/72 | — | estimated | 285 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4@high | 1 | pass | 4487 | 58/41 | — | estimated | 161 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4@high | 1 | pass | 10619 | 80/48 | — | estimated | 189 | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | codex | gpt-5.4@xhigh | 1 | pass | 13332 | 72/66 | — | estimated | 263 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4@xhigh | 1 | pass | 5455 | 78/55 | — | estimated | 218 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4@xhigh | 1 | pass | 6804 | 74/61 | — | estimated | 241 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4@xhigh | 1 | pass | 11476 | 64/55 | — | estimated | 218 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4@xhigh | 1 | partial | 14208 | 71/110 | — | estimated | 437 | yes | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4@xhigh | 1 | incorrect | 10014 | 82/53 | — | estimated | 212 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4@xhigh | 1 | pass | 57488 | 66/54 | — | estimated | 214 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4@xhigh | 1 | pass | 8164 | 71/74 | — | estimated | 295 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4@xhigh | 1 | pass | 29364 | 66/85 | — | estimated | 339 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4@xhigh | 1 | protocol_error | 11723 | 14914/506 | 332 | provider | 567 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4@xhigh | 1 | pass | 46343 | 79/136 | — | estimated | 543 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4@xhigh | 1 | pass | 9279 | 65/64 | — | estimated | 255 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4@xhigh | 1 | pass | 14651 | 84/192 | — | estimated | 766 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4@xhigh | 1 | pass | 15524 | 76/158 | — | estimated | 631 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4@xhigh | 1 | pass | 16287 | 14890/358 | 235 | provider | 327 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4@xhigh | 1 | pass | 13584 | 14894/217 | 127 | provider | 248 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4@xhigh | 1 | partial | 22563 | 14897/684 | 503 | provider | 659 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4@xhigh | 1 | partial | 21925 | 14909/673 | 516 | provider | 499 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4@xhigh | 1 | pass | 17635 | 14901/411 | 332 | provider | 267 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4@xhigh | 1 | pass | 23345 | 14894/583 | 516 | provider | 187 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4@xhigh | 1 | pass | 16629 | 14902/375 | 277 | provider | 321 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4@xhigh | 1 | pass | 44243 | 14916/1854 | 1683 | provider | 540 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4@xhigh | 1 | pass | 69771 | 14911/3300 | 3069 | provider | 769 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4@xhigh | 1 | incorrect | 40869 | 14896/1708 | 1524 | provider | 566 | yes | Did not match a fixture answer pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4@xhigh | 1 | pass | 19368 | 14899/529 | 419 | provider | 311 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4@xhigh | 1 | pass | 19028 | 14902/497 | 373 | provider | 338 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4@xhigh | 1 | pass | 16725 | 14920/379 | 284 | provider | 305 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4@xhigh | 1 | pass | 22650 | 14893/763 | 516 | provider | 823 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4@xhigh | 1 | protocol_error | 20748 | 14894/524 | 381 | provider | 370 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4@xhigh | 1 | pass | 16607 | 14900/405 | 322 | provider | 222 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4@xhigh | 1 | pass | 31623 | 14895/1223 | 1034 | provider | 599 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4@xhigh | 1 | pass | 12617 | 14889/175 | 111 | provider | 178 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4@xhigh | 1 | pass | 17776 | 14898/420 | 344 | provider | 251 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4@xhigh | 1 | pass | 20739 | 14898/461 | 362 | provider | 277 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4@xhigh | 1 | pass | 21596 | 14897/651 | 516 | provider | 409 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4@xhigh | 1 | incorrect | 17175 | 14891/349 | 245 | provider | 332 | yes | Did not match a fixture answer pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4@xhigh | 1 | pass | 13176 | 14888/209 | 150 | provider | 148 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4@xhigh | 1 | pass | 21353 | 14904/577 | 516 | provider | 191 | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.ents-iterator.v1 | codex | gpt-5.4-mini@low | 1 | pass | 12457 | 14543/220 | 145 | provider | 224 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4-mini@low | 1 | pass | 11293 | 14549/74 | 8 | provider | 180 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4-mini@low | 1 | pass | 10680 | 14544/75 | 8 | provider | 195 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4-mini@low | 1 | pass | 15321 | 14539/80 | 10 | provider | 213 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4-mini@low | 1 | incorrect | 13781 | 14543/189 | 90 | provider | 270 | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4-mini@low | 1 | pass | 10712 | 14546/101 | 23 | provider | 228 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4-mini@low | 1 | pass | 5862 | 14544/103 | 14 | provider | 256 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4265 | 14545/78 | 8 | provider | 184 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4992 | 14541/143 | 68 | provider | 256 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4-mini@low | 1 | protocol_error | 5493 | 14564/204 | 47 | provider | 503 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4-mini@low | 1 | pass | 5409 | 79/115 | — | estimated | 460 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4115 | 65/55 | — | estimated | 218 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4-mini@low | 1 | pass | 10074 | 84/102 | — | estimated | 406 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3994 | 76/87 | — | estimated | 346 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4261 | 63/60 | — | estimated | 240 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3744 | 62/47 | — | estimated | 188 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3946 | 70/113 | — | estimated | 452 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4-mini@low | 1 | partial | 4868 | 91/127 | — | estimated | 505 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3452 | 71/70 | — | estimated | 277 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4118 | 63/47 | — | estimated | 187 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4803 | 73/63 | — | estimated | 252 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4-mini@low | 1 | pass | 5600 | 76/164 | — | estimated | 653 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4-mini@low | 1 | pass | 6809 | 88/157 | — | estimated | 626 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4-mini@low | 1 | pass | 5033 | 69/102 | — | estimated | 406 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4-mini@low | 1 | protocol_error | 4386 | 14549/172 | 27 | provider | 433 | yes | Answer must contain 0 through 1 candidate loops. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4439 | 71/47 | — | estimated | 187 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3743 | 100/60 | — | estimated | 240 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4-mini@low | 1 | protocol_error | 6269 | 14541/204 | 12 | provider | 628 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4-mini@low | 1 | protocol_error | 5511 | 14546/181 | 8 | provider | 495 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3987 | 69/48 | — | estimated | 190 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4-mini@low | 1 | pass | 6090 | 76/119 | — | estimated | 473 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3183 | 62/33 | — | estimated | 129 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4-mini@low | 1 | pass | 7181 | 73/110 | — | estimated | 437 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4-mini@low | 1 | pass | 5563 | 67/65 | — | estimated | 258 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4-mini@low | 1 | pass | 4939 | 70/104 | — | estimated | 414 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4-mini@low | 1 | pass | 3451 | 66/53 | — | estimated | 209 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4-mini@low | 1 | pass | 2983 | 58/39 | — | estimated | 155 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4-mini@low | 1 | incorrect | 3564 | 80/56 | — | estimated | 221 | yes | The recommendation changes the set of visited players. |
| gmod.ents-iterator.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 6304 | 72/67 | — | estimated | 266 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 4727 | 78/49 | — | estimated | 193 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 5499 | 74/51 | — | estimated | 203 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 5135 | 64/51 | — | estimated | 201 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4-mini@medium | 1 | protocol_error | 16956 | 16630/877 | 762 | provider | 367 | yes | Answer must contain exactly one fenced code block followed by a reason. |
| gmod.perf.config-var.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 6613 | 82/46 | — | estimated | 183 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 5505 | 66/50 | — | estimated | 200 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 3880 | 71/51 | — | estimated | 202 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 8815 | 66/52 | — | estimated | 206 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4-mini@medium | 1 | protocol_error | 7801 | 14560/322 | 208 | provider | 354 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 14581 | 79/117 | — | estimated | 467 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 17370 | 65/53 | — | estimated | 210 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 5565 | 84/62 | — | estimated | 245 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 8267 | 76/128 | — | estimated | 512 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 4921 | 63/67 | — | estimated | 265 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 4847 | 62/43 | — | estimated | 169 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 8949 | 70/74 | — | estimated | 293 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4-mini@medium | 1 | partial | 21420 | 91/172 | — | estimated | 685 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 9692 | 71/62 | — | estimated | 247 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 8732 | 63/31 | — | estimated | 123 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 4119 | 73/64 | — | estimated | 254 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 31117 | 76/155 | — | estimated | 620 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 6514 | 88/180 | — | estimated | 720 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 13329 | 69/144 | — | estimated | 575 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 6770 | 79/74 | — | estimated | 296 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 5005 | 71/44 | — | estimated | 176 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 4530 | 100/66 | — | estimated | 264 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 31017 | 14543/522 | 353 | provider | 573 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4-mini@medium | 1 | protocol_error | 13544 | 14544/306 | 121 | provider | 517 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 13269 | 14546/250 | 169 | provider | 237 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 21969 | 14547/427 | 282 | provider | 446 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 45198 | 14537/152 | 107 | provider | 107 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 15481 | 14548/242 | 143 | provider | 342 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 19098 | 14544/181 | 72 | provider | 283 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 12602 | 14545/204 | 124 | provider | 223 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 14617 | 14541/188 | 117 | provider | 214 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4-mini@medium | 1 | pass | 13175 | 14538/156 | 104 | provider | 111 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4-mini@medium | 1 | partial | 11027 | 14550/119 | 44 | provider | 240 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | codex | gpt-5.4-mini@high | 1 | pass | 16615 | 14545/445 | 364 | provider | 245 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4-mini@high | 1 | pass | 12641 | 14549/167 | 96 | provider | 176 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4-mini@high | 1 | pass | 11576 | 14542/174 | 109 | provider | 177 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4-mini@high | 1 | pass | 12885 | 14535/220 | 153 | provider | 193 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4-mini@high | 1 | incorrect | 18039 | 14545/614 | 516 | provider | 310 | yes | Did not match a fixture answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4-mini@high | 1 | pass | 15036 | 14550/415 | 341 | provider | 213 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4-mini@high | 1 | pass | 17008 | 14546/538 | 468 | provider | 199 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4-mini@high | 1 | pass | 13234 | 14543/222 | 139 | provider | 245 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4-mini@high | 1 | pass | 19485 | 14541/275 | 208 | provider | 220 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4-mini@high | 1 | protocol_error | 16975 | 14560/519 | 353 | provider | 547 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4-mini@high | 1 | pass | 15537 | 14556/430 | 298 | provider | 407 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4-mini@high | 1 | pass | 13576 | 14547/296 | 215 | provider | 242 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4-mini@high | 1 | pass | 16582 | 14555/490 | 399 | provider | 293 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4-mini@high | 1 | pass | 14580 | 14552/285 | 120 | provider | 503 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4-mini@high | 1 | pass | 22799 | 14540/217 | 104 | provider | 296 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4-mini@high | 1 | pass | 12297 | 14540/153 | 76 | provider | 188 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4-mini@high | 1 | partial | 28758 | 14547/1391 | 1253 | provider | 465 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4-mini@high | 1 | partial | 21003 | 14557/671 | 458 | provider | 623 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4-mini@high | 1 | pass | 16614 | 14551/527 | 461 | provider | 193 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4-mini@high | 1 | pass | 18045 | 14544/387 | 324 | provider | 183 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4-mini@high | 1 | pass | 11458 | 14550/155 | 69 | provider | 216 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4-mini@high | 1 | pass | 17296 | 14562/519 | 310 | provider | 680 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4-mini@high | 1 | pass | 17463 | 14559/599 | 425 | provider | 632 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4-mini@high | 1 | pass | 17249 | 14544/549 | 406 | provider | 412 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4-mini@high | 1 | pass | 14693 | 14547/342 | 234 | provider | 352 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4-mini@high | 1 | pass | 12966 | 14552/235 | 171 | provider | 179 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4-mini@high | 1 | pass | 16317 | 14568/458 | 366 | provider | 316 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4-mini@high | 1 | pass | 17162 | 14541/521 | 344 | provider | 565 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4-mini@high | 1 | protocol_error | 16354 | 14540/387 | 244 | provider | 418 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4-mini@high | 1 | pass | 14471 | 14546/338 | 251 | provider | 232 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4-mini@high | 1 | pass | 16621 | 14545/517 | 376 | provider | 416 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4-mini@high | 1 | pass | 12387 | 14539/189 | 126 | provider | 182 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4-mini@high | 1 | pass | 14776 | 14546/416 | 335 | provider | 249 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4-mini@high | 1 | pass | 9127 | 14548/237 | 130 | provider | 285 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4-mini@high | 1 | pass | 9215 | 14545/243 | 157 | provider | 237 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4-mini@high | 1 | incorrect | 5540 | 66/69 | — | estimated | 273 | yes | Did not match a fixture answer pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4-mini@high | 1 | pass | 5204 | 58/40 | — | estimated | 159 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4-mini@high | 1 | partial | 5188 | 80/42 | — | estimated | 165 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 127769 | 72/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 9218 | 78/44 | — | estimated | 176 | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 8393 | 74/46 | — | estimated | 184 | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 11801 | 64/53 | — | estimated | 211 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | codex | gpt-5.4-mini@xhigh | 1 | partial | 93025 | 71/67 | — | estimated | 265 | yes | Matched a partial-answer pattern. |
| gmod.perf.config-var.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 25042 | 82/49 | — | estimated | 194 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 46748 | 66/52 | — | estimated | 206 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 6162 | 71/51 | — | estimated | 202 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 75779 | 66/57 | — | estimated | 225 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 13625 | 83/91 | — | estimated | 367 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 11731 | 79/111 | — | estimated | 444 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 7313 | 65/37 | — | estimated | 147 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 11059 | 84/88 | — | estimated | 350 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 12411 | 76/112 | — | estimated | 446 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 12903 | 63/74 | — | estimated | 295 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 8887 | 62/43 | — | estimated | 171 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 25613 | 70/115 | — | estimated | 458 | yes | Matched a pass pattern. |
| gmod.perf.looking-at.v1 | codex | gpt-5.4-mini@xhigh | 1 | partial | 61917 | 91/117 | — | estimated | 468 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 24924 | 71/60 | — | estimated | 237 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 46851 | 63/41 | — | estimated | 163 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | codex | gpt-5.4-mini@xhigh | 1 | incorrect | 9100 | 73/66 | — | estimated | 264 | yes | Did not match a fixture answer pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 11717 | 76/149 | — | estimated | 595 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 111113 | 88/203 | — | estimated | 812 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 29187 | 69/130 | — | estimated | 520 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 12191 | 79/98 | — | estimated | 389 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 16405 | 71/33 | — | estimated | 132 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 10599 | 100/73 | — | estimated | 292 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 40856 | 63/133 | — | estimated | 531 | yes | Matched a pass pattern. |
| gmod.perf.string-table-concat.v1 | codex | gpt-5.4-mini@xhigh | 1 | protocol_error | 14132 | 14546/652 | 516 | provider | 386 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 10319 | 69/50 | — | estimated | 199 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 32271 | 76/115 | — | estimated | 457 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 6624 | 62/29 | — | estimated | 116 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 10811 | 73/63 | — | estimated | 250 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | codex | gpt-5.4-mini@xhigh | 1 | protocol_error | 10660 | 14546/628 | 516 | provider | 296 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.table-literal.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 23787 | 70/42 | — | estimated | 166 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | codex | gpt-5.4-mini@xhigh | 1 | incorrect | 10653 | 66/65 | — | estimated | 257 | yes | Did not match a fixture answer pattern. |
| gmod.perf.x-times-x.v1 | codex | gpt-5.4-mini@xhigh | 1 | pass | 5905 | 58/33 | — | estimated | 129 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | codex | gpt-5.4-mini@xhigh | 1 | partial | 7160 | 80/48 | — | estimated | 190 | yes | Uses ipairs but still allocates via player.GetAll() each time. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — model ranking (coverage-first, tokens, ms)
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`