# GMod Bench report

Run: `70b164dc-6ef6-4a75-93d6-33918b6faa41`
Fixtures: 38 fixtures (`bun run bench list`)
Repeat: 5 · Concurrency: 6
Started: 2026-07-10T15:56:33.573Z · Completed: 2026-07-10T16:08:37.501Z
Wall clock: 724s · Sum of attempt durations: 4325181ms (avg 11382ms, min 5893ms, max 36033ms)

## Model leaderboard

Sorted by **coverage** (scorable attempts / all attempts), then pass count, repeat consistency, and quality.

| Rank | Runner / model | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | pass@5 | Quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `agy/Gemini 3.1 Pro (Low)` | 158 | 18 | 6 | 182 | 95.8% | 86.8% | 91.9% | 0.92 | 8 | 34/38 | 11434 | 0/0 |
| 2 | `agy/Gemini 3.1 Pro (High)` | 101 | 9 | 4 | 114 | 60.0% | 88.6% | 91.7% | 0.93 | 76 | 22/38 | 11330 | 0/0 |

## Rates

- Scored attempts: 296
- Pass / partial / incorrect: 259 / 27 / 10
- Pass rate (scored): 259/296
- pass@5 (groups with ≥1 pass / scored groups): 56/61
- Overall mean score (pass=1, partial=0.5): 0.914
- Protocol errors: 84
- Policy violations: 0
- Trace errors: 0
- Timeouts: 0
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 0
- Completion tokens: 0
- Reasoning tokens: 0
- Total tokens: 0
- Cached prompt tokens: 0
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 0 (provider 0, estimated 0)
- Answer bytes (sum): 0
- Attempt duration avg/min/max: 11382 / 5893 / 36033 ms

## Groups (pass@5 + mean score)

| Fixture | Runner | K | Passes | pass@5 | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (High) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 1 | yes | 0.20 | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 1 | yes | 0.75 | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (High) | 5 | 1 | yes | 0.50 | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.30 | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (High) | 5 | 3 | yes | 0.60 | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (High) | 5 | 3 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 1 | yes | 0.60 | pass |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13683 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 23611 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12253 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 15277 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 19702 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11231 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8171 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 8690 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8787 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8147 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8964 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8488 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10438 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9736 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10546 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8199 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 7719 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 7854 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8598 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 7975 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12957 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 19252 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12572 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10413 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 13760 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10768 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 10695 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9320 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12454 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9233 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 12893 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 2 | incorrect | 10531 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10536 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 8884 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 9355 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9875 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 10288 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9546 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8728 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9156 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8493 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8274 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9107 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9553 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11764 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 11310 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 15167 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 11923 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 4 | protocol_error | 13146 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 5 | protocol_error | 10457 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14559 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11899 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12605 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 14394 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12597 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9304 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8580 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10326 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9297 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9318 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13102 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 13677 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12347 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12574 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 15697 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13968 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12822 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12785 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11821 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 15868 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10142 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12849 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9525 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12582 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10569 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8891 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11133 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9018 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8892 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9938 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 15797 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 13420 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 12221 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 14804 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 8995 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 15770 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 15850 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 15713 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 19919 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 18961 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8847 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9854 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10371 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9706 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8974 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11102 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 10517 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9113 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10005 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9476 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9138 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 10598 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10115 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11574 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9707 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11926 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 13031 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 11773 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12866 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11954 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 16004 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 20328 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 15870 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 16654 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 13874 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9632 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12208 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10771 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 13150 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12458 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9195 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11119 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10855 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9535 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9899 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11075 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9343 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9514 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9418 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10718 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9762 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12073 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10770 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11053 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9280 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 10937 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 13159 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 17146 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 16549 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 16312 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 12860 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 2 | protocol_error | 10299 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 3 | protocol_error | 10282 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 4 | protocol_error | 8948 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 5 | protocol_error | 9251 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13701 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12017 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12387 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9771 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 14537 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12412 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12115 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10131 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9382 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10114 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9337 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8956 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9610 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10559 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9305 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 15582 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11603 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 15249 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 13668 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10132 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8715 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9887 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 11654 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11672 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12377 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11056 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11553 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9972 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10075 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9393 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14856 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 13338 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9226 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11892 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11322 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9515 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8887 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 8555 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9919 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9672 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 9977 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 9579 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 8903 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 9785 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 8146 | —/— | — | — | — | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 20092 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13587 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 34133 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 20190 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 21215 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9892 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10635 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9299 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 9054 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 8964 | —/— | — | — | — | yes | Registers a named hook with hook.Add. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11368 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 8146 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10393 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11853 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 11656 | —/— | — | — | — | yes | Uses IsValid for entity/object validity. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9274 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9202 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10418 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 9241 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 9266 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16334 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 16842 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 16101 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 18802 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 18076 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13243 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10107 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 11922 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10636 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10670 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 17875 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13377 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 17491 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11909 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 17254 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11860 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9669 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9225 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10314 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12830 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10572 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 14134 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9612 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 12109 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12089 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 13758 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 12041 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 13513 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 12460 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 17712 | —/— | — | — | — | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16281 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 16671 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10917 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 12331 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13969 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10303 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11303 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10078 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 9438 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 11116 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 15287 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 15101 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 16105 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 16206 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 15534 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 20081 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 15155 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 18269 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 14087 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13842 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14824 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 12354 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 18634 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 18740 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 14338 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9111 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9899 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10810 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 9045 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 9856 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 20860 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 23413 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 36033 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 22351 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 15264 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 17092 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 19763 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 16394 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 21449 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 22259 | —/— | — | — | — | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9811 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10284 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10282 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11176 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 9768 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11993 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13925 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 11306 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 12592 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13385 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 11885 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 12542 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 14420 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 4 | incorrect | 9923 | —/— | — | — | — | yes | Did not match a fixture answer pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 15937 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11523 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13899 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 13620 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 14127 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13789 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14837 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 27542 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 15749 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 20210 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 27913 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14164 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 15308 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 12085 | —/— | — | — | — | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6895 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6340 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6094 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6921 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6293 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6389 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6383 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6232 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 8120 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 7166 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 7092 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6056 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6939 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6016 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6093 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6139 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6121 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6994 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6025 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6132 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6177 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6886 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6928 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 7185 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6658 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6358 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6966 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6237 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 7398 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 7137 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 7150 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6335 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6990 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 7291 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6198 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 7225 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6702 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 7048 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 7399 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6421 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6547 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6032 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6144 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6083 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6224 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6865 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6221 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6769 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6955 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6252 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6111 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6630 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 7032 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6745 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 7072 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6059 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 7074 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6115 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 6713 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6117 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6715 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 5944 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6556 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 5902 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6317 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 5893 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6554 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 6686 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 7055 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 6371 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 6082 | —/— | — | — | — | no | CLI exited without a valid strict response. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 6794 | —/— | — | — | — | no | CLI exited without a valid strict response. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — model ranking (coverage-first, tokens, ms)
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`