# GMod Bench report

Run: `49efc61a-73c8-4c9c-bcf1-1efaf96c4aef`
Fixtures: 57 fixtures (`bun run bench list`)
Repeat: 5 · Concurrency: 32
Started: 2026-07-10T22:46:22.586Z · Completed: 2026-07-10T22:52:02.956Z
Wall clock: 340s · Sum of attempt durations: 8956412ms (avg 15713ms, min 7147ms, max 106104ms)

## Model leaderboard

Sorted by **fixture score** (each fixture weighted equally; failures score zero), then fixture solve rate, coverage, and pass rate.

| Rank | Runner / model | Fixture score | Fixture solve | Pass | Partial | Incorrect | Scored | Coverage | Pass rate | pass@5 | Scored quality | Protocol err | Fixtures | Avg ms | Prompt/Compl tok |
| ---: | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 1 | `agy/Gemini 3.1 Pro (High)` | 78.9% | 77.2% | 200 | 50 | 26 | 276 | 96.8% | 72.5% | 78.6% | 0.82 | 9 | 44/57 | 18397 | 23505/34476 |
| 2 | `agy/Gemini 3.1 Pro (Low)` | 75.6% | 73.7% | 191 | 49 | 35 | 275 | 96.5% | 69.5% | 75.0% | 0.78 | 10 | 42/57 | 13029 | 23505/34171 |

## Rates

- Scored attempts: 551
- Pass / partial / incorrect: 391 / 99 / 61
- Pass rate (scored): 391/551
- pass@5 (groups with ≥1 pass / scored groups): 86/112
- Overall mean score (pass=1, partial=0.5): 0.799
- Protocol errors: 19
- Policy violations: 0
- Trace errors: 0
- Timeouts: 0
- Unavailable: 0
- Unsupported: 0

## Usage & timing

Token counts: **provider** when the runner reports them (OpenRouter); otherwise **estimated** (~chars/4) so CLI runs still get numbers.

- Prompt tokens: 47010
- Completion tokens: 68647
- Reasoning tokens: 0
- Total tokens: 115657
- Cached prompt tokens: 0
- Cache write tokens: 0
- Reported cost: 0
- Upstream inference cost: 0
- Attempts with token counts: 570 (provider 0, estimated 570)
- Answer bytes (sum): 273775
- Attempt duration avg/min/max: 15713 / 7147 / 106104 ms

## Groups (pass@5 + mean score)

| Fixture | Runner | K | Passes | pass@5 | Mean | Best |
| --- | --- | ---: | ---: | --- | ---: | --- |
| gmod.darkrp-shop-npc.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.10 | partial |
| gmod.darkrp-shop-npc.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.00 | incorrect |
| gmod.ents-iterator-readonly.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.ents-iterator-readonly.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.file-data-root-confinement.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.file-data-root-confinement.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.hook-add.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.hook-object-lifecycle.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.hook-object-lifecycle.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.hudpaint-hot-path.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.hudpaint-hot-path.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.isvalid.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-bounded-chunk-transfer.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.10 | partial |
| gmod.net-bounded-chunk-transfer.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.10 | partial |
| gmod.net-bounded-decompression.v1 | agy/Gemini 3.1 Pro (High) | 5 | 4 | yes | 0.90 | pass |
| gmod.net-bounded-decompression.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 3 | yes | 0.60 | pass |
| gmod.net-compact-targeted-update.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-compact-targeted-update.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-per-player-budget.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.20 | partial |
| gmod.net-per-player-budget.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.40 | partial |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-receivers.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.net-secure-entity-action.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.net-secure-entity-action.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.networkvar-entity-state.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.networkvar-entity-state.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.angle-zero.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.config-var.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.darkrpvar.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.disttosqr.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ents-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.perf.find-ents-near.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 1 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.find-players-near.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.for-vs-while.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hook-once.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.hudpaint-cache.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-color.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.local-vs-global.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (High) | 5 | 1 | yes | 0.60 | pass |
| gmod.perf.localplayer-cache.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.30 | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.perf.looking-at.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.meta-vs-arg.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.msg-vs-print.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (High) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.pairs-ipairs-for.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 3 | yes | 0.60 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (High) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.plain-lua-vs-fn.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.player-cache-hooks.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.ply-table-index.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 4 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.seq-tables.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.setdrawcolor-split.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.sqlite-vs-mysql.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (High) | 5 | 1 | yes | 0.60 | pass |
| gmod.perf.steamid-cache.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 1 | yes | 0.60 | pass |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | — | protocol_error |
| gmod.perf.string-table-concat.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | — | protocol_error |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.surface-drawrect.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.surface-text.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (High) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.table-count-hash.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-empty.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-hasvalue.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 4 | yes | 0.80 | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-literal.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.table-random.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.perf.x-times-x.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (High) | 5 | 1 | yes | 0.60 | pass |
| gmod.player-iterator.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.prediction-one-shot-effect.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.prediction-one-shot-effect.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 5 | yes | 1.00 | pass |
| gmod.realm-shared-authority.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.20 | partial |
| gmod.realm-shared-authority.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.20 | partial |
| gmod.spatial-maintained-set.v1 | agy/Gemini 3.1 Pro (High) | 5 | 5 | yes | 1.00 | pass |
| gmod.spatial-maintained-set.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 3 | yes | 0.60 | pass |
| gmod.spawn-preventive-rate-limit.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.spawn-preventive-rate-limit.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.sqlite-batched-transaction.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.00 | incorrect |
| gmod.sqlite-batched-transaction.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.00 | incorrect |
| gmod.sqlite-typed-write.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.sqlite-typed-write.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |
| gmod.timer-delayed-validity.v1 | agy/Gemini 3.1 Pro (High) | 5 | 1 | yes | 0.20 | pass |
| gmod.timer-delayed-validity.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.00 | incorrect |
| gmod.transfer-lifecycle-cleanup.v1 | agy/Gemini 3.1 Pro (High) | 5 | 0 | no | 0.50 | partial |
| gmod.transfer-lifecycle-cleanup.v1 | agy/Gemini 3.1 Pro (Low) | 5 | 0 | no | 0.50 | partial |

## Attempts

| Fixture | Adapter | Model | # | Status | ms | P/C tok | Reason tok | Src | Bytes | Body | Detail |
| --- | --- | --- | ---: | --- | ---: | ---: | ---: | --- | ---: | --- | --- |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 34188 | 48/707 | — | estimated | 2827 | yes | Core 5/8: interaction, targeted-open, affordability, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (Low) | 2 | incorrect | 22860 | 48/358 | — | estimated | 1430 | yes | Core 5/8: interaction, affordability, purchase-order, no-client-authority, no-broadcast-menu. Missing core: targeted-open, server-authoritative, item-validation. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 22732 | 48/655 | — | estimated | 2618 | yes | Core 4/8: interaction, affordability, no-client-authority, no-broadcast-menu. Missing core: targeted-open, server-authoritative, item-validation, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 18851 | 48/364 | — | estimated | 1453 | yes | Core 4/8: interaction, targeted-open, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, affordability, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 27137 | 48/504 | — | estimated | 2016 | yes | Core 5/8: interaction, targeted-open, affordability, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 15848 | 82/75 | — | estimated | 300 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12133 | 82/77 | — | estimated | 305 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10738 | 82/90 | — | estimated | 357 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 15230 | 82/83 | — | estimated | 332 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 16615 | 82/81 | — | estimated | 321 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 18966 | 72/89 | — | estimated | 356 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 16516 | 72/83 | — | estimated | 329 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 16438 | 72/76 | — | estimated | 304 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 16105 | 72/96 | — | estimated | 384 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 15678 | 72/77 | — | estimated | 305 | yes | Matched a pass pattern. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 20535 | 139/189 | — | estimated | 756 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 20791 | 139/227 | — | estimated | 907 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 27351 | 139/208 | — | estimated | 831 | yes | File receiver satisfies 6/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 19782 | 139/239 | — | estimated | 956 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 20883 | 139/253 | — | estimated | 1011 | yes | File receiver satisfies 6/13 confinement checks. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14226 | 78/52 | — | estimated | 207 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11218 | 78/63 | — | estimated | 252 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 13435 | 78/72 | — | estimated | 286 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12163 | 78/76 | — | estimated | 303 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 13525 | 78/53 | — | estimated | 209 | yes | Registers a named hook with hook.Add. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 29664 | 93/117 | — | estimated | 468 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 14714 | 93/75 | — | estimated | 297 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 26535 | 93/109 | — | estimated | 435 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 20383 | 93/115 | — | estimated | 459 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 16538 | 93/100 | — | estimated | 399 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 25537 | 102/195 | — | estimated | 780 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 14242 | 102/204 | — | estimated | 815 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 11266 | 102/186 | — | estimated | 741 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10179 | 102/170 | — | estimated | 680 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 17887 | 102/192 | — | estimated | 766 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8419 | 74/68 | — | estimated | 271 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 7521 | 74/53 | — | estimated | 210 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 8023 | 74/49 | — | estimated | 193 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 7874 | 74/66 | — | estimated | 261 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8328 | 74/57 | — | estimated | 226 | yes | Uses IsValid for entity/object validity. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 20713 | 174/290 | — | estimated | 1160 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 31561 | 174/283 | — | estimated | 1131 | yes | Chunk receiver satisfies 13/20 state and size checks. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 21225 | 174/275 | — | estimated | 1098 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 21373 | 174/275 | — | estimated | 1097 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 20520 | 174/251 | — | estimated | 1004 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 27106 | 113/184 | — | estimated | 736 | yes | Decompresses untrusted data without the required maxSize. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 15574 | 113/172 | — | estimated | 686 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 23879 | 113/216 | — | estimated | 862 | yes | Decompresses untrusted data without the required maxSize. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 20699 | 113/179 | — | estimated | 715 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 31764 | 113/224 | — | estimated | 896 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11004 | 99/129 | — | estimated | 515 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11336 | 99/130 | — | estimated | 518 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9450 | 99/119 | — | estimated | 475 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10164 | 99/111 | — | estimated | 443 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11766 | 99/126 | — | estimated | 504 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 19284 | 127/236 | — | estimated | 944 | yes | Receiver satisfies 9/15 per-player budget checks. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 17486 | 127/247 | — | estimated | 987 | yes | Receiver satisfies 10/15 per-player budget checks. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 15596 | 127/239 | — | estimated | 954 | yes | Does not implement the bounded per-player receiver budget. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 18080 | 127/239 | — | estimated | 954 | yes | Receiver satisfies 10/15 per-player budget checks. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 17075 | 127/213 | — | estimated | 852 | yes | Receiver satisfies 10/15 per-player budget checks. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8799 | 64/64 | — | estimated | 256 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8292 | 64/58 | — | estimated | 231 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 7939 | 64/60 | — | estimated | 237 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 7687 | 64/63 | — | estimated | 250 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 7955 | 64/59 | — | estimated | 234 | yes | Matched a pass pattern. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 19740 | 120/280 | — | estimated | 1119 | yes | Receiver includes 7/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 24815 | 120/297 | — | estimated | 1187 | yes | Receiver includes 8/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 22610 | 120/290 | — | estimated | 1160 | yes | Receiver includes 7/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 16843 | 120/214 | — | estimated | 856 | yes | Receiver includes 7/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 15255 | 120/314 | — | estimated | 1254 | yes | Receiver includes 7/11 required trust-boundary checks. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9703 | 86/74 | — | estimated | 293 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9134 | 86/79 | — | estimated | 314 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10777 | 86/78 | — | estimated | 309 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9998 | 86/61 | — | estimated | 241 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 7678 | 86/50 | — | estimated | 198 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 17383 | 71/95 | — | estimated | 378 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 10569 | 71/52 | — | estimated | 206 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 13697 | 71/44 | — | estimated | 176 | yes | Did not match a fixture answer pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 14310 | 71/88 | — | estimated | 350 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 17817 | 71/76 | — | estimated | 304 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9350 | 82/66 | — | estimated | 261 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9922 | 82/65 | — | estimated | 257 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9477 | 82/69 | — | estimated | 275 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9558 | 82/62 | — | estimated | 245 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8686 | 82/66 | — | estimated | 261 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10278 | 66/58 | — | estimated | 230 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 13592 | 66/66 | — | estimated | 264 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 12245 | 66/54 | — | estimated | 215 | yes | Did not match a fixture answer pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 14756 | 66/66 | — | estimated | 262 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11622 | 66/42 | — | estimated | 166 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8180 | 71/71 | — | estimated | 283 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8275 | 71/64 | — | estimated | 256 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 7688 | 71/58 | — | estimated | 232 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9386 | 71/49 | — | estimated | 193 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8311 | 71/52 | — | estimated | 208 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10391 | 66/64 | — | estimated | 256 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9205 | 66/77 | — | estimated | 305 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9068 | 66/79 | — | estimated | 313 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10445 | 66/69 | — | estimated | 276 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9962 | 66/74 | — | estimated | 293 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 10434 | 83/114 | — | estimated | 453 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 2 | protocol_error | 12747 | 83/110 | — | estimated | 440 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 3 | protocol_error | 12757 | 83/135 | — | estimated | 538 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 13568 | 83/97 | — | estimated | 385 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (Low) | 5 | protocol_error | 9856 | 83/87 | — | estimated | 348 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11935 | 79/142 | — | estimated | 566 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9814 | 79/131 | — | estimated | 521 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10652 | 79/130 | — | estimated | 520 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12490 | 79/126 | — | estimated | 504 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11783 | 79/148 | — | estimated | 592 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10412 | 65/72 | — | estimated | 285 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8768 | 65/92 | — | estimated | 366 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9281 | 65/82 | — | estimated | 325 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8788 | 65/69 | — | estimated | 274 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9787 | 65/62 | — | estimated | 248 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13388 | 84/94 | — | estimated | 376 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12485 | 84/149 | — | estimated | 595 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12737 | 84/173 | — | estimated | 689 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 13978 | 84/134 | — | estimated | 533 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12441 | 84/76 | — | estimated | 304 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14806 | 76/145 | — | estimated | 580 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 14148 | 76/111 | — | estimated | 443 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 14075 | 76/145 | — | estimated | 578 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11084 | 76/132 | — | estimated | 526 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 17481 | 76/152 | — | estimated | 605 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10636 | 63/84 | — | estimated | 333 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9552 | 63/76 | — | estimated | 304 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 11674 | 63/101 | — | estimated | 403 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10679 | 63/78 | — | estimated | 309 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11781 | 63/128 | — | estimated | 510 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9823 | 62/73 | — | estimated | 291 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 7558 | 62/43 | — | estimated | 170 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 8168 | 62/65 | — | estimated | 258 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 7657 | 62/45 | — | estimated | 179 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 7702 | 62/58 | — | estimated | 230 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 13157 | 70/115 | — | estimated | 458 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 13268 | 70/97 | — | estimated | 386 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 8709 | 70/43 | — | estimated | 170 | yes | Did not match a fixture answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 13990 | 70/107 | — | estimated | 428 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 12500 | 70/48 | — | estimated | 189 | yes | Did not match a fixture answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 14099 | 91/126 | — | estimated | 504 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 14350 | 91/119 | — | estimated | 474 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 12728 | 91/112 | — | estimated | 447 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 12885 | 91/202 | — | estimated | 807 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 14072 | 91/120 | — | estimated | 480 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9512 | 71/38 | — | estimated | 150 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9544 | 71/38 | — | estimated | 152 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10690 | 71/33 | — | estimated | 131 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9888 | 71/32 | — | estimated | 127 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8500 | 71/36 | — | estimated | 143 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8871 | 63/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 7764 | 63/47 | — | estimated | 186 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9918 | 63/43 | — | estimated | 171 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8930 | 63/53 | — | estimated | 209 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10353 | 63/51 | — | estimated | 204 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8889 | 73/44 | — | estimated | 176 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 2 | incorrect | 10227 | 73/65 | — | estimated | 257 | yes | Did not match a fixture answer pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 9084 | 73/65 | — | estimated | 257 | yes | Did not match a fixture answer pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9740 | 73/58 | — | estimated | 232 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8232 | 73/67 | — | estimated | 266 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9241 | 76/89 | — | estimated | 356 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11411 | 76/111 | — | estimated | 441 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10780 | 76/89 | — | estimated | 356 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12969 | 76/116 | — | estimated | 463 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12917 | 76/109 | — | estimated | 434 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10535 | 88/170 | — | estimated | 677 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 14912 | 88/207 | — | estimated | 825 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 14192 | 88/180 | — | estimated | 718 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 14599 | 88/184 | — | estimated | 735 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 13651 | 88/208 | — | estimated | 832 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 12442 | 69/167 | — | estimated | 668 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12848 | 69/89 | — | estimated | 355 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12200 | 69/75 | — | estimated | 299 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9843 | 69/68 | — | estimated | 272 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12636 | 69/80 | — | estimated | 319 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9954 | 79/84 | — | estimated | 334 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9677 | 79/99 | — | estimated | 394 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10253 | 79/96 | — | estimated | 381 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 11798 | 79/118 | — | estimated | 470 | yes | Did not match a fixture answer pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11173 | 79/80 | — | estimated | 319 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 11550 | 71/43 | — | estimated | 170 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11440 | 71/57 | — | estimated | 228 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10066 | 71/56 | — | estimated | 222 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10449 | 71/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10882 | 71/41 | — | estimated | 164 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 10495 | 100/92 | — | estimated | 368 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11694 | 100/80 | — | estimated | 319 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10924 | 100/77 | — | estimated | 305 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8326 | 100/56 | — | estimated | 223 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 8594 | 100/78 | — | estimated | 311 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 14855 | 63/113 | — | estimated | 452 | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 10102 | 63/83 | — | estimated | 332 | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 11459 | 63/125 | — | estimated | 500 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 12413 | 63/90 | — | estimated | 359 | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 10509 | 63/70 | — | estimated | 279 | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 1 | protocol_error | 11073 | 70/82 | — | estimated | 326 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 2 | protocol_error | 8817 | 70/86 | — | estimated | 341 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 3 | protocol_error | 9160 | 70/96 | — | estimated | 381 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 4 | protocol_error | 9616 | 70/86 | — | estimated | 343 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (Low) | 5 | protocol_error | 9239 | 70/84 | — | estimated | 336 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8640 | 69/49 | — | estimated | 194 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9280 | 69/54 | — | estimated | 214 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10475 | 69/62 | — | estimated | 246 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10769 | 69/53 | — | estimated | 211 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9388 | 69/50 | — | estimated | 197 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13516 | 76/89 | — | estimated | 354 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 11603 | 76/80 | — | estimated | 318 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 10667 | 76/87 | — | estimated | 347 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 12292 | 76/91 | — | estimated | 363 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10072 | 76/81 | — | estimated | 321 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8692 | 62/43 | — | estimated | 172 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8880 | 62/41 | — | estimated | 164 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 9244 | 62/47 | — | estimated | 186 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 10035 | 62/53 | — | estimated | 212 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9127 | 62/34 | — | estimated | 134 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 14255 | 73/43 | — | estimated | 170 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 16211 | 73/71 | — | estimated | 281 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 14036 | 73/50 | — | estimated | 199 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 13950 | 73/47 | — | estimated | 185 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12381 | 73/51 | — | estimated | 204 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 13491 | 67/82 | — | estimated | 327 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 13751 | 67/88 | — | estimated | 350 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 14840 | 67/84 | — | estimated | 333 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9567 | 67/67 | — | estimated | 266 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 9129 | 67/95 | — | estimated | 380 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8039 | 70/54 | — | estimated | 213 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8042 | 70/68 | — | estimated | 270 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 8554 | 70/94 | — | estimated | 374 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8790 | 70/66 | — | estimated | 263 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 9415 | 70/70 | — | estimated | 280 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 9790 | 66/50 | — | estimated | 198 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 9979 | 66/54 | — | estimated | 213 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 12348 | 66/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 11256 | 66/63 | — | estimated | 251 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 11114 | 66/70 | — | estimated | 279 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 8313 | 58/39 | — | estimated | 156 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 8827 | 58/57 | — | estimated | 225 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 8120 | 58/51 | — | estimated | 201 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 8735 | 58/53 | — | estimated | 210 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 10638 | 58/45 | — | estimated | 180 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 9059 | 80/61 | — | estimated | 244 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 8772 | 80/58 | — | estimated | 230 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 9413 | 80/60 | — | estimated | 240 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 10260 | 80/44 | — | estimated | 176 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 9668 | 80/54 | — | estimated | 213 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (Low) | 1 | pass | 12392 | 84/141 | — | estimated | 561 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 12177 | 84/123 | — | estimated | 491 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (Low) | 3 | pass | 11544 | 84/133 | — | estimated | 529 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 9815 | 84/120 | — | estimated | 478 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 12518 | 84/136 | — | estimated | 544 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 12313 | 88/137 | — | estimated | 545 | yes | Does not show the required shared loading and server-authoritative action. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (Low) | 2 | incorrect | 14482 | 88/119 | — | estimated | 473 | yes | Does not show the required shared loading and server-authoritative action. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 14654 | 88/130 | — | estimated | 520 | yes | Loading is correct, but server authority or caller authorization is incomplete. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 17764 | 88/124 | — | estimated | 493 | yes | Loading is correct, but server authority or caller authorization is incomplete. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 11477 | 88/153 | — | estimated | 609 | yes | Does not show the required shared loading and server-authoritative action. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 22507 | 126/458 | — | estimated | 1832 | yes | Does not provide the complete maintained-set spatial design. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (Low) | 2 | pass | 16901 | 126/386 | — | estimated | 1541 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 20366 | 126/395 | — | estimated | 1580 | yes | Does not provide the complete maintained-set spatial design. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (Low) | 4 | pass | 24643 | 126/463 | — | estimated | 1852 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (Low) | 5 | pass | 16596 | 126/443 | — | estimated | 1770 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 15489 | 106/247 | — | estimated | 988 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 21639 | 106/283 | — | estimated | 1131 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 17028 | 106/241 | — | estimated | 962 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 13962 | 106/229 | — | estimated | 914 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 15756 | 106/285 | — | estimated | 1140 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 21428 | 82/154 | — | estimated | 613 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (Low) | 2 | incorrect | 15725 | 82/138 | — | estimated | 552 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 22280 | 82/245 | — | estimated | 980 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 17945 | 82/210 | — | estimated | 839 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 19381 | 82/141 | — | estimated | 561 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 11695 | 73/120 | — | estimated | 480 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 11706 | 73/102 | — | estimated | 405 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 13091 | 73/122 | — | estimated | 487 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 11974 | 73/124 | — | estimated | 496 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 12286 | 73/104 | — | estimated | 415 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (Low) | 1 | incorrect | 9920 | 75/56 | — | estimated | 221 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (Low) | 2 | incorrect | 9610 | 75/56 | — | estimated | 224 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (Low) | 3 | incorrect | 7754 | 75/45 | — | estimated | 177 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (Low) | 4 | incorrect | 8470 | 75/55 | — | estimated | 217 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (Low) | 5 | incorrect | 10900 | 75/49 | — | estimated | 196 | yes | Does not implement the one-shot delayed removal. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (Low) | 1 | partial | 17682 | 123/225 | — | estimated | 899 | yes | Cleanup satisfies 7/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (Low) | 2 | partial | 18232 | 123/226 | — | estimated | 902 | yes | Cleanup satisfies 7/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (Low) | 3 | partial | 18887 | 123/218 | — | estimated | 871 | yes | Cleanup satisfies 7/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (Low) | 4 | partial | 19708 | 123/193 | — | estimated | 770 | yes | Cleanup satisfies 8/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (Low) | 5 | partial | 14575 | 123/237 | — | estimated | 945 | yes | Cleanup satisfies 8/11 disconnect and timeout requirements. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 17049 | 48/385 | — | estimated | 1537 | yes | Core 4/8: interaction, targeted-open, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, affordability, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 17935 | 48/410 | — | estimated | 1639 | yes | Core 4/8: interaction, targeted-open, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, affordability, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 16236 | 48/383 | — | estimated | 1532 | yes | Core 4/8: interaction, targeted-open, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, affordability, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 29445 | 48/746 | — | estimated | 2984 | yes | Core 8/8: interaction, targeted-open, server-authoritative, item-validation, affordability, purchase-order, no-client-authority, no-broadcast-menu. Missing core: none. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.darkrp-shop-npc.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 20497 | 48/734 | — | estimated | 2933 | yes | Core 5/8: interaction, targeted-open, affordability, no-client-authority, no-broadcast-menu. Missing core: server-authoritative, item-validation, purchase-order. Hardening 0/3: none. Missing hardening: proximity, rate-limit, payload-bound. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8948 | 82/78 | — | estimated | 310 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10427 | 82/68 | — | estimated | 270 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9953 | 82/74 | — | estimated | 294 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11382 | 82/61 | — | estimated | 244 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator-readonly.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 9933 | 82/66 | — | estimated | 262 | yes | Processes ents.Iterator results directly without mutating its cache. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 31181 | 72/81 | — | estimated | 324 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 26688 | 72/84 | — | estimated | 334 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 22177 | 72/95 | — | estimated | 378 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 18783 | 72/85 | — | estimated | 338 | yes | Matched a pass pattern. |
| gmod.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 18704 | 72/87 | — | estimated | 345 | yes | Matched a pass pattern. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 23310 | 139/231 | — | estimated | 921 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 23396 | 139/203 | — | estimated | 810 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 26392 | 139/223 | — | estimated | 890 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 43650 | 139/249 | — | estimated | 994 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.file-data-root-confinement.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 25605 | 139/200 | — | estimated | 799 | yes | File receiver satisfies 5/13 confinement checks. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 7574 | 78/50 | — | estimated | 199 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 7147 | 78/68 | — | estimated | 270 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 7321 | 78/93 | — | estimated | 372 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 7747 | 78/48 | — | estimated | 192 | yes | Registers a named hook with hook.Add. |
| gmod.hook-add.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 8866 | 78/67 | — | estimated | 267 | yes | Registers a named hook with hook.Add. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 16385 | 93/103 | — | estimated | 409 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 58824 | 93/101 | — | estimated | 403 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 14960 | 93/124 | — | estimated | 495 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 13682 | 93/103 | — | estimated | 410 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hook-object-lifecycle.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13845 | 93/121 | — | estimated | 484 | yes | Uses an object hook identifier so invalid objects are removed automatically. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 15229 | 102/204 | — | estimated | 815 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 15329 | 102/191 | — | estimated | 762 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 17456 | 102/176 | — | estimated | 703 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 14254 | 102/197 | — | estimated | 788 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.hudpaint-hot-path.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 19388 | 102/208 | — | estimated | 832 | yes | Caches stable render resources and derives per-frame values once. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9546 | 74/70 | — | estimated | 279 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9297 | 74/56 | — | estimated | 224 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9221 | 74/51 | — | estimated | 202 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 9483 | 74/62 | — | estimated | 247 | yes | Uses IsValid for entity/object validity. |
| gmod.isvalid.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10524 | 74/65 | — | estimated | 259 | yes | Uses IsValid for entity/object validity. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 44251 | 174/274 | — | estimated | 1095 | yes | Chunk receiver satisfies 12/20 state and size checks. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 27487 | 174/267 | — | estimated | 1068 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 34895 | 174/263 | — | estimated | 1050 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (High) | 4 | incorrect | 28542 | 174/301 | — | estimated | 1203 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-chunk-transfer.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 19661 | 174/288 | — | estimated | 1149 | yes | Does not implement the bounded sender-owned chunk receiver. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 33455 | 113/189 | — | estimated | 755 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 21642 | 113/183 | — | estimated | 732 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 30922 | 113/187 | — | estimated | 745 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 34464 | 113/197 | — | estimated | 788 | yes | Payload receiver satisfies 10/11 bounded-decompression checks. |
| gmod.net-bounded-decompression.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 25899 | 113/184 | — | estimated | 735 | yes | Bounds compressed input before reading and caps decompressed output before use. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12166 | 99/115 | — | estimated | 457 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 12006 | 99/122 | — | estimated | 488 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 12313 | 99/119 | — | estimated | 473 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 16374 | 99/143 | — | estimated | 572 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-compact-targeted-update.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13230 | 99/126 | — | estimated | 503 | yes | Uses bounded bit widths and targeted recipient fanout. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 33528 | 127/282 | — | estimated | 1126 | yes | Receiver satisfies 10/15 per-player budget checks. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 19536 | 127/259 | — | estimated | 1035 | yes | Does not implement the bounded per-player receiver budget. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 18957 | 127/216 | — | estimated | 863 | yes | Does not implement the bounded per-player receiver budget. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 19995 | 127/222 | — | estimated | 887 | yes | Receiver satisfies 10/15 per-player budget checks. |
| gmod.net-per-player-budget.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 20955 | 127/228 | — | estimated | 910 | yes | Does not implement the bounded per-player receiver budget. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9561 | 64/66 | — | estimated | 262 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 8980 | 64/61 | — | estimated | 243 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 8903 | 64/73 | — | estimated | 292 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 8052 | 64/66 | — | estimated | 262 | yes | Matched a pass pattern. |
| gmod.net-receivers.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 8596 | 64/59 | — | estimated | 236 | yes | Matched a pass pattern. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 21289 | 120/300 | — | estimated | 1200 | yes | Receiver includes 8/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 23839 | 120/220 | — | estimated | 878 | yes | Receiver includes 8/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 20008 | 120/288 | — | estimated | 1152 | yes | Receiver includes 7/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 21742 | 120/284 | — | estimated | 1134 | yes | Receiver includes 8/11 required trust-boundary checks. |
| gmod.net-secure-entity-action.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 27390 | 120/192 | — | estimated | 767 | yes | Receiver includes 7/11 required trust-boundary checks. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11062 | 86/72 | — | estimated | 286 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11054 | 86/80 | — | estimated | 317 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9356 | 86/59 | — | estimated | 233 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10739 | 86/69 | — | estimated | 276 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.networkvar-entity-state.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 8972 | 86/62 | — | estimated | 248 | yes | Defines Power with Entity:NetworkVar in SetupDataTables. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 19736 | 71/101 | — | estimated | 402 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 15073 | 71/93 | — | estimated | 370 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 21705 | 71/90 | — | estimated | 358 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 21305 | 71/81 | — | estimated | 321 | yes | Matched a pass pattern. |
| gmod.perf.angle-zero.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 19518 | 71/82 | — | estimated | 325 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10099 | 82/67 | — | estimated | 267 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11409 | 82/68 | — | estimated | 269 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 12179 | 82/82 | — | estimated | 328 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 9667 | 82/57 | — | estimated | 225 | yes | Matched a pass pattern. |
| gmod.perf.config-var.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 17699 | 82/69 | — | estimated | 275 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14682 | 66/53 | — | estimated | 212 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 14333 | 66/51 | — | estimated | 201 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 11237 | 66/53 | — | estimated | 210 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 16667 | 66/40 | — | estimated | 157 | yes | Matched a pass pattern. |
| gmod.perf.darkrpvar.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12689 | 66/59 | — | estimated | 235 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11658 | 71/79 | — | estimated | 316 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11166 | 71/74 | — | estimated | 295 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9791 | 71/58 | — | estimated | 229 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 7574 | 71/56 | — | estimated | 224 | yes | Matched a pass pattern. |
| gmod.perf.disttosqr.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 11097 | 71/68 | — | estimated | 269 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9642 | 66/80 | — | estimated | 317 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13110 | 66/83 | — | estimated | 329 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 13035 | 66/76 | — | estimated | 301 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11853 | 66/69 | — | estimated | 274 | yes | Matched a pass pattern. |
| gmod.perf.ents-iterator.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10656 | 66/66 | — | estimated | 264 | yes | Matched a pass pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 14219 | 83/115 | — | estimated | 459 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 12004 | 83/113 | — | estimated | 452 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 14951 | 83/123 | — | estimated | 491 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 11218 | 83/77 | — | estimated | 305 | yes | Matched a partial-answer pattern. |
| gmod.perf.find-ents-near.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 11175 | 83/114 | — | estimated | 455 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14440 | 79/126 | — | estimated | 501 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 15874 | 79/129 | — | estimated | 514 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 17679 | 79/123 | — | estimated | 490 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11481 | 79/137 | — | estimated | 547 | yes | Matched a pass pattern. |
| gmod.perf.find-players-near.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12764 | 79/132 | — | estimated | 526 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10297 | 65/88 | — | estimated | 351 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9284 | 65/79 | — | estimated | 316 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9848 | 65/77 | — | estimated | 305 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 8645 | 65/71 | — | estimated | 283 | yes | Matched a pass pattern. |
| gmod.perf.for-vs-while.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10303 | 65/84 | — | estimated | 336 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 15683 | 84/121 | — | estimated | 481 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 18946 | 84/130 | — | estimated | 517 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 16923 | 84/149 | — | estimated | 594 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 14653 | 84/150 | — | estimated | 600 | yes | Matched a pass pattern. |
| gmod.perf.hook-once.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 17475 | 84/120 | — | estimated | 480 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 18606 | 76/99 | — | estimated | 395 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 18464 | 76/145 | — | estimated | 578 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 14387 | 76/136 | — | estimated | 543 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 16485 | 76/131 | — | estimated | 524 | yes | Matched a pass pattern. |
| gmod.perf.hudpaint-cache.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 15534 | 76/131 | — | estimated | 524 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12850 | 63/97 | — | estimated | 386 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 12282 | 63/85 | — | estimated | 340 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 15164 | 63/112 | — | estimated | 447 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 14487 | 63/117 | — | estimated | 465 | yes | Matched a pass pattern. |
| gmod.perf.local-color.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 15210 | 63/107 | — | estimated | 427 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 7575 | 62/54 | — | estimated | 213 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 8758 | 62/62 | — | estimated | 247 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 8626 | 62/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 8476 | 62/62 | — | estimated | 247 | yes | Matched a pass pattern. |
| gmod.perf.local-vs-global.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10258 | 62/56 | — | estimated | 224 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 19630 | 70/104 | — | estimated | 413 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11625 | 70/122 | — | estimated | 485 | yes | Matched a pass pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 19306 | 70/83 | — | estimated | 330 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 19089 | 70/118 | — | estimated | 471 | yes | Matched a partial-answer pattern. |
| gmod.perf.localplayer-cache.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 17924 | 70/106 | — | estimated | 424 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 17642 | 91/139 | — | estimated | 555 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 15916 | 91/135 | — | estimated | 540 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 11732 | 91/119 | — | estimated | 474 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 22781 | 91/130 | — | estimated | 517 | yes | Matched a partial-answer pattern. |
| gmod.perf.looking-at.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 20038 | 91/131 | — | estimated | 523 | yes | Matched a partial-answer pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11003 | 71/43 | — | estimated | 169 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10513 | 71/44 | — | estimated | 174 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9502 | 71/33 | — | estimated | 131 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10214 | 71/39 | — | estimated | 156 | yes | Matched a pass pattern. |
| gmod.perf.meta-vs-arg.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10654 | 71/45 | — | estimated | 180 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13726 | 63/48 | — | estimated | 192 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10431 | 63/57 | — | estimated | 226 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 14832 | 63/55 | — | estimated | 220 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11985 | 63/37 | — | estimated | 146 | yes | Matched a pass pattern. |
| gmod.perf.msg-vs-print.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12540 | 63/50 | — | estimated | 199 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 12611 | 73/69 | — | estimated | 276 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 13182 | 73/62 | — | estimated | 245 | yes | Did not match a fixture answer pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 14092 | 73/65 | — | estimated | 257 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 13376 | 73/60 | — | estimated | 238 | yes | Matched a pass pattern. |
| gmod.perf.pairs-ipairs-for.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 14247 | 73/66 | — | estimated | 261 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14307 | 76/157 | — | estimated | 627 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 10047 | 76/119 | — | estimated | 474 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 11358 | 76/88 | — | estimated | 350 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 13537 | 76/130 | — | estimated | 520 | yes | Matched a pass pattern. |
| gmod.perf.plain-lua-vs-fn.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 16666 | 76/162 | — | estimated | 645 | yes | Matched an incorrect-answer pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 18543 | 88/214 | — | estimated | 853 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 16474 | 88/226 | — | estimated | 904 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 18124 | 88/172 | — | estimated | 688 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 14847 | 88/186 | — | estimated | 744 | yes | Matched a pass pattern. |
| gmod.perf.player-cache-hooks.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 23143 | 88/200 | — | estimated | 797 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 14475 | 69/71 | — | estimated | 284 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 17387 | 69/71 | — | estimated | 283 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 16492 | 69/71 | — | estimated | 282 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 13925 | 69/65 | — | estimated | 259 | yes | Matched a pass pattern. |
| gmod.perf.ply-table-index.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 17802 | 69/69 | — | estimated | 276 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11154 | 79/101 | — | estimated | 402 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13928 | 79/109 | — | estimated | 436 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 12261 | 79/109 | — | estimated | 433 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10888 | 79/81 | — | estimated | 324 | yes | Matched a pass pattern. |
| gmod.perf.seq-tables.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12961 | 79/109 | — | estimated | 433 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 9230 | 71/56 | — | estimated | 221 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9829 | 71/54 | — | estimated | 216 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10504 | 71/49 | — | estimated | 193 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11076 | 71/45 | — | estimated | 178 | yes | Matched a pass pattern. |
| gmod.perf.setdrawcolor-split.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 9494 | 71/59 | — | estimated | 233 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 8964 | 100/76 | — | estimated | 301 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9849 | 100/81 | — | estimated | 321 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 8773 | 100/74 | — | estimated | 295 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11048 | 100/79 | — | estimated | 314 | yes | Matched a pass pattern. |
| gmod.perf.sqlite-vs-mysql.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 8868 | 100/71 | — | estimated | 283 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 10884 | 63/87 | — | estimated | 346 | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 15859 | 63/94 | — | estimated | 375 | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 23744 | 63/138 | — | estimated | 552 | yes | Matched a pass pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 13497 | 63/83 | — | estimated | 331 | yes | Matched a partial-answer pattern. |
| gmod.perf.steamid-cache.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 12224 | 63/90 | — | estimated | 360 | yes | Matched a partial-answer pattern. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 1 | protocol_error | 10418 | 70/84 | — | estimated | 333 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 2 | protocol_error | 9621 | 70/82 | — | estimated | 327 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 3 | protocol_error | 11760 | 70/72 | — | estimated | 288 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 4 | protocol_error | 9150 | 70/90 | — | estimated | 357 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.string-table-concat.v1 | agy | Gemini 3.1 Pro (High) | 5 | protocol_error | 9007 | 70/73 | — | estimated | 291 | yes | Answer must contain 0 through 0 candidate loops. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 17422 | 69/55 | — | estimated | 220 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 16691 | 69/61 | — | estimated | 244 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 10444 | 69/55 | — | estimated | 218 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 16491 | 69/70 | — | estimated | 279 | yes | Matched a pass pattern. |
| gmod.perf.surface-drawrect.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 14453 | 69/56 | — | estimated | 223 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11556 | 76/91 | — | estimated | 363 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11375 | 76/108 | — | estimated | 431 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 11290 | 76/82 | — | estimated | 325 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 15416 | 76/110 | — | estimated | 438 | yes | Matched a pass pattern. |
| gmod.perf.surface-text.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 11229 | 76/85 | — | estimated | 340 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11045 | 62/39 | — | estimated | 153 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 12887 | 62/45 | — | estimated | 179 | yes | Did not match a fixture answer pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9686 | 62/43 | — | estimated | 169 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10870 | 62/45 | — | estimated | 179 | yes | Matched a pass pattern. |
| gmod.perf.table-count-hash.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12557 | 62/68 | — | estimated | 271 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13981 | 73/48 | — | estimated | 191 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11876 | 73/47 | — | estimated | 185 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 13991 | 73/41 | — | estimated | 161 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 19853 | 73/48 | — | estimated | 191 | yes | Matched a pass pattern. |
| gmod.perf.table-empty.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 23535 | 73/51 | — | estimated | 203 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 11255 | 67/65 | — | estimated | 260 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 11657 | 67/75 | — | estimated | 299 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 12420 | 67/71 | — | estimated | 284 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 11989 | 67/69 | — | estimated | 275 | yes | Matched a pass pattern. |
| gmod.perf.table-hasvalue.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 13115 | 67/91 | — | estimated | 364 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13868 | 70/81 | — | estimated | 324 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 9074 | 70/63 | — | estimated | 250 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 9706 | 70/73 | — | estimated | 292 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 10934 | 70/73 | — | estimated | 292 | yes | Matched a pass pattern. |
| gmod.perf.table-literal.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 10050 | 70/64 | — | estimated | 253 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 10978 | 66/53 | — | estimated | 212 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 13120 | 66/64 | — | estimated | 256 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 16882 | 66/56 | — | estimated | 223 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 12864 | 66/55 | — | estimated | 220 | yes | Matched a pass pattern. |
| gmod.perf.table-random.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 12520 | 66/51 | — | estimated | 201 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 13882 | 58/59 | — | estimated | 235 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 12144 | 58/39 | — | estimated | 155 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 16173 | 58/59 | — | estimated | 236 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 16032 | 58/38 | — | estimated | 151 | yes | Matched a pass pattern. |
| gmod.perf.x-times-x.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 16053 | 58/52 | — | estimated | 205 | yes | Matched a pass pattern. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 15038 | 80/49 | — | estimated | 195 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 29293 | 80/60 | — | estimated | 237 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 23527 | 80/86 | — | estimated | 342 | yes | Uses player.Iterator() (wiki-recommended Lua-cached iterator). |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 23856 | 80/50 | — | estimated | 197 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.player-iterator.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 23849 | 80/55 | — | estimated | 220 | yes | Uses ipairs but still allocates via player.GetAll() each time. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 26384 | 84/142 | — | estimated | 567 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 16881 | 84/138 | — | estimated | 549 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 19021 | 84/120 | — | estimated | 478 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 26500 | 84/133 | — | estimated | 529 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.prediction-one-shot-effect.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 25752 | 84/134 | — | estimated | 536 | yes | Updates predicted state every pass and gates only the one-shot effect. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 28896 | 88/106 | — | estimated | 422 | yes | Does not show the required shared loading and server-authoritative action. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 43796 | 88/128 | — | estimated | 509 | yes | Loading is correct, but server authority or caller authorization is incomplete. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 39170 | 88/105 | — | estimated | 419 | yes | Does not show the required shared loading and server-authoritative action. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 46816 | 88/129 | — | estimated | 513 | yes | Loading is correct, but server authority or caller authorization is incomplete. |
| gmod.realm-shared-authority.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 41336 | 88/122 | — | estimated | 485 | yes | Does not show the required shared loading and server-authoritative action. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (High) | 1 | pass | 46831 | 126/443 | — | estimated | 1769 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (High) | 2 | pass | 41015 | 126/368 | — | estimated | 1470 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (High) | 3 | pass | 54593 | 126/553 | — | estimated | 2212 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 42490 | 126/513 | — | estimated | 2051 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spatial-maintained-set.v1 | agy | Gemini 3.1 Pro (High) | 5 | pass | 45141 | 126/397 | — | estimated | 1585 | yes | Seeds and maintains an addon set, then uses squared distance in Think. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 28471 | 106/237 | — | estimated | 945 | yes | Pre-spawn hook satisfies 7/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 41543 | 106/196 | — | estimated | 782 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 37984 | 106/241 | — | estimated | 961 | yes | Pre-spawn hook satisfies 6/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 36751 | 106/250 | — | estimated | 999 | yes | Pre-spawn hook satisfies 3/8 throttling checks. |
| gmod.spawn-preventive-rate-limit.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 41196 | 106/225 | — | estimated | 898 | yes | Pre-spawn hook satisfies 4/8 throttling checks. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 41323 | 82/140 | — | estimated | 559 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 106104 | 82/232 | — | estimated | 925 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 56873 | 82/149 | — | estimated | 595 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (High) | 4 | incorrect | 40508 | 82/146 | — | estimated | 582 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-batched-transaction.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 46355 | 82/159 | — | estimated | 635 | yes | Does not combine bounded writes, typed binding, and one transaction with the built-in sql library. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 32847 | 73/135 | — | estimated | 539 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 32777 | 73/97 | — | estimated | 387 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 36878 | 73/114 | — | estimated | 456 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 29852 | 73/123 | — | estimated | 489 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.sqlite-typed-write.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 27492 | 73/109 | — | estimated | 436 | yes | Safely escapes with sql.SQLStr but does not use the preferred sql.QueryTyped. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (High) | 1 | incorrect | 36546 | 75/45 | — | estimated | 179 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (High) | 2 | incorrect | 25446 | 75/42 | — | estimated | 167 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (High) | 3 | incorrect | 26214 | 75/46 | — | estimated | 184 | yes | Does not implement the one-shot delayed removal. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (High) | 4 | pass | 44068 | 75/62 | — | estimated | 247 | yes | Revalidates the captured entity inside the delayed callback. |
| gmod.timer-delayed-validity.v1 | agy | Gemini 3.1 Pro (High) | 5 | incorrect | 24678 | 75/51 | — | estimated | 201 | yes | Does not implement the one-shot delayed removal. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (High) | 1 | partial | 39880 | 123/207 | — | estimated | 827 | yes | Cleanup satisfies 8/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (High) | 2 | partial | 31471 | 123/210 | — | estimated | 840 | yes | Cleanup satisfies 7/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (High) | 3 | partial | 40923 | 123/230 | — | estimated | 917 | yes | Cleanup satisfies 8/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (High) | 4 | partial | 47778 | 123/210 | — | estimated | 840 | yes | Cleanup satisfies 8/11 disconnect and timeout requirements. |
| gmod.transfer-lifecycle-cleanup.v1 | agy | Gemini 3.1 Pro (High) | 5 | partial | 26681 | 123/205 | — | estimated | 819 | yes | Cleanup satisfies 8/11 disconnect and timeout requirements. |

## Files (audit pack)

Same run directory contains:

- `run.json` — full structured artifact (answers + per-attempt metrics; raw stdout stripped)
- `metadata.json` — run provenance + `usageTotals` (tokens, cost, timing)
- `leaderboard.json` / `leaderboard.csv` — fixture-normalized model ranking, diagnostics, tokens, and timing
- `attempts.jsonl` / `attempts.csv` — one row per attempt + tokens/timing/sizes
- `preds.jsonl` — SWE-style predictions with usage fields
- `responses/<adapter>/<model>/<fixture>--kN.txt` — graded answer files
- `raw/*.log` — redacted stdout/stderr when keepRaw is on (default)

Compare two models: `bun run bench compare --run <run.json> --model "A" --model "B"`