Run 6d5384a1
Jul 10, 2026, 17:29
Codex · 8 models · repeat ×1
6d5384a1-ae22-496a-83dd-92c789967f27
Downloads
Audit pack
Results
8 models
| # | Adapter | Model | Think | Pass % | Cover % | Score | Outcomes | Time |
|---|---|---|---|---|---|---|---|---|
| 1 | Codex | gpt-5.4 | Low | 86.5% | 97.4% | — | 32/3/2/1 | 6.1s |
#1 gpt-5.4LowPass rate86.5% 32 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k86.5% 32/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures32/38 passed in linked runperf-string-table-concatperf-angle-zeroperf-table-hasvalueperf-find-ents-nearperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 2 | Codex | gpt-5.4 | Medium | 88.9% | 94.7% | — | 32/2/2/2 | 9.3s |
#2 gpt-5.4MediumPass rate88.9% 32 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k88.9% 32/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures32/38 passed in linked runperf-find-ents-nearperf-string-table-concatperf-angle-zeroperf-ply-table-indexperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 3 | Codex | gpt-5.4-mini | High | 86.1% | 94.7% | — | 31/3/2/2 | 14.9s |
#3 gpt-5.4-miniHighPass rate86.1% 31 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k86.1% 31/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures31/38 passed in linked runperf-find-ents-nearperf-string-table-concatperf-angle-zeroperf-table-randomperf-localplayer-cacheperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-x-times-x | ||||||||
| 4 | Codex | gpt-5.4-mini | Extra High | 86.1% | 94.7% | — | 31/3/2/2 | 26.7s |
#4 gpt-5.4-miniExtra HighPass rate86.1% 31 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k86.1% 31/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures31/38 passed in linked runperf-string-table-concatperf-table-hasvalueperf-pairs-ipairs-forperf-table-randomperf-angle-zeroperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-x-times-x | ||||||||
| 5 | Codex | gpt-5.4 | Extra High | 83.3% | 94.7% | — | 30/3/3/2 | 21.4s |
#5 gpt-5.4Extra HighPass rate83.3% 30 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k83.3% 30/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures30/38 passed in linked runperf-find-ents-nearperf-string-table-concatperf-config-varperf-ply-table-indexperf-table-randomperf-angle-zeroperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-x-times-xplayer-iterator | ||||||||
| 6 | Codex | gpt-5.4-mini | Medium | 94.3% | 92.1% | — | 33/2/0/3 | 12.1s |
#6 gpt-5.4-miniMediumPass rate94.3% 33 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k94.3% 33/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures33/38 passed in linked runperf-angle-zeroperf-find-ents-nearperf-string-table-concatperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 7 | Codex | gpt-5.4 | High | 88.6% | 92.1% | — | 31/2/2/3 | 11.2s |
#7 gpt-5.4HighPass rate88.6% 31 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k88.6% 31/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures31/38 passed in linked runperf-ents-iteratorperf-find-ents-nearperf-string-table-concatperf-angle-zeroperf-ply-table-indexperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 8 | Codex | gpt-5.4-mini | Low | 91.2% | 89.5% | — | 31/1/2/4 | 6.1s |
#8 gpt-5.4-miniLowPass rate91.2% 31 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k91.2% 31/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures31/38 passed in linked runperf-find-ents-nearperf-seq-tablesperf-steamid-cacheperf-string-table-concatperf-angle-zeroplayer-iteratorperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.
Fixtures
38
gmod.ents-iterator.v1gmod.hook-add.v1gmod.isvalid.v1gmod.net-receivers.v1gmod.perf.angle-zero.v1gmod.perf.config-var.v1gmod.perf.darkrpvar.v1gmod.perf.disttosqr.v1gmod.perf.ents-iterator.v1gmod.perf.find-ents-near.v1gmod.perf.find-players-near.v1gmod.perf.for-vs-while.v1gmod.perf.hook-once.v1gmod.perf.hudpaint-cache.v1gmod.perf.local-color.v1gmod.perf.local-vs-global.v1gmod.perf.localplayer-cache.v1gmod.perf.looking-at.v1gmod.perf.meta-vs-arg.v1gmod.perf.msg-vs-print.v1gmod.perf.pairs-ipairs-for.v1gmod.perf.plain-lua-vs-fn.v1gmod.perf.player-cache-hooks.v1gmod.perf.ply-table-index.v1gmod.perf.seq-tables.v1gmod.perf.setdrawcolor-split.v1gmod.perf.sqlite-vs-mysql.v1gmod.perf.steamid-cache.v1gmod.perf.string-table-concat.v1gmod.perf.surface-drawrect.v1gmod.perf.surface-text.v1gmod.perf.table-count-hash.v1gmod.perf.table-empty.v1gmod.perf.table-hasvalue.v1gmod.perf.table-literal.v1gmod.perf.table-random.v1gmod.perf.x-times-x.v1gmod.player-iterator.v1