Run c99506be

Name: gmod-bench run c99506be-e7cc-4900-90b0-2a059597aa89
Creator: gmod-bench
License: https://github.com/Iydah/gmod-bench/blob/main/LICENSE

Jul 10, 2026, 16:21

AntiGravity · 8 models · repeat ×1

c99506be-e7cc-4900-90b0-2a059597aa89

Fixtures

304

Attempts

Models

39m 34s

Duration

AntiGravity×1 repeat

Downloads

Audit pack

Results

8 models

#	Adapter	Model	Think	Pass %	Cover %	Score	Outcomes	Time
1	AntiGravity	Gemini 3.5 Flash	High	86.5%	97.4%	88.2%	32/3/2/1	6.9s
#1 Gemini 3.5 Flash High AntiGravity Pass rate86.5% 32 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score88.2% 95% interval — · 1 run(s) pass@k86.5% 32/38 fixtures ever solved Outcome mix Pass32 Partial3 Wrong2 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed32 Fixtures solved32/38 Run facts Avg time 6.9s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label agy/Gemini 3.5 Flash (High) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 32/38 passed in linked run perf-string-table-concatperf-config-varperf-seq-tablesperf-localplayer-cacheperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
2	AntiGravity	Gemini 3.1 Pro	Low	88.6%	92.1%	86.8%	31/4/0/3	11.1s
#2 Gemini 3.1 Pro Low AntiGravity Pass rate88.6% 31 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score86.8% 95% interval — · 1 run(s) pass@k88.6% 31/38 fixtures ever solved Outcome mix Pass31 Partial4 Wrong0 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed31 Fixtures solved31/38 Run facts Avg time 11.1s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label agy/Gemini 3.1 Pro (Low) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 31/38 passed in linked run ents-iteratorperf-find-ents-nearperf-string-table-concatperf-localplayer-cacheperf-looking-atperf-steamid-cacheplayer-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
3	AntiGravity	Gemini 3.5 Flash	Low	78.4%	97.4%	82.9%	29/5/3/1	6.4s
#3 Gemini 3.5 Flash Low AntiGravity Pass rate78.4% 29 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score82.9% 95% interval — · 1 run(s) pass@k78.4% 29/38 fixtures ever solved Outcome mix Pass29 Partial5 Wrong3 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed29 Fixtures solved29/38 Run facts Avg time 6.4s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label agy/Gemini 3.5 Flash (Low) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 29/38 passed in linked run perf-string-table-concatperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-table-hasvalueperf-angle-zeroperf-find-ents-nearperf-localplayer-cacheperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
4	AntiGravity	Gemini 3.5 Flash	Medium	78.4%	97.4%	82.9%	29/5/3/1	5.9s
#4 Gemini 3.5 Flash Medium AntiGravity Pass rate78.4% 29 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score82.9% 95% interval — · 1 run(s) pass@k78.4% 29/38 fixtures ever solved Outcome mix Pass29 Partial5 Wrong3 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed29 Fixtures solved29/38 Run facts Avg time 5.9s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label agy/Gemini 3.5 Flash (Medium) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 29/38 passed in linked run perf-string-table-concatperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-seq-tablesperf-angle-zeroperf-find-ents-nearperf-localplayer-cacheperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
5	AntiGravity	Gemini 3.1 Pro	High	81.5%	71.1%	61.8%	22/3/2/11	11.5s
#5 Gemini 3.1 Pro High AntiGravity Pass rate81.5% 22 pass · 27 scored Coverage71.1% 27 / 38 evidence-bearing Verified score61.8% 95% interval — · 1 run(s) pass@k81.5% 22/38 fixtures ever solved Outcome mix Pass22 Partial3 Wrong2 Invalid output11 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored27 Passed22 Fixtures solved22/38 Run facts Avg time 11.5s Repeat Single-shot Evidence share 27/38 (71.1%) Verified runs 1 95% interval — Raw label agy/Gemini 3.1 Pro (High) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 22/38 passed in linked run perf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorperf-darkrpvarperf-seq-tablesperf-find-ents-nearperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysql
6	AntiGravity	Claude Opus 4.6	Thinking	0.0%	0.0%	0.0%	0/0/0/38	6.8s
#6 Claude Opus 4.6 Thinking AntiGravity Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output38 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored0 Passed0 Fixtures solved0/38 Run facts Avg time 6.8s Repeat Single-shot Evidence share 0/38 (0.0%) Verified runs 1 95% interval — Raw label agy/Claude Opus 4.6 (Thinking) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 0/38 passed in linked run ents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
7	AntiGravity	Claude Sonnet 4.6	Thinking	0.0%	0.0%	0.0%	0/0/0/38	6.7s
#7 Claude Sonnet 4.6 Thinking AntiGravity Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output38 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored0 Passed0 Fixtures solved0/38 Run facts Avg time 6.7s Repeat Single-shot Evidence share 0/38 (0.0%) Verified runs 1 95% interval — Raw label agy/Claude Sonnet 4.6 (Thinking) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 0/38 passed in linked run ents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
8	AntiGravity	GPT-OSS 120B	Medium	0.0%	0.0%	0.0%	0/0/0/38	7.2s
#8 GPT-OSS 120B Medium AntiGravity Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output38 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored0 Passed0 Fixtures solved0/38 Run facts Avg time 7.2s Repeat Single-shot Evidence share 0/38 (0.0%) Verified runs 1 95% interval — Raw label agy/GPT-OSS 120B (Medium) Run id c99506be-e7cc-4900-90b0-2a059597aa89 Latest run fixtures 0/38 passed in linked run ents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator

Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.

Fixtures

gmod.ents-iterator.v1
gmod.hook-add.v1
gmod.isvalid.v1
gmod.net-receivers.v1
gmod.perf.angle-zero.v1
gmod.perf.config-var.v1
gmod.perf.darkrpvar.v1
gmod.perf.disttosqr.v1
gmod.perf.ents-iterator.v1
gmod.perf.find-ents-near.v1
gmod.perf.find-players-near.v1
gmod.perf.for-vs-while.v1
gmod.perf.hook-once.v1
gmod.perf.hudpaint-cache.v1
gmod.perf.local-color.v1
gmod.perf.local-vs-global.v1
gmod.perf.localplayer-cache.v1
gmod.perf.looking-at.v1
gmod.perf.meta-vs-arg.v1
gmod.perf.msg-vs-print.v1
gmod.perf.pairs-ipairs-for.v1
gmod.perf.plain-lua-vs-fn.v1
gmod.perf.player-cache-hooks.v1
gmod.perf.ply-table-index.v1
gmod.perf.seq-tables.v1
gmod.perf.setdrawcolor-split.v1
gmod.perf.sqlite-vs-mysql.v1
gmod.perf.steamid-cache.v1
gmod.perf.string-table-concat.v1
gmod.perf.surface-drawrect.v1
gmod.perf.surface-text.v1
gmod.perf.table-count-hash.v1
gmod.perf.table-empty.v1
gmod.perf.table-hasvalue.v1
gmod.perf.table-literal.v1
gmod.perf.table-random.v1
gmod.perf.x-times-x.v1
gmod.player-iterator.v1

Downloads

Results

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Fixtures