Run 4524afb8

Name: gmod-bench run 4524afb8-11f9-4d79-b50f-a599f7b0109c
Creator: gmod-bench
License: https://github.com/Iydah/gmod-bench/blob/main/LICENSE

Jul 10, 2026, 15:49

AntiGravity · 8 models · repeat ×1

4524afb8-11f9-4d79-b50f-a599f7b0109c

Fixtures

304

Attempts

Models

4m 58s

Duration

AntiGravity×1 repeat

Downloads

Audit pack

Results

8 models

#	Adapter	Model	Think	Pass %	Cover %	Score	Outcomes	Time
1	AntiGravity	Gemini 3.1 Pro	Low	91.7%	94.7%	90.8%	33/3/0/2	11.5s
#1 Gemini 3.1 Pro Low AntiGravity Pass rate91.7% 33 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score90.8% 95% interval — · 1 run(s) pass@k91.7% 33/38 fixtures ever solved Outcome mix Pass33 Partial3 Wrong0 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed33 Fixtures solved33/38 Run facts Avg time 11.5s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label agy/Gemini 3.1 Pro (Low) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 33/38 passed in linked run perf-find-ents-nearperf-string-table-concatperf-looking-atperf-steamid-cacheplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
2	AntiGravity	Gemini 3.5 Flash	High	86.5%	97.4%	89.5%	32/4/1/1	7.0s
#2 Gemini 3.5 Flash High AntiGravity Pass rate86.5% 32 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score89.5% 95% interval — · 1 run(s) pass@k86.5% 32/38 fixtures ever solved Outcome mix Pass32 Partial4 Wrong1 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed32 Fixtures solved32/38 Run facts Avg time 7.0s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label agy/Gemini 3.5 Flash (High) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 32/38 passed in linked run perf-string-table-concatperf-hudpaint-cacheperf-find-ents-nearperf-localplayer-cacheperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
3	AntiGravity	Gemini 3.1 Pro	High	88.9%	94.7%	88.2%	32/3/1/2	12.8s
#3 Gemini 3.1 Pro High AntiGravity Pass rate88.9% 32 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score88.2% 95% interval — · 1 run(s) pass@k88.9% 32/38 fixtures ever solved Outcome mix Pass32 Partial3 Wrong1 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed32 Fixtures solved32/38 Run facts Avg time 12.8s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label agy/Gemini 3.1 Pro (High) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 32/38 passed in linked run perf-find-ents-nearperf-string-table-concatperf-localplayer-cacheperf-looking-atperf-steamid-cacheplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
4	AntiGravity	Gemini 3.5 Flash	Medium	81.1%	97.4%	84.2%	30/4/3/1	6.3s
#4 Gemini 3.5 Flash Medium AntiGravity Pass rate81.1% 30 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score84.2% 95% interval — · 1 run(s) pass@k81.1% 30/38 fixtures ever solved Outcome mix Pass30 Partial4 Wrong3 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed30 Fixtures solved30/38 Run facts Avg time 6.3s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label agy/Gemini 3.5 Flash (Medium) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 30/38 passed in linked run perf-string-table-concatperf-angle-zeroperf-hudpaint-cacheperf-seq-tablesperf-find-ents-nearperf-localplayer-cacheperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
5	AntiGravity	Gemini 3.5 Flash	Low	78.4%	97.4%	82.9%	29/5/3/1	4.7s
#5 Gemini 3.5 Flash Low AntiGravity Pass rate78.4% 29 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score82.9% 95% interval — · 1 run(s) pass@k78.4% 29/38 fixtures ever solved Outcome mix Pass29 Partial5 Wrong3 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed29 Fixtures solved29/38 Run facts Avg time 4.7s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label agy/Gemini 3.5 Flash (Low) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 29/38 passed in linked run perf-string-table-concatperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-table-hasvalueperf-angle-zeroperf-find-ents-nearperf-localplayer-cacheperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
6	AntiGravity	Claude Sonnet 4.6	Thinking	82.4%	89.5%	76.3%	28/2/4/4	10.1s
#6 Claude Sonnet 4.6 Thinking AntiGravity Pass rate82.4% 28 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score76.3% 95% interval — · 1 run(s) pass@k82.4% 28/38 fixtures ever solved Outcome mix Pass28 Partial2 Wrong4 Invalid output4 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored34 Passed28 Fixtures solved28/38 Run facts Avg time 10.1s Repeat Single-shot Evidence share 34/38 (89.5%) Verified runs 1 95% interval — Raw label agy/Claude Sonnet 4.6 (Thinking) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 28/38 passed in linked run perf-find-ents-nearperf-hook-onceperf-seq-tablesperf-string-table-concatperf-plain-lua-vs-fnperf-ply-table-indexperf-surface-textperf-table-hasvalueperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x
7	AntiGravity	Claude Opus 4.6	Thinking	82.4%	44.7%	39.5%	14/2/1/21	7.7s
#7 Claude Opus 4.6 Thinking AntiGravity Pass rate82.4% 14 pass · 17 scored Coverage44.7% 17 / 38 evidence-bearing Verified score39.5% 95% interval — · 1 run(s) pass@k82.4% 14/38 fixtures ever solved Outcome mix Pass14 Partial2 Wrong1 Invalid output21 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored17 Passed14 Fixtures solved14/38 Run facts Avg time 7.7s Repeat Single-shot Evidence share 17/38 (44.7%) Verified runs 1 95% interval — Raw label agy/Claude Opus 4.6 (Thinking) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 14/38 passed in linked run perf-find-ents-nearperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorperf-config-varperf-angle-zeroperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cache
8	AntiGravity	GPT-OSS 120B	Medium	0.0%	0.0%	0.0%	0/0/0/38	6.6s
#8 GPT-OSS 120B Medium AntiGravity Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix Pass0 Partial0 Wrong0 Invalid output38 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored0 Passed0 Fixtures solved0/38 Run facts Avg time 6.6s Repeat Single-shot Evidence share 0/38 (0.0%) Verified runs 1 95% interval — Raw label agy/GPT-OSS 120B (Medium) Run id 4524afb8-11f9-4d79-b50f-a599f7b0109c Latest run fixtures 0/38 passed in linked run ents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator

Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.

Fixtures

gmod.ents-iterator.v1
gmod.hook-add.v1
gmod.isvalid.v1
gmod.net-receivers.v1
gmod.perf.angle-zero.v1
gmod.perf.config-var.v1
gmod.perf.darkrpvar.v1
gmod.perf.disttosqr.v1
gmod.perf.ents-iterator.v1
gmod.perf.find-ents-near.v1
gmod.perf.find-players-near.v1
gmod.perf.for-vs-while.v1
gmod.perf.hook-once.v1
gmod.perf.hudpaint-cache.v1
gmod.perf.local-color.v1
gmod.perf.local-vs-global.v1
gmod.perf.localplayer-cache.v1
gmod.perf.looking-at.v1
gmod.perf.meta-vs-arg.v1
gmod.perf.msg-vs-print.v1
gmod.perf.pairs-ipairs-for.v1
gmod.perf.plain-lua-vs-fn.v1
gmod.perf.player-cache-hooks.v1
gmod.perf.ply-table-index.v1
gmod.perf.seq-tables.v1
gmod.perf.setdrawcolor-split.v1
gmod.perf.sqlite-vs-mysql.v1
gmod.perf.steamid-cache.v1
gmod.perf.string-table-concat.v1
gmod.perf.surface-drawrect.v1
gmod.perf.surface-text.v1
gmod.perf.table-count-hash.v1
gmod.perf.table-empty.v1
gmod.perf.table-hasvalue.v1
gmod.perf.table-literal.v1
gmod.perf.table-random.v1
gmod.perf.x-times-x.v1
gmod.player-iterator.v1

Downloads

Results

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Fixtures