Run 59029ed6

Name: gmod-bench run 59029ed6-30eb-4d96-ad76-21deda2a06fa
Creator: gmod-bench
License: https://github.com/Iydah/gmod-bench/blob/main/LICENSE

Jul 11, 2026, 07:54

OpenRouter · 10 models · repeat ×1

59029ed6-30eb-4d96-ad76-21deda2a06fa

Fixtures

380

Attempts

Models

23m 31s

Duration

OpenRouter×1 repeat

Downloads

Audit pack

Results

10 models

#	Adapter	Model	Think	Pass %	Cover %	Score	Outcomes	Time
1	OpenRouter	hy3	None	83.8%	97.4%	86.8%	31/4/2/1	8.8s
#1 hy3 None OpenRouter Pass rate83.8% 31 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score86.8% 95% interval — · 1 run(s) pass@k83.8% 31/38 fixtures ever solved Outcome mix Pass31 Partial4 Wrong2 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed31 Fixtures solved31/38 Run facts Avg time 8.8s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label openrouter/tencent/hy3:free@none Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 31/38 passed in linked run perf-string-table-concatperf-angle-zeroperf-surface-textperf-ents-iteratorperf-find-ents-nearperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
2	OpenRouter	hy3	Low	85.7%	92.1%	82.9%	30/3/2/3	16.8s
#2 hy3 Low OpenRouter Pass rate85.7% 30 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score82.9% 95% interval — · 1 run(s) pass@k85.7% 30/38 fixtures ever solved Outcome mix Pass30 Partial3 Wrong2 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed30 Fixtures solved30/38 Run facts Avg time 16.8s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label openrouter/tencent/hy3:free@low Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 30/38 passed in linked run perf-string-table-concatperf-surface-drawrectperf-table-hasvalueperf-ply-table-indexplayer-iteratorperf-ents-iteratorperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x
3	OpenRouter	nemotron-3-ultra-550b-a55b	Medium	90.9%	86.8%	81.6%	30/2/1/5	12.3s
#3 nemotron-3-ultra-550b-a55b Medium OpenRouter Pass rate90.9% 30 pass · 33 scored Coverage86.8% 33 / 38 evidence-bearing Verified score81.6% 95% interval — · 1 run(s) pass@k90.9% 30/38 fixtures ever solved Outcome mix Pass30 Partial2 Wrong1 Invalid output5 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored33 Passed30 Fixtures solved30/38 Run facts Avg time 12.3s Repeat Single-shot Evidence share 33/38 (86.8%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@medium Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 30/38 passed in linked run perf-find-ents-nearperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-string-table-concatperf-angle-zeroperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
4	OpenRouter	hy3	High	82.9%	92.1%	80.3%	29/3/3/3	26.9s
#4 hy3 High OpenRouter Pass rate82.9% 29 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score80.3% 95% interval — · 1 run(s) pass@k82.9% 29/38 fixtures ever solved Outcome mix Pass29 Partial3 Wrong3 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed29 Fixtures solved29/38 Run facts Avg time 26.9s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label openrouter/tencent/hy3:free@high Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 29/38 passed in linked run perf-angle-zeroperf-string-table-concatperf-table-hasvalueperf-disttosqrperf-ply-table-indexplayer-iteratorperf-ents-iteratorperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x
5	OpenRouter	nemotron-3-ultra-550b-a55b	High	87.1%	81.6%	76.3%	27/4/0/7	10.9s
#5 nemotron-3-ultra-550b-a55b High OpenRouter Pass rate87.1% 27 pass · 31 scored Coverage81.6% 31 / 38 evidence-bearing Verified score76.3% 95% interval — · 1 run(s) pass@k87.1% 27/38 fixtures ever solved Outcome mix Pass27 Partial4 Wrong0 Invalid output7 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored31 Passed27 Fixtures solved27/38 Run facts Avg time 10.9s Repeat Single-shot Evidence share 31/38 (81.6%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-ultra-550b-a55b:free@high Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 27/38 passed in linked run perf-angle-zeroperf-find-ents-nearperf-for-vs-whileperf-plain-lua-vs-fnperf-seq-tablesperf-sqlite-vs-mysqlperf-string-table-concatperf-ents-iteratorperf-looking-atperf-ply-table-indexplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-setdrawcolor-splitperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
6	OpenRouter	nemotron-3-super-120b-a12b	Medium	85.7%	73.7%	68.4%	24/4/0/8	16.0s
#6 nemotron-3-super-120b-a12b Medium OpenRouter Pass rate85.7% 24 pass · 28 scored Coverage73.7% 28 / 38 evidence-bearing Verified score68.4% 95% interval — · 1 run(s) pass@k85.7% 24/38 fixtures ever solved Outcome mix Pass24 Partial4 Wrong0 Invalid output8 Harness2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored28 Passed24 Fixtures solved24/38 Run facts Avg time 16.0s Repeat Single-shot Evidence share 28/38 (73.7%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-super-120b-a12b:free@medium Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 24/38 passed in linked run perf-local-colorperf-local-vs-globalents-iteratorhook-addisvalidnet-receiversperf-find-ents-nearperf-for-vs-whileperf-msg-vs-printplayer-iteratorperf-angle-zeroperf-ents-iteratorperf-looking-atperf-table-emptyperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-localplayer-cacheperf-meta-vs-argperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
7	OpenRouter	laguna-xs-2.1	—	69.7%	86.8%	68.4%	23/6/4/5	13.8s
#7 laguna-xs-2.1 OpenRouter Pass rate69.7% 23 pass · 33 scored Coverage86.8% 33 / 38 evidence-bearing Verified score68.4% 95% interval — · 1 run(s) pass@k69.7% 23/38 fixtures ever solved Outcome mix Pass23 Partial6 Wrong4 Invalid output5 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored33 Passed23 Fixtures solved23/38 Run facts Avg time 13.8s Repeat Single-shot Evidence share 33/38 (86.8%) Verified runs 1 95% interval — Raw label openrouter/poolside/laguna-xs-2.1:free Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 23/38 passed in linked run perf-looking-atperf-seq-tablesperf-setdrawcolor-splitperf-string-table-concatperf-table-emptyperf-darkrpvarperf-disttosqrperf-meta-vs-argperf-msg-vs-printents-iteratorperf-angle-zeroperf-ents-iteratorperf-find-ents-nearperf-for-vs-whileplayer-iteratorhook-addisvalidnet-receiversperf-config-varperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
8	OpenRouter	north-mini-code	—	82.6%	60.5%	51.3%	19/1/3/15	12.5s
#8 north-mini-code OpenRouter Pass rate82.6% 19 pass · 23 scored Coverage60.5% 23 / 38 evidence-bearing Verified score51.3% 95% interval — · 1 run(s) pass@k82.6% 19/38 fixtures ever solved Outcome mix Pass19 Partial1 Wrong3 Invalid output15 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored23 Passed19 Fixtures solved19/38 Run facts Avg time 12.5s Repeat Single-shot Evidence share 23/38 (60.5%) Verified runs 1 95% interval — Raw label openrouter/cohere/north-mini-code:free Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 19/38 passed in linked run perf-angle-zeroperf-find-ents-nearperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-looking-atperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-sqlite-vs-mysqlperf-string-table-concatperf-surface-textperf-table-emptyperf-x-times-xperf-darkrpvarperf-meta-vs-argplayer-iteratorperf-ents-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-localplayer-cacheperf-msg-vs-printperf-player-cache-hooksperf-setdrawcolor-splitperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-random
9	OpenRouter	nemotron-3-nano-30b-a3b	—	69.6%	60.5%	47.4%	16/4/3/15	11.7s
#9 nemotron-3-nano-30b-a3b OpenRouter Pass rate69.6% 16 pass · 23 scored Coverage60.5% 23 / 38 evidence-bearing Verified score47.4% 95% interval — · 1 run(s) pass@k69.6% 16/38 fixtures ever solved Outcome mix Pass16 Partial4 Wrong3 Invalid output15 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored23 Passed16 Fixtures solved16/38 Run facts Avg time 11.7s Repeat Single-shot Evidence share 23/38 (60.5%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-nano-30b-a3b:free Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 16/38 passed in linked run isvalidperf-angle-zeroperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-steamid-cacheperf-string-table-concatperf-surface-textperf-table-emptyperf-darkrpvarperf-meta-vs-argperf-sqlite-vs-mysqlperf-find-players-nearperf-hook-onceperf-looking-atplayer-iteratorents-iteratorhook-addnet-receiversperf-config-varperf-for-vs-whileperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-setdrawcolor-splitperf-surface-drawrectperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
10	OpenRouter	nemotron-3-super-120b-a12b	Low	75.0%	10.5%	7.9%	3/0/1/34	1.4s
#10 nemotron-3-super-120b-a12b Low OpenRouter Pass rate75.0% 3 pass · 4 scored Coverage10.5% 4 / 38 evidence-bearing Verified score7.9% 95% interval — · 1 run(s) pass@k75.0% 3/38 fixtures ever solved Outcome mix Pass3 Partial0 Wrong1 Invalid output34 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored4 Passed3 Fixtures solved3/38 Run facts Avg time 1.4s Repeat Single-shot Evidence share 4/38 (10.5%) Verified runs 1 95% interval — Raw label openrouter/nvidia/nemotron-3-super-120b-a12b:free@low Run id 59029ed6-30eb-4d96-ad76-21deda2a06fa Latest run fixtures 3/38 passed in linked run hook-addisvalidperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorperf-angle-zeroents-iteratornet-receiversperf-config-var

Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.

Fixtures

gmod.ents-iterator.v1
gmod.hook-add.v1
gmod.isvalid.v1
gmod.net-receivers.v1
gmod.perf.angle-zero.v1
gmod.perf.config-var.v1
gmod.perf.darkrpvar.v1
gmod.perf.disttosqr.v1
gmod.perf.ents-iterator.v1
gmod.perf.find-ents-near.v1
gmod.perf.find-players-near.v1
gmod.perf.for-vs-while.v1
gmod.perf.hook-once.v1
gmod.perf.hudpaint-cache.v1
gmod.perf.local-color.v1
gmod.perf.local-vs-global.v1
gmod.perf.localplayer-cache.v1
gmod.perf.looking-at.v1
gmod.perf.meta-vs-arg.v1
gmod.perf.msg-vs-print.v1
gmod.perf.pairs-ipairs-for.v1
gmod.perf.plain-lua-vs-fn.v1
gmod.perf.player-cache-hooks.v1
gmod.perf.ply-table-index.v1
gmod.perf.seq-tables.v1
gmod.perf.setdrawcolor-split.v1
gmod.perf.sqlite-vs-mysql.v1
gmod.perf.steamid-cache.v1
gmod.perf.string-table-concat.v1
gmod.perf.surface-drawrect.v1
gmod.perf.surface-text.v1
gmod.perf.table-count-hash.v1
gmod.perf.table-empty.v1
gmod.perf.table-hasvalue.v1
gmod.perf.table-literal.v1
gmod.perf.table-random.v1
gmod.perf.x-times-x.v1
gmod.player-iterator.v1

Downloads

Results

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Fixtures