Run d59ee9c0

Name: gmod-bench run d59ee9c0-dbbb-4508-aad0-897bdc9849c2
Creator: gmod-bench
License: https://github.com/Iydah/gmod-bench/blob/main/LICENSE

Jul 11, 2026, 07:40

OpenCode · 17 models · repeat ×1

d59ee9c0-dbbb-4508-aad0-897bdc9849c2

Fixtures

646

Attempts

Models

10m 13s

Duration

OpenCode×1 repeat

Downloads

Audit pack

Results

17 models

#	Adapter	Model	Think	Pass %	Cover %	Score	Outcomes	Time
1	OpenCode	hy3-free	High	94.3%	92.1%	89.5%	33/2/0/3	14.2s
#1 hy3-free High OpenCode Pass rate94.3% 33 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score89.5% 95% interval — · 1 run(s) pass@k94.3% 33/38 fixtures ever solved Outcome mix Pass33 Partial2 Wrong0 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed33 Fixtures solved33/38 Run facts Avg time 14.2s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/hy3-free@high Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 33/38 passed in linked run perf-find-ents-nearperf-string-table-concatperf-table-hasvalueperf-angle-zeroperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
2	OpenCode	deepseek-v4-flash-free	Max	83.8%	97.4%	88.2%	31/5/1/1	15.1s
#2 deepseek-v4-flash-free Max OpenCode Pass rate83.8% 31 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score88.2% 95% interval — · 1 run(s) pass@k83.8% 31/38 fixtures ever solved Outcome mix Pass31 Partial5 Wrong1 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed31 Fixtures solved31/38 Run facts Avg time 15.1s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label opencode/deepseek-v4-flash-free@max Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 31/38 passed in linked run perf-string-table-concatperf-ply-table-indexperf-angle-zeroperf-find-ents-nearperf-looking-atperf-steamid-cacheplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
3	OpenCode	hy3-free	Medium	94.1%	89.5%	85.5%	32/1/1/4	16.7s
#3 hy3-free Medium OpenCode Pass rate94.1% 32 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score85.5% 95% interval — · 1 run(s) pass@k94.1% 32/38 fixtures ever solved Outcome mix Pass32 Partial1 Wrong1 Invalid output4 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored34 Passed32 Fixtures solved32/38 Run facts Avg time 16.7s Repeat Single-shot Evidence share 34/38 (89.5%) Verified runs 1 95% interval — Raw label opencode/hy3-free@medium Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 32/38 passed in linked run perf-find-ents-nearperf-ply-table-indexperf-seq-tablesperf-string-table-concatperf-find-players-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
4	OpenCode	deepseek-v4-flash-free	High	88.6%	92.1%	85.5%	31/3/1/3	13.5s
#4 deepseek-v4-flash-free High OpenCode Pass rate88.6% 31 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score85.5% 95% interval — · 1 run(s) pass@k88.6% 31/38 fixtures ever solved Outcome mix Pass31 Partial3 Wrong1 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed31 Fixtures solved31/38 Run facts Avg time 13.5s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/deepseek-v4-flash-free@high Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 31/38 passed in linked run perf-seq-tablesperf-string-table-concatperf-table-count-hashperf-angle-zeroperf-find-ents-nearperf-looking-atperf-steamid-cacheents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
5	OpenCode	deepseek-v4-flash-free	Medium	88.6%	92.1%	85.5%	31/3/1/3	12.8s
#5 deepseek-v4-flash-free Medium OpenCode Pass rate88.6% 31 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score85.5% 95% interval — · 1 run(s) pass@k88.6% 31/38 fixtures ever solved Outcome mix Pass31 Partial3 Wrong1 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed31 Fixtures solved31/38 Run facts Avg time 12.8s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/deepseek-v4-flash-free@medium Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 31/38 passed in linked run perf-hook-onceperf-seq-tablesperf-string-table-concatperf-angle-zeroperf-find-ents-nearperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
6	OpenCode	nemotron-3-ultra-free	High	86.1%	94.7%	84.2%	31/2/3/2	14.6s
#6 nemotron-3-ultra-free High OpenCode Pass rate86.1% 31 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score84.2% 95% interval — · 1 run(s) pass@k86.1% 31/38 fixtures ever solved Outcome mix Pass31 Partial2 Wrong3 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed31 Fixtures solved31/38 Run facts Avg time 14.6s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label opencode/nemotron-3-ultra-free@high Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 31/38 passed in linked run perf-seq-tablesperf-string-table-concatperf-angle-zeroperf-player-cache-hooksperf-table-hasvalueperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
7	OpenCode	mimo-v2.5-free	Low	85.7%	92.1%	82.9%	30/3/2/3	15.7s
#7 mimo-v2.5-free Low OpenCode Pass rate85.7% 30 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score82.9% 95% interval — · 1 run(s) pass@k85.7% 30/38 fixtures ever solved Outcome mix Pass30 Partial3 Wrong2 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed30 Fixtures solved30/38 Run facts Avg time 15.7s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/mimo-v2.5-free@low Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 30/38 passed in linked run perf-hook-onceperf-sqlite-vs-mysqlperf-string-table-concatperf-angle-zeroperf-darkrpvarperf-find-ents-nearperf-for-vs-whileperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
8	OpenCode	nemotron-3-ultra-free	Low	88.2%	89.5%	82.9%	30/3/1/4	16.1s
#8 nemotron-3-ultra-free Low OpenCode Pass rate88.2% 30 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score82.9% 95% interval — · 1 run(s) pass@k88.2% 30/38 fixtures ever solved Outcome mix Pass30 Partial3 Wrong1 Invalid output4 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored34 Passed30 Fixtures solved30/38 Run facts Avg time 16.1s Repeat Single-shot Evidence share 34/38 (89.5%) Verified runs 1 95% interval — Raw label opencode/nemotron-3-ultra-free@low Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 30/38 passed in linked run perf-find-ents-nearperf-for-vs-whileperf-seq-tablesperf-string-table-concatperf-angle-zeroperf-looking-atperf-table-emptyplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
9	OpenCode	hy3-free	Low	85.7%	92.1%	81.6%	30/2/3/3	14.8s
#9 hy3-free Low OpenCode Pass rate85.7% 30 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score81.6% 95% interval — · 1 run(s) pass@k85.7% 30/38 fixtures ever solved Outcome mix Pass30 Partial2 Wrong3 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed30 Fixtures solved30/38 Run facts Avg time 14.8s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/hy3-free@low Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 30/38 passed in linked run perf-find-ents-nearperf-string-table-concatperf-table-hasvalueperf-angle-zeroperf-ply-table-indexperf-sqlite-vs-mysqlperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x
10	OpenCode	deepseek-v4-flash-free	Low	82.9%	92.1%	81.6%	29/4/2/3	15.1s
#10 deepseek-v4-flash-free Low OpenCode Pass rate82.9% 29 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score81.6% 95% interval — · 1 run(s) pass@k82.9% 29/38 fixtures ever solved Outcome mix Pass29 Partial4 Wrong2 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed29 Fixtures solved29/38 Run facts Avg time 15.1s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/deepseek-v4-flash-free@low Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 29/38 passed in linked run perf-for-vs-whileperf-seq-tablesperf-string-table-concatperf-msg-vs-printperf-ply-table-indexperf-angle-zeroperf-find-ents-nearperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
11	OpenCode	nemotron-3-ultra-free	Medium	80.0%	92.1%	81.6%	28/6/1/3	17.2s
#11 nemotron-3-ultra-free Medium OpenCode Pass rate80.0% 28 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score81.6% 95% interval — · 1 run(s) pass@k80.0% 28/38 fixtures ever solved Outcome mix Pass28 Partial6 Wrong1 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed28 Fixtures solved28/38 Run facts Avg time 17.2s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/nemotron-3-ultra-free@medium Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 28/38 passed in linked run perf-pairs-ipairs-forperf-seq-tablesperf-string-table-concatperf-ply-table-indexperf-angle-zeroperf-ents-iteratorperf-find-ents-nearperf-looking-atperf-table-emptyplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
12	OpenCode	mimo-v2.5-free	High	93.3%	78.9%	75.0%	28/1/1/8	16.0s
#12 mimo-v2.5-free High OpenCode Pass rate93.3% 28 pass · 30 scored Coverage78.9% 30 / 38 evidence-bearing Verified score75.0% 95% interval — · 1 run(s) pass@k93.3% 28/38 fixtures ever solved Outcome mix Pass28 Partial1 Wrong1 Invalid output8 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored30 Passed28 Fixtures solved28/38 Run facts Avg time 16.0s Repeat Single-shot Evidence share 30/38 (78.9%) Verified runs 1 95% interval — Raw label opencode/mimo-v2.5-free@high Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 28/38 passed in linked run perf-config-varperf-ents-iteratorperf-find-ents-nearperf-hook-onceperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-seq-tablesperf-string-table-concatperf-angle-zeroperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
13	OpenCode	big-pickle	—	80.6%	81.6%	72.4%	25/5/1/7	17.8s
#13 big-pickle OpenCode Pass rate80.6% 25 pass · 31 scored Coverage81.6% 31 / 38 evidence-bearing Verified score72.4% 95% interval — · 1 run(s) pass@k80.6% 25/38 fixtures ever solved Outcome mix Pass25 Partial5 Wrong1 Invalid output7 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored31 Passed25 Fixtures solved25/38 Run facts Avg time 17.8s Repeat Single-shot Evidence share 31/38 (81.6%) Verified runs 1 95% interval — Raw label opencode/big-pickle Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 25/38 passed in linked run hook-addperf-darkrpvarperf-seq-tablesperf-sqlite-vs-mysqlperf-string-table-concatperf-table-hasvalueperf-table-literalperf-player-cache-hooksperf-angle-zeroperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-looking-atents-iteratorisvalidnet-receiversperf-config-varperf-disttosqrperf-ents-iteratorperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-setdrawcolor-splitperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-randomperf-x-times-xplayer-iterator
14	OpenCode	mimo-v2.5-free	Medium	75.0%	84.2%	67.1%	24/3/5/6	17.2s
#14 mimo-v2.5-free Medium OpenCode Pass rate75.0% 24 pass · 32 scored Coverage84.2% 32 / 38 evidence-bearing Verified score67.1% 95% interval — · 1 run(s) pass@k75.0% 24/38 fixtures ever solved Outcome mix Pass24 Partial3 Wrong5 Invalid output6 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored32 Passed24 Fixtures solved24/38 Run facts Avg time 17.2s Repeat Single-shot Evidence share 32/38 (84.2%) Verified runs 1 95% interval — Raw label opencode/mimo-v2.5-free@medium Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 24/38 passed in linked run perf-for-vs-whileperf-msg-vs-printperf-seq-tablesperf-string-table-concatperf-table-hasvalueplayer-iteratorents-iteratorperf-darkrpvarperf-find-players-nearperf-meta-vs-argperf-ply-table-indexperf-angle-zeroperf-find-ents-nearperf-looking-athook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-ents-iteratorperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x
15	OpenCode	north-mini-code-free	High	79.3%	76.3%	64.5%	23/3/3/9	13.6s
#15 north-mini-code-free High OpenCode Pass rate79.3% 23 pass · 29 scored Coverage76.3% 29 / 38 evidence-bearing Verified score64.5% 95% interval — · 1 run(s) pass@k79.3% 23/38 fixtures ever solved Outcome mix Pass23 Partial3 Wrong3 Invalid output9 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored29 Passed23 Fixtures solved23/38 Run facts Avg time 13.6s Repeat Single-shot Evidence share 29/38 (76.3%) Verified runs 1 95% interval — Raw label opencode/north-mini-code-free@high Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 23/38 passed in linked run perf-angle-zeroperf-ents-iteratorperf-pairs-ipairs-forperf-seq-tablesperf-setdrawcolor-splitperf-string-table-concatperf-table-emptyperf-table-hasvalueplayer-iteratorperf-darkrpvarperf-meta-vs-argperf-ply-table-indexperf-find-ents-nearperf-local-colorperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-plain-lua-vs-fnperf-player-cache-hooksperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-literalperf-table-randomperf-x-times-x
16	OpenCode	north-mini-code-free	Medium	66.7%	78.9%	59.2%	20/5/5/8	9.5s
#16 north-mini-code-free Medium OpenCode Pass rate66.7% 20 pass · 30 scored Coverage78.9% 30 / 38 evidence-bearing Verified score59.2% 95% interval — · 1 run(s) pass@k66.7% 20/38 fixtures ever solved Outcome mix Pass20 Partial5 Wrong5 Invalid output8 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored30 Passed20 Fixtures solved20/38 Run facts Avg time 9.5s Repeat Single-shot Evidence share 30/38 (78.9%) Verified runs 1 95% interval — Raw label opencode/north-mini-code-free@medium Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 20/38 passed in linked run ents-iteratorperf-for-vs-whileperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-seq-tablesperf-setdrawcolor-splitperf-string-table-concatperf-table-emptyperf-darkrpvarperf-disttosqrperf-ply-table-indexperf-surface-textplayer-iteratorperf-angle-zeroperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-looking-athook-addisvalidnet-receiversperf-config-varperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-player-cache-hooksperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
17	OpenCode	north-mini-code-free	Low	68.0%	65.8%	47.4%	17/2/6/10	14.5s
#17 north-mini-code-free Low OpenCode Pass rate68.0% 17 pass · 25 scored Coverage65.8% 25 / 38 evidence-bearing Verified score47.4% 95% interval — · 1 run(s) pass@k68.0% 17/38 fixtures ever solved Outcome mix Pass17 Partial2 Wrong6 Invalid output10 Harness3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored25 Passed17 Fixtures solved17/38 Run facts Avg time 14.5s Repeat Single-shot Evidence share 25/38 (65.8%) Verified runs 1 95% interval — Raw label opencode/north-mini-code-free@low Run id d59ee9c0-dbbb-4508-aad0-897bdc9849c2 Latest run fixtures 17/38 passed in linked run hook-addperf-darkrpvarperf-surface-textents-iteratorperf-config-varperf-local-vs-globalperf-looking-atperf-pairs-ipairs-forperf-seq-tablesperf-setdrawcolor-splitperf-string-table-concatperf-table-count-hashperf-table-hasvalueperf-disttosqrperf-meta-vs-argperf-msg-vs-printperf-ply-table-indexperf-sqlite-vs-mysqlplayer-iteratorperf-angle-zeroperf-find-ents-nearisvalidnet-receiversperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-localplayer-cacheperf-plain-lua-vs-fnperf-player-cache-hooksperf-steamid-cacheperf-surface-drawrectperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x

Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.

Fixtures

gmod.ents-iterator.v1
gmod.hook-add.v1
gmod.isvalid.v1
gmod.net-receivers.v1
gmod.perf.angle-zero.v1
gmod.perf.config-var.v1
gmod.perf.darkrpvar.v1
gmod.perf.disttosqr.v1
gmod.perf.ents-iterator.v1
gmod.perf.find-ents-near.v1
gmod.perf.find-players-near.v1
gmod.perf.for-vs-while.v1
gmod.perf.hook-once.v1
gmod.perf.hudpaint-cache.v1
gmod.perf.local-color.v1
gmod.perf.local-vs-global.v1
gmod.perf.localplayer-cache.v1
gmod.perf.looking-at.v1
gmod.perf.meta-vs-arg.v1
gmod.perf.msg-vs-print.v1
gmod.perf.pairs-ipairs-for.v1
gmod.perf.plain-lua-vs-fn.v1
gmod.perf.player-cache-hooks.v1
gmod.perf.ply-table-index.v1
gmod.perf.seq-tables.v1
gmod.perf.setdrawcolor-split.v1
gmod.perf.sqlite-vs-mysql.v1
gmod.perf.steamid-cache.v1
gmod.perf.string-table-concat.v1
gmod.perf.surface-drawrect.v1
gmod.perf.surface-text.v1
gmod.perf.table-count-hash.v1
gmod.perf.table-empty.v1
gmod.perf.table-hasvalue.v1
gmod.perf.table-literal.v1
gmod.perf.table-random.v1
gmod.perf.x-times-x.v1
gmod.player-iterator.v1

Downloads

Results

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Fixtures