Run 824cda9a

Name: gmod-bench run 824cda9a-438d-49bb-a9fa-b581e95e2b65
Creator: gmod-bench
License: https://github.com/Iydah/gmod-bench/blob/main/LICENSE

Jul 10, 2026, 17:58

OpenCode · 17 models · repeat ×1

824cda9a-438d-49bb-a9fa-b581e95e2b65

Fixtures

646

Attempts

Models

7m 43s

Duration

OpenCode×1 repeat

Downloads

Audit pack

Results

17 models

#	Adapter	Model	Think	Pass %	Cover %	Score	Outcomes	Time
1	OpenCode	hy3-free	High	91.9%	97.4%	—	34/2/1/1	9.4s
#1 hy3-free High OpenCode Pass rate91.9% 34 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k91.9% 34/38 fixtures ever solved Outcome mix Pass34 Partial2 Wrong1 Invalid output1 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored37 Passed34 Fixtures solved34/38 Run facts Avg time 9.4s Repeat Single-shot Evidence share 37/38 (97.4%) Verified runs 1 95% interval — Raw label opencode/opencode/hy3-free@high Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 34/38 passed in linked run perf-string-table-concatperf-ply-table-indexperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
2	OpenCode	hy3-free	Medium	88.9%	94.7%	—	32/3/1/2	9.0s
#2 hy3-free Medium OpenCode Pass rate88.9% 32 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k88.9% 32/38 fixtures ever solved Outcome mix Pass32 Partial3 Wrong1 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed32 Fixtures solved32/38 Run facts Avg time 9.0s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label opencode/opencode/hy3-free@medium Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 32/38 passed in linked run perf-plain-lua-vs-fnperf-string-table-concatperf-config-varperf-localplayer-cacheperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
3	OpenCode	deepseek-v4-flash-free	High	86.1%	94.7%	—	31/3/2/2	11.1s
#3 deepseek-v4-flash-free High OpenCode Pass rate86.1% 31 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k86.1% 31/38 fixtures ever solved Outcome mix Pass31 Partial3 Wrong2 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed31 Fixtures solved31/38 Run facts Avg time 11.1s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label opencode/opencode/deepseek-v4-flash-free@high Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 31/38 passed in linked run perf-seq-tablesperf-string-table-concatperf-darkrpvarperf-plain-lua-vs-fnperf-angle-zeroperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
4	OpenCode	deepseek-v4-flash-free	Medium	86.1%	94.7%	—	31/3/2/2	10.2s
#4 deepseek-v4-flash-free Medium OpenCode Pass rate86.1% 31 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k86.1% 31/38 fixtures ever solved Outcome mix Pass31 Partial3 Wrong2 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed31 Fixtures solved31/38 Run facts Avg time 10.2s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label opencode/opencode/deepseek-v4-flash-free@medium Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 31/38 passed in linked run perf-seq-tablesperf-string-table-concatperf-meta-vs-argperf-plain-lua-vs-fnperf-angle-zeroperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
5	OpenCode	mimo-v2.5-free	Medium	72.2%	94.7%	—	26/5/5/2	10.4s
#5 mimo-v2.5-free Medium OpenCode Pass rate72.2% 26 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k72.2% 26/38 fixtures ever solved Outcome mix Pass26 Partial5 Wrong5 Invalid output2 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored36 Passed26 Fixtures solved26/38 Run facts Avg time 10.4s Repeat Single-shot Evidence share 36/38 (94.7%) Verified runs 1 95% interval — Raw label opencode/opencode/mimo-v2.5-free@medium Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 26/38 passed in linked run perf-pairs-ipairs-forperf-string-table-concatperf-angle-zeroperf-config-varperf-meta-vs-argperf-plain-lua-vs-fnperf-ply-table-indexperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
6	OpenCode	deepseek-v4-flash-free	Low	85.7%	92.1%	—	30/3/2/3	10.2s
#6 deepseek-v4-flash-free Low OpenCode Pass rate85.7% 30 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k85.7% 30/38 fixtures ever solved Outcome mix Pass30 Partial3 Wrong2 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed30 Fixtures solved30/38 Run facts Avg time 10.2s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/opencode/deepseek-v4-flash-free@low Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 30/38 passed in linked run perf-ply-table-indexperf-seq-tablesperf-string-table-concatperf-angle-zeroperf-plain-lua-vs-fnperf-find-ents-nearperf-find-players-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
7	OpenCode	nemotron-3-ultra-free	Low	82.9%	92.1%	—	29/3/3/3	11.3s
#7 nemotron-3-ultra-free Low OpenCode Pass rate82.9% 29 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k82.9% 29/38 fixtures ever solved Outcome mix Pass29 Partial3 Wrong3 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed29 Fixtures solved29/38 Run facts Avg time 11.3s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/opencode/nemotron-3-ultra-free@low Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 29/38 passed in linked run perf-hook-onceperf-seq-tablesperf-string-table-concatperf-angle-zeroperf-ply-table-indexperf-table-hasvalueperf-ents-iteratorperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
8	OpenCode	nemotron-3-ultra-free	High	80.0%	92.1%	—	28/3/4/3	10.6s
#8 nemotron-3-ultra-free High OpenCode Pass rate80.0% 28 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k80.0% 28/38 fixtures ever solved Outcome mix Pass28 Partial3 Wrong4 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed28 Fixtures solved28/38 Run facts Avg time 10.6s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/opencode/nemotron-3-ultra-free@high Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 28/38 passed in linked run perf-for-vs-whileperf-seq-tablesperf-string-table-concatperf-plain-lua-vs-fnperf-player-cache-hooksperf-surface-textperf-table-hasvalueperf-angle-zeroperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
9	OpenCode	mimo-v2.5-free	Low	77.1%	92.1%	—	27/6/2/3	11.2s
#9 mimo-v2.5-free Low OpenCode Pass rate77.1% 27 pass · 35 scored Coverage92.1% 35 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k77.1% 27/38 fixtures ever solved Outcome mix Pass27 Partial6 Wrong2 Invalid output3 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored35 Passed27 Fixtures solved27/38 Run facts Avg time 11.2s Repeat Single-shot Evidence share 35/38 (92.1%) Verified runs 1 95% interval — Raw label opencode/opencode/mimo-v2.5-free@low Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 27/38 passed in linked run perf-angle-zeroperf-string-table-concatperf-table-hasvalueperf-config-varperf-plain-lua-vs-fnperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
10	OpenCode	hy3-free	Low	88.2%	89.5%	—	30/2/2/4	9.3s
#10 hy3-free Low OpenCode Pass rate88.2% 30 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k88.2% 30/38 fixtures ever solved Outcome mix Pass30 Partial2 Wrong2 Invalid output4 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored34 Passed30 Fixtures solved30/38 Run facts Avg time 9.3s Repeat Single-shot Evidence share 34/38 (89.5%) Verified runs 1 95% interval — Raw label opencode/opencode/hy3-free@low Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 30/38 passed in linked run ents-iteratorperf-find-ents-nearperf-seq-tablesperf-string-table-concatperf-config-varperf-darkrpvarperf-looking-atplayer-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x
11	OpenCode	deepseek-v4-flash-free	Max	79.4%	89.5%	—	27/2/5/4	10.3s
#11 deepseek-v4-flash-free Max OpenCode Pass rate79.4% 27 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k79.4% 27/38 fixtures ever solved Outcome mix Pass27 Partial2 Wrong5 Invalid output4 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored34 Passed27 Fixtures solved27/38 Run facts Avg time 10.3s Repeat Single-shot Evidence share 34/38 (89.5%) Verified runs 1 95% interval — Raw label opencode/opencode/deepseek-v4-flash-free@max Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 27/38 passed in linked run perf-find-ents-nearperf-for-vs-whileperf-seq-tablesperf-string-table-concatperf-darkrpvarperf-hudpaint-cacheperf-plain-lua-vs-fnperf-ply-table-indexperf-table-hasvalueperf-angle-zeroperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-hook-onceperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
12	OpenCode	mimo-v2.5-free	High	76.5%	89.5%	—	26/4/4/4	12.2s
#12 mimo-v2.5-free High OpenCode Pass rate76.5% 26 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k76.5% 26/38 fixtures ever solved Outcome mix Pass26 Partial4 Wrong4 Invalid output4 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored34 Passed26 Fixtures solved26/38 Run facts Avg time 12.2s Repeat Single-shot Evidence share 34/38 (89.5%) Verified runs 1 95% interval — Raw label opencode/opencode/mimo-v2.5-free@high Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 26/38 passed in linked run perf-seq-tablesperf-string-table-concatperf-table-emptyperf-table-hasvalueperf-angle-zeroperf-config-varperf-msg-vs-printperf-ply-table-indexperf-find-ents-nearperf-find-players-nearperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
13	OpenCode	nemotron-3-ultra-free	Medium	84.4%	84.2%	—	27/3/2/6	9.1s
#13 nemotron-3-ultra-free Medium OpenCode Pass rate84.4% 27 pass · 32 scored Coverage84.2% 32 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k84.4% 27/38 fixtures ever solved Outcome mix Pass27 Partial3 Wrong2 Invalid output6 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored32 Passed27 Fixtures solved27/38 Run facts Avg time 9.1s Repeat Single-shot Evidence share 32/38 (84.2%) Verified runs 1 95% interval — Raw label opencode/opencode/nemotron-3-ultra-free@medium Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 27/38 passed in linked run perf-for-vs-whileperf-seq-tablesperf-steamid-cacheperf-string-table-concatperf-table-hasvalueperf-table-randomperf-angle-zeroperf-meta-vs-argperf-find-ents-nearperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-x-times-x
14	OpenCode	big-pickle	—	78.1%	84.2%	—	25/2/5/6	12.4s
#14 big-pickle OpenCode Pass rate78.1% 25 pass · 32 scored Coverage84.2% 32 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k78.1% 25/38 fixtures ever solved Outcome mix Pass25 Partial2 Wrong5 Invalid output6 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored32 Passed25 Fixtures solved25/38 Run facts Avg time 12.4s Repeat Single-shot Evidence share 32/38 (84.2%) Verified runs 1 95% interval — Raw label opencode/opencode/big-pickle Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 25/38 passed in linked run perf-angle-zeroperf-disttosqrperf-find-ents-nearperf-find-players-nearperf-seq-tablesperf-string-table-concatperf-config-varperf-meta-vs-argperf-ply-table-indexperf-surface-drawrectperf-table-hasvalueperf-ents-iteratorperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-xplayer-iterator
15	OpenCode	north-mini-code-free	Medium	68.8%	84.2%	—	22/6/4/6	10.4s
#15 north-mini-code-free Medium OpenCode Pass rate68.8% 22 pass · 32 scored Coverage84.2% 32 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k68.8% 22/38 fixtures ever solved Outcome mix Pass22 Partial6 Wrong4 Invalid output6 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored32 Passed22 Fixtures solved22/38 Run facts Avg time 10.4s Repeat Single-shot Evidence share 32/38 (84.2%) Verified runs 1 95% interval — Raw label opencode/opencode/north-mini-code-free@medium Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 22/38 passed in linked run perf-ents-iteratorperf-meta-vs-argperf-pairs-ipairs-forperf-seq-tablesperf-string-table-concatperf-table-hasvalueperf-darkrpvarperf-disttosqrperf-surface-textperf-x-times-xperf-angle-zeroperf-find-ents-nearperf-find-players-nearperf-hudpaint-cacheperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-for-vs-whileperf-hook-onceperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-emptyperf-table-literalperf-table-random
16	OpenCode	north-mini-code-free	High	63.0%	71.1%	—	17/4/6/11	9.7s
#16 north-mini-code-free High OpenCode Pass rate63.0% 17 pass · 27 scored Coverage71.1% 27 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k63.0% 17/38 fixtures ever solved Outcome mix Pass17 Partial4 Wrong6 Invalid output11 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored27 Passed17 Fixtures solved17/38 Run facts Avg time 9.7s Repeat Single-shot Evidence share 27/38 (71.1%) Verified runs 1 95% interval — Raw label opencode/opencode/north-mini-code-free@high Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 17/38 passed in linked run perf-angle-zeroperf-local-colorperf-localplayer-cacheperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-hasvalueperf-config-varperf-darkrpvarperf-disttosqrperf-meta-vs-argperf-msg-vs-printplayer-iteratorperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-vs-globalperf-plain-lua-vs-fnperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x
17	OpenCode	north-mini-code-free	Low	68.0%	65.8%	—	17/4/4/13	10.3s
#17 north-mini-code-free Low OpenCode Pass rate68.0% 17 pass · 25 scored Coverage65.8% 25 / 38 evidence-bearing Verified score— 95% interval — · 1 run(s) pass@k68.0% 17/38 fixtures ever solved Outcome mix Pass17 Partial4 Wrong4 Invalid output13 Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel Attempts38 Scored25 Passed17 Fixtures solved17/38 Run facts Avg time 10.3s Repeat Single-shot Evidence share 25/38 (65.8%) Verified runs 1 95% interval — Raw label opencode/opencode/north-mini-code-free@low Run id 824cda9a-438d-49bb-a9fa-b581e95e2b65 Latest run fixtures 17/38 passed in linked run perf-ents-iteratorperf-for-vs-whileperf-hudpaint-cacheperf-looking-atperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-seq-tablesperf-string-table-concatperf-surface-drawrectperf-table-count-hashperf-table-hasvalueplayer-iteratorperf-disttosqrperf-find-players-nearperf-meta-vs-argperf-sqlite-vs-mysqlperf-angle-zeroperf-find-ents-nearperf-steamid-cacheperf-surface-textents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-hook-onceperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x

Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.

Fixtures

gmod.ents-iterator.v1
gmod.hook-add.v1
gmod.isvalid.v1
gmod.net-receivers.v1
gmod.perf.angle-zero.v1
gmod.perf.config-var.v1
gmod.perf.darkrpvar.v1
gmod.perf.disttosqr.v1
gmod.perf.ents-iterator.v1
gmod.perf.find-ents-near.v1
gmod.perf.find-players-near.v1
gmod.perf.for-vs-while.v1
gmod.perf.hook-once.v1
gmod.perf.hudpaint-cache.v1
gmod.perf.local-color.v1
gmod.perf.local-vs-global.v1
gmod.perf.localplayer-cache.v1
gmod.perf.looking-at.v1
gmod.perf.meta-vs-arg.v1
gmod.perf.msg-vs-print.v1
gmod.perf.pairs-ipairs-for.v1
gmod.perf.plain-lua-vs-fn.v1
gmod.perf.player-cache-hooks.v1
gmod.perf.ply-table-index.v1
gmod.perf.seq-tables.v1
gmod.perf.setdrawcolor-split.v1
gmod.perf.sqlite-vs-mysql.v1
gmod.perf.steamid-cache.v1
gmod.perf.string-table-concat.v1
gmod.perf.surface-drawrect.v1
gmod.perf.surface-text.v1
gmod.perf.table-count-hash.v1
gmod.perf.table-empty.v1
gmod.perf.table-hasvalue.v1
gmod.perf.table-literal.v1
gmod.perf.table-random.v1
gmod.perf.x-times-x.v1
gmod.player-iterator.v1

Downloads

Results

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Outcome mix

Attempt funnel

Run facts

Latest run fixtures

Fixtures