Run 38c62341
Jul 10, 2026, 15:18
OpenRouter · 26 models · repeat ×1
38c62341-b58b-4e7d-9756-3fc0c03c77c9
Downloads
Audit pack
Results
26 models
| # | Adapter | Model | Think | Pass % | Cover % | Score | Outcomes | Time |
|---|---|---|---|---|---|---|---|---|
| 1 | OpenRouter | hy3 | None | 81.1% | 97.4% | 86.8% | 30/6/1/1 | 3.0s |
#1 hy3NonePass rate81.1% 30 pass · 37 scored Coverage97.4% 37 / 38 evidence-bearing Verified score86.8% 95% interval — · 1 run(s) pass@k81.1% 30/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures30/38 passed in linked runperf-string-table-concatperf-surface-textperf-angle-zeroperf-ents-iteratorperf-find-ents-nearperf-looking-atperf-player-cache-hooksplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 2 | OpenRouter | hy3 | Low | 80.6% | 94.7% | 81.6% | 29/4/3/2 | 17.0s |
#2 hy3LowPass rate80.6% 29 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score81.6% 95% interval — · 1 run(s) pass@k80.6% 29/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures29/38 passed in linked runperf-string-table-concatperf-table-hasvalueperf-config-varperf-plain-lua-vs-fnplayer-iteratorperf-ents-iteratorperf-find-ents-nearperf-localplayer-cacheperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 3 | OpenRouter | nemotron-3-ultra-550b-a55b | High | 84.8% | 86.8% | 78.9% | 28/4/1/5 | 4.6s |
#3 nemotron-3-ultra-550b-a55bHighPass rate84.8% 28 pass · 33 scored Coverage86.8% 33 / 38 evidence-bearing Verified score78.9% 95% interval — · 1 run(s) pass@k84.8% 28/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures28/38 passed in linked runperf-angle-zeroperf-find-ents-nearperf-plain-lua-vs-fnperf-seq-tablesperf-string-table-concatperf-ply-table-indexperf-ents-iteratorperf-localplayer-cacheperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 4 | OpenRouter | hy3 | High | 77.8% | 94.7% | 77.6% | 28/3/5/2 | 24.8s |
#4 hy3HighPass rate77.8% 28 pass · 36 scored Coverage94.7% 36 / 38 evidence-bearing Verified score77.6% 95% interval — · 1 run(s) pass@k77.8% 28/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures28/38 passed in linked runperf-string-table-concatperf-table-hasvalueperf-angle-zeroperf-config-varperf-pairs-ipairs-forperf-ply-table-indexplayer-iteratorperf-ents-iteratorperf-find-ents-nearperf-looking-atents-iteratorhook-addisvalidnet-receiversperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 5 | OpenRouter | nemotron-3-ultra-550b-a55b | Medium | 84.4% | 84.2% | 73.7% | 27/2/3/6 | 6.5s |
#5 nemotron-3-ultra-550b-a55bMediumPass rate84.4% 27 pass · 32 scored Coverage84.2% 32 / 38 evidence-bearing Verified score73.7% 95% interval — · 1 run(s) pass@k84.4% 27/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures27/38 passed in linked runperf-angle-zeroperf-config-varperf-darkrpvarperf-find-ents-nearperf-seq-tablesperf-string-table-concatperf-looking-atperf-player-cache-hooksperf-ply-table-indexperf-localplayer-cacheplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 6 | OpenRouter | nemotron-3-super-120b-a12b | Low | 90.0% | 78.9% | 73.7% | 27/2/1/8 | 14.0s |
#6 nemotron-3-super-120b-a12bLowPass rate90.0% 27 pass · 30 scored Coverage78.9% 30 / 38 evidence-bearing Verified score73.7% 95% interval — · 1 run(s) pass@k90.0% 27/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures27/38 passed in linked runhook-addnet-receiversperf-ents-iteratorperf-find-ents-nearperf-meta-vs-argperf-player-cache-hooksperf-string-table-concatplayer-iteratorperf-angle-zeroperf-looking-atperf-table-emptyents-iteratorisvalidperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 7 | OpenRouter | laguna-xs-2.1 | — | 70.6% | 89.5% | 71.1% | 24/6/4/4 | 1.9s |
#7 laguna-xs-2.1Pass rate70.6% 24 pass · 34 scored Coverage89.5% 34 / 38 evidence-bearing Verified score71.1% 95% interval — · 1 run(s) pass@k70.6% 24/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures24/38 passed in linked runperf-find-ents-nearperf-plain-lua-vs-fnperf-seq-tablesperf-string-table-concatperf-config-varperf-darkrpvarperf-disttosqrperf-surface-textents-iteratorperf-angle-zeroperf-ents-iteratorperf-for-vs-whileperf-looking-atplayer-iteratorhook-addisvalidnet-receiversperf-find-players-nearperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-player-cache-hooksperf-ply-table-indexperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 8 | OpenRouter | nemotron-3-super-120b-a12b | Medium | 82.1% | 73.7% | 67.1% | 23/5/0/10 | 12.8s |
#8 nemotron-3-super-120b-a12bMediumPass rate82.1% 23 pass · 28 scored Coverage73.7% 28 / 38 evidence-bearing Verified score67.1% 95% interval — · 1 run(s) pass@k82.1% 23/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures23/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-find-ents-nearperf-meta-vs-argperf-ply-table-indexperf-string-table-concatperf-x-times-xplayer-iteratorperf-angle-zeroperf-ents-iteratorperf-localplayer-cacheperf-looking-atperf-table-emptyperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-random | ||||||||
| 9 | OpenRouter | north-mini-code | — | 85.2% | 71.1% | 61.8% | 23/1/3/11 | 11.5s |
#9 north-mini-codePass rate85.2% 23 pass · 27 scored Coverage71.1% 27 / 38 evidence-bearing Verified score61.8% 95% interval — · 1 run(s) pass@k85.2% 23/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures23/38 passed in linked runents-iteratorperf-angle-zeroperf-darkrpvarperf-find-ents-nearperf-find-players-nearperf-looking-atperf-player-cache-hooksperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-hasvalueperf-config-varperf-table-randomplayer-iteratorperf-ents-iteratorhook-addisvalidnet-receiversperf-disttosqrperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-table-count-hashperf-table-emptyperf-table-literalperf-x-times-x | ||||||||
| 10 | OpenRouter | nemotron-3-nano-30b-a3b | — | 64.0% | 65.8% | 50.0% | 16/6/3/13 | 10.5s |
#10 nemotron-3-nano-30b-a3bPass rate64.0% 16 pass · 25 scored Coverage65.8% 25 / 38 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k64.0% 16/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures16/38 passed in linked runperf-angle-zeroperf-find-players-nearperf-hudpaint-cacheperf-local-colorperf-localplayer-cacheperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-darkrpvarperf-disttosqrperf-meta-vs-argents-iteratorperf-ents-iteratorperf-find-ents-nearperf-hook-onceperf-looking-atplayer-iteratorhook-addisvalidnet-receiversperf-config-varperf-for-vs-whileperf-local-vs-globalperf-player-cache-hooksperf-setdrawcolor-splitperf-steamid-cacheperf-string-table-concatperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 11 | OpenRouter | nemotron-nano-9b-v2 | — | 66.7% | 7.9% | 6.6% | 2/1/0/35 | 10.3s |
#11 nemotron-nano-9b-v2Pass rate66.7% 2 pass · 3 scored Coverage7.9% 3 / 38 evidence-bearing Verified score6.6% 95% interval — · 1 run(s) pass@k66.7% 2/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures2/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomplayer-iteratorperf-find-players-nearperf-pairs-ipairs-forperf-x-times-x | ||||||||
| 12 | OpenRouter | dolphin-mistral-24b-venice-edition | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 462ms |
#12 dolphin-mistral-24b-venice-editionPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 13 | OpenRouter | lfm-2.5-1.2b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 333ms |
#13 lfm-2.5-1.2b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 14 | OpenRouter | lfm-2.5-1.2b-thinking | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 321ms |
#14 lfm-2.5-1.2b-thinkingPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 15 | OpenRouter | llama-3.2-3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 464ms |
#15 llama-3.2-3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 16 | OpenRouter | llama-3.3-70b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 455ms |
#16 llama-3.3-70b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 17 | OpenRouter | hermes-3-llama-3.1-405b | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 515ms |
#17 hermes-3-llama-3.1-405bPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 18 | OpenRouter | gpt-oss-120b | High | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 93ms |
#18 gpt-oss-120bHighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 19 | OpenRouter | gpt-oss-120b | Low | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#19 gpt-oss-120bLowPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 20 | OpenRouter | gpt-oss-120b | Medium | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#20 gpt-oss-120bMediumPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 21 | OpenRouter | gpt-oss-20b | High | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 854ms |
#21 gpt-oss-20bHighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 22 | OpenRouter | gpt-oss-20b | Low | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#22 gpt-oss-20bLowPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 23 | OpenRouter | gpt-oss-20b | Medium | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#23 gpt-oss-20bMediumPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 24 | OpenRouter | laguna-m.1 | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 17.9s |
#24 laguna-m.1Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 25 | OpenRouter | qwen3-coder | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 55ms |
#25 qwen3-coderPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 26 | OpenRouter | qwen3-next-80b-a3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 46ms |
#26 qwen3-next-80b-a3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.
Fixtures
38
gmod.ents-iterator.v1gmod.hook-add.v1gmod.isvalid.v1gmod.net-receivers.v1gmod.perf.angle-zero.v1gmod.perf.config-var.v1gmod.perf.darkrpvar.v1gmod.perf.disttosqr.v1gmod.perf.ents-iterator.v1gmod.perf.find-ents-near.v1gmod.perf.find-players-near.v1gmod.perf.for-vs-while.v1gmod.perf.hook-once.v1gmod.perf.hudpaint-cache.v1gmod.perf.local-color.v1gmod.perf.local-vs-global.v1gmod.perf.localplayer-cache.v1gmod.perf.looking-at.v1gmod.perf.meta-vs-arg.v1gmod.perf.msg-vs-print.v1gmod.perf.pairs-ipairs-for.v1gmod.perf.plain-lua-vs-fn.v1gmod.perf.player-cache-hooks.v1gmod.perf.ply-table-index.v1gmod.perf.seq-tables.v1gmod.perf.setdrawcolor-split.v1gmod.perf.sqlite-vs-mysql.v1gmod.perf.steamid-cache.v1gmod.perf.string-table-concat.v1gmod.perf.surface-drawrect.v1gmod.perf.surface-text.v1gmod.perf.table-count-hash.v1gmod.perf.table-empty.v1gmod.perf.table-hasvalue.v1gmod.perf.table-literal.v1gmod.perf.table-random.v1gmod.perf.x-times-x.v1gmod.player-iterator.v1