Run 779e9572
Jul 10, 2026, 15:14
OpenRouter · 26 models · repeat ×1
779e9572-462f-4af1-aa06-ffad9df67bb5
38
Fixtures
988
Attempts
26
Models
1h 6m
Duration
OpenRouter×1 repeat
Downloads
Audit pack
Results
26 models
| # | Adapter | Model | Think | Pass % | Cover % | Score | Outcomes | Time |
|---|---|---|---|---|---|---|---|---|
| 1 | OpenRouter | nemotron-3-ultra-550b-a55b | Medium | 87.9% | 86.8% | 80.3% | 29/3/1/5 | 9.8s |
#1 nemotron-3-ultra-550b-a55bMediumPass rate87.9% 29 pass · 33 scored Coverage86.8% 33 / 38 evidence-bearing Verified score80.3% 95% interval — · 1 run(s) pass@k87.9% 29/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures29/38 passed in linked runperf-angle-zeroperf-darkrpvarperf-find-ents-nearperf-seq-tablesperf-string-table-concatperf-ply-table-indexperf-local-colorperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-disttosqrperf-ents-iteratorperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 2 | OpenRouter | nemotron-3-ultra-550b-a55b | High | 84.8% | 86.8% | 78.9% | 28/4/1/5 | 5.7s |
#2 nemotron-3-ultra-550b-a55bHighPass rate84.8% 28 pass · 33 scored Coverage86.8% 33 / 38 evidence-bearing Verified score78.9% 95% interval — · 1 run(s) pass@k84.8% 28/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures28/38 passed in linked runperf-angle-zeroperf-find-ents-nearperf-ply-table-indexperf-seq-tablesperf-string-table-concatperf-table-hasvalueperf-ents-iteratorperf-localplayer-cacheperf-looking-atplayer-iteratorents-iteratorhook-addisvalidnet-receiversperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 3 | OpenRouter | nemotron-3-super-120b-a12b | Low | 85.7% | 73.7% | 68.4% | 24/4/0/8 | 13.9s |
#3 nemotron-3-super-120b-a12bLowPass rate85.7% 24 pass · 28 scored Coverage73.7% 28 / 38 evidence-bearing Verified score68.4% 95% interval — · 1 run(s) pass@k85.7% 24/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures24/38 passed in linked runperf-ents-iteratorperf-find-players-nearhook-addnet-receiversperf-darkrpvarperf-disttosqrperf-sqlite-vs-mysqlperf-string-table-concatperf-surface-drawrectplayer-iteratorperf-angle-zeroperf-find-ents-nearperf-looking-atperf-table-emptyents-iteratorisvalidperf-config-varperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-steamid-cacheperf-surface-textperf-table-count-hashperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 4 | OpenRouter | north-mini-code | — | 85.2% | 71.1% | 61.8% | 23/1/3/11 | 11.5s |
#4 north-mini-codePass rate85.2% 23 pass · 27 scored Coverage71.1% 27 / 38 evidence-bearing Verified score61.8% 95% interval — · 1 run(s) pass@k85.2% 23/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures23/38 passed in linked runents-iteratorperf-angle-zeroperf-darkrpvarperf-find-ents-nearperf-find-players-nearperf-looking-atperf-player-cache-hooksperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-hasvalueperf-config-varperf-table-randomplayer-iteratorperf-ents-iteratorhook-addisvalidnet-receiversperf-disttosqrperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-table-count-hashperf-table-emptyperf-table-literalperf-x-times-x | ||||||||
| 5 | OpenRouter | nemotron-3-super-120b-a12b | Medium | 79.2% | 63.2% | 55.3% | 19/4/1/10 | 25.3s |
#5 nemotron-3-super-120b-a12bMediumPass rate79.2% 19 pass · 24 scored Coverage63.2% 24 / 38 evidence-bearing Verified score55.3% 95% interval — · 1 run(s) pass@k79.2% 19/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures19/38 passed in linked runnet-receiversperf-msg-vs-printperf-plain-lua-vs-fnplayer-iteratorents-iteratorhook-addisvalidperf-find-ents-nearperf-hudpaint-cacheperf-meta-vs-argperf-sqlite-vs-mysqlperf-string-table-concatperf-table-hasvalueperf-table-randomperf-ply-table-indexperf-angle-zeroperf-ents-iteratorperf-looking-atperf-table-emptyperf-config-varperf-darkrpvarperf-disttosqrperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-pairs-ipairs-forperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-steamid-cacheperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-literalperf-x-times-x | ||||||||
| 6 | OpenRouter | nemotron-3-nano-30b-a3b | — | 64.0% | 65.8% | 50.0% | 16/6/3/13 | 10.5s |
#6 nemotron-3-nano-30b-a3bPass rate64.0% 16 pass · 25 scored Coverage65.8% 25 / 38 evidence-bearing Verified score50.0% 95% interval — · 1 run(s) pass@k64.0% 16/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures16/38 passed in linked runperf-angle-zeroperf-find-players-nearperf-hudpaint-cacheperf-local-colorperf-localplayer-cacheperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-ply-table-indexperf-seq-tablesperf-sqlite-vs-mysqlperf-surface-drawrectperf-surface-textperf-darkrpvarperf-disttosqrperf-meta-vs-argents-iteratorperf-ents-iteratorperf-find-ents-nearperf-hook-onceperf-looking-atplayer-iteratorhook-addisvalidnet-receiversperf-config-varperf-for-vs-whileperf-local-vs-globalperf-player-cache-hooksperf-setdrawcolor-splitperf-steamid-cacheperf-string-table-concatperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-x | ||||||||
| 7 | OpenRouter | gpt-oss-20b | High | 100.0% | 5.3% | 5.3% | 2/0/0/36 | 10.8s |
#7 gpt-oss-20bHighPass rate100.0% 2 pass · 2 scored Coverage5.3% 2 / 38 evidence-bearing Verified score5.3% 95% interval — · 1 run(s) pass@k100.0% 2/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures2/38 passed in linked runents-iteratorhook-addisvalidperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratornet-receiversperf-table-count-hash | ||||||||
| 8 | OpenRouter | nemotron-nano-9b-v2 | — | 100.0% | 2.6% | 2.6% | 1/0/0/37 | 10.7s |
#8 nemotron-nano-9b-v2Pass rate100.0% 1 pass · 1 scored Coverage2.6% 1 / 38 evidence-bearing Verified score2.6% 95% interval — · 1 run(s) pass@k100.0% 1/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures1/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorperf-hudpaint-cache | ||||||||
| 9 | OpenRouter | gpt-oss-120b | High | 100.0% | 2.6% | 2.6% | 1/0/0/37 | 2.5s |
#9 gpt-oss-120bHighPass rate100.0% 1 pass · 1 scored Coverage2.6% 1 / 38 evidence-bearing Verified score2.6% 95% interval — · 1 run(s) pass@k100.0% 1/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures1/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorperf-msg-vs-print | ||||||||
| 10 | OpenRouter | gpt-oss-120b | Medium | 100.0% | 2.6% | 2.6% | 1/0/0/37 | 3.1s |
#10 gpt-oss-120bMediumPass rate100.0% 1 pass · 1 scored Coverage2.6% 1 / 38 evidence-bearing Verified score2.6% 95% interval — · 1 run(s) pass@k100.0% 1/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures1/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorperf-ply-table-index | ||||||||
| 11 | OpenRouter | gpt-oss-120b | Low | 0.0% | 2.6% | 0.0% | 0/0/1/37 | 1.8s |
#11 gpt-oss-120bLowPass rate0.0% 0 pass · 1 scored Coverage2.6% 1 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-x-times-xplayer-iteratorperf-table-random | ||||||||
| 12 | OpenRouter | gpt-oss-20b | Medium | 0.0% | 2.6% | 0.0% | 0/0/1/37 | 274ms |
#12 gpt-oss-20bMediumPass rate0.0% 0 pass · 1 scored Coverage2.6% 1 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iteratorents-iterator | ||||||||
| 13 | OpenRouter | dolphin-mistral-24b-venice-edition | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 462ms |
#13 dolphin-mistral-24b-venice-editionPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 14 | OpenRouter | lfm-2.5-1.2b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 333ms |
#14 lfm-2.5-1.2b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 15 | OpenRouter | lfm-2.5-1.2b-thinking | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 321ms |
#15 lfm-2.5-1.2b-thinkingPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 16 | OpenRouter | llama-3.2-3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 464ms |
#16 llama-3.2-3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 17 | OpenRouter | llama-3.3-70b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 455ms |
#17 llama-3.3-70b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 18 | OpenRouter | hermes-3-llama-3.1-405b | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 515ms |
#18 hermes-3-llama-3.1-405bPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 19 | OpenRouter | gpt-oss-20b | Low | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#19 gpt-oss-20bLowPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 20 | OpenRouter | laguna-m.1 | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#20 laguna-m.1Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 21 | OpenRouter | laguna-xs-2.1 | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#21 laguna-xs-2.1Pass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 22 | OpenRouter | qwen3-coder | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#22 qwen3-coderPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 23 | OpenRouter | qwen3-next-80b-a3b-instruct | — | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#23 qwen3-next-80b-a3b-instructPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 24 | OpenRouter | hy3 | High | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#24 hy3HighPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 25 | OpenRouter | hy3 | Low | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#25 hy3LowPass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
| 26 | OpenRouter | hy3 | None | 0.0% | 0.0% | 0.0% | 0/0/0/38 | 0ms |
#26 hy3NonePass rate0.0% 0 pass · 0 scored Coverage0.0% 0 / 38 evidence-bearing Verified score0.0% 95% interval — · 1 run(s) pass@k0.0% 0/38 fixtures ever solved Outcome mix
Invalid output means the model returned content that broke the answer contract, so it scores zero. Harness failures returned no answer and are excluded from score. Attempt funnel
Run facts
Latest run fixtures0/38 passed in linked runents-iteratorhook-addisvalidnet-receiversperf-angle-zeroperf-config-varperf-darkrpvarperf-disttosqrperf-ents-iteratorperf-find-ents-nearperf-find-players-nearperf-for-vs-whileperf-hook-onceperf-hudpaint-cacheperf-local-colorperf-local-vs-globalperf-localplayer-cacheperf-looking-atperf-meta-vs-argperf-msg-vs-printperf-pairs-ipairs-forperf-plain-lua-vs-fnperf-player-cache-hooksperf-ply-table-indexperf-seq-tablesperf-setdrawcolor-splitperf-sqlite-vs-mysqlperf-steamid-cacheperf-string-table-concatperf-surface-drawrectperf-surface-textperf-table-count-hashperf-table-emptyperf-table-hasvalueperf-table-literalperf-table-randomperf-x-times-xplayer-iterator | ||||||||
Verified score aggregates compatible runs. Outcomes = pass / partial / wrong / invalid output; harness failures are excluded. Click a row for evidence and the linked run's fixtures.
Fixtures
38
gmod.ents-iterator.v1gmod.hook-add.v1gmod.isvalid.v1gmod.net-receivers.v1gmod.perf.angle-zero.v1gmod.perf.config-var.v1gmod.perf.darkrpvar.v1gmod.perf.disttosqr.v1gmod.perf.ents-iterator.v1gmod.perf.find-ents-near.v1gmod.perf.find-players-near.v1gmod.perf.for-vs-while.v1gmod.perf.hook-once.v1gmod.perf.hudpaint-cache.v1gmod.perf.local-color.v1gmod.perf.local-vs-global.v1gmod.perf.localplayer-cache.v1gmod.perf.looking-at.v1gmod.perf.meta-vs-arg.v1gmod.perf.msg-vs-print.v1gmod.perf.pairs-ipairs-for.v1gmod.perf.plain-lua-vs-fn.v1gmod.perf.player-cache-hooks.v1gmod.perf.ply-table-index.v1gmod.perf.seq-tables.v1gmod.perf.setdrawcolor-split.v1gmod.perf.sqlite-vs-mysql.v1gmod.perf.steamid-cache.v1gmod.perf.string-table-concat.v1gmod.perf.surface-drawrect.v1gmod.perf.surface-text.v1gmod.perf.table-count-hash.v1gmod.perf.table-empty.v1gmod.perf.table-hasvalue.v1gmod.perf.table-literal.v1gmod.perf.table-random.v1gmod.perf.x-times-x.v1gmod.player-iterator.v1